Deepfake Detection System for Images and Videos
FakeExpose is an AI-powered application designed to detect deepfake-generated faces in both images and videos. With the increasing presence of synthetic media, the system aims to provide a reliable solution for identifying manipulated visual content and promoting digital authenticity.
The application combines computer vision and deep learning techniques to analyze facial features and determine whether a given input is real or artificially generated.
FakeExpose follows a two-stage detection pipeline:
-
Face Detection
Faces are first detected and extracted from images or video frames using YOLO, ensuring that the analysis focuses only on relevant facial regions. -
Deepfake Classification
An optimized VGG19 model is then used to classify each detected face as either real or deepfake.
- Base Model: VGG19 (pretrained)
- Optimization Strategy:
- Selected layers are unfrozen for fine-tuning
- Enhanced feature learning for detecting subtle deepfake artifacts
- Output: Binary classification (Real vs Fake)
The optimized VGG19 model achieved improved performance compared to a frozen baseline:
- Better generalization on unseen data
- Enhanced detection of subtle manipulations
- Improved overall classification accuracy
- Supports detection for:
- Images
- Videos (frame-by-frame analysis)
- Face-focused detection using YOLO
- Improved accuracy through model fine-tuning
- Simple and efficient application workflow
- Python
- TensorFlow
- YOLO (Face Detection)
- VGG19 (Transfer Learning)
- Pandas
- Flask
- Upload an image or video
- Faces are detected using YOLO
- Detected faces are extracted and preprocessed
- Each face is passed through the trained VGG19 model
- The system outputs a prediction: Real or Deepfake
- Integrate Vision Transformer (ViT) models for comparison
- Improve real-time video processing performance
- Expand dataset diversity for better generalization
- Deploy as a web-based application
- Mary Chris Viancie Oceña
- Shane Tophy Linganay
This project is for academic and research purposes.