Guardian-AI: A novel deep learning based deepfake detection model in images

Abstract

The rapid advancement of deepfake technology has introduced significant challenges and opportunities across various domains. This article proposes a robust deepfake detection pipeline utilising a combination of attention mechanisms, pre-trained Vision Transformers (ViTs), and Long Short-Term Memory (LSTM) networks. The initial phase of the pipeline involves preparing photos and videos, potentially using optional facial detection to enhance accuracy. Vision Transformers derive features by capturing the global dependencies of input data. Long short-term memory (LSTM) networks address inter-frame temporal dependencies, whereas multi-head and traditional attention processes focus on essential elements. Ultimately, fully connected layers are employed for classification within the ensemble architecture, which consolidates the outcomes of several models. To ensure generalisability, assessment and regularisation approaches are employed to train the model using labelled datasets. Given the escalating threat of deepfakes, the findings indicate that the pipeline can consistently distinguish between genuine and fabricated information.