A statistical analysis for deepfake videos forgery traces recognition followed by a fine-tuned InceptionResNetV2 detection technique.

Sandhya, Abhishek Kashyap
{"title":"A statistical analysis for deepfake videos forgery traces recognition followed by a fine-tuned InceptionResNetV2 detection technique.","authors":"Sandhya, Abhishek Kashyap","doi":"10.1111/1556-4029.15665","DOIUrl":null,"url":null,"abstract":"<p><p>Deepfake videos are growing progressively more competent because of the rapid advancements in artificial intelligence and deep learning technology. This has led to substantial problems around propaganda, privacy, and security. This research provides an analytically novel method for detecting deepfake videos using temporal discrepancies of the various statistical features of video at the pixel level, followed by a deep learning algorithm. To detect minute aberrations typical of deepfake manipulations, this study focuses on both spatial information inside individual frames and temporal correlations between subsequent frames. This study primarily provides a novel Euclidean distance variation probability score value for directly commenting on the authenticity of a deepfake video. Next, fine-tuning of InceptionResNetV2 with the addition of a dense layer is trained FaceForensics++ for deepfake detection. The proposed fine-tuned model outperforms the existing techniques as its testing accuracy on unseen data outperforms the existing methods. The propsd method achieved an accuracy of 99.80% for FF++ dataset and 97.60% accuracy for CelebDF dataset.</p>","PeriodicalId":94080,"journal":{"name":"Journal of forensic sciences","volume":" ","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-11-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of forensic sciences","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1111/1556-4029.15665","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

Deepfake videos are growing progressively more competent because of the rapid advancements in artificial intelligence and deep learning technology. This has led to substantial problems around propaganda, privacy, and security. This research provides an analytically novel method for detecting deepfake videos using temporal discrepancies of the various statistical features of video at the pixel level, followed by a deep learning algorithm. To detect minute aberrations typical of deepfake manipulations, this study focuses on both spatial information inside individual frames and temporal correlations between subsequent frames. This study primarily provides a novel Euclidean distance variation probability score value for directly commenting on the authenticity of a deepfake video. Next, fine-tuning of InceptionResNetV2 with the addition of a dense layer is trained FaceForensics++ for deepfake detection. The proposed fine-tuned model outperforms the existing techniques as its testing accuracy on unseen data outperforms the existing methods. The propsd method achieved an accuracy of 99.80% for FF++ dataset and 97.60% accuracy for CelebDF dataset.

对深度伪造视频的伪造痕迹识别进行统计分析,然后采用经过微调的 InceptionResNetV2 检测技术。
由于人工智能和深度学习技术的飞速发展,深度伪造视频的能力日益增强。这导致了围绕宣传、隐私和安全的大量问题。本研究提供了一种新颖的分析方法,利用像素级视频各种统计特征的时间差异,再利用深度学习算法来检测深度伪造视频。为了检测典型的深度伪造操作的微小畸变,本研究重点关注单个帧内的空间信息和后续帧之间的时间相关性。本研究主要提供了一种新颖的欧氏距离变化概率分值,用于直接评判深度伪造视频的真伪。接下来,通过增加密集层对 InceptionResNetV2 进行微调,训练 FaceForensics++ 进行深度伪造检测。所提出的微调模型优于现有技术,因为它在未见数据上的测试准确率优于现有方法。propsd 方法在 FF++ 数据集上的准确率达到 99.80%,在 CelebDF 数据集上的准确率达到 97.60%。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信