检测深度伪造在替代颜色空间,以抵御看不见的腐败

Kai Zeng, Xiangyu Yu, Beibei Liu, Yu Guan, Yongjian Hu
{"title":"检测深度伪造在替代颜色空间,以抵御看不见的腐败","authors":"Kai Zeng, Xiangyu Yu, Beibei Liu, Yu Guan, Yongjian Hu","doi":"10.1109/IWBF57495.2023.10157416","DOIUrl":null,"url":null,"abstract":"The adverse impact of deepfakes has recently raised world-wide concerns. Many ways of deepfake detection are published in the literature. The reported results of existing methods are generally good under known settings. However, the robustness challenge in deepfake detection is not well addressed. Most detectors fail to identify deepfakes that have undergone post-processing. Observing that the conventionally adopted RGB space does not guarantee the best performance, we propose other color spaces that prove to be more effective in detecting corrupted deepfake videos. We design a robust detection approach that leverages an adaptive manipulation trace extraction network to reveal artifacts from two color spaces. To mimic practical scenarios, we conduct experiments to detect images with post-processings that are not seen in the training stage. The results demonstrate that our approach outperforms state-of-the-art methods, boosting the average detection accuracy by 7% ~ 17%.","PeriodicalId":273412,"journal":{"name":"2023 11th International Workshop on Biometrics and Forensics (IWBF)","volume":"11 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-04-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Detecting Deepfakes in Alternative Color Spaces to Withstand Unseen Corruptions\",\"authors\":\"Kai Zeng, Xiangyu Yu, Beibei Liu, Yu Guan, Yongjian Hu\",\"doi\":\"10.1109/IWBF57495.2023.10157416\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"The adverse impact of deepfakes has recently raised world-wide concerns. Many ways of deepfake detection are published in the literature. The reported results of existing methods are generally good under known settings. However, the robustness challenge in deepfake detection is not well addressed. Most detectors fail to identify deepfakes that have undergone post-processing. Observing that the conventionally adopted RGB space does not guarantee the best performance, we propose other color spaces that prove to be more effective in detecting corrupted deepfake videos. We design a robust detection approach that leverages an adaptive manipulation trace extraction network to reveal artifacts from two color spaces. To mimic practical scenarios, we conduct experiments to detect images with post-processings that are not seen in the training stage. The results demonstrate that our approach outperforms state-of-the-art methods, boosting the average detection accuracy by 7% ~ 17%.\",\"PeriodicalId\":273412,\"journal\":{\"name\":\"2023 11th International Workshop on Biometrics and Forensics (IWBF)\",\"volume\":\"11 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-04-19\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2023 11th International Workshop on Biometrics and Forensics (IWBF)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/IWBF57495.2023.10157416\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2023 11th International Workshop on Biometrics and Forensics (IWBF)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/IWBF57495.2023.10157416","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

深度造假的负面影响最近引起了全世界的关注。文献中发表了许多深度伪造检测方法。现有方法报告的结果在已知条件下通常是好的。然而,深度伪造检测中的鲁棒性挑战并没有得到很好的解决。大多数检测器无法识别经过后处理的深度伪造。观察到传统采用的RGB空间并不能保证最佳性能,我们提出了其他被证明在检测损坏的深度假视频方面更有效的颜色空间。我们设计了一种鲁棒的检测方法,利用自适应操作跟踪提取网络来揭示来自两个颜色空间的工件。为了模拟实际场景,我们进行了实验来检测经过后处理的图像,这些图像在训练阶段是看不到的。结果表明,我们的方法优于目前最先进的方法,平均检测精度提高了7% ~ 17%。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Detecting Deepfakes in Alternative Color Spaces to Withstand Unseen Corruptions
The adverse impact of deepfakes has recently raised world-wide concerns. Many ways of deepfake detection are published in the literature. The reported results of existing methods are generally good under known settings. However, the robustness challenge in deepfake detection is not well addressed. Most detectors fail to identify deepfakes that have undergone post-processing. Observing that the conventionally adopted RGB space does not guarantee the best performance, we propose other color spaces that prove to be more effective in detecting corrupted deepfake videos. We design a robust detection approach that leverages an adaptive manipulation trace extraction network to reveal artifacts from two color spaces. To mimic practical scenarios, we conduct experiments to detect images with post-processings that are not seen in the training stage. The results demonstrate that our approach outperforms state-of-the-art methods, boosting the average detection accuracy by 7% ~ 17%.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信