{"title":"数字视频伪造多级检测高级框架。","authors":"Upasana Singh, Sandeep Rathor, Manoj Kumar","doi":"10.1111/nyas.15257","DOIUrl":null,"url":null,"abstract":"<p><p>The rapid expansion of digital media has sparked significant concerns regarding the swift dissemination and potential misuse of forged video content. Existing forgery detection technologies primarily focus on simple forgeries and are still evolving, resulting in a critical gap in the detection of multilevel forgeries, where one forgery is layered over another. This paper presents an innovative framework designed to address this challenge by extracting intricate features from forged frames using attention-augmented convolutional neural networks (AACNNs). A U-Net-based CycleGAN is employed to accurately localize forged regions, enabling a comprehensive analysis that identifies both two- and three-level forgeries by leveraging AACNN's local and global attention mechanisms. To enhance robustness and accuracy, we integrate a model-agnostic meta-learning approach. Our meticulously curated custom dataset, which represents complex forgery scenarios, underpins the effectiveness of our framework. In a 10-shot scenario, the AACNN backbone achieved an impressive accuracy of 98.2%, alongside a sensitivity of 96.3%, specificity of 97.6%, and an F1-score of 96.8%. These results represent a significant advancement in the accuracy and reliability of sophisticated video forgery detection.</p>","PeriodicalId":8250,"journal":{"name":"Annals of the New York Academy of Sciences","volume":" ","pages":""},"PeriodicalIF":4.1000,"publicationDate":"2024-11-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Advanced framework for multilevel detection of digital video forgeries.\",\"authors\":\"Upasana Singh, Sandeep Rathor, Manoj Kumar\",\"doi\":\"10.1111/nyas.15257\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>The rapid expansion of digital media has sparked significant concerns regarding the swift dissemination and potential misuse of forged video content. Existing forgery detection technologies primarily focus on simple forgeries and are still evolving, resulting in a critical gap in the detection of multilevel forgeries, where one forgery is layered over another. This paper presents an innovative framework designed to address this challenge by extracting intricate features from forged frames using attention-augmented convolutional neural networks (AACNNs). A U-Net-based CycleGAN is employed to accurately localize forged regions, enabling a comprehensive analysis that identifies both two- and three-level forgeries by leveraging AACNN's local and global attention mechanisms. To enhance robustness and accuracy, we integrate a model-agnostic meta-learning approach. Our meticulously curated custom dataset, which represents complex forgery scenarios, underpins the effectiveness of our framework. In a 10-shot scenario, the AACNN backbone achieved an impressive accuracy of 98.2%, alongside a sensitivity of 96.3%, specificity of 97.6%, and an F1-score of 96.8%. These results represent a significant advancement in the accuracy and reliability of sophisticated video forgery detection.</p>\",\"PeriodicalId\":8250,\"journal\":{\"name\":\"Annals of the New York Academy of Sciences\",\"volume\":\" \",\"pages\":\"\"},\"PeriodicalIF\":4.1000,\"publicationDate\":\"2024-11-19\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Annals of the New York Academy of Sciences\",\"FirstCategoryId\":\"103\",\"ListUrlMain\":\"https://doi.org/10.1111/nyas.15257\",\"RegionNum\":3,\"RegionCategory\":\"综合性期刊\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"MULTIDISCIPLINARY SCIENCES\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Annals of the New York Academy of Sciences","FirstCategoryId":"103","ListUrlMain":"https://doi.org/10.1111/nyas.15257","RegionNum":3,"RegionCategory":"综合性期刊","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"MULTIDISCIPLINARY SCIENCES","Score":null,"Total":0}
Advanced framework for multilevel detection of digital video forgeries.
The rapid expansion of digital media has sparked significant concerns regarding the swift dissemination and potential misuse of forged video content. Existing forgery detection technologies primarily focus on simple forgeries and are still evolving, resulting in a critical gap in the detection of multilevel forgeries, where one forgery is layered over another. This paper presents an innovative framework designed to address this challenge by extracting intricate features from forged frames using attention-augmented convolutional neural networks (AACNNs). A U-Net-based CycleGAN is employed to accurately localize forged regions, enabling a comprehensive analysis that identifies both two- and three-level forgeries by leveraging AACNN's local and global attention mechanisms. To enhance robustness and accuracy, we integrate a model-agnostic meta-learning approach. Our meticulously curated custom dataset, which represents complex forgery scenarios, underpins the effectiveness of our framework. In a 10-shot scenario, the AACNN backbone achieved an impressive accuracy of 98.2%, alongside a sensitivity of 96.3%, specificity of 97.6%, and an F1-score of 96.8%. These results represent a significant advancement in the accuracy and reliability of sophisticated video forgery detection.
期刊介绍:
Published on behalf of the New York Academy of Sciences, Annals of the New York Academy of Sciences provides multidisciplinary perspectives on research of current scientific interest with far-reaching implications for the wider scientific community and society at large. Each special issue assembles the best thinking of key contributors to a field of investigation at a time when emerging developments offer the promise of new insight. Individually themed, Annals special issues stimulate new ways to think about science by providing a neutral forum for discourse—within and across many institutions and fields.