泛化音频干扰检测的电网络频率表示自监督对比学习框架

IF 4.8 2区 计算机科学 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE
Chunyan Zeng, Fan Wang, Zhifeng Wang
{"title":"泛化音频干扰检测的电网络频率表示自监督对比学习框架","authors":"Chunyan Zeng,&nbsp;Fan Wang,&nbsp;Zhifeng Wang","doi":"10.1155/int/6478632","DOIUrl":null,"url":null,"abstract":"<p>Digital audio tampering detection is essential for preserving information authenticity, sustaining societal trust, and safeguarding public safety. However, most electric network frequency (ENF)–based detectors are trained in a fully supervised manner and therefore depend on large-scale labeled datasets, which are costly to obtain and often unavailable in real-world deployments. This heavy reliance on annotations limits representation discriminability and weakens generalization across unseen recording conditions and tampering patterns. To address these challenges, we propose ENF-based contrastive learning (ENFCL), a self-supervised framework that introduces contrastive pretraining for ENF-based audio tampering detection. ENFCL learns discriminative ENF representations from unlabeled audio by constructing diverse positive and negative sample pairs, thereby improving robustness and generalization without manual annotations. For pretraining, we design a multiscale encoder, multiscale ENF feature encoder with transformer (MSENFformer) to capture tampering cues at different resolutions. MSENFformer integrates three complementary subnetworks, zero-order phase deep residual network (ZPDR-Net), first-order phase deep representation network (FPDR-Net), and multiple-harmonics deep aggregation network (MHDA-Net) to model ENF characteristics across phase orders and harmonic components. A transformer module further aggregates global contextual information to enrich hierarchical feature representations. To mitigate the adaptation gap during fine-tuning, we introduce grouped convolution and dual-attention–based selective kernel network (GCDA-SKNet), which adaptively fuses multiscale features via dynamic selective kernels, enhancing discrimination for downstream classification. Experiments demonstrate that ENFCL achieves 94.00% accuracy on ENF-EDIT1, substantially outperforming existing state-of-the-art methods. Across ENF-EDIT1, ENF-EDIT2, and ENF-HBUT, ENFCL remains consistently strong under diverse data augmentation settings, confirming its robustness and generalization in practical audio tampering detection scenarios.</p>","PeriodicalId":14089,"journal":{"name":"International Journal of Intelligent Systems","volume":"2026 1","pages":""},"PeriodicalIF":4.8000,"publicationDate":"2026-09-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1155/int/6478632","citationCount":"0","resultStr":"{\"title\":\"ENFCL: Self-Supervised Contrastive Learning Framework of Electric Network Frequency Representations for Generalizable Audio Tampering Detection\",\"authors\":\"Chunyan Zeng,&nbsp;Fan Wang,&nbsp;Zhifeng Wang\",\"doi\":\"10.1155/int/6478632\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p>Digital audio tampering detection is essential for preserving information authenticity, sustaining societal trust, and safeguarding public safety. However, most electric network frequency (ENF)–based detectors are trained in a fully supervised manner and therefore depend on large-scale labeled datasets, which are costly to obtain and often unavailable in real-world deployments. This heavy reliance on annotations limits representation discriminability and weakens generalization across unseen recording conditions and tampering patterns. To address these challenges, we propose ENF-based contrastive learning (ENFCL), a self-supervised framework that introduces contrastive pretraining for ENF-based audio tampering detection. ENFCL learns discriminative ENF representations from unlabeled audio by constructing diverse positive and negative sample pairs, thereby improving robustness and generalization without manual annotations. For pretraining, we design a multiscale encoder, multiscale ENF feature encoder with transformer (MSENFformer) to capture tampering cues at different resolutions. MSENFformer integrates three complementary subnetworks, zero-order phase deep residual network (ZPDR-Net), first-order phase deep representation network (FPDR-Net), and multiple-harmonics deep aggregation network (MHDA-Net) to model ENF characteristics across phase orders and harmonic components. A transformer module further aggregates global contextual information to enrich hierarchical feature representations. To mitigate the adaptation gap during fine-tuning, we introduce grouped convolution and dual-attention–based selective kernel network (GCDA-SKNet), which adaptively fuses multiscale features via dynamic selective kernels, enhancing discrimination for downstream classification. Experiments demonstrate that ENFCL achieves 94.00% accuracy on ENF-EDIT1, substantially outperforming existing state-of-the-art methods. Across ENF-EDIT1, ENF-EDIT2, and ENF-HBUT, ENFCL remains consistently strong under diverse data augmentation settings, confirming its robustness and generalization in practical audio tampering detection scenarios.</p>\",\"PeriodicalId\":14089,\"journal\":{\"name\":\"International Journal of Intelligent Systems\",\"volume\":\"2026 1\",\"pages\":\"\"},\"PeriodicalIF\":4.8000,\"publicationDate\":\"2026-09-20\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://onlinelibrary.wiley.com/doi/epdf/10.1155/int/6478632\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"International Journal of Intelligent Systems\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://onlinelibrary.wiley.com/doi/10.1155/int/6478632\",\"RegionNum\":2,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Journal of Intelligent Systems","FirstCategoryId":"94","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1155/int/6478632","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0

摘要

数字音频篡改检测对于维护信息真实性、维持社会信任、保障公共安全至关重要。然而,大多数基于电网频率(ENF)的检测器都是以完全监督的方式进行训练的,因此依赖于大规模的标记数据集,这些数据集的获取成本很高,并且在实际部署中通常不可用。这种对注释的严重依赖限制了表示的可辨别性,并削弱了对未见过的记录条件和篡改模式的泛化。为了解决这些挑战,我们提出了基于enf的对比学习(ENFCL),这是一个自监督框架,为基于enf的音频篡改检测引入了对比预训练。ENFCL通过构建不同的正、负样本对,从未标记的音频中学习判别性的ENF表示,从而提高鲁棒性和泛化性,无需人工标注。对于预训练,我们设计了一个多尺度编码器,多尺度ENF特征编码器与变压器(msenformer)捕获不同分辨率的篡改线索。msenformer集成了三个互补的子网络,零阶相位深度残留网络(ZPDR-Net),一阶相位深度表示网络(FPDR-Net)和多谐波深度聚合网络(MHDA-Net),以模拟跨相位阶数和谐波分量的ENF特性。转换器模块进一步聚合全局上下文信息,以丰富分层特征表示。为了减轻微调过程中的自适应差距,我们引入了分组卷积和基于双注意的选择性核网络(GCDA-SKNet),该网络通过动态选择核自适应融合多尺度特征,增强了对下游分类的辨别能力。实验表明,ENFCL在ENF-EDIT1上的准确率达到了94.00%,大大优于现有的最先进的方法。在ENF-EDIT1、ENF-EDIT2和ENF-HBUT中,ENFCL在不同的数据增强设置下仍然保持强劲,证实了其在实际音频篡改检测场景中的鲁棒性和泛化性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
ENFCL: Self-Supervised Contrastive Learning Framework of Electric Network Frequency Representations for Generalizable Audio Tampering Detection

Digital audio tampering detection is essential for preserving information authenticity, sustaining societal trust, and safeguarding public safety. However, most electric network frequency (ENF)–based detectors are trained in a fully supervised manner and therefore depend on large-scale labeled datasets, which are costly to obtain and often unavailable in real-world deployments. This heavy reliance on annotations limits representation discriminability and weakens generalization across unseen recording conditions and tampering patterns. To address these challenges, we propose ENF-based contrastive learning (ENFCL), a self-supervised framework that introduces contrastive pretraining for ENF-based audio tampering detection. ENFCL learns discriminative ENF representations from unlabeled audio by constructing diverse positive and negative sample pairs, thereby improving robustness and generalization without manual annotations. For pretraining, we design a multiscale encoder, multiscale ENF feature encoder with transformer (MSENFformer) to capture tampering cues at different resolutions. MSENFformer integrates three complementary subnetworks, zero-order phase deep residual network (ZPDR-Net), first-order phase deep representation network (FPDR-Net), and multiple-harmonics deep aggregation network (MHDA-Net) to model ENF characteristics across phase orders and harmonic components. A transformer module further aggregates global contextual information to enrich hierarchical feature representations. To mitigate the adaptation gap during fine-tuning, we introduce grouped convolution and dual-attention–based selective kernel network (GCDA-SKNet), which adaptively fuses multiscale features via dynamic selective kernels, enhancing discrimination for downstream classification. Experiments demonstrate that ENFCL achieves 94.00% accuracy on ENF-EDIT1, substantially outperforming existing state-of-the-art methods. Across ENF-EDIT1, ENF-EDIT2, and ENF-HBUT, ENFCL remains consistently strong under diverse data augmentation settings, confirming its robustness and generalization in practical audio tampering detection scenarios.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
International Journal of Intelligent Systems
International Journal of Intelligent Systems 工程技术-计算机:人工智能
CiteScore
11.30
自引率
14.30%
发文量
304
审稿时长
9 months
期刊介绍: The International Journal of Intelligent Systems serves as a forum for individuals interested in tapping into the vast theories based on intelligent systems construction. With its peer-reviewed format, the journal explores several fascinating editorials written by today''s experts in the field. Because new developments are being introduced each day, there''s much to be learned — examination, analysis creation, information retrieval, man–computer interactions, and more. The International Journal of Intelligent Systems uses charts and illustrations to demonstrate these ground-breaking issues, and encourages readers to share their thoughts and experiences.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书