Yueneng Wang, Zhongjie Mi, Xinghao Jiang, Tanfeng Sun
{"title":"Detection of video transcoding from AVC to HEVC based on Intra Prediction Feature Maps","authors":"Yueneng Wang, Zhongjie Mi, Xinghao Jiang, Tanfeng Sun","doi":"10.1016/j.neucom.2024.128935","DOIUrl":null,"url":null,"abstract":"<div><div>As the High Efficiency Video Coding (HEVC) standard gains popularity, forgers are more inclined to transcode videos into HEVC format from the previous Advanced Video Coding (AVC) format. To verify the originality and authenticity of videos, it is crucial to propose a method for transcoded HEVC video detection. In this paper, a novel method is proposed to detect video transcoding from AVC to HEVC (AVC-HEVC). Analysis shows that the intra prediction mode is sensitive to spatial loss introduced by previous AVC encoding in the transcoding process. Thus, the intra prediction modes are extracted from the luminance and chrominance components to create Intra Prediction Feature Maps (IPFMs). Subsequently, a Dual-flow Attention-based MobileNet (DAM-Net) is introduced to learn the deep representation of AVC-HEVC transcoding artifacts. Finally, video level results are derived from the frame level analysis provided by DAM-Net. Extensive experiment results demonstrate that the performance of the proposed method outperforms the existing methods in the detection of AVC-HEVC transcoding.</div></div>","PeriodicalId":19268,"journal":{"name":"Neurocomputing","volume":"617 ","pages":"Article 128935"},"PeriodicalIF":5.5000,"publicationDate":"2024-11-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Neurocomputing","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0925231224017065","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0
Abstract
As the High Efficiency Video Coding (HEVC) standard gains popularity, forgers are more inclined to transcode videos into HEVC format from the previous Advanced Video Coding (AVC) format. To verify the originality and authenticity of videos, it is crucial to propose a method for transcoded HEVC video detection. In this paper, a novel method is proposed to detect video transcoding from AVC to HEVC (AVC-HEVC). Analysis shows that the intra prediction mode is sensitive to spatial loss introduced by previous AVC encoding in the transcoding process. Thus, the intra prediction modes are extracted from the luminance and chrominance components to create Intra Prediction Feature Maps (IPFMs). Subsequently, a Dual-flow Attention-based MobileNet (DAM-Net) is introduced to learn the deep representation of AVC-HEVC transcoding artifacts. Finally, video level results are derived from the frame level analysis provided by DAM-Net. Extensive experiment results demonstrate that the performance of the proposed method outperforms the existing methods in the detection of AVC-HEVC transcoding.
随着高效视频编码(High Efficiency Video Coding, HEVC)标准的普及,伪造者更倾向于将之前的高级视频编码(Advanced Video Coding, AVC)格式转换为HEVC格式。为了验证视频的原创性和真实性,提出一种转码HEVC视频检测方法至关重要。本文提出了一种检测视频从AVC到HEVC转码的新方法(AVC-HEVC)。分析表明,在转码过程中,帧内预测模式对先前AVC编码带来的空间损失很敏感。因此,从亮度和色度分量中提取图像内预测模式,创建图像内预测特征图(IPFMs)。随后,引入了基于双流注意力的MobileNet (DAM-Net)来学习AVC-HEVC转码工件的深度表示。最后,根据DAM-Net提供的帧级分析得出视频级结果。大量的实验结果表明,该方法在AVC-HEVC转码检测中的性能优于现有的方法。
期刊介绍:
Neurocomputing publishes articles describing recent fundamental contributions in the field of neurocomputing. Neurocomputing theory, practice and applications are the essential topics being covered.