学习卷积神经网络视频去噪的丰富特征

Xianfeng Tang, Peining Zhen, M. Kang, Hang Yi, Wei Wang, Hai-Bao Chen
{"title":"学习卷积神经网络视频去噪的丰富特征","authors":"Xianfeng Tang, Peining Zhen, M. Kang, Hang Yi, Wei Wang, Hai-Bao Chen","doi":"10.1109/APCCAS50809.2020.9301660","DOIUrl":null,"url":null,"abstract":"Video denoising is of great significance in video processing when shooting conditions are complex such as dynamic scenes and low light. Although existing algorithms have already achieved remarkable denoising performance, the inference time of them is usually impractical for real-time applications. In this paper, we propose a convolutional neural network architecture for video denoising. In contrast to other existing CNN-based methods, our approach utilizes different proportion convolutional kernel numbers in a block for extracting enriched features. Channel attention mechanism is integrated in the network to enhance the denoising performance. The network only needs three contiguous frames and noise map as inputs, which leads to a similar excellent running time to the state-of-the-art. We compare our method with different conventional algorithms VBM4D, VNLB and the state-of-the-art CNN-based method FastDVDnet. Experiment results indicate that our method outputs more convincing results in visual and more robustness than others in both peak signal-to-noise ratio (PSNR) and structural similarity index measure (SSIM) indexes.","PeriodicalId":127075,"journal":{"name":"2020 IEEE Asia Pacific Conference on Circuits and Systems (APCCAS)","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2020-12-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Learning Enriched Features for Video Denoising with Convolutional Neural Network\",\"authors\":\"Xianfeng Tang, Peining Zhen, M. Kang, Hang Yi, Wei Wang, Hai-Bao Chen\",\"doi\":\"10.1109/APCCAS50809.2020.9301660\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Video denoising is of great significance in video processing when shooting conditions are complex such as dynamic scenes and low light. Although existing algorithms have already achieved remarkable denoising performance, the inference time of them is usually impractical for real-time applications. In this paper, we propose a convolutional neural network architecture for video denoising. In contrast to other existing CNN-based methods, our approach utilizes different proportion convolutional kernel numbers in a block for extracting enriched features. Channel attention mechanism is integrated in the network to enhance the denoising performance. The network only needs three contiguous frames and noise map as inputs, which leads to a similar excellent running time to the state-of-the-art. We compare our method with different conventional algorithms VBM4D, VNLB and the state-of-the-art CNN-based method FastDVDnet. Experiment results indicate that our method outputs more convincing results in visual and more robustness than others in both peak signal-to-noise ratio (PSNR) and structural similarity index measure (SSIM) indexes.\",\"PeriodicalId\":127075,\"journal\":{\"name\":\"2020 IEEE Asia Pacific Conference on Circuits and Systems (APCCAS)\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2020-12-08\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2020 IEEE Asia Pacific Conference on Circuits and Systems (APCCAS)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/APCCAS50809.2020.9301660\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2020 IEEE Asia Pacific Conference on Circuits and Systems (APCCAS)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/APCCAS50809.2020.9301660","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

在动态场景、弱光等拍摄条件复杂的视频处理中,视频去噪具有重要意义。虽然现有的算法已经取得了显著的去噪性能,但它们的推理时间通常不适合实时应用。本文提出了一种用于视频去噪的卷积神经网络结构。与其他现有的基于cnn的方法相比,我们的方法利用块中不同比例的卷积核数来提取丰富的特征。在网络中加入了信道注意机制,提高了去噪性能。该网络只需要三个连续帧和噪声图作为输入,这使得其运行时间与最先进的网络相似。我们将我们的方法与不同的传统算法VBM4D、VNLB和最先进的基于cnn的方法FastDVDnet进行了比较。实验结果表明,该方法在视觉上的结果更令人信服,在峰值信噪比(PSNR)和结构相似指数度量(SSIM)指标上的鲁棒性更强。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Learning Enriched Features for Video Denoising with Convolutional Neural Network
Video denoising is of great significance in video processing when shooting conditions are complex such as dynamic scenes and low light. Although existing algorithms have already achieved remarkable denoising performance, the inference time of them is usually impractical for real-time applications. In this paper, we propose a convolutional neural network architecture for video denoising. In contrast to other existing CNN-based methods, our approach utilizes different proportion convolutional kernel numbers in a block for extracting enriched features. Channel attention mechanism is integrated in the network to enhance the denoising performance. The network only needs three contiguous frames and noise map as inputs, which leads to a similar excellent running time to the state-of-the-art. We compare our method with different conventional algorithms VBM4D, VNLB and the state-of-the-art CNN-based method FastDVDnet. Experiment results indicate that our method outputs more convincing results in visual and more robustness than others in both peak signal-to-noise ratio (PSNR) and structural similarity index measure (SSIM) indexes.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信