{"title":"DnM3Net:基于多级关注的多尺度多级Shuffle-CNN图像去噪","authors":"Yue Cao, Jinhe He, Yu Zhang, Gang Lu, Shigang Liu, Xiaojun Wu","doi":"10.1109/IUCC/DSCI/SmartCNS.2019.00075","DOIUrl":null,"url":null,"abstract":"Recently, based on novel convolutional neural net-work architectures proposed, tremendous advances have been achieved in image denoising task. An effective and efficient multi-level network architecture for image denoising refers to restore the latent clean image from a coarser scale to finer scales and pass features through multiple levels of the model. Unfortunately, the bottleneck of applying multi-level network architecture lies in the multi-scale information from input images is not effectively captured and the fine-to-coarse feature fusion strategy to be ignored in image denoising task. To solve these problems, we propose a multi-scale & multi-level shuffle-CNN Via multi-level attention (DnM3Net), which plugs the multi-scale feature extraction, fine-to-coarse feature fusion strategy and multi-level attention module into the new network architecture in image denoising task. The advantage of this approach are two-fold: (1) It solve the multi-scale information extraction issue of multi-level network architecture, making it more effective and efficient for the image denoising task. (2) It is impressive performance because the better trade-off between denoising and detail preservation. The proposed novel network architecture is validated by applying on synthetic gaussian noise gray and RGB images. Experimental results show that the DnM3Net effectively improve the quantitative metrics and visual quality compared to the state-of-the-art denoising methods.","PeriodicalId":410905,"journal":{"name":"2019 IEEE International Conferences on Ubiquitous Computing & Communications (IUCC) and Data Science and Computational Intelligence (DSCI) and Smart Computing, Networking and Services (SmartCNS)","volume":"88 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2019-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"DnM3Net: Multi-Scale & Multi-Level Shuffle-CNN Via Multi-Level Attention for Image Denoising\",\"authors\":\"Yue Cao, Jinhe He, Yu Zhang, Gang Lu, Shigang Liu, Xiaojun Wu\",\"doi\":\"10.1109/IUCC/DSCI/SmartCNS.2019.00075\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Recently, based on novel convolutional neural net-work architectures proposed, tremendous advances have been achieved in image denoising task. An effective and efficient multi-level network architecture for image denoising refers to restore the latent clean image from a coarser scale to finer scales and pass features through multiple levels of the model. Unfortunately, the bottleneck of applying multi-level network architecture lies in the multi-scale information from input images is not effectively captured and the fine-to-coarse feature fusion strategy to be ignored in image denoising task. To solve these problems, we propose a multi-scale & multi-level shuffle-CNN Via multi-level attention (DnM3Net), which plugs the multi-scale feature extraction, fine-to-coarse feature fusion strategy and multi-level attention module into the new network architecture in image denoising task. The advantage of this approach are two-fold: (1) It solve the multi-scale information extraction issue of multi-level network architecture, making it more effective and efficient for the image denoising task. (2) It is impressive performance because the better trade-off between denoising and detail preservation. The proposed novel network architecture is validated by applying on synthetic gaussian noise gray and RGB images. Experimental results show that the DnM3Net effectively improve the quantitative metrics and visual quality compared to the state-of-the-art denoising methods.\",\"PeriodicalId\":410905,\"journal\":{\"name\":\"2019 IEEE International Conferences on Ubiquitous Computing & Communications (IUCC) and Data Science and Computational Intelligence (DSCI) and Smart Computing, Networking and Services (SmartCNS)\",\"volume\":\"88 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2019-10-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2019 IEEE International Conferences on Ubiquitous Computing & Communications (IUCC) and Data Science and Computational Intelligence (DSCI) and Smart Computing, Networking and Services (SmartCNS)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/IUCC/DSCI/SmartCNS.2019.00075\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2019 IEEE International Conferences on Ubiquitous Computing & Communications (IUCC) and Data Science and Computational Intelligence (DSCI) and Smart Computing, Networking and Services (SmartCNS)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/IUCC/DSCI/SmartCNS.2019.00075","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
摘要
近年来,基于新的卷积神经网络架构的提出,在图像去噪方面取得了巨大的进展。一种有效且高效的图像去噪多级网络架构是指将潜在的干净图像从较粗的尺度恢复到较细的尺度,并通过模型的多个层次传递特征。然而,多级网络结构应用的瓶颈在于不能有效地捕获输入图像的多尺度信息,并且在图像去噪任务中忽略了精细到粗的特征融合策略。为了解决这些问题,我们提出了一种多尺度多级shuffle-CNN Via multi- attention (DnM3Net)算法,该算法将多尺度特征提取、精细到粗的特征融合策略和多级关注模块融入到图像去噪任务的新网络架构中。该方法的优点有两方面:(1)解决了多层次网络结构的多尺度信息提取问题,使其对图像去噪任务更加有效和高效。(2)在去噪和细节保留之间进行了较好的权衡,取得了令人印象深刻的性能。通过对合成高斯噪声、灰度和RGB图像的实验验证了该网络的有效性。实验结果表明,与现有的去噪方法相比,DnM3Net有效地提高了图像的定量指标和视觉质量。
DnM3Net: Multi-Scale & Multi-Level Shuffle-CNN Via Multi-Level Attention for Image Denoising
Recently, based on novel convolutional neural net-work architectures proposed, tremendous advances have been achieved in image denoising task. An effective and efficient multi-level network architecture for image denoising refers to restore the latent clean image from a coarser scale to finer scales and pass features through multiple levels of the model. Unfortunately, the bottleneck of applying multi-level network architecture lies in the multi-scale information from input images is not effectively captured and the fine-to-coarse feature fusion strategy to be ignored in image denoising task. To solve these problems, we propose a multi-scale & multi-level shuffle-CNN Via multi-level attention (DnM3Net), which plugs the multi-scale feature extraction, fine-to-coarse feature fusion strategy and multi-level attention module into the new network architecture in image denoising task. The advantage of this approach are two-fold: (1) It solve the multi-scale information extraction issue of multi-level network architecture, making it more effective and efficient for the image denoising task. (2) It is impressive performance because the better trade-off between denoising and detail preservation. The proposed novel network architecture is validated by applying on synthetic gaussian noise gray and RGB images. Experimental results show that the DnM3Net effectively improve the quantitative metrics and visual quality compared to the state-of-the-art denoising methods.