利用对称跳跃连接的卷积神经网络实现图像超分辨率

Yan Zou, Fujun Xiao, Linfei Zhang, Qian Chen, Bowen Wang, Yan Hu
{"title":"利用对称跳跃连接的卷积神经网络实现图像超分辨率","authors":"Yan Zou, Fujun Xiao, Linfei Zhang, Qian Chen, Bowen Wang, Yan Hu","doi":"10.1117/12.2586467","DOIUrl":null,"url":null,"abstract":"In recent years, the convolution neural network has been widely used in single image super-resolution and has an excellent super-resolution ability. In this paper, a novel convolutional neural network structure based on symmetric skip connection is proposed, which contains multiple convolution layers and deconvolution layers. The role of the convolution layer is to extract the details of image content, and the function of the deconvolution layer is to make the image upsampling and restore the image content details. In addition, we use skip connection between the convolution layer and the deconvolution layer of network structure, which can transfer image information from the front end to the back end. Meanwhile, skip connection can also effectively solve the problem of gradient vanishing. Besides, the residual block is introduced to deepen the network structure. The deeper network structure can learn more complex changes. Different from other papers, this paper uses the method of adding the number of channels for feature fusion. This method can greatly increase the number of feature images, which is helpful to restore image details by deconvolution layer. A large number of experiments show that our network has efficient super-resolution ability of infrared image details.","PeriodicalId":370739,"journal":{"name":"International Conference on Photonics and Optical Engineering and the Annual West China Photonics Conference","volume":"49 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-01-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":"{\"title\":\"Image super-resolution using convolutional neural network with symmetric skip connections\",\"authors\":\"Yan Zou, Fujun Xiao, Linfei Zhang, Qian Chen, Bowen Wang, Yan Hu\",\"doi\":\"10.1117/12.2586467\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"In recent years, the convolution neural network has been widely used in single image super-resolution and has an excellent super-resolution ability. In this paper, a novel convolutional neural network structure based on symmetric skip connection is proposed, which contains multiple convolution layers and deconvolution layers. The role of the convolution layer is to extract the details of image content, and the function of the deconvolution layer is to make the image upsampling and restore the image content details. In addition, we use skip connection between the convolution layer and the deconvolution layer of network structure, which can transfer image information from the front end to the back end. Meanwhile, skip connection can also effectively solve the problem of gradient vanishing. Besides, the residual block is introduced to deepen the network structure. The deeper network structure can learn more complex changes. Different from other papers, this paper uses the method of adding the number of channels for feature fusion. This method can greatly increase the number of feature images, which is helpful to restore image details by deconvolution layer. A large number of experiments show that our network has efficient super-resolution ability of infrared image details.\",\"PeriodicalId\":370739,\"journal\":{\"name\":\"International Conference on Photonics and Optical Engineering and the Annual West China Photonics Conference\",\"volume\":\"49 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2021-01-15\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"1\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"International Conference on Photonics and Optical Engineering and the Annual West China Photonics Conference\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1117/12.2586467\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Conference on Photonics and Optical Engineering and the Annual West China Photonics Conference","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1117/12.2586467","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 1

摘要

近年来,卷积神经网络在单幅图像超分辨中得到了广泛的应用,并具有优异的超分辨能力。本文提出了一种基于对称跳跃连接的卷积神经网络结构,该结构包含多个卷积层和反卷积层。卷积层的作用是提取图像内容的细节,反卷积层的作用是对图像进行上采样,恢复图像内容细节。此外,我们在网络结构的卷积层和反卷积层之间使用了跳跃式连接,可以将图像信息从前端传输到后端。同时,箕斗连接还能有效地解决梯度消失问题。此外,还引入了残差块来加深网络结构。更深层的网络结构可以学习到更复杂的变化。与其他论文不同的是,本文采用了增加通道数的方法进行特征融合。该方法可以大大增加特征图像的数量,有助于通过反卷积层恢复图像细节。大量实验表明,该网络具有高效的红外图像细节超分辨能力。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Image super-resolution using convolutional neural network with symmetric skip connections
In recent years, the convolution neural network has been widely used in single image super-resolution and has an excellent super-resolution ability. In this paper, a novel convolutional neural network structure based on symmetric skip connection is proposed, which contains multiple convolution layers and deconvolution layers. The role of the convolution layer is to extract the details of image content, and the function of the deconvolution layer is to make the image upsampling and restore the image content details. In addition, we use skip connection between the convolution layer and the deconvolution layer of network structure, which can transfer image information from the front end to the back end. Meanwhile, skip connection can also effectively solve the problem of gradient vanishing. Besides, the residual block is introduced to deepen the network structure. The deeper network structure can learn more complex changes. Different from other papers, this paper uses the method of adding the number of channels for feature fusion. This method can greatly increase the number of feature images, which is helpful to restore image details by deconvolution layer. A large number of experiments show that our network has efficient super-resolution ability of infrared image details.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信