Yan Zou, Fujun Xiao, Linfei Zhang, Qian Chen, Bowen Wang, Yan Hu
{"title":"利用对称跳跃连接的卷积神经网络实现图像超分辨率","authors":"Yan Zou, Fujun Xiao, Linfei Zhang, Qian Chen, Bowen Wang, Yan Hu","doi":"10.1117/12.2586467","DOIUrl":null,"url":null,"abstract":"In recent years, the convolution neural network has been widely used in single image super-resolution and has an excellent super-resolution ability. In this paper, a novel convolutional neural network structure based on symmetric skip connection is proposed, which contains multiple convolution layers and deconvolution layers. The role of the convolution layer is to extract the details of image content, and the function of the deconvolution layer is to make the image upsampling and restore the image content details. In addition, we use skip connection between the convolution layer and the deconvolution layer of network structure, which can transfer image information from the front end to the back end. Meanwhile, skip connection can also effectively solve the problem of gradient vanishing. Besides, the residual block is introduced to deepen the network structure. The deeper network structure can learn more complex changes. Different from other papers, this paper uses the method of adding the number of channels for feature fusion. This method can greatly increase the number of feature images, which is helpful to restore image details by deconvolution layer. A large number of experiments show that our network has efficient super-resolution ability of infrared image details.","PeriodicalId":370739,"journal":{"name":"International Conference on Photonics and Optical Engineering and the Annual West China Photonics Conference","volume":"49 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-01-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":"{\"title\":\"Image super-resolution using convolutional neural network with symmetric skip connections\",\"authors\":\"Yan Zou, Fujun Xiao, Linfei Zhang, Qian Chen, Bowen Wang, Yan Hu\",\"doi\":\"10.1117/12.2586467\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"In recent years, the convolution neural network has been widely used in single image super-resolution and has an excellent super-resolution ability. In this paper, a novel convolutional neural network structure based on symmetric skip connection is proposed, which contains multiple convolution layers and deconvolution layers. The role of the convolution layer is to extract the details of image content, and the function of the deconvolution layer is to make the image upsampling and restore the image content details. In addition, we use skip connection between the convolution layer and the deconvolution layer of network structure, which can transfer image information from the front end to the back end. Meanwhile, skip connection can also effectively solve the problem of gradient vanishing. Besides, the residual block is introduced to deepen the network structure. The deeper network structure can learn more complex changes. Different from other papers, this paper uses the method of adding the number of channels for feature fusion. This method can greatly increase the number of feature images, which is helpful to restore image details by deconvolution layer. A large number of experiments show that our network has efficient super-resolution ability of infrared image details.\",\"PeriodicalId\":370739,\"journal\":{\"name\":\"International Conference on Photonics and Optical Engineering and the Annual West China Photonics Conference\",\"volume\":\"49 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2021-01-15\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"1\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"International Conference on Photonics and Optical Engineering and the Annual West China Photonics Conference\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1117/12.2586467\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Conference on Photonics and Optical Engineering and the Annual West China Photonics Conference","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1117/12.2586467","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Image super-resolution using convolutional neural network with symmetric skip connections
In recent years, the convolution neural network has been widely used in single image super-resolution and has an excellent super-resolution ability. In this paper, a novel convolutional neural network structure based on symmetric skip connection is proposed, which contains multiple convolution layers and deconvolution layers. The role of the convolution layer is to extract the details of image content, and the function of the deconvolution layer is to make the image upsampling and restore the image content details. In addition, we use skip connection between the convolution layer and the deconvolution layer of network structure, which can transfer image information from the front end to the back end. Meanwhile, skip connection can also effectively solve the problem of gradient vanishing. Besides, the residual block is introduced to deepen the network structure. The deeper network structure can learn more complex changes. Different from other papers, this paper uses the method of adding the number of channels for feature fusion. This method can greatly increase the number of feature images, which is helpful to restore image details by deconvolution layer. A large number of experiments show that our network has efficient super-resolution ability of infrared image details.