深度学习超分辨技术综述

John Julius Danker Khoo, K. Lim, Jonathan Then Sien Phang
{"title":"深度学习超分辨技术综述","authors":"John Julius Danker Khoo, K. Lim, Jonathan Then Sien Phang","doi":"10.1109/ICSPC50992.2020.9305806","DOIUrl":null,"url":null,"abstract":"Super resolution techniques are used to reconstruct the detail of high-resolution image from low-resolution lossy image. The introduction of a deep learning approach in super resolution has drawn a lot of research interest in recent years due to its learning capability and noise immunity. The applications of deep learning super resolution can mainly be found in image recovery, medical imaging, and microscopy. In this paper, the deep learning super resolutions are explored in detail based on its models and architecture. They can be classified into three neural network (NN) models, i.e. Convolutional NN-based models, Recursive NN-based models, and Adversarial Network-based models. CNN-based models apply convolution operation to embed the latent feature and subsequently decode it with deconvolution operation to achieve a higher dimension. RNN-based models integrate the recursive depth model to enhance recursive learning with past memory. On the other hand, adversarial network-based models apply the generative manner to learn the probability of the input pattern to forecast the possible high dimension of output information. The details of each unsupervised model are discussed in this paper to highlight its advantages and limitations. The measurement metrics such as Peak Signal-to-Noise Ratio (PSNR), structural similarity (SSIM) and Mean opinion score (MOS) are highlighted for performance evaluation of each super resolution models. The significance of this study provide a compact review of the current development and trend in super resolution using various deep learning models.","PeriodicalId":273439,"journal":{"name":"2020 IEEE 8th Conference on Systems, Process and Control (ICSPC)","volume":"30 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2020-12-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"2","resultStr":"{\"title\":\"A Review on Deep Learning Super Resolution Techniques\",\"authors\":\"John Julius Danker Khoo, K. Lim, Jonathan Then Sien Phang\",\"doi\":\"10.1109/ICSPC50992.2020.9305806\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Super resolution techniques are used to reconstruct the detail of high-resolution image from low-resolution lossy image. The introduction of a deep learning approach in super resolution has drawn a lot of research interest in recent years due to its learning capability and noise immunity. The applications of deep learning super resolution can mainly be found in image recovery, medical imaging, and microscopy. In this paper, the deep learning super resolutions are explored in detail based on its models and architecture. They can be classified into three neural network (NN) models, i.e. Convolutional NN-based models, Recursive NN-based models, and Adversarial Network-based models. CNN-based models apply convolution operation to embed the latent feature and subsequently decode it with deconvolution operation to achieve a higher dimension. RNN-based models integrate the recursive depth model to enhance recursive learning with past memory. On the other hand, adversarial network-based models apply the generative manner to learn the probability of the input pattern to forecast the possible high dimension of output information. The details of each unsupervised model are discussed in this paper to highlight its advantages and limitations. The measurement metrics such as Peak Signal-to-Noise Ratio (PSNR), structural similarity (SSIM) and Mean opinion score (MOS) are highlighted for performance evaluation of each super resolution models. The significance of this study provide a compact review of the current development and trend in super resolution using various deep learning models.\",\"PeriodicalId\":273439,\"journal\":{\"name\":\"2020 IEEE 8th Conference on Systems, Process and Control (ICSPC)\",\"volume\":\"30 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2020-12-11\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"2\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2020 IEEE 8th Conference on Systems, Process and Control (ICSPC)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ICSPC50992.2020.9305806\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2020 IEEE 8th Conference on Systems, Process and Control (ICSPC)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICSPC50992.2020.9305806","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 2

摘要

超分辨率技术用于从低分辨率有损图像重建高分辨率图像的细节。近年来,在超分辨率中引入深度学习方法因其学习能力和抗噪声能力引起了广泛的研究兴趣。深度学习超分辨率的应用主要在图像恢复、医学成像和显微镜等领域。本文基于深度学习超分辨率的模型和体系结构对其进行了详细的探讨。它们可以分为三种神经网络模型,即基于卷积神经网络的模型、基于递归神经网络的模型和基于对抗网络的模型。基于cnn的模型采用卷积运算嵌入潜在特征,然后进行反卷积运算解码,以获得更高的维度。基于rnn的模型集成了递归深度模型,增强了对过去记忆的递归学习。另一方面,基于对抗网络的模型采用生成方式来学习输入模式的概率,以预测输出信息可能的高维数。本文讨论了每个无监督模型的细节,以突出其优点和局限性。利用峰值信噪比(PSNR)、结构相似度(SSIM)和平均意见评分(MOS)等度量指标对各超分辨率模型进行性能评价。本研究的意义是对使用各种深度学习模型的超分辨率的当前发展和趋势进行了简要的回顾。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
A Review on Deep Learning Super Resolution Techniques
Super resolution techniques are used to reconstruct the detail of high-resolution image from low-resolution lossy image. The introduction of a deep learning approach in super resolution has drawn a lot of research interest in recent years due to its learning capability and noise immunity. The applications of deep learning super resolution can mainly be found in image recovery, medical imaging, and microscopy. In this paper, the deep learning super resolutions are explored in detail based on its models and architecture. They can be classified into three neural network (NN) models, i.e. Convolutional NN-based models, Recursive NN-based models, and Adversarial Network-based models. CNN-based models apply convolution operation to embed the latent feature and subsequently decode it with deconvolution operation to achieve a higher dimension. RNN-based models integrate the recursive depth model to enhance recursive learning with past memory. On the other hand, adversarial network-based models apply the generative manner to learn the probability of the input pattern to forecast the possible high dimension of output information. The details of each unsupervised model are discussed in this paper to highlight its advantages and limitations. The measurement metrics such as Peak Signal-to-Noise Ratio (PSNR), structural similarity (SSIM) and Mean opinion score (MOS) are highlighted for performance evaluation of each super resolution models. The significance of this study provide a compact review of the current development and trend in super resolution using various deep learning models.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信