SINGLE IMAGE SUPER RESOLUTION VIA COUPLED SPARSE AND LOW RANK DICTIONARY LEARNING

Q2 Environmental Science
S. Sahebkheir, A. Esmaeily, M. Saba
{"title":"SINGLE IMAGE SUPER RESOLUTION VIA COUPLED SPARSE AND LOW RANK DICTIONARY LEARNING","authors":"S. Sahebkheir, A. Esmaeily, M. Saba","doi":"10.5194/isprs-annals-x-4-w1-2022-661-2023","DOIUrl":null,"url":null,"abstract":"Abstract. Limitations in imaging systems and the effects of changes in sensing have caused limitation in acquiring high resolution images such as satellite images and magnetic resonance imaging (MRI). Sparsity can reduce the noises and improve the resolution. Super resolution in medical and satellite imagery is essential because low resolution image analysis is very difficult. Sparsity techniques have significant influence on computer vision specially when the main objective is extracting the meaningful information. The success of sparsity is related to the nature of signals such as image and sound which are naturally sparse because they were founded based on Wavelet and Fourier equations. In this research, we proposed a method for restoring a clear image from the related low-resolution parts of both MRI and satellite images. First, we proposed a widespread structure for learning the couple low rank and sparse main characteristic representation. Combined optimization of the nuclear and L1 norms extracts the total low rank formation and the local patterns lodged in the image. In that case the reconstructed image will be more informative and matrix decomposition problem can recover a noisy observation matrix into an approximation of low rank matrix and a second matrix which contains some low dimensional structure. We assumed that by removing the blur and noise from these images, they would be reconstructed in the highest quality. The proposed method was compared with a variety dictionary learning approaches which addressed super resolution problem, such as tensor sparsity, Generative Bayesian and TV based methods. We demonstrated the results of applied method on MRI and satellite images, showing both visual and psnr improvements. Dealing with complex data in best manner shows the robustness of the proposed method.\n","PeriodicalId":30633,"journal":{"name":"ISPRS Annals of the Photogrammetry Remote Sensing and Spatial Information Sciences","volume":"145 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2023-01-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"ISPRS Annals of the Photogrammetry Remote Sensing and Spatial Information Sciences","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.5194/isprs-annals-x-4-w1-2022-661-2023","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"Environmental Science","Score":null,"Total":0}
引用次数: 0

Abstract

Abstract. Limitations in imaging systems and the effects of changes in sensing have caused limitation in acquiring high resolution images such as satellite images and magnetic resonance imaging (MRI). Sparsity can reduce the noises and improve the resolution. Super resolution in medical and satellite imagery is essential because low resolution image analysis is very difficult. Sparsity techniques have significant influence on computer vision specially when the main objective is extracting the meaningful information. The success of sparsity is related to the nature of signals such as image and sound which are naturally sparse because they were founded based on Wavelet and Fourier equations. In this research, we proposed a method for restoring a clear image from the related low-resolution parts of both MRI and satellite images. First, we proposed a widespread structure for learning the couple low rank and sparse main characteristic representation. Combined optimization of the nuclear and L1 norms extracts the total low rank formation and the local patterns lodged in the image. In that case the reconstructed image will be more informative and matrix decomposition problem can recover a noisy observation matrix into an approximation of low rank matrix and a second matrix which contains some low dimensional structure. We assumed that by removing the blur and noise from these images, they would be reconstructed in the highest quality. The proposed method was compared with a variety dictionary learning approaches which addressed super resolution problem, such as tensor sparsity, Generative Bayesian and TV based methods. We demonstrated the results of applied method on MRI and satellite images, showing both visual and psnr improvements. Dealing with complex data in best manner shows the robustness of the proposed method.
通过耦合稀疏和低秩字典学习实现单幅图像的超分辨率
摘要成像系统的局限性和传感变化的影响导致了获取高分辨率图像的限制,如卫星图像和磁共振成像(MRI)。稀疏性可以降低噪声,提高分辨率。超分辨率在医疗和卫星图像中是必不可少的,因为低分辨率图像分析非常困难。稀疏性技术对计算机视觉具有重要的影响,特别是在以提取有意义的信息为主要目标的情况下。稀疏性的成功与图像和声音等信号的本质有关,因为它们是基于小波和傅立叶方程建立的,因此它们具有天然的稀疏性。在本研究中,我们提出了一种从MRI和卫星图像的相关低分辨率部分恢复清晰图像的方法。首先,我们提出了一种广泛的结构来学习低秩和稀疏的主特征表示。核范数和L1范数的联合优化提取了图像中的总低阶结构和局部模式。矩阵分解问题可以将一个有噪声的观测矩阵恢复为一个低秩矩阵的近似值和一个包含一些低维结构的第二矩阵。我们认为,通过消除这些图像中的模糊和噪声,它们将以最高的质量重建。将该方法与解决超分辨率问题的多种字典学习方法(如张量稀疏、生成贝叶斯和基于电视的方法)进行了比较。我们在MRI和卫星图像上展示了应用方法的结果,显示了视觉和psnr的改善。以最佳方式处理复杂数据表明了所提方法的鲁棒性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
ISPRS Annals of the Photogrammetry Remote Sensing and Spatial Information Sciences
ISPRS Annals of the Photogrammetry Remote Sensing and Spatial Information Sciences Environmental Science-Environmental Science (miscellaneous)
CiteScore
2.00
自引率
0.00%
发文量
0
审稿时长
16 weeks
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书