Transformed sparsity-boosted low-rank model for image inpainting with non-convex γ-norm regularization and non-local prior

IF 4.6 2区 物理与天体物理 Q1 OPTICS
Ruyi Han , Shenghai Liao , Shujun Fu , Xingzhou Wang
{"title":"Transformed sparsity-boosted low-rank model for image inpainting with non-convex γ-norm regularization and non-local prior","authors":"Ruyi Han ,&nbsp;Shenghai Liao ,&nbsp;Shujun Fu ,&nbsp;Xingzhou Wang","doi":"10.1016/j.optlastec.2024.111865","DOIUrl":null,"url":null,"abstract":"<div><div>Low-rank prior has important applications in image restoration tasks, particularly in filling in missing information through low-rank matrix completion models. Although the truncated nuclear norm is a classic low-rank algorithm, practical solutions often rely on convex regularized nuclear norm to approximate the rank function, which limits its approximation ability and leads to blurry edges and loss of details. To improve restoration performance, we introduce a non-convex <span><math><mi>γ</mi></math></span>-norm. Theoretical analysis shows that the <span><math><mi>γ</mi></math></span>-norm approximates the rank function more accurately than the nuclear norm, leading to a novel non-convex low-rank approximation model. Furthermore, we enhance the model by introducing transform domain sparse regularization, aimed at capturing more local details and texture information, thereby improving inpainting quality. Addressing the limitations of traditional low-rank matrix restoration models in cases of entire row or column missing, we introduce a multi-pixel window strategy based on the new model, utilizing non-local similarity to search for similar blocks in the multi-pixel neighborhood of the target block to restore the entire column and eliminate residual column artifacts. Our method demonstrates excellent performance. We compare it with several state-of-the-art image restoration techniques across multiple tasks, including pixel restoration, text and scratch removal, column inpainting, and cloud removal. Experimental results prove that our method shows significant advantages in both visual quality and quantitative evaluation.</div></div>","PeriodicalId":19511,"journal":{"name":"Optics and Laser Technology","volume":"181 ","pages":"Article 111865"},"PeriodicalIF":4.6000,"publicationDate":"2024-10-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Optics and Laser Technology","FirstCategoryId":"101","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0030399224013239","RegionNum":2,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"OPTICS","Score":null,"Total":0}
引用次数: 0

Abstract

Low-rank prior has important applications in image restoration tasks, particularly in filling in missing information through low-rank matrix completion models. Although the truncated nuclear norm is a classic low-rank algorithm, practical solutions often rely on convex regularized nuclear norm to approximate the rank function, which limits its approximation ability and leads to blurry edges and loss of details. To improve restoration performance, we introduce a non-convex γ-norm. Theoretical analysis shows that the γ-norm approximates the rank function more accurately than the nuclear norm, leading to a novel non-convex low-rank approximation model. Furthermore, we enhance the model by introducing transform domain sparse regularization, aimed at capturing more local details and texture information, thereby improving inpainting quality. Addressing the limitations of traditional low-rank matrix restoration models in cases of entire row or column missing, we introduce a multi-pixel window strategy based on the new model, utilizing non-local similarity to search for similar blocks in the multi-pixel neighborhood of the target block to restore the entire column and eliminate residual column artifacts. Our method demonstrates excellent performance. We compare it with several state-of-the-art image restoration techniques across multiple tasks, including pixel restoration, text and scratch removal, column inpainting, and cloud removal. Experimental results prove that our method shows significant advantages in both visual quality and quantitative evaluation.
采用非凸 γ 规范正则化和非局部先验的用于图像绘制的变换稀疏性增强低秩模型
低秩先验在图像复原任务中有着重要的应用,特别是通过低秩矩阵补全模型填补缺失信息。虽然截断核规范是一种经典的低秩算法,但实际解决方案往往依赖凸正则化核规范来逼近秩函数,这限制了其逼近能力,导致边缘模糊和细节丢失。为了提高还原性能,我们引入了非凸 γ 准则。理论分析表明,γ 准则比核准则更精确地近似秩函数,从而产生了一种新的非凸低秩近似模型。此外,我们还通过引入变换域稀疏正则化来增强该模型,旨在捕捉更多局部细节和纹理信息,从而提高内绘质量。针对传统低阶矩阵复原模型在整行或整列缺失情况下的局限性,我们在新模型的基础上引入了多像素窗口策略,利用非局部相似性在目标块的多像素邻域中搜索相似块,从而复原整列并消除残余列伪影。我们的方法表现出卓越的性能。我们将其与几种最先进的图像复原技术进行了比较,包括像素还原、文本和划痕去除、列内画和云去除等多项任务。实验结果证明,我们的方法在视觉质量和定量评估方面都具有显著优势。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
CiteScore
8.50
自引率
10.00%
发文量
1060
审稿时长
3.4 months
期刊介绍: Optics & Laser Technology aims to provide a vehicle for the publication of a broad range of high quality research and review papers in those fields of scientific and engineering research appertaining to the development and application of the technology of optics and lasers. Papers describing original work in these areas are submitted to rigorous refereeing prior to acceptance for publication. The scope of Optics & Laser Technology encompasses, but is not restricted to, the following areas: •development in all types of lasers •developments in optoelectronic devices and photonics •developments in new photonics and optical concepts •developments in conventional optics, optical instruments and components •techniques of optical metrology, including interferometry and optical fibre sensors •LIDAR and other non-contact optical measurement techniques, including optical methods in heat and fluid flow •applications of lasers to materials processing, optical NDT display (including holography) and optical communication •research and development in the field of laser safety including studies of hazards resulting from the applications of lasers (laser safety, hazards of laser fume) •developments in optical computing and optical information processing •developments in new optical materials •developments in new optical characterization methods and techniques •developments in quantum optics •developments in light assisted micro and nanofabrication methods and techniques •developments in nanophotonics and biophotonics •developments in imaging processing and systems
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信