具有稀疏性正则化的非线性反问题的投影梯度方法

IF 0.9 4区 数学 Q2 MATHEMATICS
Zhuguang Zhao, Liang Ding
{"title":"具有稀疏性正则化的非线性反问题的投影梯度方法","authors":"Zhuguang Zhao, Liang Ding","doi":"10.1515/jiip-2023-0010","DOIUrl":null,"url":null,"abstract":"Abstract The non-convex α ⁢ ∥ ⋅ ∥ ℓ 1 − β ⁢ ∥ ⋅ ∥ ℓ 2 \\alpha\\lVert\\,{\\cdot}\\,\\rVert_{\\ell_{1}}-\\beta\\lVert\\,{\\cdot}\\,\\rVert_{\\ell_{2}} ( α ≥ β ≥ 0 \\alpha\\geq\\beta\\geq 0 ) regularization is a new approach for sparse recovery. A minimizer of the α ⁢ ∥ ⋅ ∥ ℓ 1 − β ⁢ ∥ ⋅ ∥ ℓ 2 \\alpha\\lVert\\,{\\cdot}\\,\\rVert_{\\ell_{1}}-\\beta\\lVert\\,{\\cdot}\\,\\rVert_{\\ell_{2}} regularized function can be computed by applying the ST-( α ⁢ ℓ 1 − β ⁢ ℓ 2 \\alpha\\ell_{1}-\\beta\\ell_{2} ) algorithm which is similar to the classical iterative soft thresholding algorithm (ISTA). Unfortunately, It is known that ISTA converges quite slowly, and a faster alternative to ISTA is the projected gradient (PG) method. Nevertheless, the current applicability of the PG method is limited to linear inverse problems. In this paper, we extend the PG method based on a surrogate function approach to nonlinear inverse problems with the α ⁢ ∥ ⋅ ∥ ℓ 1 − β ⁢ ∥ ⋅ ∥ ℓ 2 \\alpha\\lVert\\,{\\cdot}\\,\\rVert_{\\ell_{1}}-\\beta\\lVert\\,{\\cdot}\\,\\rVert_{\\ell_{2}} ( α ≥ β ≥ 0 \\alpha\\geq\\beta\\geq 0 ) regularization in the finite-dimensional space R n \\mathbb{R}^{n} . It is shown that the presented algorithm converges subsequentially to a stationary point of a constrained Tikhonov-type functional for sparsity regularization. Numerical experiments are given in the context of a nonlinear compressive sensing problem to illustrate the efficiency of the proposed approach.","PeriodicalId":50171,"journal":{"name":"Journal of Inverse and Ill-Posed Problems","volume":" ","pages":""},"PeriodicalIF":0.9000,"publicationDate":"2023-07-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A projected gradient method for nonlinear inverse problems with 𝛼ℓ1 − 𝛽ℓ2 sparsity regularization\",\"authors\":\"Zhuguang Zhao, Liang Ding\",\"doi\":\"10.1515/jiip-2023-0010\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Abstract The non-convex α ⁢ ∥ ⋅ ∥ ℓ 1 − β ⁢ ∥ ⋅ ∥ ℓ 2 \\\\alpha\\\\lVert\\\\,{\\\\cdot}\\\\,\\\\rVert_{\\\\ell_{1}}-\\\\beta\\\\lVert\\\\,{\\\\cdot}\\\\,\\\\rVert_{\\\\ell_{2}} ( α ≥ β ≥ 0 \\\\alpha\\\\geq\\\\beta\\\\geq 0 ) regularization is a new approach for sparse recovery. A minimizer of the α ⁢ ∥ ⋅ ∥ ℓ 1 − β ⁢ ∥ ⋅ ∥ ℓ 2 \\\\alpha\\\\lVert\\\\,{\\\\cdot}\\\\,\\\\rVert_{\\\\ell_{1}}-\\\\beta\\\\lVert\\\\,{\\\\cdot}\\\\,\\\\rVert_{\\\\ell_{2}} regularized function can be computed by applying the ST-( α ⁢ ℓ 1 − β ⁢ ℓ 2 \\\\alpha\\\\ell_{1}-\\\\beta\\\\ell_{2} ) algorithm which is similar to the classical iterative soft thresholding algorithm (ISTA). Unfortunately, It is known that ISTA converges quite slowly, and a faster alternative to ISTA is the projected gradient (PG) method. Nevertheless, the current applicability of the PG method is limited to linear inverse problems. In this paper, we extend the PG method based on a surrogate function approach to nonlinear inverse problems with the α ⁢ ∥ ⋅ ∥ ℓ 1 − β ⁢ ∥ ⋅ ∥ ℓ 2 \\\\alpha\\\\lVert\\\\,{\\\\cdot}\\\\,\\\\rVert_{\\\\ell_{1}}-\\\\beta\\\\lVert\\\\,{\\\\cdot}\\\\,\\\\rVert_{\\\\ell_{2}} ( α ≥ β ≥ 0 \\\\alpha\\\\geq\\\\beta\\\\geq 0 ) regularization in the finite-dimensional space R n \\\\mathbb{R}^{n} . It is shown that the presented algorithm converges subsequentially to a stationary point of a constrained Tikhonov-type functional for sparsity regularization. Numerical experiments are given in the context of a nonlinear compressive sensing problem to illustrate the efficiency of the proposed approach.\",\"PeriodicalId\":50171,\"journal\":{\"name\":\"Journal of Inverse and Ill-Posed Problems\",\"volume\":\" \",\"pages\":\"\"},\"PeriodicalIF\":0.9000,\"publicationDate\":\"2023-07-25\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Inverse and Ill-Posed Problems\",\"FirstCategoryId\":\"100\",\"ListUrlMain\":\"https://doi.org/10.1515/jiip-2023-0010\",\"RegionNum\":4,\"RegionCategory\":\"数学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"MATHEMATICS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Inverse and Ill-Posed Problems","FirstCategoryId":"100","ListUrlMain":"https://doi.org/10.1515/jiip-2023-0010","RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"MATHEMATICS","Score":null,"Total":0}
引用次数: 0

摘要

摘要:非凸α¹∥∑·∥∑1−β∑∥∑2 \alpha\lVert\,{\cdot}\,\rVert_{\ell_{1}}-\beta\lVert\,{\cdot}\,\rVert_{\ell_{2}} (α≥β≥0 \alpha\geq\beta\geq 正则化是稀疏恢复的一种新方法。一个最小化的α¹∥∑1−β∑∥∑2 \alpha\lVert\,{\cdot}\,\rVert_{\ell_{1}}-\beta\lVert\,{\cdot}\,\rVert_{\ell_{2}} 正则函数可以通过应用ST-(α _1 - β _2)来计算 \alpha\ell_{1}-\beta\ell_{2} )算法,该算法类似于经典的迭代软阈值算法(ISTA)。不幸的是,众所周知,ISTA的收敛速度很慢,而比ISTA更快的替代方法是投影梯度(PG)方法。然而,目前PG方法的适用性仅限于线性逆问题。本文将基于代理函数方法的PG方法推广到具有α¹∥∑1−β∑∥∑2的非线性反问题 \alpha\lVert\,{\cdot}\,\rVert_{\ell_{1}}-\beta\lVert\,{\cdot}\,\rVert_{\ell_{2}} (α≥β≥0 \alpha\geq\beta\geq 0)有限维空间rn中的正则化 \mathbb{R}^{n} 。结果表明,该算法收敛于稀疏正则化约束tikhonov型泛函的一个平稳点。在一个非线性压缩感知问题的背景下,给出了数值实验来说明该方法的有效性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
A projected gradient method for nonlinear inverse problems with 𝛼ℓ1 − 𝛽ℓ2 sparsity regularization
Abstract The non-convex α ⁢ ∥ ⋅ ∥ ℓ 1 − β ⁢ ∥ ⋅ ∥ ℓ 2 \alpha\lVert\,{\cdot}\,\rVert_{\ell_{1}}-\beta\lVert\,{\cdot}\,\rVert_{\ell_{2}} ( α ≥ β ≥ 0 \alpha\geq\beta\geq 0 ) regularization is a new approach for sparse recovery. A minimizer of the α ⁢ ∥ ⋅ ∥ ℓ 1 − β ⁢ ∥ ⋅ ∥ ℓ 2 \alpha\lVert\,{\cdot}\,\rVert_{\ell_{1}}-\beta\lVert\,{\cdot}\,\rVert_{\ell_{2}} regularized function can be computed by applying the ST-( α ⁢ ℓ 1 − β ⁢ ℓ 2 \alpha\ell_{1}-\beta\ell_{2} ) algorithm which is similar to the classical iterative soft thresholding algorithm (ISTA). Unfortunately, It is known that ISTA converges quite slowly, and a faster alternative to ISTA is the projected gradient (PG) method. Nevertheless, the current applicability of the PG method is limited to linear inverse problems. In this paper, we extend the PG method based on a surrogate function approach to nonlinear inverse problems with the α ⁢ ∥ ⋅ ∥ ℓ 1 − β ⁢ ∥ ⋅ ∥ ℓ 2 \alpha\lVert\,{\cdot}\,\rVert_{\ell_{1}}-\beta\lVert\,{\cdot}\,\rVert_{\ell_{2}} ( α ≥ β ≥ 0 \alpha\geq\beta\geq 0 ) regularization in the finite-dimensional space R n \mathbb{R}^{n} . It is shown that the presented algorithm converges subsequentially to a stationary point of a constrained Tikhonov-type functional for sparsity regularization. Numerical experiments are given in the context of a nonlinear compressive sensing problem to illustrate the efficiency of the proposed approach.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Journal of Inverse and Ill-Posed Problems
Journal of Inverse and Ill-Posed Problems MATHEMATICS, APPLIED-MATHEMATICS
CiteScore
2.60
自引率
9.10%
发文量
48
审稿时长
>12 weeks
期刊介绍: This journal aims to present original articles on the theory, numerics and applications of inverse and ill-posed problems. These inverse and ill-posed problems arise in mathematical physics and mathematical analysis, geophysics, acoustics, electrodynamics, tomography, medicine, ecology, financial mathematics etc. Articles on the construction and justification of new numerical algorithms of inverse problem solutions are also published. Issues of the Journal of Inverse and Ill-Posed Problems contain high quality papers which have an innovative approach and topical interest. The following topics are covered: Inverse problems existence and uniqueness theorems stability estimates optimization and identification problems numerical methods Ill-posed problems regularization theory operator equations integral geometry Applications inverse problems in geophysics, electrodynamics and acoustics inverse problems in ecology inverse and ill-posed problems in medicine mathematical problems of tomography
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信