{"title":"具有稀疏性正则化的非线性反问题的投影梯度方法","authors":"Zhuguang Zhao, Liang Ding","doi":"10.1515/jiip-2023-0010","DOIUrl":null,"url":null,"abstract":"Abstract The non-convex α ∥ ⋅ ∥ ℓ 1 − β ∥ ⋅ ∥ ℓ 2 \\alpha\\lVert\\,{\\cdot}\\,\\rVert_{\\ell_{1}}-\\beta\\lVert\\,{\\cdot}\\,\\rVert_{\\ell_{2}} ( α ≥ β ≥ 0 \\alpha\\geq\\beta\\geq 0 ) regularization is a new approach for sparse recovery. A minimizer of the α ∥ ⋅ ∥ ℓ 1 − β ∥ ⋅ ∥ ℓ 2 \\alpha\\lVert\\,{\\cdot}\\,\\rVert_{\\ell_{1}}-\\beta\\lVert\\,{\\cdot}\\,\\rVert_{\\ell_{2}} regularized function can be computed by applying the ST-( α ℓ 1 − β ℓ 2 \\alpha\\ell_{1}-\\beta\\ell_{2} ) algorithm which is similar to the classical iterative soft thresholding algorithm (ISTA). Unfortunately, It is known that ISTA converges quite slowly, and a faster alternative to ISTA is the projected gradient (PG) method. Nevertheless, the current applicability of the PG method is limited to linear inverse problems. In this paper, we extend the PG method based on a surrogate function approach to nonlinear inverse problems with the α ∥ ⋅ ∥ ℓ 1 − β ∥ ⋅ ∥ ℓ 2 \\alpha\\lVert\\,{\\cdot}\\,\\rVert_{\\ell_{1}}-\\beta\\lVert\\,{\\cdot}\\,\\rVert_{\\ell_{2}} ( α ≥ β ≥ 0 \\alpha\\geq\\beta\\geq 0 ) regularization in the finite-dimensional space R n \\mathbb{R}^{n} . It is shown that the presented algorithm converges subsequentially to a stationary point of a constrained Tikhonov-type functional for sparsity regularization. Numerical experiments are given in the context of a nonlinear compressive sensing problem to illustrate the efficiency of the proposed approach.","PeriodicalId":50171,"journal":{"name":"Journal of Inverse and Ill-Posed Problems","volume":" ","pages":""},"PeriodicalIF":0.9000,"publicationDate":"2023-07-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A projected gradient method for nonlinear inverse problems with 𝛼ℓ1 − 𝛽ℓ2 sparsity regularization\",\"authors\":\"Zhuguang Zhao, Liang Ding\",\"doi\":\"10.1515/jiip-2023-0010\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Abstract The non-convex α ∥ ⋅ ∥ ℓ 1 − β ∥ ⋅ ∥ ℓ 2 \\\\alpha\\\\lVert\\\\,{\\\\cdot}\\\\,\\\\rVert_{\\\\ell_{1}}-\\\\beta\\\\lVert\\\\,{\\\\cdot}\\\\,\\\\rVert_{\\\\ell_{2}} ( α ≥ β ≥ 0 \\\\alpha\\\\geq\\\\beta\\\\geq 0 ) regularization is a new approach for sparse recovery. A minimizer of the α ∥ ⋅ ∥ ℓ 1 − β ∥ ⋅ ∥ ℓ 2 \\\\alpha\\\\lVert\\\\,{\\\\cdot}\\\\,\\\\rVert_{\\\\ell_{1}}-\\\\beta\\\\lVert\\\\,{\\\\cdot}\\\\,\\\\rVert_{\\\\ell_{2}} regularized function can be computed by applying the ST-( α ℓ 1 − β ℓ 2 \\\\alpha\\\\ell_{1}-\\\\beta\\\\ell_{2} ) algorithm which is similar to the classical iterative soft thresholding algorithm (ISTA). Unfortunately, It is known that ISTA converges quite slowly, and a faster alternative to ISTA is the projected gradient (PG) method. Nevertheless, the current applicability of the PG method is limited to linear inverse problems. In this paper, we extend the PG method based on a surrogate function approach to nonlinear inverse problems with the α ∥ ⋅ ∥ ℓ 1 − β ∥ ⋅ ∥ ℓ 2 \\\\alpha\\\\lVert\\\\,{\\\\cdot}\\\\,\\\\rVert_{\\\\ell_{1}}-\\\\beta\\\\lVert\\\\,{\\\\cdot}\\\\,\\\\rVert_{\\\\ell_{2}} ( α ≥ β ≥ 0 \\\\alpha\\\\geq\\\\beta\\\\geq 0 ) regularization in the finite-dimensional space R n \\\\mathbb{R}^{n} . It is shown that the presented algorithm converges subsequentially to a stationary point of a constrained Tikhonov-type functional for sparsity regularization. Numerical experiments are given in the context of a nonlinear compressive sensing problem to illustrate the efficiency of the proposed approach.\",\"PeriodicalId\":50171,\"journal\":{\"name\":\"Journal of Inverse and Ill-Posed Problems\",\"volume\":\" \",\"pages\":\"\"},\"PeriodicalIF\":0.9000,\"publicationDate\":\"2023-07-25\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Inverse and Ill-Posed Problems\",\"FirstCategoryId\":\"100\",\"ListUrlMain\":\"https://doi.org/10.1515/jiip-2023-0010\",\"RegionNum\":4,\"RegionCategory\":\"数学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"MATHEMATICS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Inverse and Ill-Posed Problems","FirstCategoryId":"100","ListUrlMain":"https://doi.org/10.1515/jiip-2023-0010","RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"MATHEMATICS","Score":null,"Total":0}
A projected gradient method for nonlinear inverse problems with 𝛼ℓ1 − 𝛽ℓ2 sparsity regularization
Abstract The non-convex α ∥ ⋅ ∥ ℓ 1 − β ∥ ⋅ ∥ ℓ 2 \alpha\lVert\,{\cdot}\,\rVert_{\ell_{1}}-\beta\lVert\,{\cdot}\,\rVert_{\ell_{2}} ( α ≥ β ≥ 0 \alpha\geq\beta\geq 0 ) regularization is a new approach for sparse recovery. A minimizer of the α ∥ ⋅ ∥ ℓ 1 − β ∥ ⋅ ∥ ℓ 2 \alpha\lVert\,{\cdot}\,\rVert_{\ell_{1}}-\beta\lVert\,{\cdot}\,\rVert_{\ell_{2}} regularized function can be computed by applying the ST-( α ℓ 1 − β ℓ 2 \alpha\ell_{1}-\beta\ell_{2} ) algorithm which is similar to the classical iterative soft thresholding algorithm (ISTA). Unfortunately, It is known that ISTA converges quite slowly, and a faster alternative to ISTA is the projected gradient (PG) method. Nevertheless, the current applicability of the PG method is limited to linear inverse problems. In this paper, we extend the PG method based on a surrogate function approach to nonlinear inverse problems with the α ∥ ⋅ ∥ ℓ 1 − β ∥ ⋅ ∥ ℓ 2 \alpha\lVert\,{\cdot}\,\rVert_{\ell_{1}}-\beta\lVert\,{\cdot}\,\rVert_{\ell_{2}} ( α ≥ β ≥ 0 \alpha\geq\beta\geq 0 ) regularization in the finite-dimensional space R n \mathbb{R}^{n} . It is shown that the presented algorithm converges subsequentially to a stationary point of a constrained Tikhonov-type functional for sparsity regularization. Numerical experiments are given in the context of a nonlinear compressive sensing problem to illustrate the efficiency of the proposed approach.
期刊介绍:
This journal aims to present original articles on the theory, numerics and applications of inverse and ill-posed problems. These inverse and ill-posed problems arise in mathematical physics and mathematical analysis, geophysics, acoustics, electrodynamics, tomography, medicine, ecology, financial mathematics etc. Articles on the construction and justification of new numerical algorithms of inverse problem solutions are also published.
Issues of the Journal of Inverse and Ill-Posed Problems contain high quality papers which have an innovative approach and topical interest.
The following topics are covered:
Inverse problems
existence and uniqueness theorems
stability estimates
optimization and identification problems
numerical methods
Ill-posed problems
regularization theory
operator equations
integral geometry
Applications
inverse problems in geophysics, electrodynamics and acoustics
inverse problems in ecology
inverse and ill-posed problems in medicine
mathematical problems of tomography