{"title":"A fast block sparse Kaczmarz algorithm for sparse signal recovery","authors":"Yu-Qi Niu, Bing Zheng","doi":"10.1016/j.sigpro.2024.109736","DOIUrl":null,"url":null,"abstract":"<div><div>The randomized sparse Kaczmarz (RSK) method is an iterative algorithm for computing sparse solutions of linear systems. Recently, Tondji and Lorenz analyzed the parallel version of the RSK method and established its linear expected convergence by implementing a randomized control scheme for subset selection at each iteration. Expanding upon this groundwork, we explore a natural extension of the randomized control scheme: greedy strategies such as the Motzkin criteria. Specifically, we propose a fast block sparse Kaczmarz algorithm based on the Motzkin criterion. It is proved that the proposed method converges linearly to the sparse solutions of the linear systems. Additionally, we offer error estimates for linear systems with noisy right-hand sides, and show that the proposed method converges within an error threshold of the noise level. Numerical results substantiate the feasibility of our proposed method and highlight its superior convergence rate compared to the parallel version of the RSK method.</div></div>","PeriodicalId":49523,"journal":{"name":"Signal Processing","volume":"227 ","pages":"Article 109736"},"PeriodicalIF":3.4000,"publicationDate":"2024-10-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Signal Processing","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0165168424003566","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0
Abstract
The randomized sparse Kaczmarz (RSK) method is an iterative algorithm for computing sparse solutions of linear systems. Recently, Tondji and Lorenz analyzed the parallel version of the RSK method and established its linear expected convergence by implementing a randomized control scheme for subset selection at each iteration. Expanding upon this groundwork, we explore a natural extension of the randomized control scheme: greedy strategies such as the Motzkin criteria. Specifically, we propose a fast block sparse Kaczmarz algorithm based on the Motzkin criterion. It is proved that the proposed method converges linearly to the sparse solutions of the linear systems. Additionally, we offer error estimates for linear systems with noisy right-hand sides, and show that the proposed method converges within an error threshold of the noise level. Numerical results substantiate the feasibility of our proposed method and highlight its superior convergence rate compared to the parallel version of the RSK method.
期刊介绍:
Signal Processing incorporates all aspects of the theory and practice of signal processing. It features original research work, tutorial and review articles, and accounts of practical developments. It is intended for a rapid dissemination of knowledge and experience to engineers and scientists working in the research, development or practical application of signal processing.
Subject areas covered by the journal include: Signal Theory; Stochastic Processes; Detection and Estimation; Spectral Analysis; Filtering; Signal Processing Systems; Software Developments; Image Processing; Pattern Recognition; Optical Signal Processing; Digital Signal Processing; Multi-dimensional Signal Processing; Communication Signal Processing; Biomedical Signal Processing; Geophysical and Astrophysical Signal Processing; Earth Resources Signal Processing; Acoustic and Vibration Signal Processing; Data Processing; Remote Sensing; Signal Processing Technology; Radar Signal Processing; Sonar Signal Processing; Industrial Applications; New Applications.