{"title":"稀疏信号重构:序列凸松弛、受限空属性和误差边界","authors":"Shujun Bi;Lan Zhou;Shaohua Pan","doi":"10.1109/TIT.2024.3454694","DOIUrl":null,"url":null,"abstract":"For (nearly) sparse signal reconstruction problems, we propose an inexact sequential convex relaxation algorithm (iSCRA-TL1) by constructing the working index set iteratively with a simple and adaptive strategy, and solving inexactly a sequence of truncated \n<inline-formula> <tex-math>$\\ell _{1}$ </tex-math></inline-formula>\n-norm minimization subproblems. A toy example is provided to demonstrate that the exact version of iSCRA-TL1 can successfully reconstruct the true sparse signal, but almost all the present sequential convex relaxation algorithms starting from an optimal solution of the \n<inline-formula> <tex-math>$\\ell _{1}$ </tex-math></inline-formula>\n-norm minimization fail to recover it. To provide theoretical guarantees for iSCRA-TL1, we introduce two new types of null space properties, restricted null space property (RNSP) and sequential restricted null space property (SRNSP), and prove that they are both weaker than the common stable NSP, while their robust versions are not stronger than the existing robust NSP. Then, we justify that under a suitable (robust) SRNSP, iSCRA-TL1 can identify the support of the true r-sparse signal or the index set of the first r largest (in modulus) entries of the true nearly r-sparse signal via at most r truncated \n<inline-formula> <tex-math>$\\ell _{1}$ </tex-math></inline-formula>\n-norm minimization, and the error bound of its final output from the true (nearly) r-sparse signal is also quantified. To the best of our knowledge, this is the first sequential convex relaxation algorithm to recover the support of the true (nearly) sparse signal under a weaker NSP condition within a specific number of steps, provided that the classical \n<inline-formula> <tex-math>$\\ell _{1}$ </tex-math></inline-formula>\n-norm minimization problem lacks the good robustness.","PeriodicalId":13494,"journal":{"name":"IEEE Transactions on Information Theory","volume":"70 11","pages":"8378-8398"},"PeriodicalIF":2.2000,"publicationDate":"2024-09-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Sparse Signal Reconstruction: Sequential Convex Relaxation, Restricted Null Space Property, and Error Bounds\",\"authors\":\"Shujun Bi;Lan Zhou;Shaohua Pan\",\"doi\":\"10.1109/TIT.2024.3454694\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"For (nearly) sparse signal reconstruction problems, we propose an inexact sequential convex relaxation algorithm (iSCRA-TL1) by constructing the working index set iteratively with a simple and adaptive strategy, and solving inexactly a sequence of truncated \\n<inline-formula> <tex-math>$\\\\ell _{1}$ </tex-math></inline-formula>\\n-norm minimization subproblems. A toy example is provided to demonstrate that the exact version of iSCRA-TL1 can successfully reconstruct the true sparse signal, but almost all the present sequential convex relaxation algorithms starting from an optimal solution of the \\n<inline-formula> <tex-math>$\\\\ell _{1}$ </tex-math></inline-formula>\\n-norm minimization fail to recover it. To provide theoretical guarantees for iSCRA-TL1, we introduce two new types of null space properties, restricted null space property (RNSP) and sequential restricted null space property (SRNSP), and prove that they are both weaker than the common stable NSP, while their robust versions are not stronger than the existing robust NSP. Then, we justify that under a suitable (robust) SRNSP, iSCRA-TL1 can identify the support of the true r-sparse signal or the index set of the first r largest (in modulus) entries of the true nearly r-sparse signal via at most r truncated \\n<inline-formula> <tex-math>$\\\\ell _{1}$ </tex-math></inline-formula>\\n-norm minimization, and the error bound of its final output from the true (nearly) r-sparse signal is also quantified. To the best of our knowledge, this is the first sequential convex relaxation algorithm to recover the support of the true (nearly) sparse signal under a weaker NSP condition within a specific number of steps, provided that the classical \\n<inline-formula> <tex-math>$\\\\ell _{1}$ </tex-math></inline-formula>\\n-norm minimization problem lacks the good robustness.\",\"PeriodicalId\":13494,\"journal\":{\"name\":\"IEEE Transactions on Information Theory\",\"volume\":\"70 11\",\"pages\":\"8378-8398\"},\"PeriodicalIF\":2.2000,\"publicationDate\":\"2024-09-05\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Transactions on Information Theory\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10666906/\",\"RegionNum\":3,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"COMPUTER SCIENCE, INFORMATION SYSTEMS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Information Theory","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10666906/","RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
Sparse Signal Reconstruction: Sequential Convex Relaxation, Restricted Null Space Property, and Error Bounds
For (nearly) sparse signal reconstruction problems, we propose an inexact sequential convex relaxation algorithm (iSCRA-TL1) by constructing the working index set iteratively with a simple and adaptive strategy, and solving inexactly a sequence of truncated
$\ell _{1}$
-norm minimization subproblems. A toy example is provided to demonstrate that the exact version of iSCRA-TL1 can successfully reconstruct the true sparse signal, but almost all the present sequential convex relaxation algorithms starting from an optimal solution of the
$\ell _{1}$
-norm minimization fail to recover it. To provide theoretical guarantees for iSCRA-TL1, we introduce two new types of null space properties, restricted null space property (RNSP) and sequential restricted null space property (SRNSP), and prove that they are both weaker than the common stable NSP, while their robust versions are not stronger than the existing robust NSP. Then, we justify that under a suitable (robust) SRNSP, iSCRA-TL1 can identify the support of the true r-sparse signal or the index set of the first r largest (in modulus) entries of the true nearly r-sparse signal via at most r truncated
$\ell _{1}$
-norm minimization, and the error bound of its final output from the true (nearly) r-sparse signal is also quantified. To the best of our knowledge, this is the first sequential convex relaxation algorithm to recover the support of the true (nearly) sparse signal under a weaker NSP condition within a specific number of steps, provided that the classical
$\ell _{1}$
-norm minimization problem lacks the good robustness.
期刊介绍:
The IEEE Transactions on Information Theory is a journal that publishes theoretical and experimental papers concerned with the transmission, processing, and utilization of information. The boundaries of acceptable subject matter are intentionally not sharply delimited. Rather, it is hoped that as the focus of research activity changes, a flexible policy will permit this Transactions to follow suit. Current appropriate topics are best reflected by recent Tables of Contents; they are summarized in the titles of editorial areas that appear on the inside front cover.