Uniform Recovery Guarantees for Quantized Corrupted Sensing Using Structured or Generative Priors

IF 2.1 3区 数学 Q3 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE
Junren Chen, Zhaoqiang Liu, Meng Ding, Michael K. Ng
{"title":"Uniform Recovery Guarantees for Quantized Corrupted Sensing Using Structured or Generative Priors","authors":"Junren Chen, Zhaoqiang Liu, Meng Ding, Michael K. Ng","doi":"10.1137/23m1578358","DOIUrl":null,"url":null,"abstract":"SIAM Journal on Imaging Sciences, Volume 17, Issue 3, Page 1909-1977, September 2024. <br/> Abstract.This paper studies quantized corrupted sensing where the measurements are contaminated by unknown corruption and then quantized by a dithered uniform quantizer. We establish uniform guarantees for Lasso that ensure the accurate recovery of all signals and corruptions using a single draw of the sub-Gaussian sensing matrix and uniform dither. For signal and corruption with structured priors (e.g., sparsity, low-rankness), our uniform error rate for constrained Lasso typically coincides with the nonuniform one up to logarithmic factors, indicating that the uniformity costs very little. By contrast, our uniform error rate for unconstrained Lasso exhibits worse dependence on the structured parameters due to regularization parameters larger than the ones for nonuniform recovery. These results complement the nonuniform ones recently obtained in Sun, Cui, and Liu [IEEE Trans. Signal Process., 70 (2022), pp. 600–615] and provide more insights for understanding actual applications where the sensing ensemble is typically fixed and the corruption may be adversarial. For signal and corruption living in the ranges of some Lipschitz continuous generative models (referred to as generative priors), we achieve uniform recovery via constrained Lasso with a measurement number proportional to the latent dimensions of the generative models. We present experimental results to corroborate our theories. From the technical side, our treatments to the two kinds of priors are (nearly) unified and share the common key ingredients of a (global) quantized product embedding (QPE) property, which states that the dithered uniform quantization (universally) preserves the inner product. As a by-product, our QPE result refines the one in Xu and Jacques [Inf. Inference, 9 (2020), pp. 543–586] under the sub-Gaussian random matrix, and in this specific instance, we are able to sharpen the uniform error decaying rate (for the projected back-projection estimator with signals in some convex symmetric set) presented therein from [math] to [math].","PeriodicalId":49528,"journal":{"name":"SIAM Journal on Imaging Sciences","volume":"35 1","pages":""},"PeriodicalIF":2.1000,"publicationDate":"2024-09-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"SIAM Journal on Imaging Sciences","FirstCategoryId":"100","ListUrlMain":"https://doi.org/10.1137/23m1578358","RegionNum":3,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0

Abstract

SIAM Journal on Imaging Sciences, Volume 17, Issue 3, Page 1909-1977, September 2024.
Abstract.This paper studies quantized corrupted sensing where the measurements are contaminated by unknown corruption and then quantized by a dithered uniform quantizer. We establish uniform guarantees for Lasso that ensure the accurate recovery of all signals and corruptions using a single draw of the sub-Gaussian sensing matrix and uniform dither. For signal and corruption with structured priors (e.g., sparsity, low-rankness), our uniform error rate for constrained Lasso typically coincides with the nonuniform one up to logarithmic factors, indicating that the uniformity costs very little. By contrast, our uniform error rate for unconstrained Lasso exhibits worse dependence on the structured parameters due to regularization parameters larger than the ones for nonuniform recovery. These results complement the nonuniform ones recently obtained in Sun, Cui, and Liu [IEEE Trans. Signal Process., 70 (2022), pp. 600–615] and provide more insights for understanding actual applications where the sensing ensemble is typically fixed and the corruption may be adversarial. For signal and corruption living in the ranges of some Lipschitz continuous generative models (referred to as generative priors), we achieve uniform recovery via constrained Lasso with a measurement number proportional to the latent dimensions of the generative models. We present experimental results to corroborate our theories. From the technical side, our treatments to the two kinds of priors are (nearly) unified and share the common key ingredients of a (global) quantized product embedding (QPE) property, which states that the dithered uniform quantization (universally) preserves the inner product. As a by-product, our QPE result refines the one in Xu and Jacques [Inf. Inference, 9 (2020), pp. 543–586] under the sub-Gaussian random matrix, and in this specific instance, we are able to sharpen the uniform error decaying rate (for the projected back-projection estimator with signals in some convex symmetric set) presented therein from [math] to [math].
使用结构先验或生成先验为量化损坏传感提供统一恢复保证
SIAM 影像科学杂志》,第 17 卷第 3 期,第 1909-1977 页,2024 年 9 月。 摘要:本文研究的是量化损坏传感,即测量被未知损坏污染,然后被抖动均匀量化器量化。我们为 Lasso 建立了统一保证,确保使用亚高斯传感矩阵的单次绘制和统一抖动准确恢复所有信号和损坏。对于具有结构化先验(如稀疏性、低秩性)的信号和损坏,我们的受约束 Lasso 统一错误率通常与非统一错误率重合到对数因子,这表明统一性的成本非常低。相比之下,由于正则化参数大于非均匀恢复的参数,我们的无约束拉索均匀误差率对结构参数的依赖性更差。这些结果补充了 Sun、Cui 和 Liu [IEEE Trans. Signal Process.对于处于某些 Lipschitz 连续生成模型(称为生成先验)范围内的信号和损坏,我们通过约束 Lasso 实现均匀恢复,测量次数与生成模型的潜在维度成正比。我们提出了实验结果来证实我们的理论。从技术层面来看,我们对这两种先验的处理方法(几乎)是统一的,并共享(全局)量化乘积嵌入(QPE)属性的共同关键要素,即抖动均匀量化(普遍)保留了内积。作为副产品,我们的 QPE 结果完善了 Xu 和 Jacques [Inf. Inference, 9 (2020), pp.
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
SIAM Journal on Imaging Sciences
SIAM Journal on Imaging Sciences COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE-COMPUTER SCIENCE, SOFTWARE ENGINEERING
CiteScore
3.80
自引率
4.80%
发文量
58
审稿时长
>12 weeks
期刊介绍: SIAM Journal on Imaging Sciences (SIIMS) covers all areas of imaging sciences, broadly interpreted. It includes image formation, image processing, image analysis, image interpretation and understanding, imaging-related machine learning, and inverse problems in imaging; leading to applications to diverse areas in science, medicine, engineering, and other fields. The journal’s scope is meant to be broad enough to include areas now organized under the terms image processing, image analysis, computer graphics, computer vision, visual machine learning, and visualization. Formal approaches, at the level of mathematics and/or computations, as well as state-of-the-art practical results, are expected from manuscripts published in SIIMS. SIIMS is mathematically and computationally based, and offers a unique forum to highlight the commonality of methodology, models, and algorithms among diverse application areas of imaging sciences. SIIMS provides a broad authoritative source for fundamental results in imaging sciences, with a unique combination of mathematics and applications. SIIMS covers a broad range of areas, including but not limited to image formation, image processing, image analysis, computer graphics, computer vision, visualization, image understanding, pattern analysis, machine intelligence, remote sensing, geoscience, signal processing, medical and biomedical imaging, and seismic imaging. The fundamental mathematical theories addressing imaging problems covered by SIIMS include, but are not limited to, harmonic analysis, partial differential equations, differential geometry, numerical analysis, information theory, learning, optimization, statistics, and probability. Research papers that innovate both in the fundamentals and in the applications are especially welcome. SIIMS focuses on conceptually new ideas, methods, and fundamentals as applied to all aspects of imaging sciences.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信