基于早期停止镜像下降的噪声稀疏相位检索的近似极小极大最优速率

IF 1.4 4区 数学 Q2 MATHEMATICS, APPLIED
Fan Wu;Patrick Rebeschini
{"title":"基于早期停止镜像下降的噪声稀疏相位检索的近似极小极大最优速率","authors":"Fan Wu;Patrick Rebeschini","doi":"10.1093/imaiai/iaac024","DOIUrl":null,"url":null,"abstract":"This paper studies early-stopped mirror descent applied to noisy sparse phase retrieval, which is the problem of recovering a \n<tex>$k$</tex>\n-sparse signal \n<tex>$\\textbf{x}^\\star \\in{\\mathbb{R}}^n$</tex>\n from a set of quadratic Gaussian measurements corrupted by sub-exponential noise. We consider the (non-convex) unregularized empirical risk minimization problem and show that early-stopped mirror descent, when equipped with the hypentropy mirror map and proper initialization, achieves a nearly minimax-optimal rate of convergence, provided the sample size is at least of order \n<tex>$k^2$</tex>\n (modulo logarithmic term) and the minimum (in modulus) non-zero entry of the signal is on the order of \n<tex>$\\|\\textbf{x}^\\star \\|_2/\\sqrt{k}$</tex>\n. Our theory leads to a simple algorithm that does not rely on explicit regularization or thresholding steps to promote sparsity. More generally, our results establish a connection between mirror descent and sparsity in the non-convex problem of noisy sparse phase retrieval, adding to the literature on early stopping that has mostly focused on non-sparse, Euclidean and convex settings via gradient descent. Our proof combines a potential-based analysis of mirror descent with a quantitative control on a variational coherence property that we establish along the path of mirror descent, up to a prescribed stopping time.","PeriodicalId":45437,"journal":{"name":"Information and Inference-A Journal of the Ima","volume":"12 2","pages":"633-713"},"PeriodicalIF":1.4000,"publicationDate":"2022-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/iel7/8016800/10058586/10058608.pdf","citationCount":"0","resultStr":"{\"title\":\"Nearly minimax-optimal rates for noisy sparse phase retrieval via early-stopped mirror descent\",\"authors\":\"Fan Wu;Patrick Rebeschini\",\"doi\":\"10.1093/imaiai/iaac024\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"This paper studies early-stopped mirror descent applied to noisy sparse phase retrieval, which is the problem of recovering a \\n<tex>$k$</tex>\\n-sparse signal \\n<tex>$\\\\textbf{x}^\\\\star \\\\in{\\\\mathbb{R}}^n$</tex>\\n from a set of quadratic Gaussian measurements corrupted by sub-exponential noise. We consider the (non-convex) unregularized empirical risk minimization problem and show that early-stopped mirror descent, when equipped with the hypentropy mirror map and proper initialization, achieves a nearly minimax-optimal rate of convergence, provided the sample size is at least of order \\n<tex>$k^2$</tex>\\n (modulo logarithmic term) and the minimum (in modulus) non-zero entry of the signal is on the order of \\n<tex>$\\\\|\\\\textbf{x}^\\\\star \\\\|_2/\\\\sqrt{k}$</tex>\\n. Our theory leads to a simple algorithm that does not rely on explicit regularization or thresholding steps to promote sparsity. More generally, our results establish a connection between mirror descent and sparsity in the non-convex problem of noisy sparse phase retrieval, adding to the literature on early stopping that has mostly focused on non-sparse, Euclidean and convex settings via gradient descent. Our proof combines a potential-based analysis of mirror descent with a quantitative control on a variational coherence property that we establish along the path of mirror descent, up to a prescribed stopping time.\",\"PeriodicalId\":45437,\"journal\":{\"name\":\"Information and Inference-A Journal of the Ima\",\"volume\":\"12 2\",\"pages\":\"633-713\"},\"PeriodicalIF\":1.4000,\"publicationDate\":\"2022-08-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://ieeexplore.ieee.org/iel7/8016800/10058586/10058608.pdf\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Information and Inference-A Journal of the Ima\",\"FirstCategoryId\":\"100\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10058608/\",\"RegionNum\":4,\"RegionCategory\":\"数学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"MATHEMATICS, APPLIED\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Information and Inference-A Journal of the Ima","FirstCategoryId":"100","ListUrlMain":"https://ieeexplore.ieee.org/document/10058608/","RegionNum":4,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"MATHEMATICS, APPLIED","Score":null,"Total":0}
引用次数: 0

摘要

本文研究了应用于噪声稀疏相位检索的早期停止镜像下降,这是从一组被亚指数噪声破坏的二次高斯测量中恢复$k$-稀疏信号$\textbf{x}^\star\in{\mathbb{R}}^n$的问题。我们考虑了(非凸)非规则经验风险最小化问题,并表明当配备有高熵镜像图和适当的初始化时,早期停止镜像下降实现了几乎最小最大的最优收敛速度,假设样本大小至少为$k^2$阶(模对数项),并且信号的最小(以模为单位)非零项为$\|\textbf{x}^\star\|_2/\sqrt{k}$阶。我们的理论导致了一种简单的算法,该算法不依赖于显式正则化或阈值步骤来提高稀疏性。更普遍地说,我们的结果在噪声稀疏相位检索的非凸问题中建立了镜像下降和稀疏性之间的联系,增加了早期停止的文献,该文献主要关注通过梯度下降的非稀疏、欧几里得和凸设置。我们的证明将基于势的镜像下降分析与我们沿着镜像下降路径建立的变分相干性质的定量控制相结合,直到规定的停止时间。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Nearly minimax-optimal rates for noisy sparse phase retrieval via early-stopped mirror descent
This paper studies early-stopped mirror descent applied to noisy sparse phase retrieval, which is the problem of recovering a $k$ -sparse signal $\textbf{x}^\star \in{\mathbb{R}}^n$ from a set of quadratic Gaussian measurements corrupted by sub-exponential noise. We consider the (non-convex) unregularized empirical risk minimization problem and show that early-stopped mirror descent, when equipped with the hypentropy mirror map and proper initialization, achieves a nearly minimax-optimal rate of convergence, provided the sample size is at least of order $k^2$ (modulo logarithmic term) and the minimum (in modulus) non-zero entry of the signal is on the order of $\|\textbf{x}^\star \|_2/\sqrt{k}$ . Our theory leads to a simple algorithm that does not rely on explicit regularization or thresholding steps to promote sparsity. More generally, our results establish a connection between mirror descent and sparsity in the non-convex problem of noisy sparse phase retrieval, adding to the literature on early stopping that has mostly focused on non-sparse, Euclidean and convex settings via gradient descent. Our proof combines a potential-based analysis of mirror descent with a quantitative control on a variational coherence property that we establish along the path of mirror descent, up to a prescribed stopping time.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
CiteScore
3.90
自引率
0.00%
发文量
28
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信