The Iterates of the Frank–Wolfe Algorithm May Not Converge

IF 16.4 1区 化学 Q1 CHEMISTRY, MULTIDISCIPLINARY
Jérôme Bolte, Cyrille W. Combettes, Edouard Pauwels
{"title":"The Iterates of the Frank–Wolfe Algorithm May Not Converge","authors":"Jérôme Bolte, Cyrille W. Combettes, Edouard Pauwels","doi":"10.1287/moor.2022.0057","DOIUrl":null,"url":null,"abstract":"The Frank–Wolfe algorithm is a popular method for minimizing a smooth convex function f over a compact convex set [Formula: see text]. Whereas many convergence results have been derived in terms of function values, almost nothing is known about the convergence behavior of the sequence of iterates [Formula: see text]. Under the usual assumptions, we design several counterexamples to the convergence of [Formula: see text], where f is d-time continuously differentiable, [Formula: see text], and [Formula: see text]. Our counterexamples cover the cases of open-loop, closed-loop, and line-search step-size strategies and work for any choice of the linear minimization oracle, thus demonstrating the fundamental pathologies in the convergence behavior of [Formula: see text].Funding: The authors acknowledge the support of the AI Interdisciplinary Institute ANITI funding through the French “Investments for the Future – PIA3” program under the Agence Nationale de la Recherche (ANR) agreement [Grant ANR-19-PI3A0004], the Air Force Office of Scientific Research, Air Force Material Command, U.S. Air Force [Grants FA866-22-1-7012 and ANR MaSDOL 19-CE23-0017-0], ANR Chess [Grant ANR-17-EURE-0010], ANR Regulia, and Centre Lagrange.","PeriodicalId":1,"journal":{"name":"Accounts of Chemical Research","volume":null,"pages":null},"PeriodicalIF":16.4000,"publicationDate":"2023-12-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Accounts of Chemical Research","FirstCategoryId":"100","ListUrlMain":"https://doi.org/10.1287/moor.2022.0057","RegionNum":1,"RegionCategory":"化学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"CHEMISTRY, MULTIDISCIPLINARY","Score":null,"Total":0}
引用次数: 0

Abstract

The Frank–Wolfe algorithm is a popular method for minimizing a smooth convex function f over a compact convex set [Formula: see text]. Whereas many convergence results have been derived in terms of function values, almost nothing is known about the convergence behavior of the sequence of iterates [Formula: see text]. Under the usual assumptions, we design several counterexamples to the convergence of [Formula: see text], where f is d-time continuously differentiable, [Formula: see text], and [Formula: see text]. Our counterexamples cover the cases of open-loop, closed-loop, and line-search step-size strategies and work for any choice of the linear minimization oracle, thus demonstrating the fundamental pathologies in the convergence behavior of [Formula: see text].Funding: The authors acknowledge the support of the AI Interdisciplinary Institute ANITI funding through the French “Investments for the Future – PIA3” program under the Agence Nationale de la Recherche (ANR) agreement [Grant ANR-19-PI3A0004], the Air Force Office of Scientific Research, Air Force Material Command, U.S. Air Force [Grants FA866-22-1-7012 and ANR MaSDOL 19-CE23-0017-0], ANR Chess [Grant ANR-17-EURE-0010], ANR Regulia, and Centre Lagrange.
弗兰克-沃尔夫算法的迭代可能不会收敛
弗兰克-沃尔夫算法是在紧凑凸集上最小化光滑凸函数 f 的常用方法[公式:见正文]。虽然许多收敛结果都是根据函数值推导出来的,但对迭代序列的收敛行为几乎一无所知[公式:见正文]。在通常的假设条件下,我们设计了几个反例来证明 f 为 d 时连续可微分的[公式:见正文]、[公式:见正文]和[公式:见正文]的收敛性。我们的反例涵盖了开环、闭环和线性搜索步长策略的情况,并且适用于任何线性最小化神谕的选择,从而证明了[公式:见正文]收敛行为的基本病理:作者感谢人工智能跨学科研究所ANITI通过法国国家研究署(ANR)协议下的 "未来投资-PIA3 "计划[赠款ANR-19-PI3A0004]、美国空军材料司令部空军科学研究办公室[赠款FA866-22-1-7012和ANR MaSDOL 19-CE23-0017-0]、ANR国际象棋[赠款ANR-17-EURE-0010]、ANR Regulia和拉格朗日中心提供的资助。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Accounts of Chemical Research
Accounts of Chemical Research 化学-化学综合
CiteScore
31.40
自引率
1.10%
发文量
312
审稿时长
2 months
期刊介绍: Accounts of Chemical Research presents short, concise and critical articles offering easy-to-read overviews of basic research and applications in all areas of chemistry and biochemistry. These short reviews focus on research from the author’s own laboratory and are designed to teach the reader about a research project. In addition, Accounts of Chemical Research publishes commentaries that give an informed opinion on a current research problem. Special Issues online are devoted to a single topic of unusual activity and significance. Accounts of Chemical Research replaces the traditional article abstract with an article "Conspectus." These entries synopsize the research affording the reader a closer look at the content and significance of an article. Through this provision of a more detailed description of the article contents, the Conspectus enhances the article's discoverability by search engines and the exposure for the research.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信