{"title":"A new primal-dual hybrid gradient scheme for solving minimax problems with nonlinear term","authors":"Renkai Wu, Zexian Liu","doi":"10.1016/j.apnum.2024.12.010","DOIUrl":null,"url":null,"abstract":"<div><div>Primal-dual hybrid gradient (PDHG) methods are popular for solving minimax problems. The proximal terms in the corresponding subproblems play an important role in the convergence analysis and for numerical performance of PDHG methods. However, it is observed that the function values generated by some PDHG algorithms might suffer from intense oscillation as the iteration progresses. To address the drawback, we take advantage of an inertial point to exploit a new proximal term, construct a new quadratic approximation for the nonlinear term in the minimax problem, and present a new primal-dual hybrid gradient algorithm for solving minimax problems with nonlinear terms. The new proximal term is different from other commonly used proximal terms and is used in the <em>x</em>-subproblem of the proposed algorithm. The quadratic approximation is used to replace the common linear approximation in the subproblem of the proposed algorithm to accelerate the proposed method. The local convergence of the proposed algorithm is established under mild assumptions. Numerical experiments on two examples confirm the compelling numerical performance of the proposed method.</div></div>","PeriodicalId":8199,"journal":{"name":"Applied Numerical Mathematics","volume":"210 ","pages":"Pages 147-164"},"PeriodicalIF":2.2000,"publicationDate":"2024-12-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Applied Numerical Mathematics","FirstCategoryId":"100","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0168927424003519","RegionNum":2,"RegionCategory":"数学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"MATHEMATICS, APPLIED","Score":null,"Total":0}
引用次数: 0
Abstract
Primal-dual hybrid gradient (PDHG) methods are popular for solving minimax problems. The proximal terms in the corresponding subproblems play an important role in the convergence analysis and for numerical performance of PDHG methods. However, it is observed that the function values generated by some PDHG algorithms might suffer from intense oscillation as the iteration progresses. To address the drawback, we take advantage of an inertial point to exploit a new proximal term, construct a new quadratic approximation for the nonlinear term in the minimax problem, and present a new primal-dual hybrid gradient algorithm for solving minimax problems with nonlinear terms. The new proximal term is different from other commonly used proximal terms and is used in the x-subproblem of the proposed algorithm. The quadratic approximation is used to replace the common linear approximation in the subproblem of the proposed algorithm to accelerate the proposed method. The local convergence of the proposed algorithm is established under mild assumptions. Numerical experiments on two examples confirm the compelling numerical performance of the proposed method.
期刊介绍:
The purpose of the journal is to provide a forum for the publication of high quality research and tutorial papers in computational mathematics. In addition to the traditional issues and problems in numerical analysis, the journal also publishes papers describing relevant applications in such fields as physics, fluid dynamics, engineering and other branches of applied science with a computational mathematics component. The journal strives to be flexible in the type of papers it publishes and their format. Equally desirable are:
(i) Full papers, which should be complete and relatively self-contained original contributions with an introduction that can be understood by the broad computational mathematics community. Both rigorous and heuristic styles are acceptable. Of particular interest are papers about new areas of research, in which other than strictly mathematical arguments may be important in establishing a basis for further developments.
(ii) Tutorial review papers, covering some of the important issues in Numerical Mathematics, Scientific Computing and their Applications. The journal will occasionally publish contributions which are larger than the usual format for regular papers.
(iii) Short notes, which present specific new results and techniques in a brief communication.