{"title":"带线性约束的复合凸优化的自适应参数加速原始二元方法","authors":"Xin He","doi":"10.1016/j.apnum.2024.05.021","DOIUrl":null,"url":null,"abstract":"<div><p>In this paper, we introduce two accelerated primal-dual methods tailored to address linearly constrained composite convex optimization problems, where the objective function is expressed as the sum of a possibly nondifferentiable function and a differentiable function with Lipschitz continuous gradient. The first method is the accelerated linearized augmented Lagrangian method (ALALM), which permits linearization to the differentiable function; the second method is the accelerated linearized proximal point algorithm (ALPPA), which enables linearization of both the differentiable function and the augmented term. By incorporating adaptive parameters, we demonstrate that ALALM achieves the <span><math><mi>O</mi><mo>(</mo><mn>1</mn><mo>/</mo><msup><mrow><mi>k</mi></mrow><mrow><mn>2</mn></mrow></msup><mo>)</mo></math></span> convergence rate and the linear convergence rate under the assumption of convexity and strong convexity, respectively. Additionally, we establish that ALPPA enjoys the <span><math><mi>O</mi><mo>(</mo><mn>1</mn><mo>/</mo><mi>k</mi><mo>)</mo></math></span> convergence rate in convex case and the <span><math><mi>O</mi><mo>(</mo><mn>1</mn><mo>/</mo><msup><mrow><mi>k</mi></mrow><mrow><mn>2</mn></mrow></msup><mo>)</mo></math></span> convergence rate in strongly convex case. We provide numerical results to validate the effectiveness of the proposed methods.</p></div>","PeriodicalId":2,"journal":{"name":"ACS Applied Bio Materials","volume":null,"pages":null},"PeriodicalIF":4.6000,"publicationDate":"2024-05-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Accelerated primal-dual methods with adaptive parameters for composite convex optimization with linear constraints\",\"authors\":\"Xin He\",\"doi\":\"10.1016/j.apnum.2024.05.021\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>In this paper, we introduce two accelerated primal-dual methods tailored to address linearly constrained composite convex optimization problems, where the objective function is expressed as the sum of a possibly nondifferentiable function and a differentiable function with Lipschitz continuous gradient. The first method is the accelerated linearized augmented Lagrangian method (ALALM), which permits linearization to the differentiable function; the second method is the accelerated linearized proximal point algorithm (ALPPA), which enables linearization of both the differentiable function and the augmented term. By incorporating adaptive parameters, we demonstrate that ALALM achieves the <span><math><mi>O</mi><mo>(</mo><mn>1</mn><mo>/</mo><msup><mrow><mi>k</mi></mrow><mrow><mn>2</mn></mrow></msup><mo>)</mo></math></span> convergence rate and the linear convergence rate under the assumption of convexity and strong convexity, respectively. Additionally, we establish that ALPPA enjoys the <span><math><mi>O</mi><mo>(</mo><mn>1</mn><mo>/</mo><mi>k</mi><mo>)</mo></math></span> convergence rate in convex case and the <span><math><mi>O</mi><mo>(</mo><mn>1</mn><mo>/</mo><msup><mrow><mi>k</mi></mrow><mrow><mn>2</mn></mrow></msup><mo>)</mo></math></span> convergence rate in strongly convex case. We provide numerical results to validate the effectiveness of the proposed methods.</p></div>\",\"PeriodicalId\":2,\"journal\":{\"name\":\"ACS Applied Bio Materials\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":4.6000,\"publicationDate\":\"2024-05-29\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"ACS Applied Bio Materials\",\"FirstCategoryId\":\"100\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0168927424001272\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"MATERIALS SCIENCE, BIOMATERIALS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"ACS Applied Bio Materials","FirstCategoryId":"100","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0168927424001272","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"MATERIALS SCIENCE, BIOMATERIALS","Score":null,"Total":0}
Accelerated primal-dual methods with adaptive parameters for composite convex optimization with linear constraints
In this paper, we introduce two accelerated primal-dual methods tailored to address linearly constrained composite convex optimization problems, where the objective function is expressed as the sum of a possibly nondifferentiable function and a differentiable function with Lipschitz continuous gradient. The first method is the accelerated linearized augmented Lagrangian method (ALALM), which permits linearization to the differentiable function; the second method is the accelerated linearized proximal point algorithm (ALPPA), which enables linearization of both the differentiable function and the augmented term. By incorporating adaptive parameters, we demonstrate that ALALM achieves the convergence rate and the linear convergence rate under the assumption of convexity and strong convexity, respectively. Additionally, we establish that ALPPA enjoys the convergence rate in convex case and the convergence rate in strongly convex case. We provide numerical results to validate the effectiveness of the proposed methods.