{"title":"鲁棒融合套索的加速近端交替方向乘法器方法","authors":"Yibao Fan, Youlin Shang, Zheng-Fen Jin, Jia Liu, Roxin Zhang","doi":"10.1051/ro/2023065","DOIUrl":null,"url":null,"abstract":"In the era of big data, much of the data is susceptible to noise with heavy-tailed distribution. Fused Lasso can effectively handle high dimensional sparse data with strong correlation between two adjacent variables under known Gaussian noise. However, it has poor robustness to nonGaussian noise with heavy-tailed distribution. Robust fused Lasso with l1 norm loss function can overcome the drawback of fused Lasso when noise is heavy-tailed distribution. But the key challenge for solving this model is nonsmoothness and its nonseparability. Therefore, in this paper, we first deform the robust fused Lasso into an easily solvable form, which changes the three-block objective function to a two-block form. Then, we propose an accelerated proximal alternating direction method of multipliers (APADMM) with an additional update step, which is base on a new PADMM that changes the Lagrangian multiplier term update. Furthermore, we give the O(1/K) nonergodic convergence rate analysis of the proposed APADMM. Finally, numerical results show that the proposed new PADMM and APADMM have better performance than other existing ADMM solvers.","PeriodicalId":20872,"journal":{"name":"RAIRO Oper. Res.","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2023-05-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"An accelerated proximal alternating direction method of multipliers for robust fused Lasso\",\"authors\":\"Yibao Fan, Youlin Shang, Zheng-Fen Jin, Jia Liu, Roxin Zhang\",\"doi\":\"10.1051/ro/2023065\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"In the era of big data, much of the data is susceptible to noise with heavy-tailed distribution. Fused Lasso can effectively handle high dimensional sparse data with strong correlation between two adjacent variables under known Gaussian noise. However, it has poor robustness to nonGaussian noise with heavy-tailed distribution. Robust fused Lasso with l1 norm loss function can overcome the drawback of fused Lasso when noise is heavy-tailed distribution. But the key challenge for solving this model is nonsmoothness and its nonseparability. Therefore, in this paper, we first deform the robust fused Lasso into an easily solvable form, which changes the three-block objective function to a two-block form. Then, we propose an accelerated proximal alternating direction method of multipliers (APADMM) with an additional update step, which is base on a new PADMM that changes the Lagrangian multiplier term update. Furthermore, we give the O(1/K) nonergodic convergence rate analysis of the proposed APADMM. Finally, numerical results show that the proposed new PADMM and APADMM have better performance than other existing ADMM solvers.\",\"PeriodicalId\":20872,\"journal\":{\"name\":\"RAIRO Oper. Res.\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-05-11\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"RAIRO Oper. Res.\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1051/ro/2023065\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"RAIRO Oper. Res.","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1051/ro/2023065","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
An accelerated proximal alternating direction method of multipliers for robust fused Lasso
In the era of big data, much of the data is susceptible to noise with heavy-tailed distribution. Fused Lasso can effectively handle high dimensional sparse data with strong correlation between two adjacent variables under known Gaussian noise. However, it has poor robustness to nonGaussian noise with heavy-tailed distribution. Robust fused Lasso with l1 norm loss function can overcome the drawback of fused Lasso when noise is heavy-tailed distribution. But the key challenge for solving this model is nonsmoothness and its nonseparability. Therefore, in this paper, we first deform the robust fused Lasso into an easily solvable form, which changes the three-block objective function to a two-block form. Then, we propose an accelerated proximal alternating direction method of multipliers (APADMM) with an additional update step, which is base on a new PADMM that changes the Lagrangian multiplier term update. Furthermore, we give the O(1/K) nonergodic convergence rate analysis of the proposed APADMM. Finally, numerical results show that the proposed new PADMM and APADMM have better performance than other existing ADMM solvers.