{"title":"Distributed multi-timescale algorithm for nonconvex optimization problem: A control perspective","authors":"Xiasheng Shi , Jian Liu , Changyin Sun","doi":"10.1016/j.neunet.2025.107257","DOIUrl":null,"url":null,"abstract":"<div><div>The distributed nonconvex constrained optimization problem with equality and inequality constraints is researched in this paper, where the objective function and the function for constraints are all nonconvex. To solve this problem from a control perspective, a virtual reference-based convex penalty function is added to the augmented Lagrangian function. Then, based on the primal–dual technique, a two-timescale distributed approach is designed based on the consensus scheme. The slower subsystem aims to ensure the optimality, and the faster subsystem intends to guarantee the stability. Finally, three cases are presented to illustrate the approach’s effectiveness.</div></div>","PeriodicalId":49763,"journal":{"name":"Neural Networks","volume":"186 ","pages":"Article 107257"},"PeriodicalIF":6.0000,"publicationDate":"2025-02-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Neural Networks","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0893608025001364","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0
Abstract
The distributed nonconvex constrained optimization problem with equality and inequality constraints is researched in this paper, where the objective function and the function for constraints are all nonconvex. To solve this problem from a control perspective, a virtual reference-based convex penalty function is added to the augmented Lagrangian function. Then, based on the primal–dual technique, a two-timescale distributed approach is designed based on the consensus scheme. The slower subsystem aims to ensure the optimality, and the faster subsystem intends to guarantee the stability. Finally, three cases are presented to illustrate the approach’s effectiveness.
期刊介绍:
Neural Networks is a platform that aims to foster an international community of scholars and practitioners interested in neural networks, deep learning, and other approaches to artificial intelligence and machine learning. Our journal invites submissions covering various aspects of neural networks research, from computational neuroscience and cognitive modeling to mathematical analyses and engineering applications. By providing a forum for interdisciplinary discussions between biology and technology, we aim to encourage the development of biologically-inspired artificial intelligence.