Wenxiao Hu , Chenglong Du , Fanbiao Li , Xinmin Chen , Weihua Gui
{"title":"Distributed model-free deep reinforcement learning control for unknown nonlinear multi-agent systems","authors":"Wenxiao Hu , Chenglong Du , Fanbiao Li , Xinmin Chen , Weihua Gui","doi":"10.1016/j.jfranklin.2025.107636","DOIUrl":null,"url":null,"abstract":"<div><div>This paper addresses the consensus problem of a class of unknown nonlinear multi-agent systems (MASs) via a novel distributed model-free deep reinforcement learning (DRL) control method. First, the DRL-based feedback linearization approach is developed to learn an approximated linearized control protocol in a model-free fashion. Then, a distributed observer is further designed to estimate the unavailable information of the exosystem. Based on the obtained nominal linear model and developed distributed observer, the distributed model-free control protocol is synthesized such that the consensus of nonlinear MASs can be achieved. Finally, the validity of the proposed control scheme is verified by simulations.</div></div>","PeriodicalId":17283,"journal":{"name":"Journal of The Franklin Institute-engineering and Applied Mathematics","volume":"362 7","pages":"Article 107636"},"PeriodicalIF":3.7000,"publicationDate":"2025-03-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of The Franklin Institute-engineering and Applied Mathematics","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0016003225001309","RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}
引用次数: 0
Abstract
This paper addresses the consensus problem of a class of unknown nonlinear multi-agent systems (MASs) via a novel distributed model-free deep reinforcement learning (DRL) control method. First, the DRL-based feedback linearization approach is developed to learn an approximated linearized control protocol in a model-free fashion. Then, a distributed observer is further designed to estimate the unavailable information of the exosystem. Based on the obtained nominal linear model and developed distributed observer, the distributed model-free control protocol is synthesized such that the consensus of nonlinear MASs can be achieved. Finally, the validity of the proposed control scheme is verified by simulations.
期刊介绍:
The Journal of The Franklin Institute has an established reputation for publishing high-quality papers in the field of engineering and applied mathematics. Its current focus is on control systems, complex networks and dynamic systems, signal processing and communications and their applications. All submitted papers are peer-reviewed. The Journal will publish original research papers and research review papers of substance. Papers and special focus issues are judged upon possible lasting value, which has been and continues to be the strength of the Journal of The Franklin Institute.