{"title":"Event-Based Optimal Containment Control for Constrained Multiagent Systems Using Integral Reinforcement Learning","authors":"Zijie Guo;Hongru Ren;Hongyi Li;Tingwen Huang","doi":"10.1109/TCNS.2024.3510353","DOIUrl":null,"url":null,"abstract":"An optimal event-driven containment control problem is studied for partially unknown nonlinear multiagent systems with input constraints and state constraints. Its novelty lies in the optimization of the performance index while ensuring constraints handling abilities on states and inputs. First, an improved discounted cost function is constructed, and the state and input constraint information are encoded into the cost function by barrier functions and nonquadratic utility functions, respectively. Then, the approximate distributed optimal containment control policy is derived by an integral reinforcement learning (IRL)-based adaptive critic design, where the IRL technique can overcome the limitation of known drift dynamics in previous results. In critic neural networks learning, the weight tuning law is presented by virtue of the concurrent learning technique, which relaxes the persistence of excitation conditions by storing appropriate historical data. In order to reduce the amount of information transmitted through the controller-to-actuator channel, a containment error-dependent dynamic event-triggered mechanism is defined. Theoretical results indicate that signals in closed-loop systems driven by event-triggered optimal controllers are uniformly ultimately bounded, and Zeno behavior is avoided. Finally, the effectiveness of the developed method is illustrated by a simulation example on multiple single-link robot manipulators.","PeriodicalId":56023,"journal":{"name":"IEEE Transactions on Control of Network Systems","volume":"12 1","pages":"609-619"},"PeriodicalIF":4.0000,"publicationDate":"2024-12-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Control of Network Systems","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10772586/","RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}
引用次数: 0
Abstract
An optimal event-driven containment control problem is studied for partially unknown nonlinear multiagent systems with input constraints and state constraints. Its novelty lies in the optimization of the performance index while ensuring constraints handling abilities on states and inputs. First, an improved discounted cost function is constructed, and the state and input constraint information are encoded into the cost function by barrier functions and nonquadratic utility functions, respectively. Then, the approximate distributed optimal containment control policy is derived by an integral reinforcement learning (IRL)-based adaptive critic design, where the IRL technique can overcome the limitation of known drift dynamics in previous results. In critic neural networks learning, the weight tuning law is presented by virtue of the concurrent learning technique, which relaxes the persistence of excitation conditions by storing appropriate historical data. In order to reduce the amount of information transmitted through the controller-to-actuator channel, a containment error-dependent dynamic event-triggered mechanism is defined. Theoretical results indicate that signals in closed-loop systems driven by event-triggered optimal controllers are uniformly ultimately bounded, and Zeno behavior is avoided. Finally, the effectiveness of the developed method is illustrated by a simulation example on multiple single-link robot manipulators.
期刊介绍:
The IEEE Transactions on Control of Network Systems is committed to the timely publication of high-impact papers at the intersection of control systems and network science. In particular, the journal addresses research on the analysis, design and implementation of networked control systems, as well as control over networks. Relevant work includes the full spectrum from basic research on control systems to the design of engineering solutions for automatic control of, and over, networks. The topics covered by this journal include: Coordinated control and estimation over networks, Control and computation over sensor networks, Control under communication constraints, Control and performance analysis issues that arise in the dynamics of networks used in application areas such as communications, computers, transportation, manufacturing, Web ranking and aggregation, social networks, biology, power systems, economics, Synchronization of activities across a controlled network, Stability analysis of controlled networks, Analysis of networks as hybrid dynamical systems.