Hanguang Su, Huaguang Zhang, Yanhong Luo, Qiuye Sun
{"title":"部分未知非线性系统非零和博弈的基于事件的积分强化学习算法","authors":"Hanguang Su, Huaguang Zhang, Yanhong Luo, Qiuye Sun","doi":"10.1109/DDCLS52934.2021.9455455","DOIUrl":null,"url":null,"abstract":"In this work, a novel event-based integral reinforcement learning (IRL) adaptive control method is developed to solve the multiplayer non-zero-sum (NZS) games of the nonlinear systems with unknown drift dynamics. By virtue of the IRL algorithm, the system drift dynamics is no more needed in the controller design. Moreover, different from the existing iteration computation methods, this method is online implemented, on which condition the event-triggered control framework can be combined with the IRL algorithm in solving the NZS game problems. In this method, a state-dependent triggering condition is proposed, thus the computation and communication loads are reduced in the control process. Moreover, the uniform ultimate boundedness (UUB) stability of the controlled system and the convergence of the critic weights have also been proved. Finally, a numerical example is provided to demonstrate the effectiveness of our method.","PeriodicalId":325897,"journal":{"name":"2021 IEEE 10th Data Driven Control and Learning Systems Conference (DDCLS)","volume":"37 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-05-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":"{\"title\":\"Event-based Integral Reinforcement Learning Algorithm for Non-zero-sum Games of Partially Unknown Nonlinear Systems\",\"authors\":\"Hanguang Su, Huaguang Zhang, Yanhong Luo, Qiuye Sun\",\"doi\":\"10.1109/DDCLS52934.2021.9455455\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"In this work, a novel event-based integral reinforcement learning (IRL) adaptive control method is developed to solve the multiplayer non-zero-sum (NZS) games of the nonlinear systems with unknown drift dynamics. By virtue of the IRL algorithm, the system drift dynamics is no more needed in the controller design. Moreover, different from the existing iteration computation methods, this method is online implemented, on which condition the event-triggered control framework can be combined with the IRL algorithm in solving the NZS game problems. In this method, a state-dependent triggering condition is proposed, thus the computation and communication loads are reduced in the control process. Moreover, the uniform ultimate boundedness (UUB) stability of the controlled system and the convergence of the critic weights have also been proved. Finally, a numerical example is provided to demonstrate the effectiveness of our method.\",\"PeriodicalId\":325897,\"journal\":{\"name\":\"2021 IEEE 10th Data Driven Control and Learning Systems Conference (DDCLS)\",\"volume\":\"37 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2021-05-14\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"1\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2021 IEEE 10th Data Driven Control and Learning Systems Conference (DDCLS)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/DDCLS52934.2021.9455455\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2021 IEEE 10th Data Driven Control and Learning Systems Conference (DDCLS)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/DDCLS52934.2021.9455455","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Event-based Integral Reinforcement Learning Algorithm for Non-zero-sum Games of Partially Unknown Nonlinear Systems
In this work, a novel event-based integral reinforcement learning (IRL) adaptive control method is developed to solve the multiplayer non-zero-sum (NZS) games of the nonlinear systems with unknown drift dynamics. By virtue of the IRL algorithm, the system drift dynamics is no more needed in the controller design. Moreover, different from the existing iteration computation methods, this method is online implemented, on which condition the event-triggered control framework can be combined with the IRL algorithm in solving the NZS game problems. In this method, a state-dependent triggering condition is proposed, thus the computation and communication loads are reduced in the control process. Moreover, the uniform ultimate boundedness (UUB) stability of the controlled system and the convergence of the critic weights have also been proved. Finally, a numerical example is provided to demonstrate the effectiveness of our method.