{"title":"不确定非线性离散系统的强化学习事件触发输出反馈控制","authors":"Jianwei Ren, Ping Li, Zhibao Song","doi":"10.1177/01423312231196639","DOIUrl":null,"url":null,"abstract":"In this paper, a novel reinforcement learning (RL)-based event-triggered (ET) output feedback control algorithm is proposed for a class of uncertain strict-feedback nonlinear discrete-time systems. In contrast to traditional RL-based control methods, we proposed an ET output feedback controller based on the backstepping technique, where the transmission cost can be efficiently conserved. Then, in light of the radial basis function (RBF) neural network (NN), various critic NNs are constructed to approximate the critic functions in each step. Furthermore, with the backing of the proposed ET mechanism, a sampled output feedback controller is addressed to guarantee that the tracking errors and all signals of the closed-loop system are semi-global uniformly ultimately bounded (SGUUB). Finally, a simulation example is presented to demonstrate the effectiveness of the control strategy.","PeriodicalId":49426,"journal":{"name":"Transactions of the Institute of Measurement and Control","volume":"27 1","pages":"0"},"PeriodicalIF":1.7000,"publicationDate":"2023-10-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Reinforcement learning event-triggered output feedback control for uncertain nonlinear discrete systems\",\"authors\":\"Jianwei Ren, Ping Li, Zhibao Song\",\"doi\":\"10.1177/01423312231196639\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"In this paper, a novel reinforcement learning (RL)-based event-triggered (ET) output feedback control algorithm is proposed for a class of uncertain strict-feedback nonlinear discrete-time systems. In contrast to traditional RL-based control methods, we proposed an ET output feedback controller based on the backstepping technique, where the transmission cost can be efficiently conserved. Then, in light of the radial basis function (RBF) neural network (NN), various critic NNs are constructed to approximate the critic functions in each step. Furthermore, with the backing of the proposed ET mechanism, a sampled output feedback controller is addressed to guarantee that the tracking errors and all signals of the closed-loop system are semi-global uniformly ultimately bounded (SGUUB). Finally, a simulation example is presented to demonstrate the effectiveness of the control strategy.\",\"PeriodicalId\":49426,\"journal\":{\"name\":\"Transactions of the Institute of Measurement and Control\",\"volume\":\"27 1\",\"pages\":\"0\"},\"PeriodicalIF\":1.7000,\"publicationDate\":\"2023-10-12\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Transactions of the Institute of Measurement and Control\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1177/01423312231196639\",\"RegionNum\":4,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"AUTOMATION & CONTROL SYSTEMS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Transactions of the Institute of Measurement and Control","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1177/01423312231196639","RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}
Reinforcement learning event-triggered output feedback control for uncertain nonlinear discrete systems
In this paper, a novel reinforcement learning (RL)-based event-triggered (ET) output feedback control algorithm is proposed for a class of uncertain strict-feedback nonlinear discrete-time systems. In contrast to traditional RL-based control methods, we proposed an ET output feedback controller based on the backstepping technique, where the transmission cost can be efficiently conserved. Then, in light of the radial basis function (RBF) neural network (NN), various critic NNs are constructed to approximate the critic functions in each step. Furthermore, with the backing of the proposed ET mechanism, a sampled output feedback controller is addressed to guarantee that the tracking errors and all signals of the closed-loop system are semi-global uniformly ultimately bounded (SGUUB). Finally, a simulation example is presented to demonstrate the effectiveness of the control strategy.
期刊介绍:
Transactions of the Institute of Measurement and Control is a fully peer-reviewed international journal. The journal covers all areas of applications in instrumentation and control. Its scope encompasses cutting-edge research and development, education and industrial applications.