Reinforcement learning event-triggered output feedback control for uncertain nonlinear discrete systems

IF 1.7 4区 计算机科学 Q3 AUTOMATION & CONTROL SYSTEMS
Jianwei Ren, Ping Li, Zhibao Song
{"title":"Reinforcement learning event-triggered output feedback control for uncertain nonlinear discrete systems","authors":"Jianwei Ren, Ping Li, Zhibao Song","doi":"10.1177/01423312231196639","DOIUrl":null,"url":null,"abstract":"In this paper, a novel reinforcement learning (RL)-based event-triggered (ET) output feedback control algorithm is proposed for a class of uncertain strict-feedback nonlinear discrete-time systems. In contrast to traditional RL-based control methods, we proposed an ET output feedback controller based on the backstepping technique, where the transmission cost can be efficiently conserved. Then, in light of the radial basis function (RBF) neural network (NN), various critic NNs are constructed to approximate the critic functions in each step. Furthermore, with the backing of the proposed ET mechanism, a sampled output feedback controller is addressed to guarantee that the tracking errors and all signals of the closed-loop system are semi-global uniformly ultimately bounded (SGUUB). Finally, a simulation example is presented to demonstrate the effectiveness of the control strategy.","PeriodicalId":49426,"journal":{"name":"Transactions of the Institute of Measurement and Control","volume":"27 1","pages":"0"},"PeriodicalIF":1.7000,"publicationDate":"2023-10-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Transactions of the Institute of Measurement and Control","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1177/01423312231196639","RegionNum":4,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}
引用次数: 0

Abstract

In this paper, a novel reinforcement learning (RL)-based event-triggered (ET) output feedback control algorithm is proposed for a class of uncertain strict-feedback nonlinear discrete-time systems. In contrast to traditional RL-based control methods, we proposed an ET output feedback controller based on the backstepping technique, where the transmission cost can be efficiently conserved. Then, in light of the radial basis function (RBF) neural network (NN), various critic NNs are constructed to approximate the critic functions in each step. Furthermore, with the backing of the proposed ET mechanism, a sampled output feedback controller is addressed to guarantee that the tracking errors and all signals of the closed-loop system are semi-global uniformly ultimately bounded (SGUUB). Finally, a simulation example is presented to demonstrate the effectiveness of the control strategy.
不确定非线性离散系统的强化学习事件触发输出反馈控制
针对一类不确定严格反馈非线性离散系统,提出了一种基于强化学习(RL)的事件触发(ET)输出反馈控制算法。与传统的基于rl的控制方法相比,我们提出了一种基于反步技术的ET输出反馈控制器,该控制器可以有效地保持传输成本。然后,根据径向基函数(RBF)神经网络(NN),构造各种批评NN来近似每一步的批评函数。此外,在所提出的ET机制的支持下,解决了采样输出反馈控制器,以保证闭环系统的跟踪误差和所有信号是半全局一致最终有界的(SGUUB)。最后通过仿真实例验证了控制策略的有效性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
CiteScore
4.10
自引率
16.70%
发文量
203
审稿时长
3.4 months
期刊介绍: Transactions of the Institute of Measurement and Control is a fully peer-reviewed international journal. The journal covers all areas of applications in instrumentation and control. Its scope encompasses cutting-edge research and development, education and industrial applications.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信