Yangang Yao,Ziyi Liu,Yu Kang,Yunbo Zhao,Jieqing Tan,Lichuan Gu,Qiang Li,Jinling Wang
{"title":"输入约束非线性系统的滑动柔性规定性能边界引导强化学习控制。","authors":"Yangang Yao,Ziyi Liu,Yu Kang,Yunbo Zhao,Jieqing Tan,Lichuan Gu,Qiang Li,Jinling Wang","doi":"10.1109/tcyb.2025.3610913","DOIUrl":null,"url":null,"abstract":"This article first proposes a sliding flexible prescribed performance boundary-guided reinforcement learning (SFPPB-RL) control approach for input-constrained nonlinear systems (ICNSs). By designing a sliding flexible PPB, which not only can adaptively adjust the initial boundary according to the initial error, but also dynamically adjust the constraint relaxation according to the coupling correlation between the input constraint and the performance constraint, a novel prescribed performance control (PPC) approach is proposed. Compared with the existing \"horn\" shape performance boundary-based PPC methods, the limitation of having to repeatedly debug design parameters or sacrifice initial transient performance to meet different initial error requirements is eliminated. Meanwhile, the coupling effect between the input constraint and the performance constraint is also considered, and the balance between input safety and control performance is achieved by constructing an auxiliary system. Furthermore, combining identifier-critic-actor structure-based RL strategy and backstepping technique, a sliding flexible PPB-guided reinforcement learning (SFPPB-RL) optimal control algorithm is developed, which minimizes the cost function while ensuring input safety and prescribed performance indicators. The validity of the proposed algorithm is demonstrated via simulations.","PeriodicalId":13112,"journal":{"name":"IEEE Transactions on Cybernetics","volume":"14 1","pages":""},"PeriodicalIF":10.5000,"publicationDate":"2025-09-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Sliding Flexible Prescribed Performance Boundary-Guided Reinforcement Learning Control for Input-Constrained Nonlinear Systems.\",\"authors\":\"Yangang Yao,Ziyi Liu,Yu Kang,Yunbo Zhao,Jieqing Tan,Lichuan Gu,Qiang Li,Jinling Wang\",\"doi\":\"10.1109/tcyb.2025.3610913\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"This article first proposes a sliding flexible prescribed performance boundary-guided reinforcement learning (SFPPB-RL) control approach for input-constrained nonlinear systems (ICNSs). By designing a sliding flexible PPB, which not only can adaptively adjust the initial boundary according to the initial error, but also dynamically adjust the constraint relaxation according to the coupling correlation between the input constraint and the performance constraint, a novel prescribed performance control (PPC) approach is proposed. Compared with the existing \\\"horn\\\" shape performance boundary-based PPC methods, the limitation of having to repeatedly debug design parameters or sacrifice initial transient performance to meet different initial error requirements is eliminated. Meanwhile, the coupling effect between the input constraint and the performance constraint is also considered, and the balance between input safety and control performance is achieved by constructing an auxiliary system. Furthermore, combining identifier-critic-actor structure-based RL strategy and backstepping technique, a sliding flexible PPB-guided reinforcement learning (SFPPB-RL) optimal control algorithm is developed, which minimizes the cost function while ensuring input safety and prescribed performance indicators. The validity of the proposed algorithm is demonstrated via simulations.\",\"PeriodicalId\":13112,\"journal\":{\"name\":\"IEEE Transactions on Cybernetics\",\"volume\":\"14 1\",\"pages\":\"\"},\"PeriodicalIF\":10.5000,\"publicationDate\":\"2025-09-25\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Transactions on Cybernetics\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://doi.org/10.1109/tcyb.2025.3610913\",\"RegionNum\":1,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"AUTOMATION & CONTROL SYSTEMS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Cybernetics","FirstCategoryId":"94","ListUrlMain":"https://doi.org/10.1109/tcyb.2025.3610913","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}
Sliding Flexible Prescribed Performance Boundary-Guided Reinforcement Learning Control for Input-Constrained Nonlinear Systems.
This article first proposes a sliding flexible prescribed performance boundary-guided reinforcement learning (SFPPB-RL) control approach for input-constrained nonlinear systems (ICNSs). By designing a sliding flexible PPB, which not only can adaptively adjust the initial boundary according to the initial error, but also dynamically adjust the constraint relaxation according to the coupling correlation between the input constraint and the performance constraint, a novel prescribed performance control (PPC) approach is proposed. Compared with the existing "horn" shape performance boundary-based PPC methods, the limitation of having to repeatedly debug design parameters or sacrifice initial transient performance to meet different initial error requirements is eliminated. Meanwhile, the coupling effect between the input constraint and the performance constraint is also considered, and the balance between input safety and control performance is achieved by constructing an auxiliary system. Furthermore, combining identifier-critic-actor structure-based RL strategy and backstepping technique, a sliding flexible PPB-guided reinforcement learning (SFPPB-RL) optimal control algorithm is developed, which minimizes the cost function while ensuring input safety and prescribed performance indicators. The validity of the proposed algorithm is demonstrated via simulations.
期刊介绍:
The scope of the IEEE Transactions on Cybernetics includes computational approaches to the field of cybernetics. Specifically, the transactions welcomes papers on communication and control across machines or machine, human, and organizations. The scope includes such areas as computational intelligence, computer vision, neural networks, genetic algorithms, machine learning, fuzzy systems, cognitive systems, decision making, and robotics, to the extent that they contribute to the theme of cybernetics or demonstrate an application of cybernetics principles.