{"title":"切换系统的高效自学习跟踪控制:一种触发学习模型预测控制方法","authors":"Tianxiang Dong;Yiwen Qi;Shitong Guo","doi":"10.1109/TCSII.2025.3557419","DOIUrl":null,"url":null,"abstract":"Existing model predictive control (MPC) methods lack online learning capability in complex environments. Reinforcement learning (RL) requires a lot of data and computing resources to obtain optimal control. This brief uses efficient self-learning to solve this problem. “Efficient” refers to the use of triggered-learning mechanism (TLM) to manage computing resources on demand. This brief proposes a triggered-learning model predictive control (TL-MPC) method for switched systems. The proposed TL-MPC endows MPC with learning capabilities through the TLM. TLM includes a Deep Deterministic Policy Gradient (DDPG) based control incremental self-learning tuning strategy and a performance-driven event-triggering strategy. The first strategy is to give the MPC controller a control increment to optimize control effect. The second strategy is to realize the on-demand learning and reduce computational resources by comparing two cost functions that characterize the system performance. In addition, the stability of switched systems under TL-MPC is analyzed using the Lyapunov function and the average dwell time technique. Finally, the effectiveness of the proposed method is verified by simulation.","PeriodicalId":13101,"journal":{"name":"IEEE Transactions on Circuits and Systems II: Express Briefs","volume":"72 5","pages":"748-752"},"PeriodicalIF":4.0000,"publicationDate":"2025-04-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Efficient Self-Learning Tracking Control for Switched Systems: A Triggered-Learning Model Predictive Control Method\",\"authors\":\"Tianxiang Dong;Yiwen Qi;Shitong Guo\",\"doi\":\"10.1109/TCSII.2025.3557419\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Existing model predictive control (MPC) methods lack online learning capability in complex environments. Reinforcement learning (RL) requires a lot of data and computing resources to obtain optimal control. This brief uses efficient self-learning to solve this problem. “Efficient” refers to the use of triggered-learning mechanism (TLM) to manage computing resources on demand. This brief proposes a triggered-learning model predictive control (TL-MPC) method for switched systems. The proposed TL-MPC endows MPC with learning capabilities through the TLM. TLM includes a Deep Deterministic Policy Gradient (DDPG) based control incremental self-learning tuning strategy and a performance-driven event-triggering strategy. The first strategy is to give the MPC controller a control increment to optimize control effect. The second strategy is to realize the on-demand learning and reduce computational resources by comparing two cost functions that characterize the system performance. In addition, the stability of switched systems under TL-MPC is analyzed using the Lyapunov function and the average dwell time technique. Finally, the effectiveness of the proposed method is verified by simulation.\",\"PeriodicalId\":13101,\"journal\":{\"name\":\"IEEE Transactions on Circuits and Systems II: Express Briefs\",\"volume\":\"72 5\",\"pages\":\"748-752\"},\"PeriodicalIF\":4.0000,\"publicationDate\":\"2025-04-03\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Transactions on Circuits and Systems II: Express Briefs\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10948412/\",\"RegionNum\":2,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Circuits and Systems II: Express Briefs","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10948412/","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
Efficient Self-Learning Tracking Control for Switched Systems: A Triggered-Learning Model Predictive Control Method
Existing model predictive control (MPC) methods lack online learning capability in complex environments. Reinforcement learning (RL) requires a lot of data and computing resources to obtain optimal control. This brief uses efficient self-learning to solve this problem. “Efficient” refers to the use of triggered-learning mechanism (TLM) to manage computing resources on demand. This brief proposes a triggered-learning model predictive control (TL-MPC) method for switched systems. The proposed TL-MPC endows MPC with learning capabilities through the TLM. TLM includes a Deep Deterministic Policy Gradient (DDPG) based control incremental self-learning tuning strategy and a performance-driven event-triggering strategy. The first strategy is to give the MPC controller a control increment to optimize control effect. The second strategy is to realize the on-demand learning and reduce computational resources by comparing two cost functions that characterize the system performance. In addition, the stability of switched systems under TL-MPC is analyzed using the Lyapunov function and the average dwell time technique. Finally, the effectiveness of the proposed method is verified by simulation.
期刊介绍:
TCAS II publishes brief papers in the field specified by the theory, analysis, design, and practical implementations of circuits, and the application of circuit techniques to systems and to signal processing. Included is the whole spectrum from basic scientific theory to industrial applications. The field of interest covered includes:
Circuits: Analog, Digital and Mixed Signal Circuits and Systems
Nonlinear Circuits and Systems, Integrated Sensors, MEMS and Systems on Chip, Nanoscale Circuits and Systems, Optoelectronic
Circuits and Systems, Power Electronics and Systems
Software for Analog-and-Logic Circuits and Systems
Control aspects of Circuits and Systems.