Jun Zhao;Zhangu Wang;Yongfeng Lv;Congzhi Liu;Ziliang Zhao
{"title":"未知动态自适应巡航控制系统的鲁棒最优预定性能控制","authors":"Jun Zhao;Zhangu Wang;Yongfeng Lv;Congzhi Liu;Ziliang Zhao","doi":"10.1109/TITS.2025.3538107","DOIUrl":null,"url":null,"abstract":"Conventional ACC method has great fluctuation and deviation when solving speed and distance control problems. Thus, this paper develops a reinforcement learning (RL) based robust optimal prescribed performance controller for ACC systems. To this end, we first construct a continuous time ACC system with unknown system dynamics (e.g., target vehicle acceleration, sensor and actuator attacks, etc). To estimate the unknown system dynamics, an unknown system dynamic estimator (USDE) is designed, where the unknown system dynamic can be accurately estimated by using the input-output information, this is helpful for controller design. Then, a RL based optimal control method is developed, where the prescribed performance function (PPF) is applied, the system states can be effectively defined within a certain range. To realize the online solution for optimal control, we design a new adaptive law based on the adaptive dynamic programming (ADP) framework to online learn the critic neural network (NN) weights, because of the strong convergence, the proposed learning algorithm can be effectively applied in practical industrial systems. Finally, the efficacy of the proposed control technique is tested through simulations and experiments.","PeriodicalId":13416,"journal":{"name":"IEEE Transactions on Intelligent Transportation Systems","volume":"26 4","pages":"4757-4769"},"PeriodicalIF":7.9000,"publicationDate":"2025-02-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Robust Optimal Prescribed Performance Control of Adaptive Cruise Control Systems With Unknown Dynamics\",\"authors\":\"Jun Zhao;Zhangu Wang;Yongfeng Lv;Congzhi Liu;Ziliang Zhao\",\"doi\":\"10.1109/TITS.2025.3538107\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Conventional ACC method has great fluctuation and deviation when solving speed and distance control problems. Thus, this paper develops a reinforcement learning (RL) based robust optimal prescribed performance controller for ACC systems. To this end, we first construct a continuous time ACC system with unknown system dynamics (e.g., target vehicle acceleration, sensor and actuator attacks, etc). To estimate the unknown system dynamics, an unknown system dynamic estimator (USDE) is designed, where the unknown system dynamic can be accurately estimated by using the input-output information, this is helpful for controller design. Then, a RL based optimal control method is developed, where the prescribed performance function (PPF) is applied, the system states can be effectively defined within a certain range. To realize the online solution for optimal control, we design a new adaptive law based on the adaptive dynamic programming (ADP) framework to online learn the critic neural network (NN) weights, because of the strong convergence, the proposed learning algorithm can be effectively applied in practical industrial systems. Finally, the efficacy of the proposed control technique is tested through simulations and experiments.\",\"PeriodicalId\":13416,\"journal\":{\"name\":\"IEEE Transactions on Intelligent Transportation Systems\",\"volume\":\"26 4\",\"pages\":\"4757-4769\"},\"PeriodicalIF\":7.9000,\"publicationDate\":\"2025-02-21\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Transactions on Intelligent Transportation Systems\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10897316/\",\"RegionNum\":1,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, CIVIL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Intelligent Transportation Systems","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10897316/","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, CIVIL","Score":null,"Total":0}
Robust Optimal Prescribed Performance Control of Adaptive Cruise Control Systems With Unknown Dynamics
Conventional ACC method has great fluctuation and deviation when solving speed and distance control problems. Thus, this paper develops a reinforcement learning (RL) based robust optimal prescribed performance controller for ACC systems. To this end, we first construct a continuous time ACC system with unknown system dynamics (e.g., target vehicle acceleration, sensor and actuator attacks, etc). To estimate the unknown system dynamics, an unknown system dynamic estimator (USDE) is designed, where the unknown system dynamic can be accurately estimated by using the input-output information, this is helpful for controller design. Then, a RL based optimal control method is developed, where the prescribed performance function (PPF) is applied, the system states can be effectively defined within a certain range. To realize the online solution for optimal control, we design a new adaptive law based on the adaptive dynamic programming (ADP) framework to online learn the critic neural network (NN) weights, because of the strong convergence, the proposed learning algorithm can be effectively applied in practical industrial systems. Finally, the efficacy of the proposed control technique is tested through simulations and experiments.
期刊介绍:
The theoretical, experimental and operational aspects of electrical and electronics engineering and information technologies as applied to Intelligent Transportation Systems (ITS). Intelligent Transportation Systems are defined as those systems utilizing synergistic technologies and systems engineering concepts to develop and improve transportation systems of all kinds. The scope of this interdisciplinary activity includes the promotion, consolidation and coordination of ITS technical activities among IEEE entities, and providing a focus for cooperative activities, both internally and externally.