{"title":"基于知识引导的自动驾驶汽车高效自进化智能行为控制","authors":"Qiao Peng;Kailong Liu;Jingda Wu;Amir Khajepour","doi":"10.1109/JAS.2024.124746","DOIUrl":null,"url":null,"abstract":"Dear Editor, This letter addresses the enhancement of autonomous vehicles' (AVs) behavior control systems through the application of reinforcement learning (RL) techniques. It presents a novel approach to efficient knowledge-guided self-evolutionary intelligent decision-making by integrating human intervention as prior knowledge into the RL's exploratory learning process. Specifically, we propose an innovative intervention-based reward shaping mechanism and develop a novel experience replay mechanism to augment the efficiency of leveraging guided knowledge within the framework of off-policy RL. The proposed methodology significantly enhances the performance of RL-based behavior control strategies in complex scenarios for AVs. Illustrative results indicate that, relative to existing state-of-the-art methods, our approach yields superior learning efficiency and improved autonomous driving performance.","PeriodicalId":54230,"journal":{"name":"Ieee-Caa Journal of Automatica Sinica","volume":"12 7","pages":"1522-1524"},"PeriodicalIF":19.2000,"publicationDate":"2025-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=11062710","citationCount":"0","resultStr":"{\"title\":\"Efficient Knowledge-Guided Self-Evolving Intelligent Behavioral Control for Autonomous Vehicles\",\"authors\":\"Qiao Peng;Kailong Liu;Jingda Wu;Amir Khajepour\",\"doi\":\"10.1109/JAS.2024.124746\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Dear Editor, This letter addresses the enhancement of autonomous vehicles' (AVs) behavior control systems through the application of reinforcement learning (RL) techniques. It presents a novel approach to efficient knowledge-guided self-evolutionary intelligent decision-making by integrating human intervention as prior knowledge into the RL's exploratory learning process. Specifically, we propose an innovative intervention-based reward shaping mechanism and develop a novel experience replay mechanism to augment the efficiency of leveraging guided knowledge within the framework of off-policy RL. The proposed methodology significantly enhances the performance of RL-based behavior control strategies in complex scenarios for AVs. Illustrative results indicate that, relative to existing state-of-the-art methods, our approach yields superior learning efficiency and improved autonomous driving performance.\",\"PeriodicalId\":54230,\"journal\":{\"name\":\"Ieee-Caa Journal of Automatica Sinica\",\"volume\":\"12 7\",\"pages\":\"1522-1524\"},\"PeriodicalIF\":19.2000,\"publicationDate\":\"2025-07-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=11062710\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Ieee-Caa Journal of Automatica Sinica\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/11062710/\",\"RegionNum\":1,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"AUTOMATION & CONTROL SYSTEMS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Ieee-Caa Journal of Automatica Sinica","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/11062710/","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}
Efficient Knowledge-Guided Self-Evolving Intelligent Behavioral Control for Autonomous Vehicles
Dear Editor, This letter addresses the enhancement of autonomous vehicles' (AVs) behavior control systems through the application of reinforcement learning (RL) techniques. It presents a novel approach to efficient knowledge-guided self-evolutionary intelligent decision-making by integrating human intervention as prior knowledge into the RL's exploratory learning process. Specifically, we propose an innovative intervention-based reward shaping mechanism and develop a novel experience replay mechanism to augment the efficiency of leveraging guided knowledge within the framework of off-policy RL. The proposed methodology significantly enhances the performance of RL-based behavior control strategies in complex scenarios for AVs. Illustrative results indicate that, relative to existing state-of-the-art methods, our approach yields superior learning efficiency and improved autonomous driving performance.
期刊介绍:
The IEEE/CAA Journal of Automatica Sinica is a reputable journal that publishes high-quality papers in English on original theoretical/experimental research and development in the field of automation. The journal covers a wide range of topics including automatic control, artificial intelligence and intelligent control, systems theory and engineering, pattern recognition and intelligent systems, automation engineering and applications, information processing and information systems, network-based automation, robotics, sensing and measurement, and navigation, guidance, and control.
Additionally, the journal is abstracted/indexed in several prominent databases including SCIE (Science Citation Index Expanded), EI (Engineering Index), Inspec, Scopus, SCImago, DBLP, CNKI (China National Knowledge Infrastructure), CSCD (Chinese Science Citation Database), and IEEE Xplore.