{"title":"A survey on reinforcement learning-based control for signalized intersections with connected automated vehicles","authors":"Kaiwen Zhang , Zhiyong Cui , Wanjing Ma","doi":"10.1080/01441647.2024.2377637","DOIUrl":null,"url":null,"abstract":"<div><div>Recent advancements in connected automated vehicles (CAVs) and reinforcement learning (RL) hold significant promise for enhancing intelligent traffic control systems. This paper conducts a systematic review of studies on RL-based urban traffic control at signalised intersections, highlighting the significant impact of CAVs on traffic control performance improvement. We first review the fundamental concepts of RL algorithms, establishing a foundational understanding for subsequent RL-based traffic control methods. We then review recent progress in RL-based traffic signal control using CV/CAV trajectory data, RL-based CAV trajectory planning, and the cooperative control of both traffic signals and CAVs at signalised intersections. Our aim is to provide researchers with a comprehensive roadmap for future research in RL-based traffic control at signalised intersections.</div></div>","PeriodicalId":48197,"journal":{"name":"Transport Reviews","volume":"44 6","pages":"Pages 1187-1208"},"PeriodicalIF":9.5000,"publicationDate":"2024-07-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Transport Reviews","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/org/science/article/pii/S0144164724000229","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"TRANSPORTATION","Score":null,"Total":0}
引用次数: 0
Abstract
Recent advancements in connected automated vehicles (CAVs) and reinforcement learning (RL) hold significant promise for enhancing intelligent traffic control systems. This paper conducts a systematic review of studies on RL-based urban traffic control at signalised intersections, highlighting the significant impact of CAVs on traffic control performance improvement. We first review the fundamental concepts of RL algorithms, establishing a foundational understanding for subsequent RL-based traffic control methods. We then review recent progress in RL-based traffic signal control using CV/CAV trajectory data, RL-based CAV trajectory planning, and the cooperative control of both traffic signals and CAVs at signalised intersections. Our aim is to provide researchers with a comprehensive roadmap for future research in RL-based traffic control at signalised intersections.
期刊介绍:
Transport Reviews is an international journal that comprehensively covers all aspects of transportation. It offers authoritative and current research-based reviews on transportation-related topics, catering to a knowledgeable audience while also being accessible to a wide readership.
Encouraging submissions from diverse disciplinary perspectives such as economics and engineering, as well as various subject areas like social issues and the environment, Transport Reviews welcomes contributions employing different methodological approaches, including modeling, qualitative methods, or mixed-methods. The reviews typically introduce new methodologies, analyses, innovative viewpoints, and original data, although they are not limited to research-based content.