Bin Zhou;Simon Hu;Yuanbo Yang;Xiaoxiang Na;Jose Escribano;Dongfang Ma;Sheng Jin;Bugao Zhang;Der-Horng Lee
{"title":"基于异构图深度强化学习的自动公交信号优先策略","authors":"Bin Zhou;Simon Hu;Yuanbo Yang;Xiaoxiang Na;Jose Escribano;Dongfang Ma;Sheng Jin;Bugao Zhang;Der-Horng Lee","doi":"10.1109/TIV.2024.3445299","DOIUrl":null,"url":null,"abstract":"Rapid advancements in vehicle communication and autonomous driving technologies have led to the emergence of Autonomous Public Transit Vehicles (APTVs), playing a pivotal role in enhancing the efficiency of on-demand flexible-route transit services. One promising approach to further optimize these services and alleviate urban traffic congestion is the development of smarter Transit Signal Priority (TSP) strategies. This paper proposes a decentralized intelligent traffic signal control algorithm based on Deep Reinforcement Learning (DRL), tailored for the TSP strategy supporting flexible-route transit services. Our algorithm can accommodate various road network structures and APTV penetration rates, ensuring extensive applicability. Specifically, it employs a heterogeneous graph model to capture diverse information, including network topologies and dynamic characteristics of APTVs. Through extensive testing in multiple scenarios across varied road networks and traffic conditions, our algorithm has consistently outperformed both traditional traffic control methods and state-of-the-art DRL-based methods. Furthermore, it demonstrates effective zero-shot transferability, adapting to real-world scenarios without additional training.","PeriodicalId":36532,"journal":{"name":"IEEE Transactions on Intelligent Vehicles","volume":"10 3","pages":"2174-2192"},"PeriodicalIF":14.3000,"publicationDate":"2024-09-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Transit Signal Priority Strategy With Heterogeneous Graph-Based Deep Reinforcement Learning for Autonomous Public Transit Vehicles\",\"authors\":\"Bin Zhou;Simon Hu;Yuanbo Yang;Xiaoxiang Na;Jose Escribano;Dongfang Ma;Sheng Jin;Bugao Zhang;Der-Horng Lee\",\"doi\":\"10.1109/TIV.2024.3445299\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Rapid advancements in vehicle communication and autonomous driving technologies have led to the emergence of Autonomous Public Transit Vehicles (APTVs), playing a pivotal role in enhancing the efficiency of on-demand flexible-route transit services. One promising approach to further optimize these services and alleviate urban traffic congestion is the development of smarter Transit Signal Priority (TSP) strategies. This paper proposes a decentralized intelligent traffic signal control algorithm based on Deep Reinforcement Learning (DRL), tailored for the TSP strategy supporting flexible-route transit services. Our algorithm can accommodate various road network structures and APTV penetration rates, ensuring extensive applicability. Specifically, it employs a heterogeneous graph model to capture diverse information, including network topologies and dynamic characteristics of APTVs. Through extensive testing in multiple scenarios across varied road networks and traffic conditions, our algorithm has consistently outperformed both traditional traffic control methods and state-of-the-art DRL-based methods. Furthermore, it demonstrates effective zero-shot transferability, adapting to real-world scenarios without additional training.\",\"PeriodicalId\":36532,\"journal\":{\"name\":\"IEEE Transactions on Intelligent Vehicles\",\"volume\":\"10 3\",\"pages\":\"2174-2192\"},\"PeriodicalIF\":14.3000,\"publicationDate\":\"2024-09-03\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Transactions on Intelligent Vehicles\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10663982/\",\"RegionNum\":1,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Intelligent Vehicles","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10663982/","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
Transit Signal Priority Strategy With Heterogeneous Graph-Based Deep Reinforcement Learning for Autonomous Public Transit Vehicles
Rapid advancements in vehicle communication and autonomous driving technologies have led to the emergence of Autonomous Public Transit Vehicles (APTVs), playing a pivotal role in enhancing the efficiency of on-demand flexible-route transit services. One promising approach to further optimize these services and alleviate urban traffic congestion is the development of smarter Transit Signal Priority (TSP) strategies. This paper proposes a decentralized intelligent traffic signal control algorithm based on Deep Reinforcement Learning (DRL), tailored for the TSP strategy supporting flexible-route transit services. Our algorithm can accommodate various road network structures and APTV penetration rates, ensuring extensive applicability. Specifically, it employs a heterogeneous graph model to capture diverse information, including network topologies and dynamic characteristics of APTVs. Through extensive testing in multiple scenarios across varied road networks and traffic conditions, our algorithm has consistently outperformed both traditional traffic control methods and state-of-the-art DRL-based methods. Furthermore, it demonstrates effective zero-shot transferability, adapting to real-world scenarios without additional training.
期刊介绍:
The IEEE Transactions on Intelligent Vehicles (T-IV) is a premier platform for publishing peer-reviewed articles that present innovative research concepts, application results, significant theoretical findings, and application case studies in the field of intelligent vehicles. With a particular emphasis on automated vehicles within roadway environments, T-IV aims to raise awareness of pressing research and application challenges.
Our focus is on providing critical information to the intelligent vehicle community, serving as a dissemination vehicle for IEEE ITS Society members and others interested in learning about the state-of-the-art developments and progress in research and applications related to intelligent vehicles. Join us in advancing knowledge and innovation in this dynamic field.