{"title":"基于多智能体深度强化学习的区域智能交通信号控制系统","authors":"Peng Zheng, Yanhao Chen, B. V. D. Kumar","doi":"10.1109/ICCCS57501.2023.10150595","DOIUrl":null,"url":null,"abstract":"Urban traffic congestion is becoming a severe problem. A reinforcement learning-based intelligent traffic signal control system can alleviate traffic congestion problems. However, when reinforcement learning faces complex multi-agent decision problems, it is difficult for single-agent reinforcement learning algorithms to realize the complex relationships among multiple agents. Therefore, integrating reinforcement learning with multi-agent techniques in multiple ways is becoming inevitable. Based on reinforcement learning, multi-agents obtain optimal regional strategies through continuous interaction and improvement. This paper proposes a new approach to regional intelligent traffic signal control combining multi-agent techniques and deep reinforcement learning. The method effectively reduces the average trip waiting time (ATWT) and the total waiting queue length (TWQL) of vehicles in the region while performing better on the reward function compared to the deep Q network (DQN) algorithm. This approach improves traffic efficiency and increases resource utilization efficiency while reducing congestion time, road utilization, and resource waste.","PeriodicalId":266168,"journal":{"name":"2023 8th International Conference on Computer and Communication Systems (ICCCS)","volume":"18 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-04-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Regional Intelligent Traffic Signal Control System Based on Multi-agent Deep Reinforcement Learning\",\"authors\":\"Peng Zheng, Yanhao Chen, B. V. D. Kumar\",\"doi\":\"10.1109/ICCCS57501.2023.10150595\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Urban traffic congestion is becoming a severe problem. A reinforcement learning-based intelligent traffic signal control system can alleviate traffic congestion problems. However, when reinforcement learning faces complex multi-agent decision problems, it is difficult for single-agent reinforcement learning algorithms to realize the complex relationships among multiple agents. Therefore, integrating reinforcement learning with multi-agent techniques in multiple ways is becoming inevitable. Based on reinforcement learning, multi-agents obtain optimal regional strategies through continuous interaction and improvement. This paper proposes a new approach to regional intelligent traffic signal control combining multi-agent techniques and deep reinforcement learning. The method effectively reduces the average trip waiting time (ATWT) and the total waiting queue length (TWQL) of vehicles in the region while performing better on the reward function compared to the deep Q network (DQN) algorithm. This approach improves traffic efficiency and increases resource utilization efficiency while reducing congestion time, road utilization, and resource waste.\",\"PeriodicalId\":266168,\"journal\":{\"name\":\"2023 8th International Conference on Computer and Communication Systems (ICCCS)\",\"volume\":\"18 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-04-21\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2023 8th International Conference on Computer and Communication Systems (ICCCS)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ICCCS57501.2023.10150595\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2023 8th International Conference on Computer and Communication Systems (ICCCS)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICCCS57501.2023.10150595","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Regional Intelligent Traffic Signal Control System Based on Multi-agent Deep Reinforcement Learning
Urban traffic congestion is becoming a severe problem. A reinforcement learning-based intelligent traffic signal control system can alleviate traffic congestion problems. However, when reinforcement learning faces complex multi-agent decision problems, it is difficult for single-agent reinforcement learning algorithms to realize the complex relationships among multiple agents. Therefore, integrating reinforcement learning with multi-agent techniques in multiple ways is becoming inevitable. Based on reinforcement learning, multi-agents obtain optimal regional strategies through continuous interaction and improvement. This paper proposes a new approach to regional intelligent traffic signal control combining multi-agent techniques and deep reinforcement learning. The method effectively reduces the average trip waiting time (ATWT) and the total waiting queue length (TWQL) of vehicles in the region while performing better on the reward function compared to the deep Q network (DQN) algorithm. This approach improves traffic efficiency and increases resource utilization efficiency while reducing congestion time, road utilization, and resource waste.