{"title":"基于深度强化学习的ITS多路口交通信号优化","authors":"A. Paul, S. Mitra","doi":"10.1109/ANTS50601.2020.9342819","DOIUrl":null,"url":null,"abstract":"The number of vehicles is drastically increasing worldwide, especially in large cities. Thus there is a need to model and enhance the traffic management to help meet this rising requirement. The primary purpose of traffic management is to reduce traffic congestion by optimizing traffic signal, which is currently one of the main concerns. Reinforcement Learning (RL) approaches in Intelligent Transportation System (ITS) are infeasible for traffic management of large road networks. However, Deep Reinforcement Learning (DRL) is capable of handling this enlarged problem. In order to manage the traffic flow of a large road network, there is a strong need for coordination between traffic signals of the intersections, enabling vehicles to pass through intersections more easily. In this paper, a single DRL agent manages the traffic signal of multiple intersections using policy gradient algorithm. In particular, the agent is trained with spatio-temporal data of the environment that allows it to perform action in different deep neural network models. The simulation experiment is studied in terms of three different simulation metrics. The proposed system outperforms while comparing it with the baseline i.e. fixed signal duration systems.","PeriodicalId":426651,"journal":{"name":"2020 IEEE International Conference on Advanced Networks and Telecommunications Systems (ANTS)","volume":"2 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2020-12-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"8","resultStr":"{\"title\":\"Deep Reinforcement Learning based Traffic Signal optimization for Multiple Intersections in ITS\",\"authors\":\"A. Paul, S. Mitra\",\"doi\":\"10.1109/ANTS50601.2020.9342819\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"The number of vehicles is drastically increasing worldwide, especially in large cities. Thus there is a need to model and enhance the traffic management to help meet this rising requirement. The primary purpose of traffic management is to reduce traffic congestion by optimizing traffic signal, which is currently one of the main concerns. Reinforcement Learning (RL) approaches in Intelligent Transportation System (ITS) are infeasible for traffic management of large road networks. However, Deep Reinforcement Learning (DRL) is capable of handling this enlarged problem. In order to manage the traffic flow of a large road network, there is a strong need for coordination between traffic signals of the intersections, enabling vehicles to pass through intersections more easily. In this paper, a single DRL agent manages the traffic signal of multiple intersections using policy gradient algorithm. In particular, the agent is trained with spatio-temporal data of the environment that allows it to perform action in different deep neural network models. The simulation experiment is studied in terms of three different simulation metrics. The proposed system outperforms while comparing it with the baseline i.e. fixed signal duration systems.\",\"PeriodicalId\":426651,\"journal\":{\"name\":\"2020 IEEE International Conference on Advanced Networks and Telecommunications Systems (ANTS)\",\"volume\":\"2 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2020-12-14\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"8\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2020 IEEE International Conference on Advanced Networks and Telecommunications Systems (ANTS)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ANTS50601.2020.9342819\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2020 IEEE International Conference on Advanced Networks and Telecommunications Systems (ANTS)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ANTS50601.2020.9342819","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Deep Reinforcement Learning based Traffic Signal optimization for Multiple Intersections in ITS
The number of vehicles is drastically increasing worldwide, especially in large cities. Thus there is a need to model and enhance the traffic management to help meet this rising requirement. The primary purpose of traffic management is to reduce traffic congestion by optimizing traffic signal, which is currently one of the main concerns. Reinforcement Learning (RL) approaches in Intelligent Transportation System (ITS) are infeasible for traffic management of large road networks. However, Deep Reinforcement Learning (DRL) is capable of handling this enlarged problem. In order to manage the traffic flow of a large road network, there is a strong need for coordination between traffic signals of the intersections, enabling vehicles to pass through intersections more easily. In this paper, a single DRL agent manages the traffic signal of multiple intersections using policy gradient algorithm. In particular, the agent is trained with spatio-temporal data of the environment that allows it to perform action in different deep neural network models. The simulation experiment is studied in terms of three different simulation metrics. The proposed system outperforms while comparing it with the baseline i.e. fixed signal duration systems.