Chenghao Li, Xiaoteng Ma, Li Xia, Qianchuan Zhao, Jun Yang
{"title":"基于深度强化学习的交通灯公平性控制","authors":"Chenghao Li, Xiaoteng Ma, Li Xia, Qianchuan Zhao, Jun Yang","doi":"10.1109/CASE48305.2020.9216899","DOIUrl":null,"url":null,"abstract":"Traffic congestion is a severe issue of a developing world. Recently, many researchers are attempting to utilize deep reinforcement learning algorithms to bring intelligence to traffic lights. To the best of our knowledge, most prior researchers only consider the average criterion of all vehicles while training. However, fairness is another important metric but ignored. In this paper, we study the fairness control of traffic light and propose a deep reinforcement learning algorithm to optimize the fairness of all drivers’ waiting time. The objective is to minimize the maximal waiting time of drivers during a light time loop, which also partly reflects the optimization of the average waiting time. We conduct experiments for a 4-lane crossroad in SUMO. Simulation results show that our algorithm can efficiently optimize the fairness criterion. Meanwhile the average criterion is further improved. We wish to shed light on complementing the entire framework of reinforcement learning with our research on fairness control.","PeriodicalId":212181,"journal":{"name":"2020 IEEE 16th International Conference on Automation Science and Engineering (CASE)","volume":"45 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2020-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"8","resultStr":"{\"title\":\"Fairness Control of Traffic Light via Deep Reinforcement Learning\",\"authors\":\"Chenghao Li, Xiaoteng Ma, Li Xia, Qianchuan Zhao, Jun Yang\",\"doi\":\"10.1109/CASE48305.2020.9216899\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Traffic congestion is a severe issue of a developing world. Recently, many researchers are attempting to utilize deep reinforcement learning algorithms to bring intelligence to traffic lights. To the best of our knowledge, most prior researchers only consider the average criterion of all vehicles while training. However, fairness is another important metric but ignored. In this paper, we study the fairness control of traffic light and propose a deep reinforcement learning algorithm to optimize the fairness of all drivers’ waiting time. The objective is to minimize the maximal waiting time of drivers during a light time loop, which also partly reflects the optimization of the average waiting time. We conduct experiments for a 4-lane crossroad in SUMO. Simulation results show that our algorithm can efficiently optimize the fairness criterion. Meanwhile the average criterion is further improved. We wish to shed light on complementing the entire framework of reinforcement learning with our research on fairness control.\",\"PeriodicalId\":212181,\"journal\":{\"name\":\"2020 IEEE 16th International Conference on Automation Science and Engineering (CASE)\",\"volume\":\"45 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2020-08-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"8\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2020 IEEE 16th International Conference on Automation Science and Engineering (CASE)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/CASE48305.2020.9216899\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2020 IEEE 16th International Conference on Automation Science and Engineering (CASE)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/CASE48305.2020.9216899","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Fairness Control of Traffic Light via Deep Reinforcement Learning
Traffic congestion is a severe issue of a developing world. Recently, many researchers are attempting to utilize deep reinforcement learning algorithms to bring intelligence to traffic lights. To the best of our knowledge, most prior researchers only consider the average criterion of all vehicles while training. However, fairness is another important metric but ignored. In this paper, we study the fairness control of traffic light and propose a deep reinforcement learning algorithm to optimize the fairness of all drivers’ waiting time. The objective is to minimize the maximal waiting time of drivers during a light time loop, which also partly reflects the optimization of the average waiting time. We conduct experiments for a 4-lane crossroad in SUMO. Simulation results show that our algorithm can efficiently optimize the fairness criterion. Meanwhile the average criterion is further improved. We wish to shed light on complementing the entire framework of reinforcement learning with our research on fairness control.