{"title":"基于图像处理和强化学习的智能交通灯仿真","authors":"Chin Chun Keat, Sharifah Sakinah Syed Ahmad","doi":"10.1109/IICAIET55139.2022.9936772","DOIUrl":null,"url":null,"abstract":"Vehicle travel is on the rise across the world, particularly in metropolitan cities. As a result, simulating and optimizing traffic control algorithms is required to better handle this growing demand. In this research, we investigate the simulation and optimization of traffic light controllers in a city and provide a reinforcement learning-based approach. The algorithm that is used is deep Q-learning. There are four processes in this study. The first is data collection. Next, a simulation is built. Then, a reinforcement learning model is trained and tested in the model. Last, the results are compared between the traditional traffic lights and traffic lights that were applied with the reinforcement learning model. The results obtained in this study are queue length of vehicles in front of traffic light and delay time of vehicles after given green signal in two scenarios, which are an environment that uses traditional traffic light and an environment that uses traffic light that applied with reinforcement learning model. From the result, the environment that applied with reinforcement learning agent has shorter time delay and queue length of vehicles. Queue length of vehicles is reduced from 58 to 18 and time delay is reduced from 3900 seconds to 380 seconds.","PeriodicalId":142482,"journal":{"name":"2022 IEEE International Conference on Artificial Intelligence in Engineering and Technology (IICAIET)","volume":"4 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-09-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Simulation of Smart Traffic Light By Using Image Processing and Reinforcement Learning\",\"authors\":\"Chin Chun Keat, Sharifah Sakinah Syed Ahmad\",\"doi\":\"10.1109/IICAIET55139.2022.9936772\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Vehicle travel is on the rise across the world, particularly in metropolitan cities. As a result, simulating and optimizing traffic control algorithms is required to better handle this growing demand. In this research, we investigate the simulation and optimization of traffic light controllers in a city and provide a reinforcement learning-based approach. The algorithm that is used is deep Q-learning. There are four processes in this study. The first is data collection. Next, a simulation is built. Then, a reinforcement learning model is trained and tested in the model. Last, the results are compared between the traditional traffic lights and traffic lights that were applied with the reinforcement learning model. The results obtained in this study are queue length of vehicles in front of traffic light and delay time of vehicles after given green signal in two scenarios, which are an environment that uses traditional traffic light and an environment that uses traffic light that applied with reinforcement learning model. From the result, the environment that applied with reinforcement learning agent has shorter time delay and queue length of vehicles. Queue length of vehicles is reduced from 58 to 18 and time delay is reduced from 3900 seconds to 380 seconds.\",\"PeriodicalId\":142482,\"journal\":{\"name\":\"2022 IEEE International Conference on Artificial Intelligence in Engineering and Technology (IICAIET)\",\"volume\":\"4 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-09-13\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2022 IEEE International Conference on Artificial Intelligence in Engineering and Technology (IICAIET)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/IICAIET55139.2022.9936772\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 IEEE International Conference on Artificial Intelligence in Engineering and Technology (IICAIET)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/IICAIET55139.2022.9936772","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Simulation of Smart Traffic Light By Using Image Processing and Reinforcement Learning
Vehicle travel is on the rise across the world, particularly in metropolitan cities. As a result, simulating and optimizing traffic control algorithms is required to better handle this growing demand. In this research, we investigate the simulation and optimization of traffic light controllers in a city and provide a reinforcement learning-based approach. The algorithm that is used is deep Q-learning. There are four processes in this study. The first is data collection. Next, a simulation is built. Then, a reinforcement learning model is trained and tested in the model. Last, the results are compared between the traditional traffic lights and traffic lights that were applied with the reinforcement learning model. The results obtained in this study are queue length of vehicles in front of traffic light and delay time of vehicles after given green signal in two scenarios, which are an environment that uses traditional traffic light and an environment that uses traffic light that applied with reinforcement learning model. From the result, the environment that applied with reinforcement learning agent has shorter time delay and queue length of vehicles. Queue length of vehicles is reduced from 58 to 18 and time delay is reduced from 3900 seconds to 380 seconds.