Ricardo Yauri, Frank Silva, Ademir Huaccho, Oscar Llerena
{"title":"基于深度强化学习的智能交通灯系统","authors":"Ricardo Yauri, Frank Silva, Ademir Huaccho, Oscar Llerena","doi":"10.37394/23203.2023.18.26","DOIUrl":null,"url":null,"abstract":"Currently, population growth in cities results in an increase in urban vehicle traffic. That is why it is necessary to improve the quality of life of citizens based on the improvement of transport control services. To solve this problem, there are solutions, related to the improvement of the road infrastructure by increasing the roads or paths. One of the solutions is using traffic lights that allow traffic regulation automatically with machine learning techniques. That is why the implementation of an intelligent traffic light system with automatic learning by reinforcement is proposed to reduce vehicular and pedestrian traffic. As a result, the use of the YOLOv4 tool allowed us to adequately count cars and people, differentiating them based on size and other characteristics. On the other hand, the position of the camera and its resolution is a key point for counting vehicles by detecting their contour. An improvement in time has been obtained using reinforcement learning, which depends on the number of episodes analyzed and affects the length of training time, where the analysis of 100 episodes takes around 12 hours on a Ryzen 7 computer with a graphics card built-in 2 GB.","PeriodicalId":39422,"journal":{"name":"WSEAS Transactions on Systems and Control","volume":"34 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-09-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Intelligent Traffic Light System using Deep Reinforcement Learning\",\"authors\":\"Ricardo Yauri, Frank Silva, Ademir Huaccho, Oscar Llerena\",\"doi\":\"10.37394/23203.2023.18.26\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Currently, population growth in cities results in an increase in urban vehicle traffic. That is why it is necessary to improve the quality of life of citizens based on the improvement of transport control services. To solve this problem, there are solutions, related to the improvement of the road infrastructure by increasing the roads or paths. One of the solutions is using traffic lights that allow traffic regulation automatically with machine learning techniques. That is why the implementation of an intelligent traffic light system with automatic learning by reinforcement is proposed to reduce vehicular and pedestrian traffic. As a result, the use of the YOLOv4 tool allowed us to adequately count cars and people, differentiating them based on size and other characteristics. On the other hand, the position of the camera and its resolution is a key point for counting vehicles by detecting their contour. An improvement in time has been obtained using reinforcement learning, which depends on the number of episodes analyzed and affects the length of training time, where the analysis of 100 episodes takes around 12 hours on a Ryzen 7 computer with a graphics card built-in 2 GB.\",\"PeriodicalId\":39422,\"journal\":{\"name\":\"WSEAS Transactions on Systems and Control\",\"volume\":\"34 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-09-12\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"WSEAS Transactions on Systems and Control\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.37394/23203.2023.18.26\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"Mathematics\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"WSEAS Transactions on Systems and Control","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.37394/23203.2023.18.26","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"Mathematics","Score":null,"Total":0}
Intelligent Traffic Light System using Deep Reinforcement Learning
Currently, population growth in cities results in an increase in urban vehicle traffic. That is why it is necessary to improve the quality of life of citizens based on the improvement of transport control services. To solve this problem, there are solutions, related to the improvement of the road infrastructure by increasing the roads or paths. One of the solutions is using traffic lights that allow traffic regulation automatically with machine learning techniques. That is why the implementation of an intelligent traffic light system with automatic learning by reinforcement is proposed to reduce vehicular and pedestrian traffic. As a result, the use of the YOLOv4 tool allowed us to adequately count cars and people, differentiating them based on size and other characteristics. On the other hand, the position of the camera and its resolution is a key point for counting vehicles by detecting their contour. An improvement in time has been obtained using reinforcement learning, which depends on the number of episodes analyzed and affects the length of training time, where the analysis of 100 episodes takes around 12 hours on a Ryzen 7 computer with a graphics card built-in 2 GB.
期刊介绍:
WSEAS Transactions on Systems and Control publishes original research papers relating to systems theory and automatic control. We aim to bring important work to a wide international audience and therefore only publish papers of exceptional scientific value that advance our understanding of these particular areas. The research presented must transcend the limits of case studies, while both experimental and theoretical studies are accepted. It is a multi-disciplinary journal and therefore its content mirrors the diverse interests and approaches of scholars involved with systems theory, dynamical systems, linear and non-linear control, intelligent control, robotics and related areas. We also welcome scholarly contributions from officials with government agencies, international agencies, and non-governmental organizations.