Researches on Intelligent Traffic Signal Control Based on Deep Reinforcement Learning

Abstract

The rapidly growing traffic flow exceeds the capacity of the existing infrastructure. It will cause traffic congestion and increase travel time and carbon emissions. Intelligent traffic signal control is a significant element in intelligent transportation system. In order to improve the efficiency of intelligent traffic signal control, the traffic information needs to be collected and processed in real-time. In this paper, we propose a deep reinforcement learning model for traffic signal control. In this model, intersections are divided into several grids of different sizes, which represents the complex traffic state. The switching of traffic signals are defined as actions, and the weighted sum of various indicators reflecting traffic conditions is defined as rewards. The whole process is modeled as Markov Decision Process (MDP), and Convolutional Neural Network (CNN) is used to map the states to rewards. We evaluated the efficiency of the model through Simulation of Urban Mobility (SUMO), and the simulation results proved the efficiency of the model.