Optimisation of Lane-Level Dynamic Traffic Control Strategy Based on Bidirectional Adaptive Gated Graph Convolutional Network and Deep Reinforcement Learning
IF 2.3 4区 工程技术Q2 ENGINEERING, ELECTRICAL & ELECTRONIC
{"title":"Optimisation of Lane-Level Dynamic Traffic Control Strategy Based on Bidirectional Adaptive Gated Graph Convolutional Network and Deep Reinforcement Learning","authors":"Shaowei Sun, Mingzhou Liu","doi":"10.1049/itr2.70055","DOIUrl":null,"url":null,"abstract":"<p>This paper innovatively proposes a lane-level dynamic traffic control strategy optimisation method integrating the bidirectional adaptive gated graph convolutional network (Bi-AGGCN) and deep reinforcement learning (DRL). The core innovation lies in three aspects. First, Bi-AGGCN is introduced to precisely capture the spatiotemporal dependencies of traffic flow by simultaneously considering forward and backward information, overcoming the limitations of traditional unidirectional models. Second, an improved deep Q-network (DQN) algorithm is adopted, incorporating a dual network structure, experience pool sampling strategy, and dominance function, which effectively enhances the learning speed and estimation accuracy of the value function. Third, the combination of Bi-AGGCN and DRL enables the framework to automatically adjust traffic signal parameters based on real-time traffic flow, achieving dynamic optimisation of traffic flow. Experimental results indicate that compared with traditional timed signal control (FTSC), fast Q-learning (FQ learning), and modified DQN (M-DQN) algorithms, the proposed Bi-AGGCN + DRL model demonstrates significant advantages. In the experiment, the traffic flow of this model reaches 2600 pcu/h, the delay time is reduced to 90 s, the lane-level control response speed is shortened to 5 s, and the average lane speed is increased to 110 km/h. This verifies the efficiency and feasibility of the model in lane-level traffic control, providing feasible technical support and optimisation directions for the traffic management of actual highways.</p>","PeriodicalId":50381,"journal":{"name":"IET Intelligent Transport Systems","volume":"19 1","pages":""},"PeriodicalIF":2.3000,"publicationDate":"2025-06-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1049/itr2.70055","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IET Intelligent Transport Systems","FirstCategoryId":"5","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1049/itr2.70055","RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0
Abstract
This paper innovatively proposes a lane-level dynamic traffic control strategy optimisation method integrating the bidirectional adaptive gated graph convolutional network (Bi-AGGCN) and deep reinforcement learning (DRL). The core innovation lies in three aspects. First, Bi-AGGCN is introduced to precisely capture the spatiotemporal dependencies of traffic flow by simultaneously considering forward and backward information, overcoming the limitations of traditional unidirectional models. Second, an improved deep Q-network (DQN) algorithm is adopted, incorporating a dual network structure, experience pool sampling strategy, and dominance function, which effectively enhances the learning speed and estimation accuracy of the value function. Third, the combination of Bi-AGGCN and DRL enables the framework to automatically adjust traffic signal parameters based on real-time traffic flow, achieving dynamic optimisation of traffic flow. Experimental results indicate that compared with traditional timed signal control (FTSC), fast Q-learning (FQ learning), and modified DQN (M-DQN) algorithms, the proposed Bi-AGGCN + DRL model demonstrates significant advantages. In the experiment, the traffic flow of this model reaches 2600 pcu/h, the delay time is reduced to 90 s, the lane-level control response speed is shortened to 5 s, and the average lane speed is increased to 110 km/h. This verifies the efficiency and feasibility of the model in lane-level traffic control, providing feasible technical support and optimisation directions for the traffic management of actual highways.
期刊介绍:
IET Intelligent Transport Systems is an interdisciplinary journal devoted to research into the practical applications of ITS and infrastructures. The scope of the journal includes the following:
Sustainable traffic solutions
Deployments with enabling technologies
Pervasive monitoring
Applications; demonstrations and evaluation
Economic and behavioural analyses of ITS services and scenario
Data Integration and analytics
Information collection and processing; image processing applications in ITS
ITS aspects of electric vehicles
Autonomous vehicles; connected vehicle systems;
In-vehicle ITS, safety and vulnerable road user aspects
Mobility as a service systems
Traffic management and control
Public transport systems technologies
Fleet and public transport logistics
Emergency and incident management
Demand management and electronic payment systems
Traffic related air pollution management
Policy and institutional issues
Interoperability, standards and architectures
Funding scenarios
Enforcement
Human machine interaction
Education, training and outreach
Current Special Issue Call for papers:
Intelligent Transportation Systems in Smart Cities for Sustainable Environment - https://digital-library.theiet.org/files/IET_ITS_CFP_ITSSCSE.pdf
Sustainably Intelligent Mobility (SIM) - https://digital-library.theiet.org/files/IET_ITS_CFP_SIM.pdf
Traffic Theory and Modelling in the Era of Artificial Intelligence and Big Data (in collaboration with World Congress for Transport Research, WCTR 2019) - https://digital-library.theiet.org/files/IET_ITS_CFP_WCTR.pdf