Traffic Signal Control Optimization Based on Neural Network in the Framework of Model Predictive Control

IF 2.2 3区 工程技术 Q2 ENGINEERING, MECHANICAL
Actuators Pub Date : 2024-07-01 DOI:10.3390/act13070251
Dapeng Tang, Yuzhou Duan
{"title":"Traffic Signal Control Optimization Based on Neural Network in the Framework of Model Predictive Control","authors":"Dapeng Tang, Yuzhou Duan","doi":"10.3390/act13070251","DOIUrl":null,"url":null,"abstract":"To improve the effectiveness of model predictive control (MPC) in dynamic traffic signal control strategies, it has been combined with graph convolutional networks (GCNs) and deep reinforcement learning (DRL) technologies. In this study, a neural-network-based traffic signal control optimization method under the MPC framework is proposed. A dynamic correlation matrix is introduced in the predictive model to adapt to the dynamic changes in correlations between nodes over time. The signal control optimization strategy is solved using DRL, where the agent explores the optimal control strategy based on pre-set constraints in the future road environment. The geometric structure and traffic flow data of a real intersection were selected as the simulation validation environment, and a joint simulation was conducted using Python and SUMO. The experimental results indicate that in low-traffic scenarios, the queue length is reduced by more than 2 vehicles compared to the selected comparison methods; in high-traffic scenarios, the queue length is reduced by an average of 17 vehicles. Under the actual traffic data of the intersection, the average speed is increased by 6.4% compared to the fixed timing method; compared to the inductive signal control method, it increases from 9.76 m/s to 11.69 m/s, an improvement of 19.7%, effectively enhancing the intersection signal control performance.","PeriodicalId":48584,"journal":{"name":"Actuators","volume":null,"pages":null},"PeriodicalIF":2.2000,"publicationDate":"2024-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Actuators","FirstCategoryId":"5","ListUrlMain":"https://doi.org/10.3390/act13070251","RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENGINEERING, MECHANICAL","Score":null,"Total":0}
引用次数: 0

Abstract

To improve the effectiveness of model predictive control (MPC) in dynamic traffic signal control strategies, it has been combined with graph convolutional networks (GCNs) and deep reinforcement learning (DRL) technologies. In this study, a neural-network-based traffic signal control optimization method under the MPC framework is proposed. A dynamic correlation matrix is introduced in the predictive model to adapt to the dynamic changes in correlations between nodes over time. The signal control optimization strategy is solved using DRL, where the agent explores the optimal control strategy based on pre-set constraints in the future road environment. The geometric structure and traffic flow data of a real intersection were selected as the simulation validation environment, and a joint simulation was conducted using Python and SUMO. The experimental results indicate that in low-traffic scenarios, the queue length is reduced by more than 2 vehicles compared to the selected comparison methods; in high-traffic scenarios, the queue length is reduced by an average of 17 vehicles. Under the actual traffic data of the intersection, the average speed is increased by 6.4% compared to the fixed timing method; compared to the inductive signal control method, it increases from 9.76 m/s to 11.69 m/s, an improvement of 19.7%, effectively enhancing the intersection signal control performance.
基于模型预测控制框架下神经网络的交通信号控制优化
为了提高动态交通信号控制策略中模型预测控制(MPC)的有效性,人们将其与图卷积网络(GCN)和深度强化学习(DRL)技术相结合。本研究在 MPC 框架下提出了一种基于神经网络的交通信号控制优化方法。预测模型中引入了动态相关矩阵,以适应节点间相关性随时间的动态变化。信号控制优化策略采用 DRL 方法求解,代理在未来道路环境中根据预设约束条件探索最优控制策略。仿真验证环境选择了一个真实交叉口的几何结构和交通流数据,并使用 Python 和 SUMO 进行了联合仿真。实验结果表明,在低流量场景下,与所选对比方法相比,队列长度减少了 2 辆以上;在高流量场景下,队列长度平均减少了 17 辆。在交叉口实际交通数据下,与固定配时方法相比,平均车速提高了 6.4%;与感应信号控制方法相比,平均车速从 9.76 m/s 提高到 11.69 m/s,提高了 19.7%,有效提升了交叉口信号控制性能。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Actuators
Actuators Mathematics-Control and Optimization
CiteScore
3.90
自引率
15.40%
发文量
315
审稿时长
11 weeks
期刊介绍: Actuators (ISSN 2076-0825; CODEN: ACTUC3) is an international open access journal on the science and technology of actuators and control systems published quarterly online by MDPI.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信