基于深度强化学习的孤立交叉口自适应红绿灯控制新方法

Tarek Amine Haddad, D. Hedjazi, Sofiane Aouag
{"title":"基于深度强化学习的孤立交叉口自适应红绿灯控制新方法","authors":"Tarek Amine Haddad, D. Hedjazi, Sofiane Aouag","doi":"10.1109/ISIA55826.2022.9993598","DOIUrl":null,"url":null,"abstract":"In this work, we focus on optimizing traffic signal control at an isolated intersection and subsequently alleviate the traffic flow. We propose a new Deep Reinforcement Learning-based approach. Thus, the traffic network controller in an isolated intersection is modelled as an intelligent agent that perceives the discrete state encoding of traffic information as the network inputs. Our contribution resides to use a Double Deep Q-Network (DDQN). This argues that the idea of having a simplified state and reward formula facilitates the training of the agent by simplifying the convergence of the latter. It dynamically select the phases improving the traffic quality. The experimental results shows that the proposed approach is competitive in terms of Average Waiting Time, Average Queue Length, Average Fuel Consumption and Average Emission CO2 at intersection when compared to some baseline methods.","PeriodicalId":169898,"journal":{"name":"2022 5th International Symposium on Informatics and its Applications (ISIA)","volume":"12 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-11-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A New Deep Reinforcement Learning-Based Adaptive Traffic Light Control Approach for Isolated Intersection\",\"authors\":\"Tarek Amine Haddad, D. Hedjazi, Sofiane Aouag\",\"doi\":\"10.1109/ISIA55826.2022.9993598\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"In this work, we focus on optimizing traffic signal control at an isolated intersection and subsequently alleviate the traffic flow. We propose a new Deep Reinforcement Learning-based approach. Thus, the traffic network controller in an isolated intersection is modelled as an intelligent agent that perceives the discrete state encoding of traffic information as the network inputs. Our contribution resides to use a Double Deep Q-Network (DDQN). This argues that the idea of having a simplified state and reward formula facilitates the training of the agent by simplifying the convergence of the latter. It dynamically select the phases improving the traffic quality. The experimental results shows that the proposed approach is competitive in terms of Average Waiting Time, Average Queue Length, Average Fuel Consumption and Average Emission CO2 at intersection when compared to some baseline methods.\",\"PeriodicalId\":169898,\"journal\":{\"name\":\"2022 5th International Symposium on Informatics and its Applications (ISIA)\",\"volume\":\"12 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-11-29\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2022 5th International Symposium on Informatics and its Applications (ISIA)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ISIA55826.2022.9993598\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 5th International Symposium on Informatics and its Applications (ISIA)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ISIA55826.2022.9993598","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

在本研究中,我们着重于优化孤立交叉口的交通信号控制,从而缓解交通流量。我们提出了一种新的基于深度强化学习的方法。因此,孤立路口的交通网络控制器被建模为一个智能代理,它将交通信息的离散状态编码视为网络输入。我们的贡献在于使用双深度q网络(DDQN)。该理论认为,简化状态和奖励公式的想法通过简化后者的收敛性来促进代理的训练。它动态地选择提高交通质量的阶段。实验结果表明,该方法在平均等待时间、平均排队长度、平均燃油消耗和平均交叉口二氧化碳排放等方面均优于一些基准方法。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
A New Deep Reinforcement Learning-Based Adaptive Traffic Light Control Approach for Isolated Intersection
In this work, we focus on optimizing traffic signal control at an isolated intersection and subsequently alleviate the traffic flow. We propose a new Deep Reinforcement Learning-based approach. Thus, the traffic network controller in an isolated intersection is modelled as an intelligent agent that perceives the discrete state encoding of traffic information as the network inputs. Our contribution resides to use a Double Deep Q-Network (DDQN). This argues that the idea of having a simplified state and reward formula facilitates the training of the agent by simplifying the convergence of the latter. It dynamically select the phases improving the traffic quality. The experimental results shows that the proposed approach is competitive in terms of Average Waiting Time, Average Queue Length, Average Fuel Consumption and Average Emission CO2 at intersection when compared to some baseline methods.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信