{"title":"信号交叉口部分无线充电车道生态驾驶:一种强化学习方法","authors":"Xinxing Ren;Chun Sing Lai;Zekun Guo;Gareth Taylor","doi":"10.1109/TCE.2024.3482101","DOIUrl":null,"url":null,"abstract":"Consumer electronics such as advanced GPS, vehicular sensors, inertial measurement units (IMUs), and wireless modules integrate vehicle-to-vehicle (V2V) and vehicle-to-infrastructure (V2I) within Internet of Things (IoT), enabling connected autonomous electric vehicles (CAEVs) to optimize energy optimization through eco-driving. In scenarios with traffic light intersections and partial wireless charging lanes (WCL), an eco-driving algorithm must consider net and gross energy consumption, safety, and traffic efficiency. We introduced a deep reinforcement learning (DRL) based eco-driving control approach, employing a twin-delayed deep deterministic policy gradient (TD3) agent for real-time acceleration planning. This approach uses reward functions for acceleration, velocity, safety, and efficiency, incorporating a dynamic velocity range model which not only enables the vehicle to smoothly pass the signalized intersections but also uses partial WCL efficiently and time-adaptively while ensuring traffic efficiency in diverse traffic scenarios. Tested in Simulation of Urban Mobility (SUMO) across various intersections with partial WCL, our method significantly lowered net and gross energy consumption by up to 44.01% and 17.19%, respectively, compared to conventional driving, while adhering to traffic and safety norms.","PeriodicalId":13208,"journal":{"name":"IEEE Transactions on Consumer Electronics","volume":"70 4","pages":"6547-6559"},"PeriodicalIF":4.3000,"publicationDate":"2024-10-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10720214","citationCount":"0","resultStr":"{\"title\":\"Eco-Driving With Partial Wireless Charging Lane at Signalized Intersection: A Reinforcement Learning Approach\",\"authors\":\"Xinxing Ren;Chun Sing Lai;Zekun Guo;Gareth Taylor\",\"doi\":\"10.1109/TCE.2024.3482101\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Consumer electronics such as advanced GPS, vehicular sensors, inertial measurement units (IMUs), and wireless modules integrate vehicle-to-vehicle (V2V) and vehicle-to-infrastructure (V2I) within Internet of Things (IoT), enabling connected autonomous electric vehicles (CAEVs) to optimize energy optimization through eco-driving. In scenarios with traffic light intersections and partial wireless charging lanes (WCL), an eco-driving algorithm must consider net and gross energy consumption, safety, and traffic efficiency. We introduced a deep reinforcement learning (DRL) based eco-driving control approach, employing a twin-delayed deep deterministic policy gradient (TD3) agent for real-time acceleration planning. This approach uses reward functions for acceleration, velocity, safety, and efficiency, incorporating a dynamic velocity range model which not only enables the vehicle to smoothly pass the signalized intersections but also uses partial WCL efficiently and time-adaptively while ensuring traffic efficiency in diverse traffic scenarios. Tested in Simulation of Urban Mobility (SUMO) across various intersections with partial WCL, our method significantly lowered net and gross energy consumption by up to 44.01% and 17.19%, respectively, compared to conventional driving, while adhering to traffic and safety norms.\",\"PeriodicalId\":13208,\"journal\":{\"name\":\"IEEE Transactions on Consumer Electronics\",\"volume\":\"70 4\",\"pages\":\"6547-6559\"},\"PeriodicalIF\":4.3000,\"publicationDate\":\"2024-10-16\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10720214\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Transactions on Consumer Electronics\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10720214/\",\"RegionNum\":2,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Consumer Electronics","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10720214/","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
Eco-Driving With Partial Wireless Charging Lane at Signalized Intersection: A Reinforcement Learning Approach
Consumer electronics such as advanced GPS, vehicular sensors, inertial measurement units (IMUs), and wireless modules integrate vehicle-to-vehicle (V2V) and vehicle-to-infrastructure (V2I) within Internet of Things (IoT), enabling connected autonomous electric vehicles (CAEVs) to optimize energy optimization through eco-driving. In scenarios with traffic light intersections and partial wireless charging lanes (WCL), an eco-driving algorithm must consider net and gross energy consumption, safety, and traffic efficiency. We introduced a deep reinforcement learning (DRL) based eco-driving control approach, employing a twin-delayed deep deterministic policy gradient (TD3) agent for real-time acceleration planning. This approach uses reward functions for acceleration, velocity, safety, and efficiency, incorporating a dynamic velocity range model which not only enables the vehicle to smoothly pass the signalized intersections but also uses partial WCL efficiently and time-adaptively while ensuring traffic efficiency in diverse traffic scenarios. Tested in Simulation of Urban Mobility (SUMO) across various intersections with partial WCL, our method significantly lowered net and gross energy consumption by up to 44.01% and 17.19%, respectively, compared to conventional driving, while adhering to traffic and safety norms.
期刊介绍:
The main focus for the IEEE Transactions on Consumer Electronics is the engineering and research aspects of the theory, design, construction, manufacture or end use of mass market electronics, systems, software and services for consumers.