{"title":"网联车辆智能变道决策方法","authors":"Zheyu Cui, Jianming Hu","doi":"10.1145/3487075.3487175","DOIUrl":null,"url":null,"abstract":"Aiming at the problem of driving scenarios redundancy in the lane change decision-making, this paper proposes a deep reinforcement learning method (DRL) for lane change decision based on embedded attention mechanism (CADQN). The algorithm introduces the Convolutional Attention Mechanism Module (CBAM) into the DQN network to optimize the scenarios in time and space dimensions, and assist connected vehicles in making lane changing decisions. The algorithm is verified by the traffic simulation platform under the highway environment, and the results show that CADQN is helpful to improve the global traffic efficiency, and with the increase of traffic flow density, the benefit is more significant. Moreover, the visualization results of the attention layer in the CADQN can guide the optimization of the driving scenario.","PeriodicalId":354966,"journal":{"name":"Proceedings of the 5th International Conference on Computer Science and Application Engineering","volume":"172 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-10-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"An Intelligent Lane Changing Decision Method for Connected Vehicles\",\"authors\":\"Zheyu Cui, Jianming Hu\",\"doi\":\"10.1145/3487075.3487175\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Aiming at the problem of driving scenarios redundancy in the lane change decision-making, this paper proposes a deep reinforcement learning method (DRL) for lane change decision based on embedded attention mechanism (CADQN). The algorithm introduces the Convolutional Attention Mechanism Module (CBAM) into the DQN network to optimize the scenarios in time and space dimensions, and assist connected vehicles in making lane changing decisions. The algorithm is verified by the traffic simulation platform under the highway environment, and the results show that CADQN is helpful to improve the global traffic efficiency, and with the increase of traffic flow density, the benefit is more significant. Moreover, the visualization results of the attention layer in the CADQN can guide the optimization of the driving scenario.\",\"PeriodicalId\":354966,\"journal\":{\"name\":\"Proceedings of the 5th International Conference on Computer Science and Application Engineering\",\"volume\":\"172 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2021-10-19\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Proceedings of the 5th International Conference on Computer Science and Application Engineering\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1145/3487075.3487175\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings of the 5th International Conference on Computer Science and Application Engineering","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1145/3487075.3487175","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
An Intelligent Lane Changing Decision Method for Connected Vehicles
Aiming at the problem of driving scenarios redundancy in the lane change decision-making, this paper proposes a deep reinforcement learning method (DRL) for lane change decision based on embedded attention mechanism (CADQN). The algorithm introduces the Convolutional Attention Mechanism Module (CBAM) into the DQN network to optimize the scenarios in time and space dimensions, and assist connected vehicles in making lane changing decisions. The algorithm is verified by the traffic simulation platform under the highway environment, and the results show that CADQN is helpful to improve the global traffic efficiency, and with the increase of traffic flow density, the benefit is more significant. Moreover, the visualization results of the attention layer in the CADQN can guide the optimization of the driving scenario.