{"title":"基于深度强化学习和知识转移的互联自动驾驶汽车的舒适驾驶控制","authors":"Chuna Wu, Jing Chen, Jinqiang Yao, Tianyi Chen, Jing Cao, Cong Zhao","doi":"10.1049/itr2.12540","DOIUrl":null,"url":null,"abstract":"With the development of connected automated vehicles (CAVs), preview and large‐scale road profile information detected by different vehicles become available for speed planning and active suspension control of CAVs to enhance ride comfort. Existing methods are not well adapted to rough pavements of different districts, where the distributions of road roughness are significantly different because of the traffic volume, maintenance, weather, etc. This study proposes a comfortable driving framework by coordinating speed planning and suspension control with knowledge transfer. Based on existing speed planning approaches, a deep reinforcement learning (DRL) algorithm is designed to learn comfortable suspension control strategies with preview road and speed information. Fine‐tuning and lateral connection are adopted to transfer the learned knowledge for adaptability in different districts. DRL‐based suspension control models are trained and transferred using real‐world rough pavement data in districts of Shanghai, China. The experimental results show that the proposed control method increases vertical comfort by 41.10% on rough pavements, compared to model predictive control. The proposed framework is proven to be applicable to stochastic rough pavements for CAVs.","PeriodicalId":50381,"journal":{"name":"IET Intelligent Transport Systems","volume":null,"pages":null},"PeriodicalIF":2.3000,"publicationDate":"2024-08-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Comfortable driving control for connected automated vehicles based on deep reinforcement learning and knowledge transfer\",\"authors\":\"Chuna Wu, Jing Chen, Jinqiang Yao, Tianyi Chen, Jing Cao, Cong Zhao\",\"doi\":\"10.1049/itr2.12540\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"With the development of connected automated vehicles (CAVs), preview and large‐scale road profile information detected by different vehicles become available for speed planning and active suspension control of CAVs to enhance ride comfort. Existing methods are not well adapted to rough pavements of different districts, where the distributions of road roughness are significantly different because of the traffic volume, maintenance, weather, etc. This study proposes a comfortable driving framework by coordinating speed planning and suspension control with knowledge transfer. Based on existing speed planning approaches, a deep reinforcement learning (DRL) algorithm is designed to learn comfortable suspension control strategies with preview road and speed information. Fine‐tuning and lateral connection are adopted to transfer the learned knowledge for adaptability in different districts. DRL‐based suspension control models are trained and transferred using real‐world rough pavement data in districts of Shanghai, China. The experimental results show that the proposed control method increases vertical comfort by 41.10% on rough pavements, compared to model predictive control. The proposed framework is proven to be applicable to stochastic rough pavements for CAVs.\",\"PeriodicalId\":50381,\"journal\":{\"name\":\"IET Intelligent Transport Systems\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":2.3000,\"publicationDate\":\"2024-08-08\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IET Intelligent Transport Systems\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://doi.org/10.1049/itr2.12540\",\"RegionNum\":4,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IET Intelligent Transport Systems","FirstCategoryId":"5","ListUrlMain":"https://doi.org/10.1049/itr2.12540","RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
Comfortable driving control for connected automated vehicles based on deep reinforcement learning and knowledge transfer
With the development of connected automated vehicles (CAVs), preview and large‐scale road profile information detected by different vehicles become available for speed planning and active suspension control of CAVs to enhance ride comfort. Existing methods are not well adapted to rough pavements of different districts, where the distributions of road roughness are significantly different because of the traffic volume, maintenance, weather, etc. This study proposes a comfortable driving framework by coordinating speed planning and suspension control with knowledge transfer. Based on existing speed planning approaches, a deep reinforcement learning (DRL) algorithm is designed to learn comfortable suspension control strategies with preview road and speed information. Fine‐tuning and lateral connection are adopted to transfer the learned knowledge for adaptability in different districts. DRL‐based suspension control models are trained and transferred using real‐world rough pavement data in districts of Shanghai, China. The experimental results show that the proposed control method increases vertical comfort by 41.10% on rough pavements, compared to model predictive control. The proposed framework is proven to be applicable to stochastic rough pavements for CAVs.
期刊介绍:
IET Intelligent Transport Systems is an interdisciplinary journal devoted to research into the practical applications of ITS and infrastructures. The scope of the journal includes the following:
Sustainable traffic solutions
Deployments with enabling technologies
Pervasive monitoring
Applications; demonstrations and evaluation
Economic and behavioural analyses of ITS services and scenario
Data Integration and analytics
Information collection and processing; image processing applications in ITS
ITS aspects of electric vehicles
Autonomous vehicles; connected vehicle systems;
In-vehicle ITS, safety and vulnerable road user aspects
Mobility as a service systems
Traffic management and control
Public transport systems technologies
Fleet and public transport logistics
Emergency and incident management
Demand management and electronic payment systems
Traffic related air pollution management
Policy and institutional issues
Interoperability, standards and architectures
Funding scenarios
Enforcement
Human machine interaction
Education, training and outreach
Current Special Issue Call for papers:
Intelligent Transportation Systems in Smart Cities for Sustainable Environment - https://digital-library.theiet.org/files/IET_ITS_CFP_ITSSCSE.pdf
Sustainably Intelligent Mobility (SIM) - https://digital-library.theiet.org/files/IET_ITS_CFP_SIM.pdf
Traffic Theory and Modelling in the Era of Artificial Intelligence and Big Data (in collaboration with World Congress for Transport Research, WCTR 2019) - https://digital-library.theiet.org/files/IET_ITS_CFP_WCTR.pdf