基于深度强化学习和知识转移的互联自动驾驶汽车的舒适驾驶控制

IF 2.3 4区 工程技术 Q2 ENGINEERING, ELECTRICAL & ELECTRONIC
Chuna Wu, Jing Chen, Jinqiang Yao, Tianyi Chen, Jing Cao, Cong Zhao
{"title":"基于深度强化学习和知识转移的互联自动驾驶汽车的舒适驾驶控制","authors":"Chuna Wu, Jing Chen, Jinqiang Yao, Tianyi Chen, Jing Cao, Cong Zhao","doi":"10.1049/itr2.12540","DOIUrl":null,"url":null,"abstract":"With the development of connected automated vehicles (CAVs), preview and large‐scale road profile information detected by different vehicles become available for speed planning and active suspension control of CAVs to enhance ride comfort. Existing methods are not well adapted to rough pavements of different districts, where the distributions of road roughness are significantly different because of the traffic volume, maintenance, weather, etc. This study proposes a comfortable driving framework by coordinating speed planning and suspension control with knowledge transfer. Based on existing speed planning approaches, a deep reinforcement learning (DRL) algorithm is designed to learn comfortable suspension control strategies with preview road and speed information. Fine‐tuning and lateral connection are adopted to transfer the learned knowledge for adaptability in different districts. DRL‐based suspension control models are trained and transferred using real‐world rough pavement data in districts of Shanghai, China. The experimental results show that the proposed control method increases vertical comfort by 41.10% on rough pavements, compared to model predictive control. The proposed framework is proven to be applicable to stochastic rough pavements for CAVs.","PeriodicalId":50381,"journal":{"name":"IET Intelligent Transport Systems","volume":null,"pages":null},"PeriodicalIF":2.3000,"publicationDate":"2024-08-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Comfortable driving control for connected automated vehicles based on deep reinforcement learning and knowledge transfer\",\"authors\":\"Chuna Wu, Jing Chen, Jinqiang Yao, Tianyi Chen, Jing Cao, Cong Zhao\",\"doi\":\"10.1049/itr2.12540\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"With the development of connected automated vehicles (CAVs), preview and large‐scale road profile information detected by different vehicles become available for speed planning and active suspension control of CAVs to enhance ride comfort. Existing methods are not well adapted to rough pavements of different districts, where the distributions of road roughness are significantly different because of the traffic volume, maintenance, weather, etc. This study proposes a comfortable driving framework by coordinating speed planning and suspension control with knowledge transfer. Based on existing speed planning approaches, a deep reinforcement learning (DRL) algorithm is designed to learn comfortable suspension control strategies with preview road and speed information. Fine‐tuning and lateral connection are adopted to transfer the learned knowledge for adaptability in different districts. DRL‐based suspension control models are trained and transferred using real‐world rough pavement data in districts of Shanghai, China. The experimental results show that the proposed control method increases vertical comfort by 41.10% on rough pavements, compared to model predictive control. The proposed framework is proven to be applicable to stochastic rough pavements for CAVs.\",\"PeriodicalId\":50381,\"journal\":{\"name\":\"IET Intelligent Transport Systems\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":2.3000,\"publicationDate\":\"2024-08-08\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IET Intelligent Transport Systems\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://doi.org/10.1049/itr2.12540\",\"RegionNum\":4,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IET Intelligent Transport Systems","FirstCategoryId":"5","ListUrlMain":"https://doi.org/10.1049/itr2.12540","RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0

摘要

随着联网自动驾驶汽车(CAV)的发展,不同车辆检测到的预览和大规模路面信息可用于自动驾驶汽车的速度规划和主动悬架控制,以提高乘坐舒适性。现有方法不能很好地适应不同地区的粗糙路面,因为这些地区的路面粗糙度分布因交通流量、维护、天气等因素而存在显著差异。本研究通过协调速度规划和悬挂控制与知识转移,提出了一种舒适驾驶框架。在现有速度规划方法的基础上,设计了一种深度强化学习(DRL)算法,通过预览道路和速度信息来学习舒适的悬架控制策略。采用微调和横向联系来传递所学知识,以适应不同地区的情况。基于 DRL 的悬架控制模型利用中国上海各区的实际粗糙路面数据进行了训练和传输。实验结果表明,与模型预测控制相比,所提出的控制方法可将粗糙路面上的垂直舒适度提高 41.10%。事实证明,所提出的框架适用于适用于 CAV 的随机粗糙路面。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Comfortable driving control for connected automated vehicles based on deep reinforcement learning and knowledge transfer
With the development of connected automated vehicles (CAVs), preview and large‐scale road profile information detected by different vehicles become available for speed planning and active suspension control of CAVs to enhance ride comfort. Existing methods are not well adapted to rough pavements of different districts, where the distributions of road roughness are significantly different because of the traffic volume, maintenance, weather, etc. This study proposes a comfortable driving framework by coordinating speed planning and suspension control with knowledge transfer. Based on existing speed planning approaches, a deep reinforcement learning (DRL) algorithm is designed to learn comfortable suspension control strategies with preview road and speed information. Fine‐tuning and lateral connection are adopted to transfer the learned knowledge for adaptability in different districts. DRL‐based suspension control models are trained and transferred using real‐world rough pavement data in districts of Shanghai, China. The experimental results show that the proposed control method increases vertical comfort by 41.10% on rough pavements, compared to model predictive control. The proposed framework is proven to be applicable to stochastic rough pavements for CAVs.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
IET Intelligent Transport Systems
IET Intelligent Transport Systems 工程技术-运输科技
CiteScore
6.50
自引率
7.40%
发文量
159
审稿时长
3 months
期刊介绍: IET Intelligent Transport Systems is an interdisciplinary journal devoted to research into the practical applications of ITS and infrastructures. The scope of the journal includes the following: Sustainable traffic solutions Deployments with enabling technologies Pervasive monitoring Applications; demonstrations and evaluation Economic and behavioural analyses of ITS services and scenario Data Integration and analytics Information collection and processing; image processing applications in ITS ITS aspects of electric vehicles Autonomous vehicles; connected vehicle systems; In-vehicle ITS, safety and vulnerable road user aspects Mobility as a service systems Traffic management and control Public transport systems technologies Fleet and public transport logistics Emergency and incident management Demand management and electronic payment systems Traffic related air pollution management Policy and institutional issues Interoperability, standards and architectures Funding scenarios Enforcement Human machine interaction Education, training and outreach Current Special Issue Call for papers: Intelligent Transportation Systems in Smart Cities for Sustainable Environment - https://digital-library.theiet.org/files/IET_ITS_CFP_ITSSCSE.pdf Sustainably Intelligent Mobility (SIM) - https://digital-library.theiet.org/files/IET_ITS_CFP_SIM.pdf Traffic Theory and Modelling in the Era of Artificial Intelligence and Big Data (in collaboration with World Congress for Transport Research, WCTR 2019) - https://digital-library.theiet.org/files/IET_ITS_CFP_WCTR.pdf
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信