SEAE:使用事件触发注意力和探索驱动深度强化学习的稳定端到端自动驾驶

IF 3.7 2区 工程技术 Q1 COMPUTER SCIENCE, HARDWARE & ARCHITECTURE
Jianping Cui , Liang Yuan , Wendong Xiao , Teng Ran , Li He , Jianbo Zhang
{"title":"SEAE:使用事件触发注意力和探索驱动深度强化学习的稳定端到端自动驾驶","authors":"Jianping Cui ,&nbsp;Liang Yuan ,&nbsp;Wendong Xiao ,&nbsp;Teng Ran ,&nbsp;Li He ,&nbsp;Jianbo Zhang","doi":"10.1016/j.displa.2024.102946","DOIUrl":null,"url":null,"abstract":"<div><div>In self-driving cars, significant losses can be caused by various unstable factors. Thus, the use of the reinforcement learning self-driving technology with stability constraints is essential. The proposed multi-input stable autonomous driving based on exploration-driven with attention and event-triggered (SEAE) helps the agent program better autonomous driving with stability. This paper optimizes the input information processing of deep reinforcement learning using the multi-head self-attention mechanism, enhances the spatial exploration ability of the agent using the exploration-driven network. It combines the acceleration stability with the event-triggered mechanism to ensure a high driving safety while taking the driving stability into account. More precisely, the proposed multi-input approach treats the instantaneous acceleration as a constraint specified by the agent and optimizes the reward function, while taking into consideration the rate of motion change. Weights are then assigned to the data sequences through a multi-head self-attention mechanism, allowing the agent to focus on the environmental information part that is more important for the autonomous driving task received by the sensors. In addition, the proposed multi-input SEAE method is compatible with SAC and DDPG algorithms to verify its effectiveness in driving stability. The obtained results show that the proposed method has the highest performance in average reward value, average episode length, driving speed and driving stability in complex scenarios of autonomous driving tasks.</div></div>","PeriodicalId":50570,"journal":{"name":"Displays","volume":"87 ","pages":"Article 102946"},"PeriodicalIF":3.7000,"publicationDate":"2025-01-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"SEAE: Stable end-to-end autonomous driving using event-triggered attention and exploration-driven deep reinforcement learning\",\"authors\":\"Jianping Cui ,&nbsp;Liang Yuan ,&nbsp;Wendong Xiao ,&nbsp;Teng Ran ,&nbsp;Li He ,&nbsp;Jianbo Zhang\",\"doi\":\"10.1016/j.displa.2024.102946\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>In self-driving cars, significant losses can be caused by various unstable factors. Thus, the use of the reinforcement learning self-driving technology with stability constraints is essential. The proposed multi-input stable autonomous driving based on exploration-driven with attention and event-triggered (SEAE) helps the agent program better autonomous driving with stability. This paper optimizes the input information processing of deep reinforcement learning using the multi-head self-attention mechanism, enhances the spatial exploration ability of the agent using the exploration-driven network. It combines the acceleration stability with the event-triggered mechanism to ensure a high driving safety while taking the driving stability into account. More precisely, the proposed multi-input approach treats the instantaneous acceleration as a constraint specified by the agent and optimizes the reward function, while taking into consideration the rate of motion change. Weights are then assigned to the data sequences through a multi-head self-attention mechanism, allowing the agent to focus on the environmental information part that is more important for the autonomous driving task received by the sensors. In addition, the proposed multi-input SEAE method is compatible with SAC and DDPG algorithms to verify its effectiveness in driving stability. The obtained results show that the proposed method has the highest performance in average reward value, average episode length, driving speed and driving stability in complex scenarios of autonomous driving tasks.</div></div>\",\"PeriodicalId\":50570,\"journal\":{\"name\":\"Displays\",\"volume\":\"87 \",\"pages\":\"Article 102946\"},\"PeriodicalIF\":3.7000,\"publicationDate\":\"2025-01-03\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Displays\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S014193822400310X\",\"RegionNum\":2,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, HARDWARE & ARCHITECTURE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Displays","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S014193822400310X","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, HARDWARE & ARCHITECTURE","Score":null,"Total":0}
引用次数: 0

摘要

在自动驾驶汽车中,各种不稳定因素可能造成重大损失。因此,使用具有稳定性约束的强化学习自动驾驶技术是必不可少的。提出了一种基于探索驱动与注意事件触发(SEAE)的多输入稳定自动驾驶方法,帮助智能体程序更好地实现稳定自动驾驶。本文利用多头自注意机制优化深度强化学习的输入信息处理,利用探索驱动网络增强智能体的空间探索能力。它将加速稳定性与事件触发机制相结合,在考虑驾驶稳定性的同时确保高驾驶安全性。更准确地说,提出的多输入方法将瞬时加速度作为智能体指定的约束,并在考虑运动变化率的同时优化奖励函数。然后通过多头自关注机制为数据序列分配权重,使智能体能够专注于传感器接收到的对自动驾驶任务更重要的环境信息部分。此外,本文提出的多输入SEAE方法与SAC和DDPG算法兼容,验证了其在行驶稳定性方面的有效性。结果表明,该方法在自动驾驶任务的复杂场景中,在平均奖励值、平均插曲长度、行驶速度和行驶稳定性方面具有最高的性能。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
SEAE: Stable end-to-end autonomous driving using event-triggered attention and exploration-driven deep reinforcement learning
In self-driving cars, significant losses can be caused by various unstable factors. Thus, the use of the reinforcement learning self-driving technology with stability constraints is essential. The proposed multi-input stable autonomous driving based on exploration-driven with attention and event-triggered (SEAE) helps the agent program better autonomous driving with stability. This paper optimizes the input information processing of deep reinforcement learning using the multi-head self-attention mechanism, enhances the spatial exploration ability of the agent using the exploration-driven network. It combines the acceleration stability with the event-triggered mechanism to ensure a high driving safety while taking the driving stability into account. More precisely, the proposed multi-input approach treats the instantaneous acceleration as a constraint specified by the agent and optimizes the reward function, while taking into consideration the rate of motion change. Weights are then assigned to the data sequences through a multi-head self-attention mechanism, allowing the agent to focus on the environmental information part that is more important for the autonomous driving task received by the sensors. In addition, the proposed multi-input SEAE method is compatible with SAC and DDPG algorithms to verify its effectiveness in driving stability. The obtained results show that the proposed method has the highest performance in average reward value, average episode length, driving speed and driving stability in complex scenarios of autonomous driving tasks.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Displays
Displays 工程技术-工程:电子与电气
CiteScore
4.60
自引率
25.60%
发文量
138
审稿时长
92 days
期刊介绍: Displays is the international journal covering the research and development of display technology, its effective presentation and perception of information, and applications and systems including display-human interface. Technical papers on practical developments in Displays technology provide an effective channel to promote greater understanding and cross-fertilization across the diverse disciplines of the Displays community. Original research papers solving ergonomics issues at the display-human interface advance effective presentation of information. Tutorial papers covering fundamentals intended for display technologies and human factor engineers new to the field will also occasionally featured.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信