Learning and Adapting Behavior of Autonomous Vehicles through Inverse Reinforcement Learning

Rainer Trauth, Marc Kaufeld, Maximilian Geisslinger, Johannes Betz
{"title":"Learning and Adapting Behavior of Autonomous Vehicles through Inverse Reinforcement Learning","authors":"Rainer Trauth, Marc Kaufeld, Maximilian Geisslinger, Johannes Betz","doi":"10.1109/IV55152.2023.10186668","DOIUrl":null,"url":null,"abstract":"The driving behavior of autonomous vehicles has a significant impact on safety for all traffic participants. Unlike current traffic participants, autonomous vehicles in the future will also need to adhere to safety standards and defined risk properties in order to achieve a high level of public acceptance. At the same time, successful autonomous vehicles must be able to interact with human drivers in mixed traffic in a way that enables traffic to flow. In this paper, we present a hybrid approach to trajectory planning that learns and adapts human driving behavior using inverse reinforcement learning. The proposed approach performs a large-scale simulation with HighD real-world scenarios to learn human driving behavior and domain-specific traffic-flow characteristics. The analysis of the work focuses on the influence of risk-taking, which provides information about driving style safety. The results show insights into the risk behavior of trajectory planning approaches compared to human risk assessment. The comparison to human trajectories is intended to ensure comparability and accurate classification of risk-taking. We recommend a hybrid method for adapting driving behavior, in order to maintain the explainability and safety of the trajectory planning algorithm.","PeriodicalId":195148,"journal":{"name":"2023 IEEE Intelligent Vehicles Symposium (IV)","volume":"20 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-06-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2023 IEEE Intelligent Vehicles Symposium (IV)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/IV55152.2023.10186668","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

The driving behavior of autonomous vehicles has a significant impact on safety for all traffic participants. Unlike current traffic participants, autonomous vehicles in the future will also need to adhere to safety standards and defined risk properties in order to achieve a high level of public acceptance. At the same time, successful autonomous vehicles must be able to interact with human drivers in mixed traffic in a way that enables traffic to flow. In this paper, we present a hybrid approach to trajectory planning that learns and adapts human driving behavior using inverse reinforcement learning. The proposed approach performs a large-scale simulation with HighD real-world scenarios to learn human driving behavior and domain-specific traffic-flow characteristics. The analysis of the work focuses on the influence of risk-taking, which provides information about driving style safety. The results show insights into the risk behavior of trajectory planning approaches compared to human risk assessment. The comparison to human trajectories is intended to ensure comparability and accurate classification of risk-taking. We recommend a hybrid method for adapting driving behavior, in order to maintain the explainability and safety of the trajectory planning algorithm.
基于逆强化学习的自动驾驶汽车学习与自适应行为
自动驾驶汽车的驾驶行为对所有交通参与者的安全都有重大影响。与目前的交通参与者不同,未来的自动驾驶汽车还需要遵守安全标准和定义风险属性,以获得高水平的公众接受度。与此同时,成功的自动驾驶汽车必须能够在混合交通中与人类驾驶员互动,使交通顺畅。在本文中,我们提出了一种混合的轨迹规划方法,该方法使用逆强化学习来学习和适应人类驾驶行为。该方法对真实世界场景进行大规模模拟,以学习人类驾驶行为和特定领域的交通流特征。对工作的分析侧重于冒险行为的影响,这提供了有关驾驶方式安全的信息。结果表明,与人类风险评估相比,轨迹规划方法对风险行为有了深入的了解。与人类轨迹的比较旨在确保风险的可比性和准确分类。为了保持轨迹规划算法的可解释性和安全性,我们推荐了一种混合方法来适应驾驶行为。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信