Reinforcement-Learning-Based Trajectory Learning in Frenet Frame for Autonomous Driving

Sangho Yoon, Youngjoon Kwon, Jaesung Ryu, Sungkwan Kim, Sungwoo Choi, Kyungjae Lee
{"title":"Reinforcement-Learning-Based Trajectory Learning in Frenet Frame for Autonomous Driving","authors":"Sangho Yoon, Youngjoon Kwon, Jaesung Ryu, Sungkwan Kim, Sungwoo Choi, Kyungjae Lee","doi":"10.3390/app14166977","DOIUrl":null,"url":null,"abstract":"Autonomous driving is a complex problem that requires intelligent decision making, and it has recently garnered significant interest due to its potential advantages in convenience and safety. In autonomous driving, conventional path planning to reach a destination is a time-consuming challenge. Therefore, learning-based approaches have been successfully applied to the controller or decision-making aspects of autonomous driving. However, these methods often lack explainability, as passengers cannot discern where the vehicle is headed. Additionally, most experiments primarily focus on highway scenarios, which do not effectively represent road curvature. To address these issues, we propose a reinforcement-learning-based trajectory learning in the Frenet frame (RLTF), which involves learning trajectories in the Frenet frame. Learning trajectories enable the consideration of future states and enhance explainability. We demonstrate that RLTF achieves a 100% success rate in the simulation environment, considering future states on curvy roads with continuous obstacles while overcoming issues associated with the Frenet frame.","PeriodicalId":502388,"journal":{"name":"Applied Sciences","volume":"58 28","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-08-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Applied Sciences","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.3390/app14166977","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

Autonomous driving is a complex problem that requires intelligent decision making, and it has recently garnered significant interest due to its potential advantages in convenience and safety. In autonomous driving, conventional path planning to reach a destination is a time-consuming challenge. Therefore, learning-based approaches have been successfully applied to the controller or decision-making aspects of autonomous driving. However, these methods often lack explainability, as passengers cannot discern where the vehicle is headed. Additionally, most experiments primarily focus on highway scenarios, which do not effectively represent road curvature. To address these issues, we propose a reinforcement-learning-based trajectory learning in the Frenet frame (RLTF), which involves learning trajectories in the Frenet frame. Learning trajectories enable the consideration of future states and enhance explainability. We demonstrate that RLTF achieves a 100% success rate in the simulation environment, considering future states on curvy roads with continuous obstacles while overcoming issues associated with the Frenet frame.
用于自动驾驶的 Frenet 框架中基于强化学习的轨迹学习
自动驾驶是一个需要智能决策的复杂问题,由于其在便利性和安全性方面的潜在优势,最近引起了人们的极大兴趣。在自动驾驶中,传统的到达目的地的路径规划是一项耗时的挑战。因此,基于学习的方法已成功应用于自动驾驶的控制器或决策方面。然而,这些方法往往缺乏可解释性,因为乘客无法辨别车辆的行驶方向。此外,大多数实验主要集中在高速公路场景,无法有效体现道路曲率。为了解决这些问题,我们提出了基于强化学习的弗里尼特框架轨迹学习(RLTF),其中包括在弗里尼特框架中学习轨迹。学习轨迹可以考虑未来状态并提高可解释性。我们证明了 RLTF 在模拟环境中实现了 100% 的成功率,在有连续障碍物的弯曲道路上考虑了未来状态,同时克服了与 Frenet 框架相关的问题。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信