Pedestrian Avoidance with and Without Incoming Traffic by Using Deep Reinforcement Learning

Dazhi Guan, Shu Xu, Qinjie Liu, Jinyan Ma
{"title":"Pedestrian Avoidance with and Without Incoming Traffic by Using Deep Reinforcement Learning","authors":"Dazhi Guan, Shu Xu, Qinjie Liu, Jinyan Ma","doi":"10.1109/ICRAE53653.2021.9657771","DOIUrl":null,"url":null,"abstract":"Pedestrian avoidance is one of the most challenging autonomous driving operations in the field of intelligent vehicles. In an emergency, the optimal maneuver is to steer to avoid pedestrians and other vehicles. In this paper, a deep reinforcement learning based method has been proposed, in which the agent is trained to maneuver the ego vehicle steering away from the pedestrian with a safety clearance to the adjacent lane. A scenario both with and without other traffic have been investigated. By using TensorFlow as the learning framework and Unity3D to model the environment and different scenarios, the agent has been trained to obtain the maximum reward and take optimal policy in the process of continuously interacting with the environment. The capsule tool in Unity can ensure that the agent would keep the ego vehicle a safe distance from pedestrians during the training. The success rate of the trained agent in different conditions have proven the effectiveness of the proposed approach.","PeriodicalId":338398,"journal":{"name":"2021 6th International Conference on Robotics and Automation Engineering (ICRAE)","volume":"84 2 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-11-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2021 6th International Conference on Robotics and Automation Engineering (ICRAE)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICRAE53653.2021.9657771","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

Pedestrian avoidance is one of the most challenging autonomous driving operations in the field of intelligent vehicles. In an emergency, the optimal maneuver is to steer to avoid pedestrians and other vehicles. In this paper, a deep reinforcement learning based method has been proposed, in which the agent is trained to maneuver the ego vehicle steering away from the pedestrian with a safety clearance to the adjacent lane. A scenario both with and without other traffic have been investigated. By using TensorFlow as the learning framework and Unity3D to model the environment and different scenarios, the agent has been trained to obtain the maximum reward and take optimal policy in the process of continuously interacting with the environment. The capsule tool in Unity can ensure that the agent would keep the ego vehicle a safe distance from pedestrians during the training. The success rate of the trained agent in different conditions have proven the effectiveness of the proposed approach.
基于深度强化学习的行人避撞
避开行人是智能汽车领域最具挑战性的自动驾驶操作之一。在紧急情况下,最佳的机动是避开行人和其他车辆。在本文中,提出了一种基于深度强化学习的方法,该方法训练智能体操纵自我车辆以安全间隙从行人转向相邻车道。已经调查了有和没有其他交通的情况。通过使用TensorFlow作为学习框架,使用Unity3D对环境和不同场景进行建模,训练agent在与环境不断交互的过程中获得最大的奖励并采取最优策略。Unity中的胶囊工具可以确保agent在训练过程中保持自我车辆与行人的安全距离。在不同条件下训练的智能体的成功率证明了该方法的有效性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信