{"title":"基于深度强化学习的行人避撞","authors":"Dazhi Guan, Shu Xu, Qinjie Liu, Jinyan Ma","doi":"10.1109/ICRAE53653.2021.9657771","DOIUrl":null,"url":null,"abstract":"Pedestrian avoidance is one of the most challenging autonomous driving operations in the field of intelligent vehicles. In an emergency, the optimal maneuver is to steer to avoid pedestrians and other vehicles. In this paper, a deep reinforcement learning based method has been proposed, in which the agent is trained to maneuver the ego vehicle steering away from the pedestrian with a safety clearance to the adjacent lane. A scenario both with and without other traffic have been investigated. By using TensorFlow as the learning framework and Unity3D to model the environment and different scenarios, the agent has been trained to obtain the maximum reward and take optimal policy in the process of continuously interacting with the environment. The capsule tool in Unity can ensure that the agent would keep the ego vehicle a safe distance from pedestrians during the training. The success rate of the trained agent in different conditions have proven the effectiveness of the proposed approach.","PeriodicalId":338398,"journal":{"name":"2021 6th International Conference on Robotics and Automation Engineering (ICRAE)","volume":"84 2 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-11-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Pedestrian Avoidance with and Without Incoming Traffic by Using Deep Reinforcement Learning\",\"authors\":\"Dazhi Guan, Shu Xu, Qinjie Liu, Jinyan Ma\",\"doi\":\"10.1109/ICRAE53653.2021.9657771\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Pedestrian avoidance is one of the most challenging autonomous driving operations in the field of intelligent vehicles. In an emergency, the optimal maneuver is to steer to avoid pedestrians and other vehicles. In this paper, a deep reinforcement learning based method has been proposed, in which the agent is trained to maneuver the ego vehicle steering away from the pedestrian with a safety clearance to the adjacent lane. A scenario both with and without other traffic have been investigated. By using TensorFlow as the learning framework and Unity3D to model the environment and different scenarios, the agent has been trained to obtain the maximum reward and take optimal policy in the process of continuously interacting with the environment. The capsule tool in Unity can ensure that the agent would keep the ego vehicle a safe distance from pedestrians during the training. The success rate of the trained agent in different conditions have proven the effectiveness of the proposed approach.\",\"PeriodicalId\":338398,\"journal\":{\"name\":\"2021 6th International Conference on Robotics and Automation Engineering (ICRAE)\",\"volume\":\"84 2 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2021-11-19\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2021 6th International Conference on Robotics and Automation Engineering (ICRAE)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ICRAE53653.2021.9657771\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2021 6th International Conference on Robotics and Automation Engineering (ICRAE)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICRAE53653.2021.9657771","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Pedestrian Avoidance with and Without Incoming Traffic by Using Deep Reinforcement Learning
Pedestrian avoidance is one of the most challenging autonomous driving operations in the field of intelligent vehicles. In an emergency, the optimal maneuver is to steer to avoid pedestrians and other vehicles. In this paper, a deep reinforcement learning based method has been proposed, in which the agent is trained to maneuver the ego vehicle steering away from the pedestrian with a safety clearance to the adjacent lane. A scenario both with and without other traffic have been investigated. By using TensorFlow as the learning framework and Unity3D to model the environment and different scenarios, the agent has been trained to obtain the maximum reward and take optimal policy in the process of continuously interacting with the environment. The capsule tool in Unity can ensure that the agent would keep the ego vehicle a safe distance from pedestrians during the training. The success rate of the trained agent in different conditions have proven the effectiveness of the proposed approach.