Ambuj, Harsh Nagar, Ayan Paul, Rajendra Machavaram, Peeyush Soni
{"title":"\"基于强化学习的粒子群优化,利用二维激光雷达点云进行自主地面飞行器轨迹规划\"","authors":"Ambuj, Harsh Nagar, Ayan Paul, Rajendra Machavaram, Peeyush Soni","doi":"10.1016/j.robot.2024.104723","DOIUrl":null,"url":null,"abstract":"<div><p>The advent of autonomous mobile robots has spurred research into efficient trajectory planning methods, particularly in dynamic environments with varied obstacles. This study focuses on optimizing trajectory planning for an Autonomous Ground Vehicle (AGV) using a novel Reinforcement Learning Particle Swarm Optimization (RLPSO) algorithm. Real-time mobile robot localization and map generation are introduced through the utilization of the Hector-SLAM algorithm within the Robot Operating System (ROS) platform, resulting in the creation of a binary occupancy grid. The present research thoroughly investigates the performance of the RLPSO algorithm, juxtaposed against five established Particle Swarm Optimization (PSO) variants, within the context of four distinct physical environments. The experimental design is tailored to emulate real-world scenarios, encompassing a spectrum of challenges posed by static and dynamic obstacles. The AGV, equipped with LiDAR sensors, navigates through diverse environments characterized by obstacles of different geometries. The RLPSO algorithm dynamically adapts its strategies based on feedback, enabling adaptable trajectory planning while effectively avoiding obstacles. Numerical results obtained from extensive experimentation highlight the algorithm's efficacy. The navigational model's validation is achieved within a MATLAB 2D virtual environment, employing 2D Lidar mapping point data. Transitioning to physical experiments with an AGV, RLPSO continues to demonstrate superior performance, showcasing its potential for real-world applications in autonomous navigation. On average, RLPSO achieves a 10–15 % reduction in path distances and traversal time compared to the following best-performing PSO variant across diverse scenarios. The adaptive nature of RLPSO, informed by feedback from the environment, distinguishes it as a promising solution for autonomous navigation in dynamic settings, with implications for practical implementation in real-world scenarios.</p></div>","PeriodicalId":49592,"journal":{"name":"Robotics and Autonomous Systems","volume":null,"pages":null},"PeriodicalIF":4.3000,"publicationDate":"2024-05-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"“Reinforcement learning particle swarm optimization based trajectory planning of autonomous ground vehicle using 2D LiDAR point cloud”\",\"authors\":\"Ambuj, Harsh Nagar, Ayan Paul, Rajendra Machavaram, Peeyush Soni\",\"doi\":\"10.1016/j.robot.2024.104723\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>The advent of autonomous mobile robots has spurred research into efficient trajectory planning methods, particularly in dynamic environments with varied obstacles. This study focuses on optimizing trajectory planning for an Autonomous Ground Vehicle (AGV) using a novel Reinforcement Learning Particle Swarm Optimization (RLPSO) algorithm. Real-time mobile robot localization and map generation are introduced through the utilization of the Hector-SLAM algorithm within the Robot Operating System (ROS) platform, resulting in the creation of a binary occupancy grid. The present research thoroughly investigates the performance of the RLPSO algorithm, juxtaposed against five established Particle Swarm Optimization (PSO) variants, within the context of four distinct physical environments. The experimental design is tailored to emulate real-world scenarios, encompassing a spectrum of challenges posed by static and dynamic obstacles. The AGV, equipped with LiDAR sensors, navigates through diverse environments characterized by obstacles of different geometries. The RLPSO algorithm dynamically adapts its strategies based on feedback, enabling adaptable trajectory planning while effectively avoiding obstacles. Numerical results obtained from extensive experimentation highlight the algorithm's efficacy. The navigational model's validation is achieved within a MATLAB 2D virtual environment, employing 2D Lidar mapping point data. Transitioning to physical experiments with an AGV, RLPSO continues to demonstrate superior performance, showcasing its potential for real-world applications in autonomous navigation. On average, RLPSO achieves a 10–15 % reduction in path distances and traversal time compared to the following best-performing PSO variant across diverse scenarios. The adaptive nature of RLPSO, informed by feedback from the environment, distinguishes it as a promising solution for autonomous navigation in dynamic settings, with implications for practical implementation in real-world scenarios.</p></div>\",\"PeriodicalId\":49592,\"journal\":{\"name\":\"Robotics and Autonomous Systems\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":4.3000,\"publicationDate\":\"2024-05-21\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Robotics and Autonomous Systems\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0921889024001064\",\"RegionNum\":2,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"AUTOMATION & CONTROL SYSTEMS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Robotics and Autonomous Systems","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0921889024001064","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}
“Reinforcement learning particle swarm optimization based trajectory planning of autonomous ground vehicle using 2D LiDAR point cloud”
The advent of autonomous mobile robots has spurred research into efficient trajectory planning methods, particularly in dynamic environments with varied obstacles. This study focuses on optimizing trajectory planning for an Autonomous Ground Vehicle (AGV) using a novel Reinforcement Learning Particle Swarm Optimization (RLPSO) algorithm. Real-time mobile robot localization and map generation are introduced through the utilization of the Hector-SLAM algorithm within the Robot Operating System (ROS) platform, resulting in the creation of a binary occupancy grid. The present research thoroughly investigates the performance of the RLPSO algorithm, juxtaposed against five established Particle Swarm Optimization (PSO) variants, within the context of four distinct physical environments. The experimental design is tailored to emulate real-world scenarios, encompassing a spectrum of challenges posed by static and dynamic obstacles. The AGV, equipped with LiDAR sensors, navigates through diverse environments characterized by obstacles of different geometries. The RLPSO algorithm dynamically adapts its strategies based on feedback, enabling adaptable trajectory planning while effectively avoiding obstacles. Numerical results obtained from extensive experimentation highlight the algorithm's efficacy. The navigational model's validation is achieved within a MATLAB 2D virtual environment, employing 2D Lidar mapping point data. Transitioning to physical experiments with an AGV, RLPSO continues to demonstrate superior performance, showcasing its potential for real-world applications in autonomous navigation. On average, RLPSO achieves a 10–15 % reduction in path distances and traversal time compared to the following best-performing PSO variant across diverse scenarios. The adaptive nature of RLPSO, informed by feedback from the environment, distinguishes it as a promising solution for autonomous navigation in dynamic settings, with implications for practical implementation in real-world scenarios.
期刊介绍:
Robotics and Autonomous Systems will carry articles describing fundamental developments in the field of robotics, with special emphasis on autonomous systems. An important goal of this journal is to extend the state of the art in both symbolic and sensory based robot control and learning in the context of autonomous systems.
Robotics and Autonomous Systems will carry articles on the theoretical, computational and experimental aspects of autonomous systems, or modules of such systems.