Xin Liu , Shuhuan Wen , Yaohua Hu , Fei Han , Hong Zhang , Hamid Reza Karimi
{"title":"基于深度强化学习的蛇形机器人多传感器融合主动式 SLAM","authors":"Xin Liu , Shuhuan Wen , Yaohua Hu , Fei Han , Hong Zhang , Hamid Reza Karimi","doi":"10.1016/j.mechatronics.2024.103248","DOIUrl":null,"url":null,"abstract":"<div><p>Snake-like robots can imitate the movement patterns of animals in nature and enter the space that traditional robots cannot enter, which adapt to environments that humans cannot reach, and expand the field of human exploration. However, it is often challenging to realize autonomous navigation and simultaneously avoid obstacles under an unknown environment, that is, active SLAM (Simultaneous Localization and Mapping). This paper proposes an autonomous obstacle avoidance method combined with SLAM based on deep reinforcement learning for a wheeled snake robot by using a multi-sensor. Firstly, we design a modular wheeled snake robot structure with lightweight materials based on orthogonal joints and build a three-dimensional model of a snake robot in Gazebo. Secondly, the SLAM based on two-dimensional LiDAR and IMU is used to realize autonomous navigation under an unknown environment and detect obstacles. At the same time, a Deep Q-Learning-based path planning method of the snake robot is proposed to realize obstacles avoidance during navigation. Finally, simulation studies and experiments show that the designed snake-like robot can realize effective path planning and environmental mapping in environments with obstacles. The proposed active SLAM algorithm improves the success rate of snake-like robot path planning, has better obstacle avoidance ability for obstacles, and reduces the number of collisions compared with the traditional A* and the sampling-based RRT* algorithms.</p></div>","PeriodicalId":49842,"journal":{"name":"Mechatronics","volume":"103 ","pages":"Article 103248"},"PeriodicalIF":3.1000,"publicationDate":"2024-08-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"An active SLAM with multi-sensor fusion for snake robots based on deep reinforcement learning\",\"authors\":\"Xin Liu , Shuhuan Wen , Yaohua Hu , Fei Han , Hong Zhang , Hamid Reza Karimi\",\"doi\":\"10.1016/j.mechatronics.2024.103248\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>Snake-like robots can imitate the movement patterns of animals in nature and enter the space that traditional robots cannot enter, which adapt to environments that humans cannot reach, and expand the field of human exploration. However, it is often challenging to realize autonomous navigation and simultaneously avoid obstacles under an unknown environment, that is, active SLAM (Simultaneous Localization and Mapping). This paper proposes an autonomous obstacle avoidance method combined with SLAM based on deep reinforcement learning for a wheeled snake robot by using a multi-sensor. Firstly, we design a modular wheeled snake robot structure with lightweight materials based on orthogonal joints and build a three-dimensional model of a snake robot in Gazebo. Secondly, the SLAM based on two-dimensional LiDAR and IMU is used to realize autonomous navigation under an unknown environment and detect obstacles. At the same time, a Deep Q-Learning-based path planning method of the snake robot is proposed to realize obstacles avoidance during navigation. Finally, simulation studies and experiments show that the designed snake-like robot can realize effective path planning and environmental mapping in environments with obstacles. The proposed active SLAM algorithm improves the success rate of snake-like robot path planning, has better obstacle avoidance ability for obstacles, and reduces the number of collisions compared with the traditional A* and the sampling-based RRT* algorithms.</p></div>\",\"PeriodicalId\":49842,\"journal\":{\"name\":\"Mechatronics\",\"volume\":\"103 \",\"pages\":\"Article 103248\"},\"PeriodicalIF\":3.1000,\"publicationDate\":\"2024-08-23\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Mechatronics\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0957415824001132\",\"RegionNum\":3,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"AUTOMATION & CONTROL SYSTEMS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Mechatronics","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0957415824001132","RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}
引用次数: 0
摘要
仿蛇机器人可以模仿自然界动物的运动规律,进入传统机器人无法进入的空间,适应人类无法到达的环境,拓展人类的探索领域。然而,如何在未知环境下实现自主导航并同时避开障碍物,即主动式 SLAM(同时定位与绘图),往往是一项挑战。本文提出了一种基于深度强化学习的轮式蛇形机器人自主避障方法。首先,我们设计了基于正交关节的轻质材料模块化轮式蛇形机器人结构,并在 Gazebo 中构建了蛇形机器人的三维模型。其次,利用基于二维激光雷达和 IMU 的 SLAM 实现未知环境下的自主导航和障碍物检测。同时,提出了一种基于深度 Q 学习的蛇形机器人路径规划方法,以实现导航过程中的避障。最后,仿真研究和实验表明,所设计的蛇形机器人能在有障碍物的环境中实现有效的路径规划和环境映射。与传统的 A* 算法和基于采样的 RRT* 算法相比,所提出的主动 SLAM 算法提高了蛇形机器人路径规划的成功率,对障碍物有更好的避障能力,并减少了碰撞次数。
An active SLAM with multi-sensor fusion for snake robots based on deep reinforcement learning
Snake-like robots can imitate the movement patterns of animals in nature and enter the space that traditional robots cannot enter, which adapt to environments that humans cannot reach, and expand the field of human exploration. However, it is often challenging to realize autonomous navigation and simultaneously avoid obstacles under an unknown environment, that is, active SLAM (Simultaneous Localization and Mapping). This paper proposes an autonomous obstacle avoidance method combined with SLAM based on deep reinforcement learning for a wheeled snake robot by using a multi-sensor. Firstly, we design a modular wheeled snake robot structure with lightweight materials based on orthogonal joints and build a three-dimensional model of a snake robot in Gazebo. Secondly, the SLAM based on two-dimensional LiDAR and IMU is used to realize autonomous navigation under an unknown environment and detect obstacles. At the same time, a Deep Q-Learning-based path planning method of the snake robot is proposed to realize obstacles avoidance during navigation. Finally, simulation studies and experiments show that the designed snake-like robot can realize effective path planning and environmental mapping in environments with obstacles. The proposed active SLAM algorithm improves the success rate of snake-like robot path planning, has better obstacle avoidance ability for obstacles, and reduces the number of collisions compared with the traditional A* and the sampling-based RRT* algorithms.
期刊介绍:
Mechatronics is the synergistic combination of precision mechanical engineering, electronic control and systems thinking in the design of products and manufacturing processes. It relates to the design of systems, devices and products aimed at achieving an optimal balance between basic mechanical structure and its overall control. The purpose of this journal is to provide rapid publication of topical papers featuring practical developments in mechatronics. It will cover a wide range of application areas including consumer product design, instrumentation, manufacturing methods, computer integration and process and device control, and will attract a readership from across the industrial and academic research spectrum. Particular importance will be attached to aspects of innovation in mechatronics design philosophy which illustrate the benefits obtainable by an a priori integration of functionality with embedded microprocessor control. A major item will be the design of machines, devices and systems possessing a degree of computer based intelligence. The journal seeks to publish research progress in this field with an emphasis on the applied rather than the theoretical. It will also serve the dual role of bringing greater recognition to this important area of engineering.