基于深度强化学习的蛇形机器人多传感器融合主动式 SLAM

IF 3.1 3区 计算机科学 Q2 AUTOMATION & CONTROL SYSTEMS
Xin Liu , Shuhuan Wen , Yaohua Hu , Fei Han , Hong Zhang , Hamid Reza Karimi
{"title":"基于深度强化学习的蛇形机器人多传感器融合主动式 SLAM","authors":"Xin Liu ,&nbsp;Shuhuan Wen ,&nbsp;Yaohua Hu ,&nbsp;Fei Han ,&nbsp;Hong Zhang ,&nbsp;Hamid Reza Karimi","doi":"10.1016/j.mechatronics.2024.103248","DOIUrl":null,"url":null,"abstract":"<div><p>Snake-like robots can imitate the movement patterns of animals in nature and enter the space that traditional robots cannot enter, which adapt to environments that humans cannot reach, and expand the field of human exploration. However, it is often challenging to realize autonomous navigation and simultaneously avoid obstacles under an unknown environment, that is, active SLAM (Simultaneous Localization and Mapping). This paper proposes an autonomous obstacle avoidance method combined with SLAM based on deep reinforcement learning for a wheeled snake robot by using a multi-sensor. Firstly, we design a modular wheeled snake robot structure with lightweight materials based on orthogonal joints and build a three-dimensional model of a snake robot in Gazebo. Secondly, the SLAM based on two-dimensional LiDAR and IMU is used to realize autonomous navigation under an unknown environment and detect obstacles. At the same time, a Deep Q-Learning-based path planning method of the snake robot is proposed to realize obstacles avoidance during navigation. Finally, simulation studies and experiments show that the designed snake-like robot can realize effective path planning and environmental mapping in environments with obstacles. The proposed active SLAM algorithm improves the success rate of snake-like robot path planning, has better obstacle avoidance ability for obstacles, and reduces the number of collisions compared with the traditional A* and the sampling-based RRT* algorithms.</p></div>","PeriodicalId":49842,"journal":{"name":"Mechatronics","volume":"103 ","pages":"Article 103248"},"PeriodicalIF":3.1000,"publicationDate":"2024-08-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"An active SLAM with multi-sensor fusion for snake robots based on deep reinforcement learning\",\"authors\":\"Xin Liu ,&nbsp;Shuhuan Wen ,&nbsp;Yaohua Hu ,&nbsp;Fei Han ,&nbsp;Hong Zhang ,&nbsp;Hamid Reza Karimi\",\"doi\":\"10.1016/j.mechatronics.2024.103248\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>Snake-like robots can imitate the movement patterns of animals in nature and enter the space that traditional robots cannot enter, which adapt to environments that humans cannot reach, and expand the field of human exploration. However, it is often challenging to realize autonomous navigation and simultaneously avoid obstacles under an unknown environment, that is, active SLAM (Simultaneous Localization and Mapping). This paper proposes an autonomous obstacle avoidance method combined with SLAM based on deep reinforcement learning for a wheeled snake robot by using a multi-sensor. Firstly, we design a modular wheeled snake robot structure with lightweight materials based on orthogonal joints and build a three-dimensional model of a snake robot in Gazebo. Secondly, the SLAM based on two-dimensional LiDAR and IMU is used to realize autonomous navigation under an unknown environment and detect obstacles. At the same time, a Deep Q-Learning-based path planning method of the snake robot is proposed to realize obstacles avoidance during navigation. Finally, simulation studies and experiments show that the designed snake-like robot can realize effective path planning and environmental mapping in environments with obstacles. The proposed active SLAM algorithm improves the success rate of snake-like robot path planning, has better obstacle avoidance ability for obstacles, and reduces the number of collisions compared with the traditional A* and the sampling-based RRT* algorithms.</p></div>\",\"PeriodicalId\":49842,\"journal\":{\"name\":\"Mechatronics\",\"volume\":\"103 \",\"pages\":\"Article 103248\"},\"PeriodicalIF\":3.1000,\"publicationDate\":\"2024-08-23\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Mechatronics\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0957415824001132\",\"RegionNum\":3,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"AUTOMATION & CONTROL SYSTEMS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Mechatronics","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0957415824001132","RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}
引用次数: 0

摘要

仿蛇机器人可以模仿自然界动物的运动规律,进入传统机器人无法进入的空间,适应人类无法到达的环境,拓展人类的探索领域。然而,如何在未知环境下实现自主导航并同时避开障碍物,即主动式 SLAM(同时定位与绘图),往往是一项挑战。本文提出了一种基于深度强化学习的轮式蛇形机器人自主避障方法。首先,我们设计了基于正交关节的轻质材料模块化轮式蛇形机器人结构,并在 Gazebo 中构建了蛇形机器人的三维模型。其次,利用基于二维激光雷达和 IMU 的 SLAM 实现未知环境下的自主导航和障碍物检测。同时,提出了一种基于深度 Q 学习的蛇形机器人路径规划方法,以实现导航过程中的避障。最后,仿真研究和实验表明,所设计的蛇形机器人能在有障碍物的环境中实现有效的路径规划和环境映射。与传统的 A* 算法和基于采样的 RRT* 算法相比,所提出的主动 SLAM 算法提高了蛇形机器人路径规划的成功率,对障碍物有更好的避障能力,并减少了碰撞次数。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
An active SLAM with multi-sensor fusion for snake robots based on deep reinforcement learning

Snake-like robots can imitate the movement patterns of animals in nature and enter the space that traditional robots cannot enter, which adapt to environments that humans cannot reach, and expand the field of human exploration. However, it is often challenging to realize autonomous navigation and simultaneously avoid obstacles under an unknown environment, that is, active SLAM (Simultaneous Localization and Mapping). This paper proposes an autonomous obstacle avoidance method combined with SLAM based on deep reinforcement learning for a wheeled snake robot by using a multi-sensor. Firstly, we design a modular wheeled snake robot structure with lightweight materials based on orthogonal joints and build a three-dimensional model of a snake robot in Gazebo. Secondly, the SLAM based on two-dimensional LiDAR and IMU is used to realize autonomous navigation under an unknown environment and detect obstacles. At the same time, a Deep Q-Learning-based path planning method of the snake robot is proposed to realize obstacles avoidance during navigation. Finally, simulation studies and experiments show that the designed snake-like robot can realize effective path planning and environmental mapping in environments with obstacles. The proposed active SLAM algorithm improves the success rate of snake-like robot path planning, has better obstacle avoidance ability for obstacles, and reduces the number of collisions compared with the traditional A* and the sampling-based RRT* algorithms.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Mechatronics
Mechatronics 工程技术-工程:电子与电气
CiteScore
5.90
自引率
9.10%
发文量
0
审稿时长
109 days
期刊介绍: Mechatronics is the synergistic combination of precision mechanical engineering, electronic control and systems thinking in the design of products and manufacturing processes. It relates to the design of systems, devices and products aimed at achieving an optimal balance between basic mechanical structure and its overall control. The purpose of this journal is to provide rapid publication of topical papers featuring practical developments in mechatronics. It will cover a wide range of application areas including consumer product design, instrumentation, manufacturing methods, computer integration and process and device control, and will attract a readership from across the industrial and academic research spectrum. Particular importance will be attached to aspects of innovation in mechatronics design philosophy which illustrate the benefits obtainable by an a priori integration of functionality with embedded microprocessor control. A major item will be the design of machines, devices and systems possessing a degree of computer based intelligence. The journal seeks to publish research progress in this field with an emphasis on the applied rather than the theoretical. It will also serve the dual role of bringing greater recognition to this important area of engineering.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信