基于点-线特征和高效IMU初始化的视觉惯性SLAM

IF 4.3 2区 综合性期刊 Q1 ENGINEERING, ELECTRICAL & ELECTRONIC
Jiaming He;Mingrui Li;Yangyang Wang;Hongyu Wang
{"title":"基于点-线特征和高效IMU初始化的视觉惯性SLAM","authors":"Jiaming He;Mingrui Li;Yangyang Wang;Hongyu Wang","doi":"10.1109/JSEN.2024.3523039","DOIUrl":null,"url":null,"abstract":"Camera and IMU are widely used in robotics to achieve accurate and robust pose estimation. However, this fusion relies heavily on sufficient visual feature observations and precise inertial state variables. This article proposes PLE-SLAM, a real-time visual-inertial simultaneous localization and mapping (SLAM) for complex environments, which introduces line features to point-based SLAM and proposes an efficient IMU initialization method. First, we use parallel computing methods to extract point-line features and compute descriptors to ensure real-time performance. Adjacent short-line segments are merged into long-line segments for more stable tracking, and isolated short-line segments are directly eliminated. Second, to overcome rapid rotation and low-texture scenes, we estimate gyroscope bias by tightly coupling rotation preintegration and 2-D point-line observations without 3-D point cloud and vision-only rotation estimation. Accelerometer bias and gravity direction are solved by an analytical method, which is more efficient than nonlinear optimization. To improve the system’s robustness in complex environments, an improved method of dynamic feature elimination and a solution for loop detection and loop frames pose estimation using CNN and GNN are integrated into the system. The experimental results on public datasets demonstrate that PLE-SLAM achieves more than 20%~50% improvement in localization performance than ORB-SLAM3 and outperforms other state-of-the-art visual-inertial SLAM systems in most environments.","PeriodicalId":447,"journal":{"name":"IEEE Sensors Journal","volume":"25 4","pages":"6801-6811"},"PeriodicalIF":4.3000,"publicationDate":"2025-01-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"PLE-SLAM: A Visual-Inertial SLAM Based on Point-Line Features and Efficient IMU Initialization\",\"authors\":\"Jiaming He;Mingrui Li;Yangyang Wang;Hongyu Wang\",\"doi\":\"10.1109/JSEN.2024.3523039\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Camera and IMU are widely used in robotics to achieve accurate and robust pose estimation. However, this fusion relies heavily on sufficient visual feature observations and precise inertial state variables. This article proposes PLE-SLAM, a real-time visual-inertial simultaneous localization and mapping (SLAM) for complex environments, which introduces line features to point-based SLAM and proposes an efficient IMU initialization method. First, we use parallel computing methods to extract point-line features and compute descriptors to ensure real-time performance. Adjacent short-line segments are merged into long-line segments for more stable tracking, and isolated short-line segments are directly eliminated. Second, to overcome rapid rotation and low-texture scenes, we estimate gyroscope bias by tightly coupling rotation preintegration and 2-D point-line observations without 3-D point cloud and vision-only rotation estimation. Accelerometer bias and gravity direction are solved by an analytical method, which is more efficient than nonlinear optimization. To improve the system’s robustness in complex environments, an improved method of dynamic feature elimination and a solution for loop detection and loop frames pose estimation using CNN and GNN are integrated into the system. The experimental results on public datasets demonstrate that PLE-SLAM achieves more than 20%~50% improvement in localization performance than ORB-SLAM3 and outperforms other state-of-the-art visual-inertial SLAM systems in most environments.\",\"PeriodicalId\":447,\"journal\":{\"name\":\"IEEE Sensors Journal\",\"volume\":\"25 4\",\"pages\":\"6801-6811\"},\"PeriodicalIF\":4.3000,\"publicationDate\":\"2025-01-03\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Sensors Journal\",\"FirstCategoryId\":\"103\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10824222/\",\"RegionNum\":2,\"RegionCategory\":\"综合性期刊\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Sensors Journal","FirstCategoryId":"103","ListUrlMain":"https://ieeexplore.ieee.org/document/10824222/","RegionNum":2,"RegionCategory":"综合性期刊","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0

摘要

相机和IMU被广泛应用于机器人中,以实现准确和鲁棒的姿态估计。然而,这种融合在很大程度上依赖于足够的视觉特征观测和精确的惯性状态变量。本文提出了一种用于复杂环境的实时视觉惯性同步定位与映射(le -SLAM)方法,将线特征引入到基于点的实时定位与映射中,并提出了一种高效的IMU初始化方法。首先,我们使用并行计算方法提取点线特征并计算描述符,以确保实时性能。相邻的短线段合并为长线段,跟踪更加稳定,孤立的短线段直接消除。其次,为了克服快速旋转和低纹理场景,我们通过紧密耦合旋转预积分和二维点线观测来估计陀螺仪偏差,而不考虑三维点云和视觉旋转估计。采用解析法求解加速度计偏置和重力方向,比非线性优化求解更有效。为了提高系统在复杂环境下的鲁棒性,将一种改进的动态特征消除方法、一种利用CNN和GNN进行环路检测和环路帧位姿估计的解决方案集成到系统中。在公共数据集上的实验结果表明,与ORB-SLAM3相比,PLE-SLAM的定位性能提高了20%~50%以上,在大多数环境下优于其他最先进的视觉惯性SLAM系统。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
PLE-SLAM: A Visual-Inertial SLAM Based on Point-Line Features and Efficient IMU Initialization
Camera and IMU are widely used in robotics to achieve accurate and robust pose estimation. However, this fusion relies heavily on sufficient visual feature observations and precise inertial state variables. This article proposes PLE-SLAM, a real-time visual-inertial simultaneous localization and mapping (SLAM) for complex environments, which introduces line features to point-based SLAM and proposes an efficient IMU initialization method. First, we use parallel computing methods to extract point-line features and compute descriptors to ensure real-time performance. Adjacent short-line segments are merged into long-line segments for more stable tracking, and isolated short-line segments are directly eliminated. Second, to overcome rapid rotation and low-texture scenes, we estimate gyroscope bias by tightly coupling rotation preintegration and 2-D point-line observations without 3-D point cloud and vision-only rotation estimation. Accelerometer bias and gravity direction are solved by an analytical method, which is more efficient than nonlinear optimization. To improve the system’s robustness in complex environments, an improved method of dynamic feature elimination and a solution for loop detection and loop frames pose estimation using CNN and GNN are integrated into the system. The experimental results on public datasets demonstrate that PLE-SLAM achieves more than 20%~50% improvement in localization performance than ORB-SLAM3 and outperforms other state-of-the-art visual-inertial SLAM systems in most environments.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
IEEE Sensors Journal
IEEE Sensors Journal 工程技术-工程:电子与电气
CiteScore
7.70
自引率
14.00%
发文量
2058
审稿时长
5.2 months
期刊介绍: The fields of interest of the IEEE Sensors Journal are the theory, design , fabrication, manufacturing and applications of devices for sensing and transducing physical, chemical and biological phenomena, with emphasis on the electronics and physics aspect of sensors and integrated sensors-actuators. IEEE Sensors Journal deals with the following: -Sensor Phenomenology, Modelling, and Evaluation -Sensor Materials, Processing, and Fabrication -Chemical and Gas Sensors -Microfluidics and Biosensors -Optical Sensors -Physical Sensors: Temperature, Mechanical, Magnetic, and others -Acoustic and Ultrasonic Sensors -Sensor Packaging -Sensor Networks -Sensor Applications -Sensor Systems: Signals, Processing, and Interfaces -Actuators and Sensor Power Systems -Sensor Signal Processing for high precision and stability (amplification, filtering, linearization, modulation/demodulation) and under harsh conditions (EMC, radiation, humidity, temperature); energy consumption/harvesting -Sensor Data Processing (soft computing with sensor data, e.g., pattern recognition, machine learning, evolutionary computation; sensor data fusion, processing of wave e.g., electromagnetic and acoustic; and non-wave, e.g., chemical, gravity, particle, thermal, radiative and non-radiative sensor data, detection, estimation and classification based on sensor data) -Sensors in Industrial Practice
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信