{"title":"Localization and Mapping Based on Multi-feature and Multi-sensor Fusion","authors":"Danni Li, Yibing Zhao, Weiqi Wang, Lie Guo","doi":"10.1007/s12239-024-00122-7","DOIUrl":null,"url":null,"abstract":"<p>Simultaneous Localization and Mapping (SLAM) is the foundation for high-precision localization, environmental awareness, and autonomous decision-making of autonomous vehicles. It has developed rapidly, but there are still challenges such as sensor errors, data fusion, and real-time computing. This paper proposes an optimization-based fusion algorithm that integrates IMU data, visual data and LiDAR data to construct a high-frequency visual-inertial odometry. The odometry is employed to obtain the relative pose transformation during the LiDAR data acquisition process, and eliminate the distortion of the point cloud by interpolation. By utilizing the local curvatures, some edge and plane features are extracted by LiDAR after removing the distortion, which are further combined with local map alignment to reconstruct the LiDAR constrains. In addition, the LiDAR odometer can be obtained through the initial values provided by high-frequency visual-inertial odometry. To address the cumulative error in odometers, adjacent keyframe and multi descriptor fusion loop constraints are combined to construct back-end optimization constraints, solving for high-accuracy localization results and constructing a 3D point cloud map of the surroundings. Compared with some classical algorithm, results show that the accuracy of this paper's algorithm is better than the laser SLAM method and the multi-sensor fusion SLAM method. Besides, the laser-assisted multi-feature visual-inertial odometry localization accuracy is also better than that of the single-feature visual-inertial odometry. In summary, the newly proposed SLAM method can largely improve the accuracy of odometry in real traffic scenarios.</p>","PeriodicalId":50338,"journal":{"name":"International Journal of Automotive Technology","volume":"175 1","pages":""},"PeriodicalIF":1.5000,"publicationDate":"2024-07-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Journal of Automotive Technology","FirstCategoryId":"5","ListUrlMain":"https://doi.org/10.1007/s12239-024-00122-7","RegionNum":4,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"ENGINEERING, MECHANICAL","Score":null,"Total":0}
引用次数: 0
Abstract
Simultaneous Localization and Mapping (SLAM) is the foundation for high-precision localization, environmental awareness, and autonomous decision-making of autonomous vehicles. It has developed rapidly, but there are still challenges such as sensor errors, data fusion, and real-time computing. This paper proposes an optimization-based fusion algorithm that integrates IMU data, visual data and LiDAR data to construct a high-frequency visual-inertial odometry. The odometry is employed to obtain the relative pose transformation during the LiDAR data acquisition process, and eliminate the distortion of the point cloud by interpolation. By utilizing the local curvatures, some edge and plane features are extracted by LiDAR after removing the distortion, which are further combined with local map alignment to reconstruct the LiDAR constrains. In addition, the LiDAR odometer can be obtained through the initial values provided by high-frequency visual-inertial odometry. To address the cumulative error in odometers, adjacent keyframe and multi descriptor fusion loop constraints are combined to construct back-end optimization constraints, solving for high-accuracy localization results and constructing a 3D point cloud map of the surroundings. Compared with some classical algorithm, results show that the accuracy of this paper's algorithm is better than the laser SLAM method and the multi-sensor fusion SLAM method. Besides, the laser-assisted multi-feature visual-inertial odometry localization accuracy is also better than that of the single-feature visual-inertial odometry. In summary, the newly proposed SLAM method can largely improve the accuracy of odometry in real traffic scenarios.
同步定位与绘图(SLAM)是自动驾驶汽车实现高精度定位、环境感知和自主决策的基础。它发展迅速,但仍面临传感器误差、数据融合和实时计算等挑战。本文提出了一种基于优化的融合算法,该算法整合了 IMU 数据、视觉数据和激光雷达数据,构建了一个高频视觉-惯性里程计。在获取激光雷达数据的过程中,利用里程计获得相对姿态变换,并通过插值消除点云的失真。利用局部曲率,激光雷达在消除畸变后提取出一些边缘和平面特征,再结合局部地图配准重建激光雷达约束。此外,还可以通过高频视觉惯性里程计提供的初始值获得激光雷达里程计。为解决里程计的累积误差问题,将相邻关键帧和多描述符融合循环约束结合起来,构建后端优化约束,求解高精度定位结果,并构建周围环境的三维点云图。与一些经典算法相比,结果表明本文算法的精度优于激光 SLAM 方法和多传感器融合 SLAM 方法。此外,激光辅助多特征视觉惯性里程定位精度也优于单特征视觉惯性里程定位精度。总之,新提出的 SLAM 方法能在很大程度上提高实际交通场景中的里程测量精度。
期刊介绍:
The International Journal of Automotive Technology has as its objective the publication and dissemination of original research in all fields of AUTOMOTIVE TECHNOLOGY, SCIENCE and ENGINEERING. It fosters thus the exchange of ideas among researchers in different parts of the world and also among researchers who emphasize different aspects of the foundations and applications of the field.
Standing as it does at the cross-roads of Physics, Chemistry, Mechanics, Engineering Design and Materials Sciences, AUTOMOTIVE TECHNOLOGY is experiencing considerable growth as a result of recent technological advances. The Journal, by providing an international medium of communication, is encouraging this growth and is encompassing all aspects of the field from thermal engineering, flow analysis, structural analysis, modal analysis, control, vehicular electronics, mechatronis, electro-mechanical engineering, optimum design methods, ITS, and recycling. Interest extends from the basic science to technology applications with analytical, experimental and numerical studies.
The emphasis is placed on contributions that appear to be of permanent interest to research workers and engineers in the field. If furthering knowledge in the area of principal concern of the Journal, papers of primary interest to the innovative disciplines of AUTOMOTIVE TECHNOLOGY, SCIENCE and ENGINEERING may be published. Papers that are merely illustrations of established principles and procedures, even though possibly containing new numerical or experimental data, will generally not be published.
When outstanding advances are made in existing areas or when new areas have been developed to a definitive stage, special review articles will be considered by the editors.
No length limitations for contributions are set, but only concisely written papers are published. Brief articles are considered on the basis of technical merit.