{"title":"基于运动检测和分割的动态环境中稳健的视觉 SLAM","authors":"Xin Yu, Rulin Shen, Kang Wu, Zhi Lin","doi":"10.1115/1.4065873","DOIUrl":null,"url":null,"abstract":"\n In this study, we propose a robust and accurate SLAM method for dynamic environments. Our approach combines sparse optical flow with epipolar geometric constraints to detect motion, determining whether a priori dynamic objects are moving. By integrating semantic segmentation with this motion detection, we can effectively remove dynamic keypoints, eliminating the influence of dynamic objects. This dynamic object removal technique is integrated into ORB-SLAM2, en-hancing its robustness and accuracy for localization and mapping. Experimental results on the TUM dataset demonstrate that our proposed system significantly reduces pose estimation error compared to ORB-SLAM2. Specifically, the RMSE and standard deviation (S.D.) of ORB-SLAM2 are reduced by up to 97.78% and 97.91%, respectively, in highly dynamic se-quences, markedly improving robustness in dynamic environments. Furthermore, compared to other similar SLAM methods, our method reduces RMSE and S.D. by up to 69.26% and 73.03%, respectively. Dense semantic maps generated by our method also closely align with the ground truth.","PeriodicalId":164923,"journal":{"name":"Journal of Autonomous Vehicles and Systems","volume":"63 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-07-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Robust Visual SLAM in Dynamic Environment Based on Motion Detection and Segmentation\",\"authors\":\"Xin Yu, Rulin Shen, Kang Wu, Zhi Lin\",\"doi\":\"10.1115/1.4065873\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"\\n In this study, we propose a robust and accurate SLAM method for dynamic environments. Our approach combines sparse optical flow with epipolar geometric constraints to detect motion, determining whether a priori dynamic objects are moving. By integrating semantic segmentation with this motion detection, we can effectively remove dynamic keypoints, eliminating the influence of dynamic objects. This dynamic object removal technique is integrated into ORB-SLAM2, en-hancing its robustness and accuracy for localization and mapping. Experimental results on the TUM dataset demonstrate that our proposed system significantly reduces pose estimation error compared to ORB-SLAM2. Specifically, the RMSE and standard deviation (S.D.) of ORB-SLAM2 are reduced by up to 97.78% and 97.91%, respectively, in highly dynamic se-quences, markedly improving robustness in dynamic environments. Furthermore, compared to other similar SLAM methods, our method reduces RMSE and S.D. by up to 69.26% and 73.03%, respectively. Dense semantic maps generated by our method also closely align with the ground truth.\",\"PeriodicalId\":164923,\"journal\":{\"name\":\"Journal of Autonomous Vehicles and Systems\",\"volume\":\"63 1\",\"pages\":\"\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-07-02\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Autonomous Vehicles and Systems\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1115/1.4065873\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Autonomous Vehicles and Systems","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1115/1.4065873","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
摘要
在这项研究中,我们提出了一种针对动态环境的稳健而精确的 SLAM 方法。我们的方法结合了稀疏光流和外极几何约束来检测运动,先验地确定动态物体是否在移动。通过将语义分割与运动检测相结合,我们可以有效地去除动态关键点,从而消除动态物体的影响。这种动态物体移除技术被集成到 ORB-SLAM2 中,提高了定位和映射的鲁棒性和准确性。在TUM数据集上的实验结果表明,与ORB-SLAM2相比,我们提出的系统显著降低了姿势估计误差。具体来说,在高动态序列中,ORB-SLAM2 的 RMSE 和标准偏差(S.D.)分别降低了 97.78% 和 97.91%,显著提高了动态环境中的鲁棒性。此外,与其他类似的 SLAM 方法相比,我们的方法将 RMSE 和 S.D. 分别降低了 69.26% 和 73.03%。我们的方法生成的密集语义图也与地面实况非常吻合。
Robust Visual SLAM in Dynamic Environment Based on Motion Detection and Segmentation
In this study, we propose a robust and accurate SLAM method for dynamic environments. Our approach combines sparse optical flow with epipolar geometric constraints to detect motion, determining whether a priori dynamic objects are moving. By integrating semantic segmentation with this motion detection, we can effectively remove dynamic keypoints, eliminating the influence of dynamic objects. This dynamic object removal technique is integrated into ORB-SLAM2, en-hancing its robustness and accuracy for localization and mapping. Experimental results on the TUM dataset demonstrate that our proposed system significantly reduces pose estimation error compared to ORB-SLAM2. Specifically, the RMSE and standard deviation (S.D.) of ORB-SLAM2 are reduced by up to 97.78% and 97.91%, respectively, in highly dynamic se-quences, markedly improving robustness in dynamic environments. Furthermore, compared to other similar SLAM methods, our method reduces RMSE and S.D. by up to 69.26% and 73.03%, respectively. Dense semantic maps generated by our method also closely align with the ground truth.