Min Deng;Jiwei Hu;Junxiang Wen;Xiaomei Zhang;Qiwen Jin
{"title":"基于目标检测的动态场景视觉SLAM优化方法","authors":"Min Deng;Jiwei Hu;Junxiang Wen;Xiaomei Zhang;Qiwen Jin","doi":"10.1109/JSEN.2025.3552797","DOIUrl":null,"url":null,"abstract":"In the realm of visual simultaneous localization and mapping (SLAM), the conventional assumption of a static environment presents notable challenges for achieving precision in dynamic settings. Moreover, the reliance on feature point-based techniques for generating sparse metric maps often proves insufficient for meeting complex higher level requirements. To tackle these challenges, we propose a real-time visual SLAM system that incorporates a parallel semantic thread for swift semantic scene analysis. By integrating a dynamic feature rejection module, our system enhances robustness in dynamic scenes by effectively leveraging both semantic and geometric information. A dense point cloud map is constructed using keyframes and their associated poses, employing techniques such as voxel grid filtering to mitigate map size. Experimental evaluations conducted on the public TUM RGB-D dataset and Bonn dataset validate the efficacy of our approach. The results showcase improved robustness and accuracy in dynamic environments, alongside the construction of dense maps for the static portions of real scenes, thereby facilitating downstream tasks.","PeriodicalId":447,"journal":{"name":"IEEE Sensors Journal","volume":"25 9","pages":"16480-16488"},"PeriodicalIF":4.3000,"publicationDate":"2025-03-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Object Detection-Based Visual SLAM Optimization Method for Dynamic Scene\",\"authors\":\"Min Deng;Jiwei Hu;Junxiang Wen;Xiaomei Zhang;Qiwen Jin\",\"doi\":\"10.1109/JSEN.2025.3552797\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"In the realm of visual simultaneous localization and mapping (SLAM), the conventional assumption of a static environment presents notable challenges for achieving precision in dynamic settings. Moreover, the reliance on feature point-based techniques for generating sparse metric maps often proves insufficient for meeting complex higher level requirements. To tackle these challenges, we propose a real-time visual SLAM system that incorporates a parallel semantic thread for swift semantic scene analysis. By integrating a dynamic feature rejection module, our system enhances robustness in dynamic scenes by effectively leveraging both semantic and geometric information. A dense point cloud map is constructed using keyframes and their associated poses, employing techniques such as voxel grid filtering to mitigate map size. Experimental evaluations conducted on the public TUM RGB-D dataset and Bonn dataset validate the efficacy of our approach. The results showcase improved robustness and accuracy in dynamic environments, alongside the construction of dense maps for the static portions of real scenes, thereby facilitating downstream tasks.\",\"PeriodicalId\":447,\"journal\":{\"name\":\"IEEE Sensors Journal\",\"volume\":\"25 9\",\"pages\":\"16480-16488\"},\"PeriodicalIF\":4.3000,\"publicationDate\":\"2025-03-27\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Sensors Journal\",\"FirstCategoryId\":\"103\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10944233/\",\"RegionNum\":2,\"RegionCategory\":\"综合性期刊\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Sensors Journal","FirstCategoryId":"103","ListUrlMain":"https://ieeexplore.ieee.org/document/10944233/","RegionNum":2,"RegionCategory":"综合性期刊","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
Object Detection-Based Visual SLAM Optimization Method for Dynamic Scene
In the realm of visual simultaneous localization and mapping (SLAM), the conventional assumption of a static environment presents notable challenges for achieving precision in dynamic settings. Moreover, the reliance on feature point-based techniques for generating sparse metric maps often proves insufficient for meeting complex higher level requirements. To tackle these challenges, we propose a real-time visual SLAM system that incorporates a parallel semantic thread for swift semantic scene analysis. By integrating a dynamic feature rejection module, our system enhances robustness in dynamic scenes by effectively leveraging both semantic and geometric information. A dense point cloud map is constructed using keyframes and their associated poses, employing techniques such as voxel grid filtering to mitigate map size. Experimental evaluations conducted on the public TUM RGB-D dataset and Bonn dataset validate the efficacy of our approach. The results showcase improved robustness and accuracy in dynamic environments, alongside the construction of dense maps for the static portions of real scenes, thereby facilitating downstream tasks.
期刊介绍:
The fields of interest of the IEEE Sensors Journal are the theory, design , fabrication, manufacturing and applications of devices for sensing and transducing physical, chemical and biological phenomena, with emphasis on the electronics and physics aspect of sensors and integrated sensors-actuators. IEEE Sensors Journal deals with the following:
-Sensor Phenomenology, Modelling, and Evaluation
-Sensor Materials, Processing, and Fabrication
-Chemical and Gas Sensors
-Microfluidics and Biosensors
-Optical Sensors
-Physical Sensors: Temperature, Mechanical, Magnetic, and others
-Acoustic and Ultrasonic Sensors
-Sensor Packaging
-Sensor Networks
-Sensor Applications
-Sensor Systems: Signals, Processing, and Interfaces
-Actuators and Sensor Power Systems
-Sensor Signal Processing for high precision and stability (amplification, filtering, linearization, modulation/demodulation) and under harsh conditions (EMC, radiation, humidity, temperature); energy consumption/harvesting
-Sensor Data Processing (soft computing with sensor data, e.g., pattern recognition, machine learning, evolutionary computation; sensor data fusion, processing of wave e.g., electromagnetic and acoustic; and non-wave, e.g., chemical, gravity, particle, thermal, radiative and non-radiative sensor data, detection, estimation and classification based on sensor data)
-Sensors in Industrial Practice