TriGS-SLAM: Tristate Visibility Modeling for Robust 3DGS-SLAM in Dynamic Scenes Based on RGB-D Sensor

IF 4.5 2区 综合性期刊 Q1 ENGINEERING, ELECTRICAL & ELECTRONIC
IEEE Sensors Journal Pub Date : 2026-10-15 Epub Date: 2026-08-07 DOI:10.1109/JSEN.2026.3719476
Yong Zhou;Yongchuan Zhang;Jun Xia;Yiduo Bai;Yong He
{"title":"TriGS-SLAM: Tristate Visibility Modeling for Robust 3DGS-SLAM in Dynamic Scenes Based on RGB-D Sensor","authors":"Yong Zhou;Yongchuan Zhang;Jun Xia;Yiduo Bai;Yong He","doi":"10.1109/JSEN.2026.3719476","DOIUrl":null,"url":null,"abstract":"Simultaneous localization and mapping (SLAM) systems based on 3-D Gaussian splatting (3DGS) have garnered widespread attention due to their real-time high-fidelity rendering capabilities. However, in dynamic scenes, the interpretation of Gaussian visibility at the boundaries of dynamic occlusions is still unstable, often manifesting as boundary flickering, ghosting, residual artifacts, and geometric interpretation errors, which further interfere with pose estimation and map updates. The reason is that dynamic occlusion is not a simple binary switching process, but a continuous transition from fully visible to completely invisible. Traditional binary mask processing causes structural errors in information utilization for continuous occlusion changes, whereas relying solely on continuous opacity to handle discrete visibility switching can easily lead to boundary flickering and trailing effects. To this end, we propose a three-state visibility modeling method driven by multisource evidence for dynamic scenes captured by red-green-blue-depth (RGB-D) sensors. This method explicitly introduces a partial visibility intermediate state between the traditional binary states of visible and invisible, thereby transforming dynamic occlusion handling from a traditional post hoc residual-correction strategy into a visibility interpretation mechanism oriented toward the generative process. On this basis, we further use the three-state posterior as a soft constraint weight to uniformly regulate rendering, pose optimization, and mapping, enabling the system to form more stable and consistent observation interpretations in dynamic boundaries and occluded areas. Experimental results show that the proposed method can effectively alleviate boundary flickering and occlusion artifacts, and outperform existing state-of-the-art methods in terms of pose tracking accuracy and map reconstruction quality on real-world dynamic-scene datasets.","PeriodicalId":447,"journal":{"name":"IEEE Sensors Journal","volume":"26 20","pages":"30703-30720"},"PeriodicalIF":4.5000,"publicationDate":"2026-10-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Sensors Journal","FirstCategoryId":"103","ListUrlMain":"https://ieeexplore.ieee.org/document/11644818/","RegionNum":2,"RegionCategory":"综合性期刊","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2026/8/7 0:00:00","PubModel":"Epub","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0

Abstract

Simultaneous localization and mapping (SLAM) systems based on 3-D Gaussian splatting (3DGS) have garnered widespread attention due to their real-time high-fidelity rendering capabilities. However, in dynamic scenes, the interpretation of Gaussian visibility at the boundaries of dynamic occlusions is still unstable, often manifesting as boundary flickering, ghosting, residual artifacts, and geometric interpretation errors, which further interfere with pose estimation and map updates. The reason is that dynamic occlusion is not a simple binary switching process, but a continuous transition from fully visible to completely invisible. Traditional binary mask processing causes structural errors in information utilization for continuous occlusion changes, whereas relying solely on continuous opacity to handle discrete visibility switching can easily lead to boundary flickering and trailing effects. To this end, we propose a three-state visibility modeling method driven by multisource evidence for dynamic scenes captured by red-green-blue-depth (RGB-D) sensors. This method explicitly introduces a partial visibility intermediate state between the traditional binary states of visible and invisible, thereby transforming dynamic occlusion handling from a traditional post hoc residual-correction strategy into a visibility interpretation mechanism oriented toward the generative process. On this basis, we further use the three-state posterior as a soft constraint weight to uniformly regulate rendering, pose optimization, and mapping, enabling the system to form more stable and consistent observation interpretations in dynamic boundaries and occluded areas. Experimental results show that the proposed method can effectively alleviate boundary flickering and occlusion artifacts, and outperform existing state-of-the-art methods in terms of pose tracking accuracy and map reconstruction quality on real-world dynamic-scene datasets.
TriGS-SLAM:基于RGB-D传感器的动态场景鲁棒3DGS-SLAM三状态可视性建模
基于三维高斯飞溅(3DGS)的同步定位和地图绘制(SLAM)系统因其实时高保真渲染能力而受到广泛关注。然而,在动态场景中,动态遮挡边界处高斯可见性的解译仍然不稳定,通常表现为边界闪烁、重影、残余伪影和几何解译误差,进一步干扰姿态估计和地图更新。因为动态遮挡不是一个简单的二进制切换过程,而是一个从完全可见到完全不可见的连续过渡过程。传统的二值掩码处理在连续遮挡变化的信息利用上存在结构性错误,而单纯依靠连续不透明度处理离散可见性切换容易导致边界闪烁和拖尾效应。为此,我们提出了一种由多源证据驱动的红绿蓝深(RGB-D)传感器捕获动态场景的三状态可视性建模方法。该方法明确地在传统的可见和不可见二元状态之间引入了部分可见性中间状态,从而将动态遮挡处理从传统的事后残差校正策略转变为面向生成过程的可见性解释机制。在此基础上,我们进一步利用三态后验作为软约束权重,统一调控绘制、位姿优化和映射,使系统在动态边界和遮挡区域形成更加稳定一致的观测解译。实验结果表明,该方法可以有效地缓解边界闪烁和遮挡伪影,在真实动态场景数据集上的姿态跟踪精度和地图重建质量优于现有的先进方法。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
IEEE Sensors Journal
IEEE Sensors Journal 工程技术-工程:电子与电气
CiteScore
7.70
自引率
14.00%
发文量
2058
审稿时长
5.2 months
期刊介绍: The fields of interest of the IEEE Sensors Journal are the theory, design , fabrication, manufacturing and applications of devices for sensing and transducing physical, chemical and biological phenomena, with emphasis on the electronics and physics aspect of sensors and integrated sensors-actuators. IEEE Sensors Journal deals with the following: -Sensor Phenomenology, Modelling, and Evaluation -Sensor Materials, Processing, and Fabrication -Chemical and Gas Sensors -Microfluidics and Biosensors -Optical Sensors -Physical Sensors: Temperature, Mechanical, Magnetic, and others -Acoustic and Ultrasonic Sensors -Sensor Packaging -Sensor Networks -Sensor Applications -Sensor Systems: Signals, Processing, and Interfaces -Actuators and Sensor Power Systems -Sensor Signal Processing for high precision and stability (amplification, filtering, linearization, modulation/demodulation) and under harsh conditions (EMC, radiation, humidity, temperature); energy consumption/harvesting -Sensor Data Processing (soft computing with sensor data, e.g., pattern recognition, machine learning, evolutionary computation; sensor data fusion, processing of wave e.g., electromagnetic and acoustic; and non-wave, e.g., chemical, gravity, particle, thermal, radiative and non-radiative sensor data, detection, estimation and classification based on sensor data) -Sensors in Industrial Practice
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书