基于三维高斯溅射增强的紧密集成gnss -视觉惯性导航系统

IF 3.6 3区 计算机科学 Q2 COMPUTER SCIENCE, INFORMATION SYSTEMS
Zelin Zhou;Shichuang Nie;Saurav Uprety;Hongzhou Yang
{"title":"基于三维高斯溅射增强的紧密集成gnss -视觉惯性导航系统","authors":"Zelin Zhou;Shichuang Nie;Saurav Uprety;Hongzhou Yang","doi":"10.1109/ACCESS.2025.3589161","DOIUrl":null,"url":null,"abstract":"Accurate navigation is critical for autonomous vehicles in today’s diverse traffic environments. Integrating Global Satellite Navigation System (GNSS), Inertial Navigation System (INS), and camera has demonstrated significant robustness and high accuracy for navigation in complex environments. However, most integrated systems rely on feature-tracking based visual odometry, which suffers from the problem of feature sparsity, high dynamics, significant illumination changes, etc. Recently, the emergence of 3D Gaussian Splatting (3DGS) has drawn significant attention in the area of 3D map reconstruction and visual SLAM. While extensive research has explored 3DGS for indoor trajectory tracking using visual sensor alone or in combination with Light Detection and Ranging (LiDAR) and Inertial Measurement Unit (IMU), its integration with GNSS for large-scale outdoor navigation remains underexplored. To address these concerns, we propose GS-GVINS: a tightly-integrated GNSS-Visual-Inertial Navigation System augmented by 3DGS. This system leverages 3D Gaussian as a continuous differentiable scene representation in large-scale outdoor environments, enhancing navigation performance through the constructed 3D Gaussian map. Notably, GS-GVINS is the first GNSS-Visual-Inertial navigation application that directly utilizes the analytical jacobians of SE3 camera pose with respect to 3D Gaussians. To maintain the quality of 3DGS rendering in extreme dynamic states, we introduce a motion-aware 3D Gaussian pruning mechanism, updating the map based on relative pose translation and the accumulated opacity along the camera ray. For validation, we test our system under different driving environments: open-sky, suburban, and urban. Both self-collected and public datasets are used for evaluation. The results demonstrate the effectiveness of GS-GVINS in enhancing navigation accuracy across diverse driving environments.","PeriodicalId":13079,"journal":{"name":"IEEE Access","volume":"13 ","pages":"125817-125829"},"PeriodicalIF":3.6000,"publicationDate":"2025-07-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=11080066","citationCount":"0","resultStr":"{\"title\":\"GS-GVINS: A Tightly-Integrated GNSS-Visual-Inertial Navigation System Augmented by 3D Gaussian Splatting\",\"authors\":\"Zelin Zhou;Shichuang Nie;Saurav Uprety;Hongzhou Yang\",\"doi\":\"10.1109/ACCESS.2025.3589161\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Accurate navigation is critical for autonomous vehicles in today’s diverse traffic environments. Integrating Global Satellite Navigation System (GNSS), Inertial Navigation System (INS), and camera has demonstrated significant robustness and high accuracy for navigation in complex environments. However, most integrated systems rely on feature-tracking based visual odometry, which suffers from the problem of feature sparsity, high dynamics, significant illumination changes, etc. Recently, the emergence of 3D Gaussian Splatting (3DGS) has drawn significant attention in the area of 3D map reconstruction and visual SLAM. While extensive research has explored 3DGS for indoor trajectory tracking using visual sensor alone or in combination with Light Detection and Ranging (LiDAR) and Inertial Measurement Unit (IMU), its integration with GNSS for large-scale outdoor navigation remains underexplored. To address these concerns, we propose GS-GVINS: a tightly-integrated GNSS-Visual-Inertial Navigation System augmented by 3DGS. This system leverages 3D Gaussian as a continuous differentiable scene representation in large-scale outdoor environments, enhancing navigation performance through the constructed 3D Gaussian map. Notably, GS-GVINS is the first GNSS-Visual-Inertial navigation application that directly utilizes the analytical jacobians of SE3 camera pose with respect to 3D Gaussians. To maintain the quality of 3DGS rendering in extreme dynamic states, we introduce a motion-aware 3D Gaussian pruning mechanism, updating the map based on relative pose translation and the accumulated opacity along the camera ray. For validation, we test our system under different driving environments: open-sky, suburban, and urban. Both self-collected and public datasets are used for evaluation. The results demonstrate the effectiveness of GS-GVINS in enhancing navigation accuracy across diverse driving environments.\",\"PeriodicalId\":13079,\"journal\":{\"name\":\"IEEE Access\",\"volume\":\"13 \",\"pages\":\"125817-125829\"},\"PeriodicalIF\":3.6000,\"publicationDate\":\"2025-07-14\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=11080066\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Access\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/11080066/\",\"RegionNum\":3,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"COMPUTER SCIENCE, INFORMATION SYSTEMS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Access","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/11080066/","RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
引用次数: 0

摘要

在当今多样化的交通环境中,精确导航对自动驾驶汽车至关重要。将全球卫星导航系统(GNSS)、惯性导航系统(INS)和相机集成在一起,在复杂环境中显示出显著的鲁棒性和高精度导航能力。然而,大多数集成系统依赖于基于特征跟踪的视觉里程计,存在特征稀疏、高动态、光照变化大等问题。近年来,三维高斯飞溅(3DGS)技术的出现引起了三维地图重建和视觉SLAM领域的广泛关注。虽然已有广泛的研究探索了使用视觉传感器单独或结合光探测和测距(LiDAR)和惯性测量单元(IMU)进行室内轨迹跟踪的3DGS,但其与大规模户外导航的GNSS集成仍未得到充分探索。为了解决这些问题,我们提出了GS-GVINS:一种由3DGS增强的紧密集成的gnss视觉惯性导航系统。该系统利用三维高斯作为大规模室外环境中的连续可微场景表示,通过构建三维高斯地图来增强导航性能。值得注意的是,GS-GVINS是第一个直接利用SE3相机姿态相对于三维高斯的解析雅可比矩阵的gnss视觉惯性导航应用。为了在极端动态状态下保持3DGS渲染的质量,我们引入了一种运动感知的3D高斯剪剪机制,基于相对姿态平移和沿着相机光线累积的不透明度来更新地图。为了验证,我们在不同的驾驶环境下测试了我们的系统:露天、郊区和城市。自我收集和公共数据集都用于评估。结果证明了gps - gvins在不同驾驶环境下提高导航精度的有效性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
GS-GVINS: A Tightly-Integrated GNSS-Visual-Inertial Navigation System Augmented by 3D Gaussian Splatting
Accurate navigation is critical for autonomous vehicles in today’s diverse traffic environments. Integrating Global Satellite Navigation System (GNSS), Inertial Navigation System (INS), and camera has demonstrated significant robustness and high accuracy for navigation in complex environments. However, most integrated systems rely on feature-tracking based visual odometry, which suffers from the problem of feature sparsity, high dynamics, significant illumination changes, etc. Recently, the emergence of 3D Gaussian Splatting (3DGS) has drawn significant attention in the area of 3D map reconstruction and visual SLAM. While extensive research has explored 3DGS for indoor trajectory tracking using visual sensor alone or in combination with Light Detection and Ranging (LiDAR) and Inertial Measurement Unit (IMU), its integration with GNSS for large-scale outdoor navigation remains underexplored. To address these concerns, we propose GS-GVINS: a tightly-integrated GNSS-Visual-Inertial Navigation System augmented by 3DGS. This system leverages 3D Gaussian as a continuous differentiable scene representation in large-scale outdoor environments, enhancing navigation performance through the constructed 3D Gaussian map. Notably, GS-GVINS is the first GNSS-Visual-Inertial navigation application that directly utilizes the analytical jacobians of SE3 camera pose with respect to 3D Gaussians. To maintain the quality of 3DGS rendering in extreme dynamic states, we introduce a motion-aware 3D Gaussian pruning mechanism, updating the map based on relative pose translation and the accumulated opacity along the camera ray. For validation, we test our system under different driving environments: open-sky, suburban, and urban. Both self-collected and public datasets are used for evaluation. The results demonstrate the effectiveness of GS-GVINS in enhancing navigation accuracy across diverse driving environments.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
IEEE Access
IEEE Access COMPUTER SCIENCE, INFORMATION SYSTEMSENGIN-ENGINEERING, ELECTRICAL & ELECTRONIC
CiteScore
9.80
自引率
7.70%
发文量
6673
审稿时长
6 weeks
期刊介绍: IEEE Access® is a multidisciplinary, open access (OA), applications-oriented, all-electronic archival journal that continuously presents the results of original research or development across all of IEEE''s fields of interest. IEEE Access will publish articles that are of high interest to readers, original, technically correct, and clearly presented. Supported by author publication charges (APC), its hallmarks are a rapid peer review and publication process with open access to all readers. Unlike IEEE''s traditional Transactions or Journals, reviews are "binary", in that reviewers will either Accept or Reject an article in the form it is submitted in order to achieve rapid turnaround. Especially encouraged are submissions on: Multidisciplinary topics, or applications-oriented articles and negative results that do not fit within the scope of IEEE''s traditional journals. Practical articles discussing new experiments or measurement techniques, interesting solutions to engineering. Development of new or improved fabrication or manufacturing techniques. Reviews or survey articles of new or evolving fields oriented to assist others in understanding the new area.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信