Novel VSLAM positioning through synthetic data and deep learning: Applications in virtual archaeology, ArQVIA

IF 3.5 2区综合性期刊 0 ARCHAEOLOGY

Journal of Cultural Heritage Pub Date : 2025-05-01 DOI:10.1016/j.culher.2025.04.004

Alicia Colmenero-Fernández

{"title":"Novel VSLAM positioning through synthetic data and deep learning: Applications in virtual archaeology, ArQVIA","authors":"Alicia Colmenero-Fernández","doi":"10.1016/j.culher.2025.04.004","DOIUrl":null,"url":null,"abstract":"<div><div>Virtual archaeology enhances the visitor’s understanding of historical sites through 3D reconstructions of original locations. However, a major obstacle to interactive visualization is the VSLAM (Visual Simultaneous Localization and Mapping) problem, which revolves around accurately matching real-world positions with scaled virtual replicas. Current methods—such as marker recognition or image feature comparison against keyframes or point clouds—often involve high computational costs, complex setups, or software dependencies (embedded systems, GPUs, library compilations).</div><div>Our proposed method leverages Content-Based Image Retrieval (CBIR) to match RGB input images taken on-site with features learned from photogrammetric models. A single image is transmitted via a server-based system, and an easy-to-use request-response interface is guided by the gyroscope. A 360-degree panorama that is in line with the nearest camera perspective is returned after the match. This approach is demonstrated by the mobile app ArQVIA, which makes 3D visualizations accessible and interactive for any monocular device without the need for specialized hardware.</div></div>","PeriodicalId":15480,"journal":{"name":"Journal of Cultural Heritage","volume":"73 ","pages":"Pages 347-357"},"PeriodicalIF":3.5000,"publicationDate":"2025-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Cultural Heritage","FirstCategoryId":"103","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1296207425000615","RegionNum":2,"RegionCategory":"综合性期刊","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"0","JCRName":"ARCHAEOLOGY","Score":null,"Total":0}

引用次数: 0

Abstract

Virtual archaeology enhances the visitor’s understanding of historical sites through 3D reconstructions of original locations. However, a major obstacle to interactive visualization is the VSLAM (Visual Simultaneous Localization and Mapping) problem, which revolves around accurately matching real-world positions with scaled virtual replicas. Current methods—such as marker recognition or image feature comparison against keyframes or point clouds—often involve high computational costs, complex setups, or software dependencies (embedded systems, GPUs, library compilations).

Our proposed method leverages Content-Based Image Retrieval (CBIR) to match RGB input images taken on-site with features learned from photogrammetric models. A single image is transmitted via a server-based system, and an easy-to-use request-response interface is guided by the gyroscope. A 360-degree panorama that is in line with the nearest camera perspective is returned after the match. This approach is demonstrated by the mobile app ArQVIA, which makes 3D visualizations accessible and interactive for any monocular device without the need for specialized hardware.

查看原文本刊更多论文

基于综合数据和深度学习的新型VSLAM定位：在虚拟考古中的应用

虚拟考古通过对原始地点进行三维重建，增强了游客对历史遗址的了解。然而，交互式可视化的一个主要障碍是VSLAM（视觉同步定位和映射）问题，该问题围绕着将真实世界的位置与缩放的虚拟复制品精确匹配。当前的方法（如标记识别或与关键帧或点云进行图像特征比较）通常涉及高计算成本、复杂设置或软件依赖（嵌入式系统、gpu、库编译）。我们提出的方法利用基于内容的图像检索（CBIR）将现场拍摄的RGB输入图像与从摄影测量模型中学习到的特征进行匹配。单个图像通过基于服务器的系统传输，并由陀螺仪引导一个易于使用的请求-响应接口。与最近的摄像机视角一致的360度全景在比赛结束后返回。移动应用ArQVIA演示了这种方法，它使任何单目设备都可以访问和交互3D可视化，而无需专门的硬件。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

Journal of Cultural Heritage 综合性期刊-材料科学：综合

CiteScore

6.80

自引率

9.70%

发文量

166

审稿时长

52 days

期刊介绍： The Journal of Cultural Heritage publishes original papers which comprise previously unpublished data and present innovative methods concerning all aspects of science and technology of cultural heritage as well as interpretation and theoretical issues related to preservation.