一种新颖的空间金字塔增强型室内视觉定位方法

IF 2.9 3区 工程技术 Q2 ENGINEERING, ELECTRICAL & ELECTRONIC
Jiaqiang Yang , Danyang Qin , Huapeng Tang , Sili Tao , Haoze Bie , Lin Ma
{"title":"一种新颖的空间金字塔增强型室内视觉定位方法","authors":"Jiaqiang Yang ,&nbsp;Danyang Qin ,&nbsp;Huapeng Tang ,&nbsp;Sili Tao ,&nbsp;Haoze Bie ,&nbsp;Lin Ma","doi":"10.1016/j.dsp.2024.104831","DOIUrl":null,"url":null,"abstract":"<div><div>As a key application of Internet of Things (IoT) technology, visual localization plays an important role in everyday life. However, pedestrians in images can obstruct environmental features, negatively impacting the performance of visual localization systems. To address this issue, we propose a Spatial Pyramid-Enhanced MixVPR visual localization method (SPE-VL) that aims to enhance image feature descriptions through multi-scale spatial information, thereby mitigating the effects of pedestrian occlusion on localization accuracy. The SPE-VL method is divided into two main phases: sensor-based matching range constraint and image feature extraction and matching. In the matching range constraint phase, we propose a direction decision method based on a machine learning classifier that utilizes smartphone sensor data to restrict the direction of image matching, reducing the likelihood of mismatches. In the feature extraction and matching phase, we propose a Transformer-based feature cross-enhancement method that leverages local features and spatial contextual information to enhance features, improving both image retrieval accuracy and localization precision. Experimental results indicate that the SPE-VL method demonstrates higher localization accuracy and robustness compared to existing state-of-the-art methods, providing new insights and solutions for the application of visual localization in complex environments.</div></div>","PeriodicalId":51011,"journal":{"name":"Digital Signal Processing","volume":"156 ","pages":"Article 104831"},"PeriodicalIF":2.9000,"publicationDate":"2024-10-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A novel spatial pyramid-enhanced indoor visual positioning method\",\"authors\":\"Jiaqiang Yang ,&nbsp;Danyang Qin ,&nbsp;Huapeng Tang ,&nbsp;Sili Tao ,&nbsp;Haoze Bie ,&nbsp;Lin Ma\",\"doi\":\"10.1016/j.dsp.2024.104831\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>As a key application of Internet of Things (IoT) technology, visual localization plays an important role in everyday life. However, pedestrians in images can obstruct environmental features, negatively impacting the performance of visual localization systems. To address this issue, we propose a Spatial Pyramid-Enhanced MixVPR visual localization method (SPE-VL) that aims to enhance image feature descriptions through multi-scale spatial information, thereby mitigating the effects of pedestrian occlusion on localization accuracy. The SPE-VL method is divided into two main phases: sensor-based matching range constraint and image feature extraction and matching. In the matching range constraint phase, we propose a direction decision method based on a machine learning classifier that utilizes smartphone sensor data to restrict the direction of image matching, reducing the likelihood of mismatches. In the feature extraction and matching phase, we propose a Transformer-based feature cross-enhancement method that leverages local features and spatial contextual information to enhance features, improving both image retrieval accuracy and localization precision. Experimental results indicate that the SPE-VL method demonstrates higher localization accuracy and robustness compared to existing state-of-the-art methods, providing new insights and solutions for the application of visual localization in complex environments.</div></div>\",\"PeriodicalId\":51011,\"journal\":{\"name\":\"Digital Signal Processing\",\"volume\":\"156 \",\"pages\":\"Article 104831\"},\"PeriodicalIF\":2.9000,\"publicationDate\":\"2024-10-28\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Digital Signal Processing\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S1051200424004561\",\"RegionNum\":3,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Digital Signal Processing","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1051200424004561","RegionNum":3,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0

摘要

作为物联网(IoT)技术的一项重要应用,视觉定位在日常生活中发挥着重要作用。然而,图像中的行人会遮挡环境特征,对视觉定位系统的性能产生负面影响。针对这一问题,我们提出了一种空间金字塔增强混合VPR可视化定位方法(SPE-VL),旨在通过多尺度空间信息增强图像特征描述,从而减轻行人遮挡对定位精度的影响。SPE-VL 方法分为两个主要阶段:基于传感器的匹配范围约束和图像特征提取与匹配。在匹配范围约束阶段,我们提出了一种基于机器学习分类器的方向判定方法,利用智能手机传感器数据来限制图像匹配的方向,从而降低不匹配的可能性。在特征提取和匹配阶段,我们提出了一种基于变换器的特征交叉增强方法,利用局部特征和空间上下文信息来增强特征,从而提高图像检索准确率和定位精度。实验结果表明,与现有的先进方法相比,SPE-VL 方法具有更高的定位精度和鲁棒性,为复杂环境中的视觉定位应用提供了新的见解和解决方案。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
A novel spatial pyramid-enhanced indoor visual positioning method
As a key application of Internet of Things (IoT) technology, visual localization plays an important role in everyday life. However, pedestrians in images can obstruct environmental features, negatively impacting the performance of visual localization systems. To address this issue, we propose a Spatial Pyramid-Enhanced MixVPR visual localization method (SPE-VL) that aims to enhance image feature descriptions through multi-scale spatial information, thereby mitigating the effects of pedestrian occlusion on localization accuracy. The SPE-VL method is divided into two main phases: sensor-based matching range constraint and image feature extraction and matching. In the matching range constraint phase, we propose a direction decision method based on a machine learning classifier that utilizes smartphone sensor data to restrict the direction of image matching, reducing the likelihood of mismatches. In the feature extraction and matching phase, we propose a Transformer-based feature cross-enhancement method that leverages local features and spatial contextual information to enhance features, improving both image retrieval accuracy and localization precision. Experimental results indicate that the SPE-VL method demonstrates higher localization accuracy and robustness compared to existing state-of-the-art methods, providing new insights and solutions for the application of visual localization in complex environments.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Digital Signal Processing
Digital Signal Processing 工程技术-工程:电子与电气
CiteScore
5.30
自引率
17.20%
发文量
435
审稿时长
66 days
期刊介绍: Digital Signal Processing: A Review Journal is one of the oldest and most established journals in the field of signal processing yet it aims to be the most innovative. The Journal invites top quality research articles at the frontiers of research in all aspects of signal processing. Our objective is to provide a platform for the publication of ground-breaking research in signal processing with both academic and industrial appeal. The journal has a special emphasis on statistical signal processing methodology such as Bayesian signal processing, and encourages articles on emerging applications of signal processing such as: • big data• machine learning• internet of things• information security• systems biology and computational biology,• financial time series analysis,• autonomous vehicles,• quantum computing,• neuromorphic engineering,• human-computer interaction and intelligent user interfaces,• environmental signal processing,• geophysical signal processing including seismic signal processing,• chemioinformatics and bioinformatics,• audio, visual and performance arts,• disaster management and prevention,• renewable energy,
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信