TKO-SLAM: Visual SLAM algorithm based on time-delay feature regression and keyframe pose optimization

IF 4.2 2区 计算机科学 Q2 ROBOTICS
Tao Xu, Mengyuan Chen, Jinhui Liu
{"title":"TKO-SLAM: Visual SLAM algorithm based on time-delay feature regression and keyframe pose optimization","authors":"Tao Xu,&nbsp;Mengyuan Chen,&nbsp;Jinhui Liu","doi":"10.1002/rob.22357","DOIUrl":null,"url":null,"abstract":"<p>This paper addresses the challenge of generating clear image frames and minimizing the loss of keyframes by a robot engaging in rapid large viewing angle motion. These issues often lead to detrimental consequences such as trajectory drifting and loss during the construction of curved motion trajectories. To tackle this, we proposed a novel visual simultaneous localization and mapping (SLAM) algorithm, TKO-SLAM, which is based on time-delay feature regression and keyframe position optimization. TKO-SLAM uses a multiscale recurrent neural network to rectify object deformation and image motion smear. This network effectively repairs the time-delay image features caused by the rapid movement of the robot, thereby enhancing visual clarity. Simultaneously, inspired by the keyframe selection strategy of the ORB-SLAM3 algorithm, we introduced a grayscale motion-based image processing method to supplement keyframes that may be omitted due to the robot's rapid large viewing angle motion. To further refine the algorithm, the time-delay feature regression image keyframes and adjacent secondary keyframes were used as dual measurement constraints to optimize camera poses and restore robot trajectories. The results of experiments on the benchmark RGB-D data set TUM and real-world scenarios show that TKO-SLAM algorithm achieves more than 10% better localization accuracy than the PKS-SLAM algorithm in the rapid large viewing angle motion scenario, and has advantages over the SOTA algorithms.</p>","PeriodicalId":192,"journal":{"name":"Journal of Field Robotics","volume":"41 6","pages":"1960-1983"},"PeriodicalIF":4.2000,"publicationDate":"2024-05-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Field Robotics","FirstCategoryId":"94","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1002/rob.22357","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ROBOTICS","Score":null,"Total":0}
引用次数: 0

Abstract

This paper addresses the challenge of generating clear image frames and minimizing the loss of keyframes by a robot engaging in rapid large viewing angle motion. These issues often lead to detrimental consequences such as trajectory drifting and loss during the construction of curved motion trajectories. To tackle this, we proposed a novel visual simultaneous localization and mapping (SLAM) algorithm, TKO-SLAM, which is based on time-delay feature regression and keyframe position optimization. TKO-SLAM uses a multiscale recurrent neural network to rectify object deformation and image motion smear. This network effectively repairs the time-delay image features caused by the rapid movement of the robot, thereby enhancing visual clarity. Simultaneously, inspired by the keyframe selection strategy of the ORB-SLAM3 algorithm, we introduced a grayscale motion-based image processing method to supplement keyframes that may be omitted due to the robot's rapid large viewing angle motion. To further refine the algorithm, the time-delay feature regression image keyframes and adjacent secondary keyframes were used as dual measurement constraints to optimize camera poses and restore robot trajectories. The results of experiments on the benchmark RGB-D data set TUM and real-world scenarios show that TKO-SLAM algorithm achieves more than 10% better localization accuracy than the PKS-SLAM algorithm in the rapid large viewing angle motion scenario, and has advantages over the SOTA algorithms.

TKO-SLAM:基于时延特征回归和关键帧姿势优化的视觉 SLAM 算法
本文探讨了机器人在进行大视角快速运动时,如何生成清晰的图像帧并尽量减少关键帧的丢失。这些问题往往会导致不利后果,例如在构建曲线运动轨迹时出现轨迹漂移和丢失。为了解决这个问题,我们提出了一种新颖的视觉同步定位和映射(SLAM)算法 TKO-SLAM,它基于时延特征回归和关键帧位置优化。TKO-SLAM 使用多尺度递归神经网络来纠正物体变形和图像运动涂抹。该网络能有效修复机器人快速运动造成的时延图像特征,从而提高视觉清晰度。同时,受 ORB-SLAM3 算法关键帧选择策略的启发,我们引入了一种基于灰度运动的图像处理方法,以补充因机器人快速大视角运动而可能遗漏的关键帧。为了进一步完善该算法,我们将时间延迟特征回归图像关键帧和相邻的辅助关键帧作为双重测量约束,以优化摄像机姿势并恢复机器人轨迹。在基准 RGB-D 数据集 TUM 和实际场景中的实验结果表明,在快速大视角运动场景中,TKO-SLAM 算法的定位精度比 PKS-SLAM 算法高出 10%以上,并且比 SOTA 算法更具优势。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Journal of Field Robotics
Journal of Field Robotics 工程技术-机器人学
CiteScore
15.00
自引率
3.60%
发文量
80
审稿时长
6 months
期刊介绍: The Journal of Field Robotics seeks to promote scholarly publications dealing with the fundamentals of robotics in unstructured and dynamic environments. The Journal focuses on experimental robotics and encourages publication of work that has both theoretical and practical significance.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信