Model-based monocular 6-degree-of-freedom pose tracking for asteroid

Hao Tang, Chang Liu, Yuzhu Su, Qiuyin Wang, Weiduo Hu
{"title":"Model-based monocular 6-degree-of-freedom pose tracking for asteroid","authors":"Hao Tang, Chang Liu, Yuzhu Su, Qiuyin Wang, Weiduo Hu","doi":"10.3389/frspt.2024.1337262","DOIUrl":null,"url":null,"abstract":"In this paper, we present a novel vision-based framework to track the 6-DoF pose of an asteroid in real time with the 3D contour of the asteroid as a feature. During pose tracking, at the beginning time of tracking, the tracking system is initialized by a pose retrieval method. At each subsequent time instant, given the 3D mesh model of an asteroid, with the initial pose and its covariance given by the square root cubature Kalman Filter (SCKF), the 3D mesh segments constituting the 3D asteroid contour are efficiently extracted from the 3D mesh model. Then, in the input asteroid image, we search the image points corresponding to the extracted 3D segments within the searching range defined by the initial pose and its covariance. After that, the asteroid pose is determined in real time by minimizing the angles between the back-projection lines of the searched image points and the projection planes of the corresponding 3D segments, which is much more robust to the position change of the asteroid and asteroid size. The covariance matrix of the pose is inferred from the Cartesian noise model in the first order. Eventually, the SCKF is derived from the second-order auto regression to generate the final pose estimate and give the initial pose and its covariance for the next time instant. The synthetic trials quantitatively validate the real-time performance, robustness, and accuracy of our algorithm in dark space, different imaging distances, lighting conditions, image noise, model error, and initial pose error, and meanwhile, the real trial qualitatively shows the effectiveness of our method.","PeriodicalId":137674,"journal":{"name":"Frontiers in Space Technologies","volume":"17 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-02-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Frontiers in Space Technologies","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.3389/frspt.2024.1337262","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

In this paper, we present a novel vision-based framework to track the 6-DoF pose of an asteroid in real time with the 3D contour of the asteroid as a feature. During pose tracking, at the beginning time of tracking, the tracking system is initialized by a pose retrieval method. At each subsequent time instant, given the 3D mesh model of an asteroid, with the initial pose and its covariance given by the square root cubature Kalman Filter (SCKF), the 3D mesh segments constituting the 3D asteroid contour are efficiently extracted from the 3D mesh model. Then, in the input asteroid image, we search the image points corresponding to the extracted 3D segments within the searching range defined by the initial pose and its covariance. After that, the asteroid pose is determined in real time by minimizing the angles between the back-projection lines of the searched image points and the projection planes of the corresponding 3D segments, which is much more robust to the position change of the asteroid and asteroid size. The covariance matrix of the pose is inferred from the Cartesian noise model in the first order. Eventually, the SCKF is derived from the second-order auto regression to generate the final pose estimate and give the initial pose and its covariance for the next time instant. The synthetic trials quantitatively validate the real-time performance, robustness, and accuracy of our algorithm in dark space, different imaging distances, lighting conditions, image noise, model error, and initial pose error, and meanwhile, the real trial qualitatively shows the effectiveness of our method.
基于模型的小行星单目 6 自由度姿态跟踪
本文提出了一种基于视觉的新型框架,以小行星的三维轮廓为特征,实时跟踪小行星的 6-DoF 姿态。在姿态跟踪过程中,在跟踪开始时,跟踪系统通过姿态检索方法进行初始化。在随后的每个时间瞬时,给定小行星的三维网格模型,利用平方根立方卡尔曼滤波器(SCKF)给出初始姿态及其协方差,从三维网格模型中有效提取构成三维小行星轮廓的三维网格段。然后,在输入的小行星图像中,我们在初始姿态及其协方差定义的搜索范围内搜索与提取的三维片段相对应的图像点。之后,通过最小化搜索到的图像点的背投影线与相应三维片段的投影面之间的夹角,实时确定小行星的姿态,这对小行星的位置变化和小行星大小的影响更为稳健。姿态的协方差矩阵由一阶笛卡尔噪声模型推断。最后,SCKF 从二阶自动回归中推导出最终姿态估计值,并给出下一时间瞬间的初始姿态及其协方差。合成试验从数量上验证了我们的算法在暗空间、不同成像距离、光照条件、图像噪声、模型误差和初始姿态误差下的实时性能、鲁棒性和准确性,同时,实际试验从质量上显示了我们方法的有效性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信