基于先验知识的复杂形状物体6DoF姿态估计

Tonghui Jiao, Yanzhao Xia, Xiaosong Gao, Yongyu Chen, Qunfei Zhao
{"title":"基于先验知识的复杂形状物体6DoF姿态估计","authors":"Tonghui Jiao, Yanzhao Xia, Xiaosong Gao, Yongyu Chen, Qunfei Zhao","doi":"10.1109/ISASS.2019.8757758","DOIUrl":null,"url":null,"abstract":"Quick and accurate estimation for the 6-DoF pose of a randomly arranged object in intricate shape plays an important role in robotic picking applications. In this paper we propose an approach based on template matching by using the aligned RGB-D image with prior knowledge to recover the 6-DoF pose of a randomly arranged object. First, the object’s template database is generated with the help of a defined virtual imaging model and its CAD model. Then in the practical phase, we segment RGB-D image to get the mask representing the location of the object and then these data are modified into a comparable format with the characteristics of scale invariance. At last, a similar function with adjustable attention weight to color and depth data is defined to find Top-K matched templates. The selected matched templates are refined by ICP to generate the final answer. Experiments are conducted using an RGB-D camera and a robot arm to pick up given objects in intricate shape. The average recognition rate of the object in different poses is 97.826%. It also can work well with multiple objects randomly arranged with good masks representing the locations.","PeriodicalId":359959,"journal":{"name":"2019 3rd International Symposium on Autonomous Systems (ISAS)","volume":"8 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2019-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"6DoF Pose Estimation for Intricately-Shaped Object with Prior Knowledge for Robotic Picking\",\"authors\":\"Tonghui Jiao, Yanzhao Xia, Xiaosong Gao, Yongyu Chen, Qunfei Zhao\",\"doi\":\"10.1109/ISASS.2019.8757758\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Quick and accurate estimation for the 6-DoF pose of a randomly arranged object in intricate shape plays an important role in robotic picking applications. In this paper we propose an approach based on template matching by using the aligned RGB-D image with prior knowledge to recover the 6-DoF pose of a randomly arranged object. First, the object’s template database is generated with the help of a defined virtual imaging model and its CAD model. Then in the practical phase, we segment RGB-D image to get the mask representing the location of the object and then these data are modified into a comparable format with the characteristics of scale invariance. At last, a similar function with adjustable attention weight to color and depth data is defined to find Top-K matched templates. The selected matched templates are refined by ICP to generate the final answer. Experiments are conducted using an RGB-D camera and a robot arm to pick up given objects in intricate shape. The average recognition rate of the object in different poses is 97.826%. It also can work well with multiple objects randomly arranged with good masks representing the locations.\",\"PeriodicalId\":359959,\"journal\":{\"name\":\"2019 3rd International Symposium on Autonomous Systems (ISAS)\",\"volume\":\"8 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2019-05-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2019 3rd International Symposium on Autonomous Systems (ISAS)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ISASS.2019.8757758\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2019 3rd International Symposium on Autonomous Systems (ISAS)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ISASS.2019.8757758","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

快速准确地估计复杂形状随机排列物体的六自由度位姿在机器人拾取应用中具有重要意义。本文提出了一种基于模板匹配的方法,利用具有先验知识的对齐RGB-D图像来恢复随机排列对象的6自由度位姿。首先,利用已定义的虚拟成像模型及其CAD模型生成目标模板数据库;然后在实际阶段,我们对RGB-D图像进行分割,得到代表目标位置的掩码,然后将这些数据修改成具有尺度不变性特征的可比较格式。最后,定义了一个类似的函数,该函数对颜色和深度数据的关注权重可调,用于查找Top-K匹配的模板。选择的匹配模板由ICP进行细化以生成最终答案。实验使用RGB-D相机和机械臂来拾取复杂形状的给定物体。不同姿态目标的平均识别率为97.826%。它也可以很好地处理随机排列的多个对象,并使用良好的遮罩表示位置。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
6DoF Pose Estimation for Intricately-Shaped Object with Prior Knowledge for Robotic Picking
Quick and accurate estimation for the 6-DoF pose of a randomly arranged object in intricate shape plays an important role in robotic picking applications. In this paper we propose an approach based on template matching by using the aligned RGB-D image with prior knowledge to recover the 6-DoF pose of a randomly arranged object. First, the object’s template database is generated with the help of a defined virtual imaging model and its CAD model. Then in the practical phase, we segment RGB-D image to get the mask representing the location of the object and then these data are modified into a comparable format with the characteristics of scale invariance. At last, a similar function with adjustable attention weight to color and depth data is defined to find Top-K matched templates. The selected matched templates are refined by ICP to generate the final answer. Experiments are conducted using an RGB-D camera and a robot arm to pick up given objects in intricate shape. The average recognition rate of the object in different poses is 97.826%. It also can work well with multiple objects randomly arranged with good masks representing the locations.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信