一种基于双目视觉的机器人螺纹装配预对准姿态估计方法

IF 9.1 1区 计算机科学 Q1 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS
Yi Zhang , Zhonghai Song , Jiuwei Yu , Bingzhang Cao , Lei Wang
{"title":"一种基于双目视觉的机器人螺纹装配预对准姿态估计方法","authors":"Yi Zhang ,&nbsp;Zhonghai Song ,&nbsp;Jiuwei Yu ,&nbsp;Bingzhang Cao ,&nbsp;Lei Wang","doi":"10.1016/j.rcim.2024.102939","DOIUrl":null,"url":null,"abstract":"<div><div>Threaded assembly plays a critical role in industrial manufacturing; however, achieving a fully automated threaded assembly remains challenging. In this study, an automatic robot thread assembly system based on binocular vision was developed, along with a novel approach for spatial circle pose estimation. Notably, this method utilises the chamfering circle of the threaded hole as the recognition target and achieves precise pose estimation without requiring any prior knowledge, from a geometric perspective. Utilising only a chord of the ellipse projected from the circular feature of the threaded hole, the method effectively addresses the traditional reliance on complete target features. Additionally, it avoids the need for point cloud fitting, which is commonly used in conventional 3D pose estimation, thereby significantly reducing computational complexity and improving both efficiency and accuracy. An innovative method for verifying the spatial circle positioning accuracy is proposed based on the calibration plate coordinate system. The proposed method achieved position error ranges of [0.0419, 0.0837], [-0.0864, 0.0148], and [-0.0434, 0.0286] in mm along the x, y, and z axes, respectively. Furthermore, the orientation error ranged from 0.649° - 1.752° To comprehensively consider the origin of the various errors, a workpiece was designed to conduct robot alignment experiments. The average errors along the x, y, and z axes were -0.23, -0.57, and -0.45 mm, respectively. Overall, the proposed vision measurement method demonstrated excellent pose estimation accuracy and significantly enhanced the automation of robotic threaded assembly processes. This advancement holds great potential for widespread applications in industrial manufacturing environments.</div></div>","PeriodicalId":21452,"journal":{"name":"Robotics and Computer-integrated Manufacturing","volume":"93 ","pages":"Article 102939"},"PeriodicalIF":9.1000,"publicationDate":"2024-12-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A novel pose estimation method for robot threaded assembly pre-alignment based on binocular vision\",\"authors\":\"Yi Zhang ,&nbsp;Zhonghai Song ,&nbsp;Jiuwei Yu ,&nbsp;Bingzhang Cao ,&nbsp;Lei Wang\",\"doi\":\"10.1016/j.rcim.2024.102939\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Threaded assembly plays a critical role in industrial manufacturing; however, achieving a fully automated threaded assembly remains challenging. In this study, an automatic robot thread assembly system based on binocular vision was developed, along with a novel approach for spatial circle pose estimation. Notably, this method utilises the chamfering circle of the threaded hole as the recognition target and achieves precise pose estimation without requiring any prior knowledge, from a geometric perspective. Utilising only a chord of the ellipse projected from the circular feature of the threaded hole, the method effectively addresses the traditional reliance on complete target features. Additionally, it avoids the need for point cloud fitting, which is commonly used in conventional 3D pose estimation, thereby significantly reducing computational complexity and improving both efficiency and accuracy. An innovative method for verifying the spatial circle positioning accuracy is proposed based on the calibration plate coordinate system. The proposed method achieved position error ranges of [0.0419, 0.0837], [-0.0864, 0.0148], and [-0.0434, 0.0286] in mm along the x, y, and z axes, respectively. Furthermore, the orientation error ranged from 0.649° - 1.752° To comprehensively consider the origin of the various errors, a workpiece was designed to conduct robot alignment experiments. The average errors along the x, y, and z axes were -0.23, -0.57, and -0.45 mm, respectively. Overall, the proposed vision measurement method demonstrated excellent pose estimation accuracy and significantly enhanced the automation of robotic threaded assembly processes. This advancement holds great potential for widespread applications in industrial manufacturing environments.</div></div>\",\"PeriodicalId\":21452,\"journal\":{\"name\":\"Robotics and Computer-integrated Manufacturing\",\"volume\":\"93 \",\"pages\":\"Article 102939\"},\"PeriodicalIF\":9.1000,\"publicationDate\":\"2024-12-25\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Robotics and Computer-integrated Manufacturing\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0736584524002266\",\"RegionNum\":1,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Robotics and Computer-integrated Manufacturing","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0736584524002266","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS","Score":null,"Total":0}
引用次数: 0

摘要

螺纹装配在工业制造中起着至关重要的作用;然而,实现全自动螺纹装配仍然具有挑战性。本研究开发了一种基于双目视觉的机器人螺纹自动装配系统,并提出了一种新的空间圆位姿估计方法。值得注意的是,该方法从几何角度利用螺纹孔的倒角圆作为识别目标,无需任何先验知识即可实现精确的姿态估计。该方法仅利用螺纹孔圆形特征投射的椭圆弦,有效地解决了传统上对完整目标特征的依赖。此外,它避免了传统3D姿态估计中常用的点云拟合的需要,从而大大降低了计算复杂度,提高了效率和精度。提出了一种基于标定板坐标系的空间圆定位精度验证方法。该方法在x、y和z轴上的位置误差范围分别为[0.0419、0.0837]、[-0.0864、0.0148]和[-0.0434、0.0286]mm。为了综合考虑各种误差的来源,设计了一个工件进行机器人对中实验。沿x、y、z轴的平均误差分别为-0.23、-0.57、-0.45 mm。总体而言,所提出的视觉测量方法具有良好的姿态估计精度,显著提高了机器人螺纹装配过程的自动化程度。这一进步在工业制造环境中具有广泛应用的巨大潜力。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
A novel pose estimation method for robot threaded assembly pre-alignment based on binocular vision
Threaded assembly plays a critical role in industrial manufacturing; however, achieving a fully automated threaded assembly remains challenging. In this study, an automatic robot thread assembly system based on binocular vision was developed, along with a novel approach for spatial circle pose estimation. Notably, this method utilises the chamfering circle of the threaded hole as the recognition target and achieves precise pose estimation without requiring any prior knowledge, from a geometric perspective. Utilising only a chord of the ellipse projected from the circular feature of the threaded hole, the method effectively addresses the traditional reliance on complete target features. Additionally, it avoids the need for point cloud fitting, which is commonly used in conventional 3D pose estimation, thereby significantly reducing computational complexity and improving both efficiency and accuracy. An innovative method for verifying the spatial circle positioning accuracy is proposed based on the calibration plate coordinate system. The proposed method achieved position error ranges of [0.0419, 0.0837], [-0.0864, 0.0148], and [-0.0434, 0.0286] in mm along the x, y, and z axes, respectively. Furthermore, the orientation error ranged from 0.649° - 1.752° To comprehensively consider the origin of the various errors, a workpiece was designed to conduct robot alignment experiments. The average errors along the x, y, and z axes were -0.23, -0.57, and -0.45 mm, respectively. Overall, the proposed vision measurement method demonstrated excellent pose estimation accuracy and significantly enhanced the automation of robotic threaded assembly processes. This advancement holds great potential for widespread applications in industrial manufacturing environments.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Robotics and Computer-integrated Manufacturing
Robotics and Computer-integrated Manufacturing 工程技术-工程:制造
CiteScore
24.10
自引率
13.50%
发文量
160
审稿时长
50 days
期刊介绍: The journal, Robotics and Computer-Integrated Manufacturing, focuses on sharing research applications that contribute to the development of new or enhanced robotics, manufacturing technologies, and innovative manufacturing strategies that are relevant to industry. Papers that combine theory and experimental validation are preferred, while review papers on current robotics and manufacturing issues are also considered. However, papers on traditional machining processes, modeling and simulation, supply chain management, and resource optimization are generally not within the scope of the journal, as there are more appropriate journals for these topics. Similarly, papers that are overly theoretical or mathematical will be directed to other suitable journals. The journal welcomes original papers in areas such as industrial robotics, human-robot collaboration in manufacturing, cloud-based manufacturing, cyber-physical production systems, big data analytics in manufacturing, smart mechatronics, machine learning, adaptive and sustainable manufacturing, and other fields involving unique manufacturing technologies.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信