Zhouxiang Jiang , Ruoheng Ding , Yuxuan Liu , Zhongjie Long , Bao Song
{"title":"基于深度学习和降维模型的工业机器人视觉实时标定","authors":"Zhouxiang Jiang , Ruoheng Ding , Yuxuan Liu , Zhongjie Long , Bao Song","doi":"10.1016/j.precisioneng.2025.06.011","DOIUrl":null,"url":null,"abstract":"<div><div>A real-time calibration method for six-DoF industrial robot is presented. It aims to address the issue that calibration always suspends the work of robot and is quite costly due to repeated utilization of expensive measurement instrument. For this, a pose measurement strategy with cost-effective cameras is proposed where the work trajectory of robot is considered as a strict constraint on configurations to meet the requirement of real time. However, such efficiency improvement is accompanied by the accuracy decrease because the camera brings large measurement error and the trajectory constraint results in the reduced parameter identifiability. Firstly, to pull up the camera performance to the same level of precise instrument like the laser tracker, a set of neural networks are designed to map the inaccurately measured poses by camera to the accurate poses of concerned joints. Secondly, a dimension-reducing method is proposed to truncate the constrained kinematic-error model into two, which commonly achieve high parameter identifiability. Simulation shows that the prediction accuracy of joint pose with the well-trained networks is much higher than the measurement accuracy of laser tracker. Besides, the calibration accuracy with the dimension-reduced models is validated to be higher than that with the single high-dimension model of typical calibration. Finally, a generation strategy of training data with deeper regularity is proposed to meet the accuracy requirement in real scene, and the comparative results in the experiment validate a good potential of the real-time calibration method in manufacturing that requires high accuracy of robot and no suspension of work.</div></div>","PeriodicalId":54589,"journal":{"name":"Precision Engineering-Journal of the International Societies for Precision Engineering and Nanotechnology","volume":"96 ","pages":"Pages 192-211"},"PeriodicalIF":3.7000,"publicationDate":"2025-06-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Vision-based and real-time calibration of industrial robot by using deep learning and dimension-reduced models\",\"authors\":\"Zhouxiang Jiang , Ruoheng Ding , Yuxuan Liu , Zhongjie Long , Bao Song\",\"doi\":\"10.1016/j.precisioneng.2025.06.011\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>A real-time calibration method for six-DoF industrial robot is presented. It aims to address the issue that calibration always suspends the work of robot and is quite costly due to repeated utilization of expensive measurement instrument. For this, a pose measurement strategy with cost-effective cameras is proposed where the work trajectory of robot is considered as a strict constraint on configurations to meet the requirement of real time. However, such efficiency improvement is accompanied by the accuracy decrease because the camera brings large measurement error and the trajectory constraint results in the reduced parameter identifiability. Firstly, to pull up the camera performance to the same level of precise instrument like the laser tracker, a set of neural networks are designed to map the inaccurately measured poses by camera to the accurate poses of concerned joints. Secondly, a dimension-reducing method is proposed to truncate the constrained kinematic-error model into two, which commonly achieve high parameter identifiability. Simulation shows that the prediction accuracy of joint pose with the well-trained networks is much higher than the measurement accuracy of laser tracker. Besides, the calibration accuracy with the dimension-reduced models is validated to be higher than that with the single high-dimension model of typical calibration. Finally, a generation strategy of training data with deeper regularity is proposed to meet the accuracy requirement in real scene, and the comparative results in the experiment validate a good potential of the real-time calibration method in manufacturing that requires high accuracy of robot and no suspension of work.</div></div>\",\"PeriodicalId\":54589,\"journal\":{\"name\":\"Precision Engineering-Journal of the International Societies for Precision Engineering and Nanotechnology\",\"volume\":\"96 \",\"pages\":\"Pages 192-211\"},\"PeriodicalIF\":3.7000,\"publicationDate\":\"2025-06-13\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Precision Engineering-Journal of the International Societies for Precision Engineering and Nanotechnology\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0141635925001990\",\"RegionNum\":2,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"ENGINEERING, MANUFACTURING\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Precision Engineering-Journal of the International Societies for Precision Engineering and Nanotechnology","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0141635925001990","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENGINEERING, MANUFACTURING","Score":null,"Total":0}
Vision-based and real-time calibration of industrial robot by using deep learning and dimension-reduced models
A real-time calibration method for six-DoF industrial robot is presented. It aims to address the issue that calibration always suspends the work of robot and is quite costly due to repeated utilization of expensive measurement instrument. For this, a pose measurement strategy with cost-effective cameras is proposed where the work trajectory of robot is considered as a strict constraint on configurations to meet the requirement of real time. However, such efficiency improvement is accompanied by the accuracy decrease because the camera brings large measurement error and the trajectory constraint results in the reduced parameter identifiability. Firstly, to pull up the camera performance to the same level of precise instrument like the laser tracker, a set of neural networks are designed to map the inaccurately measured poses by camera to the accurate poses of concerned joints. Secondly, a dimension-reducing method is proposed to truncate the constrained kinematic-error model into two, which commonly achieve high parameter identifiability. Simulation shows that the prediction accuracy of joint pose with the well-trained networks is much higher than the measurement accuracy of laser tracker. Besides, the calibration accuracy with the dimension-reduced models is validated to be higher than that with the single high-dimension model of typical calibration. Finally, a generation strategy of training data with deeper regularity is proposed to meet the accuracy requirement in real scene, and the comparative results in the experiment validate a good potential of the real-time calibration method in manufacturing that requires high accuracy of robot and no suspension of work.
期刊介绍:
Precision Engineering - Journal of the International Societies for Precision Engineering and Nanotechnology is devoted to the multidisciplinary study and practice of high accuracy engineering, metrology, and manufacturing. The journal takes an integrated approach to all subjects related to research, design, manufacture, performance validation, and application of high precision machines, instruments, and components, including fundamental and applied research and development in manufacturing processes, fabrication technology, and advanced measurement science. The scope includes precision-engineered systems and supporting metrology over the full range of length scales, from atom-based nanotechnology and advanced lithographic technology to large-scale systems, including optical and radio telescopes and macrometrology.