Huanlong Liu, Zhiyu Nie, Yuqi Liu, Jingyu Xu, Hao Tian
{"title":"基于深度在线检测的枕弹簧视觉伺服定位方法","authors":"Huanlong Liu, Zhiyu Nie, Yuqi Liu, Jingyu Xu, Hao Tian","doi":"10.1002/rob.22557","DOIUrl":null,"url":null,"abstract":"<div>\n \n <p>The intelligent assembly system for railway wagon bolster springs needs to realize the positioning and grabbing of bolster springs, and also has high requirements for grabbing efficiency. To solve the problem of low efficiency of traditional visual servo positioning methods, an image visual servo (IBVS) control method based on depth online detection is proposed to improve the efficiency of maintenance operations. Based on MobileNetv3 network architecture and ECA attention mechanism, a lightweight object detection ME-YOLO model is proposed to improve the real-time positioning efficiency of bolster springs. The training results show that compared with the original YOLOv5s model, the detection accuracy of ME-YOLO is slightly reduced, but the model size is reduced by 81% and the detection speed is increased by 1.7 times. Taking advantage of the real-time detection advantages of the depth camera, a visual servo control method based on depth online detection is proposed to speed up the convergence of the IBVS system. A bolster spring grasping robot experimental platform was used to conduct a visual servo bolster spring positioning comparison test. The results show that the proposed ME-YOLO detection model can meet the grabbing needs of the bolster spring assembly robot system based on IBVS, while reducing the system convergence times by about 35%. The proposed IBVS method based on deep online detection can also further improve system operation efficiency by 7%.</p>\n </div>","PeriodicalId":192,"journal":{"name":"Journal of Field Robotics","volume":"42 6","pages":"2968-2984"},"PeriodicalIF":5.2000,"publicationDate":"2025-04-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Bolster Spring Visual Servo Positioning Method Based on Depth Online Detection\",\"authors\":\"Huanlong Liu, Zhiyu Nie, Yuqi Liu, Jingyu Xu, Hao Tian\",\"doi\":\"10.1002/rob.22557\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div>\\n \\n <p>The intelligent assembly system for railway wagon bolster springs needs to realize the positioning and grabbing of bolster springs, and also has high requirements for grabbing efficiency. To solve the problem of low efficiency of traditional visual servo positioning methods, an image visual servo (IBVS) control method based on depth online detection is proposed to improve the efficiency of maintenance operations. Based on MobileNetv3 network architecture and ECA attention mechanism, a lightweight object detection ME-YOLO model is proposed to improve the real-time positioning efficiency of bolster springs. The training results show that compared with the original YOLOv5s model, the detection accuracy of ME-YOLO is slightly reduced, but the model size is reduced by 81% and the detection speed is increased by 1.7 times. Taking advantage of the real-time detection advantages of the depth camera, a visual servo control method based on depth online detection is proposed to speed up the convergence of the IBVS system. A bolster spring grasping robot experimental platform was used to conduct a visual servo bolster spring positioning comparison test. The results show that the proposed ME-YOLO detection model can meet the grabbing needs of the bolster spring assembly robot system based on IBVS, while reducing the system convergence times by about 35%. The proposed IBVS method based on deep online detection can also further improve system operation efficiency by 7%.</p>\\n </div>\",\"PeriodicalId\":192,\"journal\":{\"name\":\"Journal of Field Robotics\",\"volume\":\"42 6\",\"pages\":\"2968-2984\"},\"PeriodicalIF\":5.2000,\"publicationDate\":\"2025-04-21\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Field Robotics\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://onlinelibrary.wiley.com/doi/10.1002/rob.22557\",\"RegionNum\":2,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"ROBOTICS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Field Robotics","FirstCategoryId":"94","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1002/rob.22557","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ROBOTICS","Score":null,"Total":0}
Bolster Spring Visual Servo Positioning Method Based on Depth Online Detection
The intelligent assembly system for railway wagon bolster springs needs to realize the positioning and grabbing of bolster springs, and also has high requirements for grabbing efficiency. To solve the problem of low efficiency of traditional visual servo positioning methods, an image visual servo (IBVS) control method based on depth online detection is proposed to improve the efficiency of maintenance operations. Based on MobileNetv3 network architecture and ECA attention mechanism, a lightweight object detection ME-YOLO model is proposed to improve the real-time positioning efficiency of bolster springs. The training results show that compared with the original YOLOv5s model, the detection accuracy of ME-YOLO is slightly reduced, but the model size is reduced by 81% and the detection speed is increased by 1.7 times. Taking advantage of the real-time detection advantages of the depth camera, a visual servo control method based on depth online detection is proposed to speed up the convergence of the IBVS system. A bolster spring grasping robot experimental platform was used to conduct a visual servo bolster spring positioning comparison test. The results show that the proposed ME-YOLO detection model can meet the grabbing needs of the bolster spring assembly robot system based on IBVS, while reducing the system convergence times by about 35%. The proposed IBVS method based on deep online detection can also further improve system operation efficiency by 7%.
期刊介绍:
The Journal of Field Robotics seeks to promote scholarly publications dealing with the fundamentals of robotics in unstructured and dynamic environments.
The Journal focuses on experimental robotics and encourages publication of work that has both theoretical and practical significance.