Changyu Jing , Tianyu Fu , Fengming Li , Ligang Jin , Rui Song
{"title":"FPC-BTB detection and positioning system based on optimized YOLOv5","authors":"Changyu Jing , Tianyu Fu , Fengming Li , Ligang Jin , Rui Song","doi":"10.1016/j.birob.2023.100132","DOIUrl":null,"url":null,"abstract":"<div><p>With the aim of addressing the visual positioning problem of board-to-board (BTB) jacks during the automatic assembly of flexible printed circuit (FPC) in mobile phones, an FPC-BTB jack detection method based on the optimized You Only Look Once, version 5 (YOLOv5) deep learning algorithm was proposed in this study. An FPC-BTB jack real-time detection and positioning system was developed for the real-time target detection and pose output synchronization of the BTB jack. On that basis, a visual positioning experimental platform that integrated a UR5e manipulator arm and Hikvision industrial camera was built for BTB jack detection and positioning experiments. As indicated by the experimental results, the developed FPC-BTB jack detection and positioning system for BTB target recognition and positioning achieved a success rate of 99.677%. Its average detection accuracy reached 99.341%, the average confidence of the detected target was 91%, the detection and positioning speed reached 31.25 frames per second, and the positioning deviation was less than 0.93 mm, which conforms to the practical application requirements of the FPC assembly process.</p></div>","PeriodicalId":100184,"journal":{"name":"Biomimetic Intelligence and Robotics","volume":"3 4","pages":"Article 100132"},"PeriodicalIF":0.0000,"publicationDate":"2023-10-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2667379723000463/pdfft?md5=389029475c5fb205080a541f55997139&pid=1-s2.0-S2667379723000463-main.pdf","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Biomimetic Intelligence and Robotics","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2667379723000463","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
With the aim of addressing the visual positioning problem of board-to-board (BTB) jacks during the automatic assembly of flexible printed circuit (FPC) in mobile phones, an FPC-BTB jack detection method based on the optimized You Only Look Once, version 5 (YOLOv5) deep learning algorithm was proposed in this study. An FPC-BTB jack real-time detection and positioning system was developed for the real-time target detection and pose output synchronization of the BTB jack. On that basis, a visual positioning experimental platform that integrated a UR5e manipulator arm and Hikvision industrial camera was built for BTB jack detection and positioning experiments. As indicated by the experimental results, the developed FPC-BTB jack detection and positioning system for BTB target recognition and positioning achieved a success rate of 99.677%. Its average detection accuracy reached 99.341%, the average confidence of the detected target was 91%, the detection and positioning speed reached 31.25 frames per second, and the positioning deviation was less than 0.93 mm, which conforms to the practical application requirements of the FPC assembly process.
针对手机柔性印刷电路(FPC)自动装配过程中板对板(BTB)插孔的视觉定位问题,提出了一种基于优化后的You Only Look Once, version 5 (YOLOv5)深度学习算法的FPC-BTB插孔检测方法。为实现BTB千斤顶的实时目标检测和位姿输出同步,研制了FPC-BTB千斤顶实时检测定位系统。在此基础上,搭建了UR5e机械手与海康威视工业相机相结合的视觉定位实验平台,进行BTB千斤顶检测与定位实验。实验结果表明,所开发的FPC-BTB插孔检测定位系统对BTB目标的识别定位成功率达到99.677%。其平均检测精度达到99.341%,检测目标平均置信度91%,检测定位速度达到31.25帧/秒,定位偏差小于0.93 mm,符合FPC装配工艺的实际应用要求。