Xinyao Zhang, Kareem A. Eltouny, Xiao Liang, S. Behdad
{"title":"机器人拆卸螺丝自动检测与工具推荐系统","authors":"Xinyao Zhang, Kareem A. Eltouny, Xiao Liang, S. Behdad","doi":"10.1115/msec2022-85403","DOIUrl":null,"url":null,"abstract":"\n Disassembly is an essential process for the recovery of end-of-life (EOL) electronics in remanufacturing sites. Nevertheless, the process remains labor-intensive due to EOL electronics’ high degree of uncertainty and complexity. The robotic technology can assist in improving disassembly efficiency, however, the characteristics of EOL electronics pose difficulties for robot operation, such as removing small components. For such tasks, detecting small objects is critical for robotic disassembly systems. Screws are widely used as fasteners in ordinary electronic products while having small sizes and varying shapes in a scene. To achieve robotic disassembly of screws, the location information and the required tools need to be predicted. This paper proposes a framework to automatically detect screws and recommend related tools for disassembly. First, the YOLOv4 algorithm is used to detect screw targets in EOL electronic devices, and then a screw image extraction mechanism is executed based on the position coordinates predicted by YOLOv4. Second, after obtaining the screw images, the EfficientNetv2 algorithm is applied for screw shape classification. In addition to proposing a framework for automatic small-object detection, we explore how to modify the object detection algorithm to improve its performance and discuss the sensitivity of tool recommendations to the detection predictions. A case study of three different types of screws is used to evaluate the performance of the proposed framework.","PeriodicalId":45459,"journal":{"name":"Journal of Micro and Nano-Manufacturing","volume":null,"pages":null},"PeriodicalIF":1.0000,"publicationDate":"2022-06-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"4","resultStr":"{\"title\":\"Automatic Screw Detection and Tool Recommendation System for Robotic Disassembly\",\"authors\":\"Xinyao Zhang, Kareem A. Eltouny, Xiao Liang, S. Behdad\",\"doi\":\"10.1115/msec2022-85403\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"\\n Disassembly is an essential process for the recovery of end-of-life (EOL) electronics in remanufacturing sites. Nevertheless, the process remains labor-intensive due to EOL electronics’ high degree of uncertainty and complexity. The robotic technology can assist in improving disassembly efficiency, however, the characteristics of EOL electronics pose difficulties for robot operation, such as removing small components. For such tasks, detecting small objects is critical for robotic disassembly systems. Screws are widely used as fasteners in ordinary electronic products while having small sizes and varying shapes in a scene. To achieve robotic disassembly of screws, the location information and the required tools need to be predicted. This paper proposes a framework to automatically detect screws and recommend related tools for disassembly. First, the YOLOv4 algorithm is used to detect screw targets in EOL electronic devices, and then a screw image extraction mechanism is executed based on the position coordinates predicted by YOLOv4. Second, after obtaining the screw images, the EfficientNetv2 algorithm is applied for screw shape classification. In addition to proposing a framework for automatic small-object detection, we explore how to modify the object detection algorithm to improve its performance and discuss the sensitivity of tool recommendations to the detection predictions. A case study of three different types of screws is used to evaluate the performance of the proposed framework.\",\"PeriodicalId\":45459,\"journal\":{\"name\":\"Journal of Micro and Nano-Manufacturing\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":1.0000,\"publicationDate\":\"2022-06-27\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"4\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Micro and Nano-Manufacturing\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1115/msec2022-85403\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q4\",\"JCRName\":\"ENGINEERING, MANUFACTURING\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Micro and Nano-Manufacturing","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1115/msec2022-85403","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q4","JCRName":"ENGINEERING, MANUFACTURING","Score":null,"Total":0}
Automatic Screw Detection and Tool Recommendation System for Robotic Disassembly
Disassembly is an essential process for the recovery of end-of-life (EOL) electronics in remanufacturing sites. Nevertheless, the process remains labor-intensive due to EOL electronics’ high degree of uncertainty and complexity. The robotic technology can assist in improving disassembly efficiency, however, the characteristics of EOL electronics pose difficulties for robot operation, such as removing small components. For such tasks, detecting small objects is critical for robotic disassembly systems. Screws are widely used as fasteners in ordinary electronic products while having small sizes and varying shapes in a scene. To achieve robotic disassembly of screws, the location information and the required tools need to be predicted. This paper proposes a framework to automatically detect screws and recommend related tools for disassembly. First, the YOLOv4 algorithm is used to detect screw targets in EOL electronic devices, and then a screw image extraction mechanism is executed based on the position coordinates predicted by YOLOv4. Second, after obtaining the screw images, the EfficientNetv2 algorithm is applied for screw shape classification. In addition to proposing a framework for automatic small-object detection, we explore how to modify the object detection algorithm to improve its performance and discuss the sensitivity of tool recommendations to the detection predictions. A case study of three different types of screws is used to evaluate the performance of the proposed framework.
期刊介绍:
The Journal of Micro and Nano-Manufacturing provides a forum for the rapid dissemination of original theoretical and applied research in the areas of micro- and nano-manufacturing that are related to process innovation, accuracy, and precision, throughput enhancement, material utilization, compact equipment development, environmental and life-cycle analysis, and predictive modeling of manufacturing processes with feature sizes less than one hundred micrometers. Papers addressing special needs in emerging areas, such as biomedical devices, drug manufacturing, water and energy, are also encouraged. Areas of interest including, but not limited to: Unit micro- and nano-manufacturing processes; Hybrid manufacturing processes combining bottom-up and top-down processes; Hybrid manufacturing processes utilizing various energy sources (optical, mechanical, electrical, solar, etc.) to achieve multi-scale features and resolution; High-throughput micro- and nano-manufacturing processes; Equipment development; Predictive modeling and simulation of materials and/or systems enabling point-of-need or scaled-up micro- and nano-manufacturing; Metrology at the micro- and nano-scales over large areas; Sensors and sensor integration; Design algorithms for multi-scale manufacturing; Life cycle analysis; Logistics and material handling related to micro- and nano-manufacturing.