Automatic Screw Detection and Tool Recommendation System for Robotic Disassembly

IF 1 Q4 ENGINEERING, MANUFACTURING
Xinyao Zhang, Kareem A. Eltouny, Xiao Liang, S. Behdad
{"title":"Automatic Screw Detection and Tool Recommendation System for Robotic Disassembly","authors":"Xinyao Zhang, Kareem A. Eltouny, Xiao Liang, S. Behdad","doi":"10.1115/msec2022-85403","DOIUrl":null,"url":null,"abstract":"\n Disassembly is an essential process for the recovery of end-of-life (EOL) electronics in remanufacturing sites. Nevertheless, the process remains labor-intensive due to EOL electronics’ high degree of uncertainty and complexity. The robotic technology can assist in improving disassembly efficiency, however, the characteristics of EOL electronics pose difficulties for robot operation, such as removing small components. For such tasks, detecting small objects is critical for robotic disassembly systems. Screws are widely used as fasteners in ordinary electronic products while having small sizes and varying shapes in a scene. To achieve robotic disassembly of screws, the location information and the required tools need to be predicted. This paper proposes a framework to automatically detect screws and recommend related tools for disassembly. First, the YOLOv4 algorithm is used to detect screw targets in EOL electronic devices, and then a screw image extraction mechanism is executed based on the position coordinates predicted by YOLOv4. Second, after obtaining the screw images, the EfficientNetv2 algorithm is applied for screw shape classification. In addition to proposing a framework for automatic small-object detection, we explore how to modify the object detection algorithm to improve its performance and discuss the sensitivity of tool recommendations to the detection predictions. A case study of three different types of screws is used to evaluate the performance of the proposed framework.","PeriodicalId":45459,"journal":{"name":"Journal of Micro and Nano-Manufacturing","volume":null,"pages":null},"PeriodicalIF":1.0000,"publicationDate":"2022-06-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"4","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Micro and Nano-Manufacturing","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1115/msec2022-85403","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q4","JCRName":"ENGINEERING, MANUFACTURING","Score":null,"Total":0}
引用次数: 4

Abstract

Disassembly is an essential process for the recovery of end-of-life (EOL) electronics in remanufacturing sites. Nevertheless, the process remains labor-intensive due to EOL electronics’ high degree of uncertainty and complexity. The robotic technology can assist in improving disassembly efficiency, however, the characteristics of EOL electronics pose difficulties for robot operation, such as removing small components. For such tasks, detecting small objects is critical for robotic disassembly systems. Screws are widely used as fasteners in ordinary electronic products while having small sizes and varying shapes in a scene. To achieve robotic disassembly of screws, the location information and the required tools need to be predicted. This paper proposes a framework to automatically detect screws and recommend related tools for disassembly. First, the YOLOv4 algorithm is used to detect screw targets in EOL electronic devices, and then a screw image extraction mechanism is executed based on the position coordinates predicted by YOLOv4. Second, after obtaining the screw images, the EfficientNetv2 algorithm is applied for screw shape classification. In addition to proposing a framework for automatic small-object detection, we explore how to modify the object detection algorithm to improve its performance and discuss the sensitivity of tool recommendations to the detection predictions. A case study of three different types of screws is used to evaluate the performance of the proposed framework.
机器人拆卸螺丝自动检测与工具推荐系统
拆卸是回收报废电子产品的一个重要过程。然而,由于EOL电子产品的高度不确定性和复杂性,该过程仍然是劳动密集型的。机器人技术可以帮助提高拆卸效率,然而,EOL电子器件的特性给机器人操作带来了困难,例如拆卸小部件。对于此类任务,检测小物体对机器人拆卸系统至关重要。螺钉作为紧固件广泛应用于普通电子产品中,但其尺寸小,在场景中形状多变。为了实现机器人拆卸螺钉,需要预测位置信息和所需的工具。本文提出了一种自动检测螺钉的框架,并推荐了相应的拆卸工具。首先利用YOLOv4算法对EOL电子器件中的螺旋目标进行检测,然后根据YOLOv4预测的位置坐标执行螺旋图像提取机制。其次,在获得螺旋图像后,应用effentnetv2算法对螺旋形状进行分类。除了提出一个自动小目标检测框架外,我们还探讨了如何修改目标检测算法以提高其性能,并讨论了工具推荐对检测预测的敏感性。通过对三种不同类型螺钉的案例研究来评估所提出框架的性能。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Journal of Micro and Nano-Manufacturing
Journal of Micro and Nano-Manufacturing ENGINEERING, MANUFACTURING-
CiteScore
2.70
自引率
0.00%
发文量
12
期刊介绍: The Journal of Micro and Nano-Manufacturing provides a forum for the rapid dissemination of original theoretical and applied research in the areas of micro- and nano-manufacturing that are related to process innovation, accuracy, and precision, throughput enhancement, material utilization, compact equipment development, environmental and life-cycle analysis, and predictive modeling of manufacturing processes with feature sizes less than one hundred micrometers. Papers addressing special needs in emerging areas, such as biomedical devices, drug manufacturing, water and energy, are also encouraged. Areas of interest including, but not limited to: Unit micro- and nano-manufacturing processes; Hybrid manufacturing processes combining bottom-up and top-down processes; Hybrid manufacturing processes utilizing various energy sources (optical, mechanical, electrical, solar, etc.) to achieve multi-scale features and resolution; High-throughput micro- and nano-manufacturing processes; Equipment development; Predictive modeling and simulation of materials and/or systems enabling point-of-need or scaled-up micro- and nano-manufacturing; Metrology at the micro- and nano-scales over large areas; Sensors and sensor integration; Design algorithms for multi-scale manufacturing; Life cycle analysis; Logistics and material handling related to micro- and nano-manufacturing.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信