Research on intelligent auxiliary assembly technology based on deep learning

Cobot Pub Date : 2024-02-23 DOI:10.12688/cobot.17668.1
Wang Yan, Wei Wei, Baitao Tang
{"title":"Research on intelligent auxiliary assembly technology based on deep learning","authors":"Wang Yan, Wei Wei, Baitao Tang","doi":"10.12688/cobot.17668.1","DOIUrl":null,"url":null,"abstract":"Background Auxiliary assembly refers to guiding and prompting the assembly process to help operators complete complex assembly operations. Due to the complex structure of products, the similar shape of parts and human factors, the misassembly and missing assembly of parts still occur in the process of product assembly, so it is of great significance to detect the assembly correctness of complex products. Methods Aiming at the problem that manual inspection is inefficient and depends heavily on the level of inspectors in the process of complex product assembly inspection, this paper proposes an assembly correctness detection method based on deep learning. Through the three steps of view transformation, semantic segmentation and template matching, the automatic judgment of assembly errors such as wrong assembly, missing assembly and redundancy is realized, and the method is verified by the computer motherboard. Results Taking the computer motherboard as the verification object to test the correctness of assembly, the experimental re sults show that the perspective adjustment of the image after homography transformation is very obvious. The evaluation index of the semantic segmentation network detection object is calculated, and each accuracy meets the requirements of assembly correctness detection. A visualization module is also used to visually display the results of assembly correctness detection based on template matching. Conclusions The assembly correctness detection method can provide a guarantee for the manual assembly process and reduce the error rate of assembly. The machine vision detection technology can be used for automatic detection of assembly quality to improve the efficiency and automation level of detection.","PeriodicalId":505492,"journal":{"name":"Cobot","volume":"8 6","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-02-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Cobot","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.12688/cobot.17668.1","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

Background Auxiliary assembly refers to guiding and prompting the assembly process to help operators complete complex assembly operations. Due to the complex structure of products, the similar shape of parts and human factors, the misassembly and missing assembly of parts still occur in the process of product assembly, so it is of great significance to detect the assembly correctness of complex products. Methods Aiming at the problem that manual inspection is inefficient and depends heavily on the level of inspectors in the process of complex product assembly inspection, this paper proposes an assembly correctness detection method based on deep learning. Through the three steps of view transformation, semantic segmentation and template matching, the automatic judgment of assembly errors such as wrong assembly, missing assembly and redundancy is realized, and the method is verified by the computer motherboard. Results Taking the computer motherboard as the verification object to test the correctness of assembly, the experimental re sults show that the perspective adjustment of the image after homography transformation is very obvious. The evaluation index of the semantic segmentation network detection object is calculated, and each accuracy meets the requirements of assembly correctness detection. A visualization module is also used to visually display the results of assembly correctness detection based on template matching. Conclusions The assembly correctness detection method can provide a guarantee for the manual assembly process and reduce the error rate of assembly. The machine vision detection technology can be used for automatic detection of assembly quality to improve the efficiency and automation level of detection.
基于深度学习的智能辅助装配技术研究
背景 辅助装配是指在装配过程中进行引导和提示,帮助操作人员完成复杂的装配操作。由于产品结构复杂、零件形状相似以及人为因素,产品装配过程中仍会出现零件错装、漏装等现象,因此检测复杂产品的装配正确性具有重要意义。方法 针对复杂产品装配检测过程中人工检测效率低、严重依赖检测人员水平的问题,本文提出了一种基于深度学习的装配正确性检测方法。通过视图转换、语义分割和模板匹配三个步骤,实现了装配错误(如装配错误、装配缺失和冗余)的自动判断,并通过计算机主板对该方法进行了验证。结果 以计算机主板为验证对象,检验装配的正确性,实验结果表明,同像变换后图像的视角调整非常明显。计算了语义分割网络检测对象的评价指标,各项精度均满足装配正确性检测的要求。可视化模块还用于直观显示基于模板匹配的装配正确性检测结果。结论 装配正确性检测方法可以为人工装配过程提供保障,降低装配错误率。机器视觉检测技术可用于装配质量的自动检测,提高检测效率和自动化水平。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信