Industry-Oriented Detection Method of PCBA Defects Using Semantic Segmentation Models

IF 15.3 1区 计算机科学 Q1 AUTOMATION & CONTROL SYSTEMS
Yang Li;Xiao Wang;Zhifan He;Ze Wang;Ke Cheng;Sanchuan Ding;Yijing Fan;Xiaotao Li;Yawen Niu;Shanpeng Xiao;Zhenqi Hao;Bin Gao;Huaqiang Wu
{"title":"Industry-Oriented Detection Method of PCBA Defects Using Semantic Segmentation Models","authors":"Yang Li;Xiao Wang;Zhifan He;Ze Wang;Ke Cheng;Sanchuan Ding;Yijing Fan;Xiaotao Li;Yawen Niu;Shanpeng Xiao;Zhenqi Hao;Bin Gao;Huaqiang Wu","doi":"10.1109/JAS.2024.124422","DOIUrl":null,"url":null,"abstract":"Automated optical inspection (AOI) is a significant process in printed circuit board assembly (PCBA) production lines which aims to detect tiny defects in PCBAs. Existing AOI equipment has several deficiencies including low throughput, large computation cost, high latency, and poor flexibility, which limits the efficiency of online PCBA inspection. In this paper, a novel PCBA defect detection method based on a lightweight deep convolution neural network is proposed. In this method, the semantic segmentation model is combined with a rule-based defect recognition algorithm to build up a defect detection framework. To improve the performance of the model, extensive real PCBA images are collected from production lines as datasets. Some optimization methods have been applied in the model according to production demand and enable integration in lightweight computing devices. Experiment results show that the production line using our method realizes a throughput more than three times higher than traditional methods. Our method can be integrated into a lightweight inference system and promote the flexibility of AOI. The proposed method builds up a general paradigm and excellent example for model design and optimization oriented towards industrial requirements.","PeriodicalId":54230,"journal":{"name":"Ieee-Caa Journal of Automatica Sinica","volume":"11 6","pages":"1438-1446"},"PeriodicalIF":15.3000,"publicationDate":"2024-03-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Ieee-Caa Journal of Automatica Sinica","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10539290/","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}
引用次数: 0

Abstract

Automated optical inspection (AOI) is a significant process in printed circuit board assembly (PCBA) production lines which aims to detect tiny defects in PCBAs. Existing AOI equipment has several deficiencies including low throughput, large computation cost, high latency, and poor flexibility, which limits the efficiency of online PCBA inspection. In this paper, a novel PCBA defect detection method based on a lightweight deep convolution neural network is proposed. In this method, the semantic segmentation model is combined with a rule-based defect recognition algorithm to build up a defect detection framework. To improve the performance of the model, extensive real PCBA images are collected from production lines as datasets. Some optimization methods have been applied in the model according to production demand and enable integration in lightweight computing devices. Experiment results show that the production line using our method realizes a throughput more than three times higher than traditional methods. Our method can be integrated into a lightweight inference system and promote the flexibility of AOI. The proposed method builds up a general paradigm and excellent example for model design and optimization oriented towards industrial requirements.
利用语义分割模型检测 PCBA 缺陷的行业导向方法
自动光学检测(AOI)是印刷电路板组装(PCBA)生产线中的一项重要工序,旨在检测 PCBA 中的微小缺陷。现有的自动光学检测设备存在吞吐量低、计算成本高、延迟大、灵活性差等缺陷,限制了在线 PCBA 检测的效率。本文提出了一种基于轻量级深度卷积神经网络的新型 PCBA 缺陷检测方法。在该方法中,语义分割模型与基于规则的缺陷识别算法相结合,构建了一个缺陷检测框架。为了提高模型的性能,从生产线上收集了大量真实的 PCBA 图像作为数据集。根据生产需求在模型中应用了一些优化方法,使其能够集成到轻量级计算设备中。实验结果表明,使用我们的方法的生产线的吞吐量比传统方法高出三倍多。我们的方法可以集成到轻量级推理系统中,提高自动光学检测的灵活性。所提出的方法为面向工业需求的模型设计和优化建立了通用范例和优秀范例。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Ieee-Caa Journal of Automatica Sinica
Ieee-Caa Journal of Automatica Sinica Engineering-Control and Systems Engineering
CiteScore
23.50
自引率
11.00%
发文量
880
期刊介绍: The IEEE/CAA Journal of Automatica Sinica is a reputable journal that publishes high-quality papers in English on original theoretical/experimental research and development in the field of automation. The journal covers a wide range of topics including automatic control, artificial intelligence and intelligent control, systems theory and engineering, pattern recognition and intelligent systems, automation engineering and applications, information processing and information systems, network-based automation, robotics, sensing and measurement, and navigation, guidance, and control. Additionally, the journal is abstracted/indexed in several prominent databases including SCIE (Science Citation Index Expanded), EI (Engineering Index), Inspec, Scopus, SCImago, DBLP, CNKI (China National Knowledge Infrastructure), CSCD (Chinese Science Citation Database), and IEEE Xplore.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信