Zhenrong Wang, Weifeng Li, Miao Wang, Baohui Liu, Tongzhi Niu, Bin Li
{"title":"Semi-supervised adaptive network for commutator defect detection with limited labels","authors":"Zhenrong Wang, Weifeng Li, Miao Wang, Baohui Liu, Tongzhi Niu, Bin Li","doi":"10.1016/j.jmsy.2024.09.016","DOIUrl":null,"url":null,"abstract":"<div><div>Deep learning-based surface defect detection methods have obtained good performance. However, customizing architectures for specific tasks is a complex and laborious process. Neural architecture search (NAS) offers a promising data-driven adaptive design approach. Yet, deploying NAS in industrial applications presents challenges due to its reliance on supervised learning paradigm. Hence, we propose a mixed semi-supervised adaptive network for commutator surface defect detection, even with limited labeled samples. In the proposed framework, we employ a multi-branch network with complementary perturbation flows, leveraging consistency regularization, pseudo-labeling, and contrastive learning. First, a confidence-guided directional consistency regularization strategy aligns features in high-quality directions. Second, confidence-aware hybrid pseudo-labeling improves the pseudo-supervision quality. Finally, foreground/background contrast awareness encourages the model to more sensitively identify defect regions. The detection backbone is data-driven generated through a neural architecture search process, replacing manual design strategies. Experimental results show our method automatically generates optimal commutator detection networks using limited labels, outperforming existing state-of-the-art methods. Our work paves the way for adaptive defect detection networks with limited labels and can extend to surface defect detection in various production lines.</div></div>","PeriodicalId":16227,"journal":{"name":"Journal of Manufacturing Systems","volume":"77 ","pages":"Pages 639-651"},"PeriodicalIF":12.2000,"publicationDate":"2024-10-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Manufacturing Systems","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0278612524002188","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, INDUSTRIAL","Score":null,"Total":0}
引用次数: 0
Abstract
Deep learning-based surface defect detection methods have obtained good performance. However, customizing architectures for specific tasks is a complex and laborious process. Neural architecture search (NAS) offers a promising data-driven adaptive design approach. Yet, deploying NAS in industrial applications presents challenges due to its reliance on supervised learning paradigm. Hence, we propose a mixed semi-supervised adaptive network for commutator surface defect detection, even with limited labeled samples. In the proposed framework, we employ a multi-branch network with complementary perturbation flows, leveraging consistency regularization, pseudo-labeling, and contrastive learning. First, a confidence-guided directional consistency regularization strategy aligns features in high-quality directions. Second, confidence-aware hybrid pseudo-labeling improves the pseudo-supervision quality. Finally, foreground/background contrast awareness encourages the model to more sensitively identify defect regions. The detection backbone is data-driven generated through a neural architecture search process, replacing manual design strategies. Experimental results show our method automatically generates optimal commutator detection networks using limited labels, outperforming existing state-of-the-art methods. Our work paves the way for adaptive defect detection networks with limited labels and can extend to surface defect detection in various production lines.
基于深度学习的表面缺陷检测方法取得了良好的性能。然而,为特定任务定制架构是一个复杂而费力的过程。神经架构搜索(NAS)提供了一种很有前景的数据驱动自适应设计方法。然而,由于依赖于监督学习模式,在工业应用中部署 NAS 会面临挑战。因此,我们提出了一种用于换向器表面缺陷检测的混合半监督自适应网络,即使标注的样本有限。在提出的框架中,我们采用了具有互补扰动流的多分支网络,利用一致性正则化、伪标记和对比学习。首先,置信度指导下的方向一致性正则化策略使高质量方向上的特征保持一致。其次,置信度感知混合伪标签提高了伪监督的质量。最后,前景/背景对比意识促使模型更灵敏地识别缺陷区域。检测骨干由数据驱动,通过神经架构搜索过程生成,取代了人工设计策略。实验结果表明,我们的方法能利用有限的标签自动生成最佳换向器检测网络,性能优于现有的先进方法。我们的工作为使用有限标签的自适应缺陷检测网络铺平了道路,并可扩展到各种生产线的表面缺陷检测。
期刊介绍:
The Journal of Manufacturing Systems is dedicated to showcasing cutting-edge fundamental and applied research in manufacturing at the systems level. Encompassing products, equipment, people, information, control, and support functions, manufacturing systems play a pivotal role in the economical and competitive development, production, delivery, and total lifecycle of products, meeting market and societal needs.
With a commitment to publishing archival scholarly literature, the journal strives to advance the state of the art in manufacturing systems and foster innovation in crafting efficient, robust, and sustainable manufacturing systems. The focus extends from equipment-level considerations to the broader scope of the extended enterprise. The Journal welcomes research addressing challenges across various scales, including nano, micro, and macro-scale manufacturing, and spanning diverse sectors such as aerospace, automotive, energy, and medical device manufacturing.