A novel FuseDecode Autoencoder for industrial visual inspection: Incremental anomaly detection improvement with gradual transition from unsupervised to mixed-supervision learning with reduced human effort

IF 8.2 1区 计算机科学 Q1 COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS
Nejc Kozamernik, Drago Bračun
{"title":"A novel FuseDecode Autoencoder for industrial visual inspection: Incremental anomaly detection improvement with gradual transition from unsupervised to mixed-supervision learning with reduced human effort","authors":"Nejc Kozamernik,&nbsp;Drago Bračun","doi":"10.1016/j.compind.2024.104198","DOIUrl":null,"url":null,"abstract":"<div><div>The industrial implementation of automated visual inspection leveraging deep learning is limited due to the labor-intensive labeling of datasets and the lack of datasets containing images of defects, which is especially the case in high-volume manufacturing with zero defect constraints. In this study, we present the FuseDecode Autoencoder (FuseDecode AE), a novel reconstruction-based anomaly detection model featuring incremental learning. Initially, the FuseDecode AE operates in an unsupervised manner on noisy data containing predominantly normal images and a small number of anomalous images. The predictions generated assist experts in distinguishing between normal and anomalous samples. Later, it adapts to weakly labeled datasets by retraining in a semi-supervised manner on normal data augmented with synthetic anomalies. As more real anomalous samples become available, the model further refines its capabilities through mixed-supervision learning on both normal and anomalous samples. Evaluation on a real industrial dataset of coating defects shows the effectiveness of the incremental learning approach. Furthermore, validation on the publicly accessible MVTec AD dataset demonstrates the FuseDecode AE's superiority over other state-of-the-art reconstruction-based models. These findings underscore its generalizability and effectiveness in automated visual inspection tasks, particularly in industrial settings.</div></div>","PeriodicalId":55219,"journal":{"name":"Computers in Industry","volume":"164 ","pages":"Article 104198"},"PeriodicalIF":8.2000,"publicationDate":"2024-10-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Computers in Industry","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S016636152400126X","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, INTERDISCIPLINARY APPLICATIONS","Score":null,"Total":0}
引用次数: 0

Abstract

The industrial implementation of automated visual inspection leveraging deep learning is limited due to the labor-intensive labeling of datasets and the lack of datasets containing images of defects, which is especially the case in high-volume manufacturing with zero defect constraints. In this study, we present the FuseDecode Autoencoder (FuseDecode AE), a novel reconstruction-based anomaly detection model featuring incremental learning. Initially, the FuseDecode AE operates in an unsupervised manner on noisy data containing predominantly normal images and a small number of anomalous images. The predictions generated assist experts in distinguishing between normal and anomalous samples. Later, it adapts to weakly labeled datasets by retraining in a semi-supervised manner on normal data augmented with synthetic anomalies. As more real anomalous samples become available, the model further refines its capabilities through mixed-supervision learning on both normal and anomalous samples. Evaluation on a real industrial dataset of coating defects shows the effectiveness of the incremental learning approach. Furthermore, validation on the publicly accessible MVTec AD dataset demonstrates the FuseDecode AE's superiority over other state-of-the-art reconstruction-based models. These findings underscore its generalizability and effectiveness in automated visual inspection tasks, particularly in industrial settings.
用于工业视觉检测的新型 FuseDecode 自动编码器:从无监督学习到混合监督学习的渐进式异常检测改进,同时减少人力投入
由于数据集的标注耗费大量人力,而且缺乏包含缺陷图像的数据集,尤其是在零缺陷约束的大批量生产中,利用深度学习进行自动视觉检测的工业实施受到了限制。在本研究中,我们提出了 FuseDecode Autoencoder(FuseDecode AE),这是一种基于重构的新型异常检测模型,具有增量学习的特点。起初,FuseDecode AE 以无监督的方式对主要包含正常图像和少量异常图像的噪声数据进行操作。生成的预测结果可帮助专家区分正常样本和异常样本。之后,它通过对添加了合成异常图像的正常数据进行半监督式再训练,以适应弱标记数据集。随着更多真实异常样本的出现,该模型通过对正常样本和异常样本进行混合监督学习,进一步完善了自己的能力。在一个真实的涂层缺陷工业数据集上进行的评估显示了增量学习方法的有效性。此外,在可公开访问的 MVTec AD 数据集上进行的验证表明,FuseDecode AE 优于其他最先进的基于重构的模型。这些发现强调了其在自动视觉检测任务中的通用性和有效性,尤其是在工业环境中。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Computers in Industry
Computers in Industry 工程技术-计算机:跨学科应用
CiteScore
18.90
自引率
8.00%
发文量
152
审稿时长
22 days
期刊介绍: The objective of Computers in Industry is to present original, high-quality, application-oriented research papers that: • Illuminate emerging trends and possibilities in the utilization of Information and Communication Technology in industry; • Establish connections or integrations across various technology domains within the expansive realm of computer applications for industry; • Foster connections or integrations across diverse application areas of ICT in industry.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信