基于红外热成像的无监督内部缺陷分割

IF 14.2 1区 工程技术 Q1 ENGINEERING, INDUSTRIAL
Hao Shi , Yifeng Pan , Ruoxiang Gao , Zhengchuan Guo , Chengqian Zhang , Peng Zhao
{"title":"基于红外热成像的无监督内部缺陷分割","authors":"Hao Shi ,&nbsp;Yifeng Pan ,&nbsp;Ruoxiang Gao ,&nbsp;Zhengchuan Guo ,&nbsp;Chengqian Zhang ,&nbsp;Peng Zhao","doi":"10.1016/j.jmsy.2025.07.016","DOIUrl":null,"url":null,"abstract":"<div><div>Accurate defect detection is essential for manufacturing reliability, yet identifying internal defects remains challenging. While infrared thermography offers distinct advantages for internal inspection, its effectiveness is hindered by noise and uneven heating. Traditional image processing algorithms struggle with these nonlinearities, while supervised deep learning methods require large annotated datasets, usually impractical in industrial settings. To overcome data scarcity, we propose a novel infrared data amplification strategy leveraging the dynamic temperature evolution. By varying defect depth and heating duration, we generate 16000 thermal images from merely two defective samples using pulsed thermography. Furthermore, we introduce an unsupervised defect segmentation framework, Deep Autoencoder with Swin Transformer Wnet (DAE-SWnet). First, a deep autoencoder denoises thermal images, during which we discover a non-monotonic relationship between reconstruction loss and denoising performance. Next, Swin Transformer and Wnet are cohesively integrated with optimized encoder-decoder channels, to extract latent defect features from denoised images. These latent representations are postprocessed to obtain final segmentation results. Trained solely on artificially designed defects, our model exhibits exceptional performance across samples with varying materials and defect shapes. Moreover, comparative experiments demonstrate that the model achieves higher precision, stronger stability, and better generalization to real-world manufacturing processes. Specifically, it achieves 74.0 % IoU, 84.3 % F1-score, and 97.7 % accuracy, with an average inference time of 0.278 s, highlighting its superiority and practical potential in industrial scenarios where defective products are difficult to obtain and annotate.</div></div>","PeriodicalId":16227,"journal":{"name":"Journal of Manufacturing Systems","volume":"82 ","pages":"Pages 766-785"},"PeriodicalIF":14.2000,"publicationDate":"2025-08-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"DAE-SWnet: Unsupervised internal defect segmentation through infrared thermography with scarce samples\",\"authors\":\"Hao Shi ,&nbsp;Yifeng Pan ,&nbsp;Ruoxiang Gao ,&nbsp;Zhengchuan Guo ,&nbsp;Chengqian Zhang ,&nbsp;Peng Zhao\",\"doi\":\"10.1016/j.jmsy.2025.07.016\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Accurate defect detection is essential for manufacturing reliability, yet identifying internal defects remains challenging. While infrared thermography offers distinct advantages for internal inspection, its effectiveness is hindered by noise and uneven heating. Traditional image processing algorithms struggle with these nonlinearities, while supervised deep learning methods require large annotated datasets, usually impractical in industrial settings. To overcome data scarcity, we propose a novel infrared data amplification strategy leveraging the dynamic temperature evolution. By varying defect depth and heating duration, we generate 16000 thermal images from merely two defective samples using pulsed thermography. Furthermore, we introduce an unsupervised defect segmentation framework, Deep Autoencoder with Swin Transformer Wnet (DAE-SWnet). First, a deep autoencoder denoises thermal images, during which we discover a non-monotonic relationship between reconstruction loss and denoising performance. Next, Swin Transformer and Wnet are cohesively integrated with optimized encoder-decoder channels, to extract latent defect features from denoised images. These latent representations are postprocessed to obtain final segmentation results. Trained solely on artificially designed defects, our model exhibits exceptional performance across samples with varying materials and defect shapes. Moreover, comparative experiments demonstrate that the model achieves higher precision, stronger stability, and better generalization to real-world manufacturing processes. Specifically, it achieves 74.0 % IoU, 84.3 % F1-score, and 97.7 % accuracy, with an average inference time of 0.278 s, highlighting its superiority and practical potential in industrial scenarios where defective products are difficult to obtain and annotate.</div></div>\",\"PeriodicalId\":16227,\"journal\":{\"name\":\"Journal of Manufacturing Systems\",\"volume\":\"82 \",\"pages\":\"Pages 766-785\"},\"PeriodicalIF\":14.2000,\"publicationDate\":\"2025-08-02\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Manufacturing Systems\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0278612525001918\",\"RegionNum\":1,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, INDUSTRIAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Manufacturing Systems","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0278612525001918","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, INDUSTRIAL","Score":null,"Total":0}
引用次数: 0

摘要

准确的缺陷检测对于制造可靠性至关重要,但识别内部缺陷仍然具有挑战性。虽然红外热成像为内部检查提供了明显的优势,但其有效性受到噪声和加热不均匀的阻碍。传统的图像处理算法难以应对这些非线性,而监督深度学习方法需要大量带注释的数据集,这在工业环境中通常是不切实际的。为了克服数据的稀缺性,我们提出了一种利用温度动态变化的红外数据放大策略。通过改变缺陷深度和加热时间,我们使用脉冲热成像技术从仅仅两个缺陷样品中生成16000张热图像。在此基础上,我们引入了一种无监督缺陷分割框架——带Swin变压器的深度自编码器Wnet (DAE-SWnet)。首先,利用深度自编码器对热图像进行去噪,发现重构损失与去噪性能之间存在非单调关系。然后,将Swin Transformer和Wnet与优化的编解码器通道紧密结合,从去噪后的图像中提取潜在缺陷特征。对这些潜在表示进行后处理以获得最终的分割结果。仅在人工设计缺陷上进行训练,我们的模型在不同材料和缺陷形状的样品中表现出卓越的性能。对比实验表明,该模型具有较高的精度、较强的稳定性和较好的泛化能力。具体而言,IoU达到74.0 %,f1得分达到84.3 %,准确率达到97.7% %,平均推理时间为0.278 s,突出了其在缺陷产品难以获取和标注的工业场景中的优势和应用潜力。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
DAE-SWnet: Unsupervised internal defect segmentation through infrared thermography with scarce samples
Accurate defect detection is essential for manufacturing reliability, yet identifying internal defects remains challenging. While infrared thermography offers distinct advantages for internal inspection, its effectiveness is hindered by noise and uneven heating. Traditional image processing algorithms struggle with these nonlinearities, while supervised deep learning methods require large annotated datasets, usually impractical in industrial settings. To overcome data scarcity, we propose a novel infrared data amplification strategy leveraging the dynamic temperature evolution. By varying defect depth and heating duration, we generate 16000 thermal images from merely two defective samples using pulsed thermography. Furthermore, we introduce an unsupervised defect segmentation framework, Deep Autoencoder with Swin Transformer Wnet (DAE-SWnet). First, a deep autoencoder denoises thermal images, during which we discover a non-monotonic relationship between reconstruction loss and denoising performance. Next, Swin Transformer and Wnet are cohesively integrated with optimized encoder-decoder channels, to extract latent defect features from denoised images. These latent representations are postprocessed to obtain final segmentation results. Trained solely on artificially designed defects, our model exhibits exceptional performance across samples with varying materials and defect shapes. Moreover, comparative experiments demonstrate that the model achieves higher precision, stronger stability, and better generalization to real-world manufacturing processes. Specifically, it achieves 74.0 % IoU, 84.3 % F1-score, and 97.7 % accuracy, with an average inference time of 0.278 s, highlighting its superiority and practical potential in industrial scenarios where defective products are difficult to obtain and annotate.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Journal of Manufacturing Systems
Journal of Manufacturing Systems 工程技术-工程:工业
CiteScore
23.30
自引率
13.20%
发文量
216
审稿时长
25 days
期刊介绍: The Journal of Manufacturing Systems is dedicated to showcasing cutting-edge fundamental and applied research in manufacturing at the systems level. Encompassing products, equipment, people, information, control, and support functions, manufacturing systems play a pivotal role in the economical and competitive development, production, delivery, and total lifecycle of products, meeting market and societal needs. With a commitment to publishing archival scholarly literature, the journal strives to advance the state of the art in manufacturing systems and foster innovation in crafting efficient, robust, and sustainable manufacturing systems. The focus extends from equipment-level considerations to the broader scope of the extended enterprise. The Journal welcomes research addressing challenges across various scales, including nano, micro, and macro-scale manufacturing, and spanning diverse sectors such as aerospace, automotive, energy, and medical device manufacturing.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信