High-resolution weld defect detection with RSU-MLP and dynamic kernel supervision

IF 5.2 2区 工程技术 Q1 ENGINEERING, MULTIDISCIPLINARY
Liangliang Li , Peng Wang , Ying Li , Zhigang Lü , Yuntao Xu , RuoHai Di , Xiaoyan Li , Tingjing Geng
{"title":"High-resolution weld defect detection with RSU-MLP and dynamic kernel supervision","authors":"Liangliang Li ,&nbsp;Peng Wang ,&nbsp;Ying Li ,&nbsp;Zhigang Lü ,&nbsp;Yuntao Xu ,&nbsp;RuoHai Di ,&nbsp;Xiaoyan Li ,&nbsp;Tingjing Geng","doi":"10.1016/j.measurement.2024.116208","DOIUrl":null,"url":null,"abstract":"<div><div>The challenges posed by high-resolution X-ray images of weld defects—including fuzzy features, multi-scale variability, small targets, and sample imbalance—create significant obstacles for accurate defect localization. Traditional deep learning methods typically emphasize global image characteristics, often neglecting local and multi-scale information, which leads to the inaccurate detection of small defects. To address this issue, we propose a novel high-resolution weld defect detection method called RSU-MLP. This method combines the RSU-MLP network with multi-scale feature extraction technology to effectively capture both local and global image features. Additionally, we design a dynamic kernel adaptive segmentation head based on a hybrid extended convolutional attention mechanism, which adaptively adjusts the receptive field size of the convolutional kernel, thereby enhancing detection capabilities for defects of varying scales. Furthermore, an in-depth supervision mechanism is introduced to monitor and learn defects at different levels of the network, leading to improved detection performance. Experimental results on real high-resolution welding datasets demonstrate that the proposed method achieves promising results in welding defect detection. Compared to traditional approaches, this method provides more accurate detection and identification of various welding defects, achieving DICE and Jaccard scores of 75.97% and 64.01%, respectively. This represents the best performance, demonstrating both robustness and generalization capabilities. Consequently, it offers a reliable automated detection method for producing high-quality welded products.</div></div>","PeriodicalId":18349,"journal":{"name":"Measurement","volume":"242 ","pages":"Article 116208"},"PeriodicalIF":5.2000,"publicationDate":"2024-11-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Measurement","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0263224124020931","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, MULTIDISCIPLINARY","Score":null,"Total":0}
引用次数: 0

Abstract

The challenges posed by high-resolution X-ray images of weld defects—including fuzzy features, multi-scale variability, small targets, and sample imbalance—create significant obstacles for accurate defect localization. Traditional deep learning methods typically emphasize global image characteristics, often neglecting local and multi-scale information, which leads to the inaccurate detection of small defects. To address this issue, we propose a novel high-resolution weld defect detection method called RSU-MLP. This method combines the RSU-MLP network with multi-scale feature extraction technology to effectively capture both local and global image features. Additionally, we design a dynamic kernel adaptive segmentation head based on a hybrid extended convolutional attention mechanism, which adaptively adjusts the receptive field size of the convolutional kernel, thereby enhancing detection capabilities for defects of varying scales. Furthermore, an in-depth supervision mechanism is introduced to monitor and learn defects at different levels of the network, leading to improved detection performance. Experimental results on real high-resolution welding datasets demonstrate that the proposed method achieves promising results in welding defect detection. Compared to traditional approaches, this method provides more accurate detection and identification of various welding defects, achieving DICE and Jaccard scores of 75.97% and 64.01%, respectively. This represents the best performance, demonstrating both robustness and generalization capabilities. Consequently, it offers a reliable automated detection method for producing high-quality welded products.
利用 RSU-MLP 和动态内核监督进行高分辨率焊接缺陷检测
焊接缺陷的高分辨率 X 射线图像所带来的挑战--包括模糊特征、多尺度可变性、小目标和样本不平衡--为准确定位缺陷制造了巨大障碍。传统的深度学习方法通常强调全局图像特征,往往忽视局部和多尺度信息,从而导致对小缺陷的检测不准确。针对这一问题,我们提出了一种名为 RSU-MLP 的新型高分辨率焊接缺陷检测方法。该方法将 RSU-MLP 网络与多尺度特征提取技术相结合,可有效捕捉局部和全局图像特征。此外,我们还设计了一种基于混合扩展卷积注意机制的动态内核自适应分割头,它能自适应地调整卷积内核的感受野大小,从而增强对不同尺度缺陷的检测能力。此外,还引入了深度监督机制,以监控和学习网络不同层次的缺陷,从而提高检测性能。在真实高分辨率焊接数据集上的实验结果表明,所提出的方法在焊接缺陷检测方面取得了可喜的成果。与传统方法相比,该方法能更准确地检测和识别各种焊接缺陷,DICE 和 Jaccard 分数分别达到 75.97% 和 64.01%。这代表了最佳性能,显示了稳健性和泛化能力。因此,它为生产高质量的焊接产品提供了一种可靠的自动检测方法。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Measurement
Measurement 工程技术-工程:综合
CiteScore
10.20
自引率
12.50%
发文量
1589
审稿时长
12.1 months
期刊介绍: Contributions are invited on novel achievements in all fields of measurement and instrumentation science and technology. Authors are encouraged to submit novel material, whose ultimate goal is an advancement in the state of the art of: measurement and metrology fundamentals, sensors, measurement instruments, measurement and estimation techniques, measurement data processing and fusion algorithms, evaluation procedures and methodologies for plants and industrial processes, performance analysis of systems, processes and algorithms, mathematical models for measurement-oriented purposes, distributed measurement systems in a connected world.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信