Liangliang Li , Peng Wang , Ying Li , Zhigang Lü , Yuntao Xu , RuoHai Di , Xiaoyan Li , Tingjing Geng
{"title":"利用 RSU-MLP 和动态内核监督进行高分辨率焊接缺陷检测","authors":"Liangliang Li , Peng Wang , Ying Li , Zhigang Lü , Yuntao Xu , RuoHai Di , Xiaoyan Li , Tingjing Geng","doi":"10.1016/j.measurement.2024.116208","DOIUrl":null,"url":null,"abstract":"<div><div>The challenges posed by high-resolution X-ray images of weld defects—including fuzzy features, multi-scale variability, small targets, and sample imbalance—create significant obstacles for accurate defect localization. Traditional deep learning methods typically emphasize global image characteristics, often neglecting local and multi-scale information, which leads to the inaccurate detection of small defects. To address this issue, we propose a novel high-resolution weld defect detection method called RSU-MLP. This method combines the RSU-MLP network with multi-scale feature extraction technology to effectively capture both local and global image features. Additionally, we design a dynamic kernel adaptive segmentation head based on a hybrid extended convolutional attention mechanism, which adaptively adjusts the receptive field size of the convolutional kernel, thereby enhancing detection capabilities for defects of varying scales. Furthermore, an in-depth supervision mechanism is introduced to monitor and learn defects at different levels of the network, leading to improved detection performance. Experimental results on real high-resolution welding datasets demonstrate that the proposed method achieves promising results in welding defect detection. Compared to traditional approaches, this method provides more accurate detection and identification of various welding defects, achieving DICE and Jaccard scores of 75.97% and 64.01%, respectively. This represents the best performance, demonstrating both robustness and generalization capabilities. Consequently, it offers a reliable automated detection method for producing high-quality welded products.</div></div>","PeriodicalId":18349,"journal":{"name":"Measurement","volume":"242 ","pages":"Article 116208"},"PeriodicalIF":5.2000,"publicationDate":"2024-11-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"High-resolution weld defect detection with RSU-MLP and dynamic kernel supervision\",\"authors\":\"Liangliang Li , Peng Wang , Ying Li , Zhigang Lü , Yuntao Xu , RuoHai Di , Xiaoyan Li , Tingjing Geng\",\"doi\":\"10.1016/j.measurement.2024.116208\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>The challenges posed by high-resolution X-ray images of weld defects—including fuzzy features, multi-scale variability, small targets, and sample imbalance—create significant obstacles for accurate defect localization. Traditional deep learning methods typically emphasize global image characteristics, often neglecting local and multi-scale information, which leads to the inaccurate detection of small defects. To address this issue, we propose a novel high-resolution weld defect detection method called RSU-MLP. This method combines the RSU-MLP network with multi-scale feature extraction technology to effectively capture both local and global image features. Additionally, we design a dynamic kernel adaptive segmentation head based on a hybrid extended convolutional attention mechanism, which adaptively adjusts the receptive field size of the convolutional kernel, thereby enhancing detection capabilities for defects of varying scales. Furthermore, an in-depth supervision mechanism is introduced to monitor and learn defects at different levels of the network, leading to improved detection performance. Experimental results on real high-resolution welding datasets demonstrate that the proposed method achieves promising results in welding defect detection. Compared to traditional approaches, this method provides more accurate detection and identification of various welding defects, achieving DICE and Jaccard scores of 75.97% and 64.01%, respectively. This represents the best performance, demonstrating both robustness and generalization capabilities. Consequently, it offers a reliable automated detection method for producing high-quality welded products.</div></div>\",\"PeriodicalId\":18349,\"journal\":{\"name\":\"Measurement\",\"volume\":\"242 \",\"pages\":\"Article 116208\"},\"PeriodicalIF\":5.2000,\"publicationDate\":\"2024-11-13\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Measurement\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0263224124020931\",\"RegionNum\":2,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, MULTIDISCIPLINARY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Measurement","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0263224124020931","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, MULTIDISCIPLINARY","Score":null,"Total":0}
High-resolution weld defect detection with RSU-MLP and dynamic kernel supervision
The challenges posed by high-resolution X-ray images of weld defects—including fuzzy features, multi-scale variability, small targets, and sample imbalance—create significant obstacles for accurate defect localization. Traditional deep learning methods typically emphasize global image characteristics, often neglecting local and multi-scale information, which leads to the inaccurate detection of small defects. To address this issue, we propose a novel high-resolution weld defect detection method called RSU-MLP. This method combines the RSU-MLP network with multi-scale feature extraction technology to effectively capture both local and global image features. Additionally, we design a dynamic kernel adaptive segmentation head based on a hybrid extended convolutional attention mechanism, which adaptively adjusts the receptive field size of the convolutional kernel, thereby enhancing detection capabilities for defects of varying scales. Furthermore, an in-depth supervision mechanism is introduced to monitor and learn defects at different levels of the network, leading to improved detection performance. Experimental results on real high-resolution welding datasets demonstrate that the proposed method achieves promising results in welding defect detection. Compared to traditional approaches, this method provides more accurate detection and identification of various welding defects, achieving DICE and Jaccard scores of 75.97% and 64.01%, respectively. This represents the best performance, demonstrating both robustness and generalization capabilities. Consequently, it offers a reliable automated detection method for producing high-quality welded products.
期刊介绍:
Contributions are invited on novel achievements in all fields of measurement and instrumentation science and technology. Authors are encouraged to submit novel material, whose ultimate goal is an advancement in the state of the art of: measurement and metrology fundamentals, sensors, measurement instruments, measurement and estimation techniques, measurement data processing and fusion algorithms, evaluation procedures and methodologies for plants and industrial processes, performance analysis of systems, processes and algorithms, mathematical models for measurement-oriented purposes, distributed measurement systems in a connected world.