Yitong Fan , Haoyang Huang , Wei Dai , Yongjia Zheng , Ding Tang , Yinghong Peng
{"title":"基于多源信息融合网络的电阻点焊缺陷在线检测方法","authors":"Yitong Fan , Haoyang Huang , Wei Dai , Yongjia Zheng , Ding Tang , Yinghong Peng","doi":"10.1016/j.engappai.2025.111956","DOIUrl":null,"url":null,"abstract":"<div><div>Resistance Spot Welding (RSW), a crucial joining technique widely used in various industries, is especially significant in automotive sheet metal assembly. However, the erratic disruptions in fast-paced automotive production lines present challenges to weld spot quality detection and control. In this study, a multi-source information fusion network (MSIFN) that takes the energy and mechanical feature vector extracted based on expert knowledge as inputs is developed for online resistance spot welding (RSW) defect detection. The network comprises three parts: a single-source data high-dimensional feature extraction module based on attention multi-layer perceptron (MLP), a multi-source feature interaction module based on the mutual attention mechanism (MAM), and a feature mixing and enhancement module based on multi-head bilinear fusion. To address the limited and imbalanced nature of real-world data, Focal Loss is used as the training objective. The model classifies four types of welding outcomes: normal weld, cold weld, burn-through, and shrinkage. Compared with the models using only energy features or mechanical features, the proposed MSIFN achieved the highest average classification accuracy (96.3 %), demonstrating the complementarity of the two feature types and can enrich the characterization of welding quality. Meanwhile, compared with other commonly used artificial intelligence classification models, the MSIFN also demonstrated the highest average classification accuracy and better performance in terms of the false negative rate and false positive rate for each defect category. These experiments have verified the applicability of the proposed method with high precision and robustness in online RSW defect detection and can enhance the understanding of RSW process.</div></div>","PeriodicalId":50523,"journal":{"name":"Engineering Applications of Artificial Intelligence","volume":"160 ","pages":"Article 111956"},"PeriodicalIF":8.0000,"publicationDate":"2025-08-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Online defect detection method for resistance spot welding based on multi-source information fusion network\",\"authors\":\"Yitong Fan , Haoyang Huang , Wei Dai , Yongjia Zheng , Ding Tang , Yinghong Peng\",\"doi\":\"10.1016/j.engappai.2025.111956\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Resistance Spot Welding (RSW), a crucial joining technique widely used in various industries, is especially significant in automotive sheet metal assembly. However, the erratic disruptions in fast-paced automotive production lines present challenges to weld spot quality detection and control. In this study, a multi-source information fusion network (MSIFN) that takes the energy and mechanical feature vector extracted based on expert knowledge as inputs is developed for online resistance spot welding (RSW) defect detection. The network comprises three parts: a single-source data high-dimensional feature extraction module based on attention multi-layer perceptron (MLP), a multi-source feature interaction module based on the mutual attention mechanism (MAM), and a feature mixing and enhancement module based on multi-head bilinear fusion. To address the limited and imbalanced nature of real-world data, Focal Loss is used as the training objective. The model classifies four types of welding outcomes: normal weld, cold weld, burn-through, and shrinkage. Compared with the models using only energy features or mechanical features, the proposed MSIFN achieved the highest average classification accuracy (96.3 %), demonstrating the complementarity of the two feature types and can enrich the characterization of welding quality. Meanwhile, compared with other commonly used artificial intelligence classification models, the MSIFN also demonstrated the highest average classification accuracy and better performance in terms of the false negative rate and false positive rate for each defect category. These experiments have verified the applicability of the proposed method with high precision and robustness in online RSW defect detection and can enhance the understanding of RSW process.</div></div>\",\"PeriodicalId\":50523,\"journal\":{\"name\":\"Engineering Applications of Artificial Intelligence\",\"volume\":\"160 \",\"pages\":\"Article 111956\"},\"PeriodicalIF\":8.0000,\"publicationDate\":\"2025-08-21\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Engineering Applications of Artificial Intelligence\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0952197625019645\",\"RegionNum\":2,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"AUTOMATION & CONTROL SYSTEMS\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Engineering Applications of Artificial Intelligence","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0952197625019645","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}
Online defect detection method for resistance spot welding based on multi-source information fusion network
Resistance Spot Welding (RSW), a crucial joining technique widely used in various industries, is especially significant in automotive sheet metal assembly. However, the erratic disruptions in fast-paced automotive production lines present challenges to weld spot quality detection and control. In this study, a multi-source information fusion network (MSIFN) that takes the energy and mechanical feature vector extracted based on expert knowledge as inputs is developed for online resistance spot welding (RSW) defect detection. The network comprises three parts: a single-source data high-dimensional feature extraction module based on attention multi-layer perceptron (MLP), a multi-source feature interaction module based on the mutual attention mechanism (MAM), and a feature mixing and enhancement module based on multi-head bilinear fusion. To address the limited and imbalanced nature of real-world data, Focal Loss is used as the training objective. The model classifies four types of welding outcomes: normal weld, cold weld, burn-through, and shrinkage. Compared with the models using only energy features or mechanical features, the proposed MSIFN achieved the highest average classification accuracy (96.3 %), demonstrating the complementarity of the two feature types and can enrich the characterization of welding quality. Meanwhile, compared with other commonly used artificial intelligence classification models, the MSIFN also demonstrated the highest average classification accuracy and better performance in terms of the false negative rate and false positive rate for each defect category. These experiments have verified the applicability of the proposed method with high precision and robustness in online RSW defect detection and can enhance the understanding of RSW process.
期刊介绍:
Artificial Intelligence (AI) is pivotal in driving the fourth industrial revolution, witnessing remarkable advancements across various machine learning methodologies. AI techniques have become indispensable tools for practicing engineers, enabling them to tackle previously insurmountable challenges. Engineering Applications of Artificial Intelligence serves as a global platform for the swift dissemination of research elucidating the practical application of AI methods across all engineering disciplines. Submitted papers are expected to present novel aspects of AI utilized in real-world engineering applications, validated using publicly available datasets to ensure the replicability of research outcomes. Join us in exploring the transformative potential of AI in engineering.