Mingda Huang, Linyuxuan Li, Yixing Meng, Guanhua Zhu, Hu Wu, Xianhai Yang
{"title":"Research on weld start point detection and localization using deep learning techniques","authors":"Mingda Huang, Linyuxuan Li, Yixing Meng, Guanhua Zhu, Hu Wu, Xianhai Yang","doi":"10.1016/j.engappai.2025.111833","DOIUrl":null,"url":null,"abstract":"<div><div>In industrial automated welding, precise positioning of the weld start point is crucial for ensuring weld stability and quality. To address this challenge, this paper proposes an improved weld start point recognition algorithm based on the Real-Time Detection Transformer (RT-DETR), enabling the welding robot to adaptively recognize and initially position the weld start point. Images of the weld start point are captured using a vision system based on the D435i camera, and a dataset is constructed for deep learning training. The algorithm is based on the RT-DETR model, utilizing a Residual Network architecture with 18 layers (RT-DETR-R18), integrating the Context Guided Block (CGBlock) from the Context Guided Network (CGNet) with the BasicBlock of Residual Network 18 (ResNet18) to form a new architecture, Context Guided Residual Network 18 (CG-ResNet18), enhancing the model's global perception and accuracy. Additionally, a Large Separable Kernel Attention (LSKA) mechanism is incorporated into the backbone network to improve applicability and robustness. The hybrid encoder of RT-DETR is further optimized using Group Separable Convolution (GSConv) and Efficient Cross Stage Partial Network Block (VoV-GSCSP) modules, enhancing feature fusion and reducing computational load. Experimental results show that the improved model achieves a mean Average Precision (mAP) of 99.4 %, a 5 % increase from the original, with a 32 % reduction in parameters and a 31 % reduction in computational load. The detection error of the weld start point is below 0.4 mm, meeting the real-time detection and positioning requirements of the welding robot.</div></div>","PeriodicalId":50523,"journal":{"name":"Engineering Applications of Artificial Intelligence","volume":"159 ","pages":"Article 111833"},"PeriodicalIF":7.5000,"publicationDate":"2025-07-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Engineering Applications of Artificial Intelligence","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0952197625018354","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}
引用次数: 0
Abstract
In industrial automated welding, precise positioning of the weld start point is crucial for ensuring weld stability and quality. To address this challenge, this paper proposes an improved weld start point recognition algorithm based on the Real-Time Detection Transformer (RT-DETR), enabling the welding robot to adaptively recognize and initially position the weld start point. Images of the weld start point are captured using a vision system based on the D435i camera, and a dataset is constructed for deep learning training. The algorithm is based on the RT-DETR model, utilizing a Residual Network architecture with 18 layers (RT-DETR-R18), integrating the Context Guided Block (CGBlock) from the Context Guided Network (CGNet) with the BasicBlock of Residual Network 18 (ResNet18) to form a new architecture, Context Guided Residual Network 18 (CG-ResNet18), enhancing the model's global perception and accuracy. Additionally, a Large Separable Kernel Attention (LSKA) mechanism is incorporated into the backbone network to improve applicability and robustness. The hybrid encoder of RT-DETR is further optimized using Group Separable Convolution (GSConv) and Efficient Cross Stage Partial Network Block (VoV-GSCSP) modules, enhancing feature fusion and reducing computational load. Experimental results show that the improved model achieves a mean Average Precision (mAP) of 99.4 %, a 5 % increase from the original, with a 32 % reduction in parameters and a 31 % reduction in computational load. The detection error of the weld start point is below 0.4 mm, meeting the real-time detection and positioning requirements of the welding robot.
期刊介绍:
Artificial Intelligence (AI) is pivotal in driving the fourth industrial revolution, witnessing remarkable advancements across various machine learning methodologies. AI techniques have become indispensable tools for practicing engineers, enabling them to tackle previously insurmountable challenges. Engineering Applications of Artificial Intelligence serves as a global platform for the swift dissemination of research elucidating the practical application of AI methods across all engineering disciplines. Submitted papers are expected to present novel aspects of AI utilized in real-world engineering applications, validated using publicly available datasets to ensure the replicability of research outcomes. Join us in exploring the transformative potential of AI in engineering.