在机器人自动焊接过程中,基于机器视觉和 ANN 模型支持下的红外热图像预测内部焊接熔深

IF 3.8 Q2 MATERIALS SCIENCE, MULTIDISCIPLINARY
Yunfeng Wang , Wonjoo Lee , Seungbeom Jang , Van Doi Truong , Yuhyeong Jeong , Chanhee Won , Jangwook Lee , Jonghun Yoon
{"title":"在机器人自动焊接过程中,基于机器视觉和 ANN 模型支持下的红外热图像预测内部焊接熔深","authors":"Yunfeng Wang ,&nbsp;Wonjoo Lee ,&nbsp;Seungbeom Jang ,&nbsp;Van Doi Truong ,&nbsp;Yuhyeong Jeong ,&nbsp;Chanhee Won ,&nbsp;Jangwook Lee ,&nbsp;Jonghun Yoon","doi":"10.1016/j.jajp.2024.100199","DOIUrl":null,"url":null,"abstract":"<div><p>Welding quality is a critical criterion for evaluating welding operations. Traditional evaluation methods suffer from drawbacks such as lack of objectivity, untimeliness, and high costs. Therefore, real-time monitoring and assessment of the weld pool have become the mainstream trend in welding technology. This study introduces a novel method for defining weld pool width boundaries. It utilizes an infrared (IR) camera to capture the weld pool temperature clusters and employs the Sobel operator for convolution to generate the gradient map of the weld pool temperature clusters. Through enhanced processing in the gradient map, the width boundaries of the weld pool are more effectively detected compared to previous methods. Previous studies defined weld pool width boundaries by identifying characteristic points with the most distinct temperature fluctuations, caused by the different radiative properties of the same material in different states. However, practical tests revealed susceptibility to interference from reflected arc light. The proposed method mitigates the impact of reflected arc light and is applicable to complex multilayer welding scenarios. To address the lag in quality monitoring, reduce welding costs, and achieve real-time monitoring of the weld pool process, we employed machine vision and an artificial neural network (ANN) model. This led to the development of a weld penetration assessment system based on infrared thermal images. The system successfully predicted the penetration depth for 4 mm carbon steel with an accuracy of 86.6 %. This validates the feasibility of estimating and predicting weld performance using the surface temperature characteristics of the weld pool. The newly proposed weld pool boundary definition method holds promise for real-time monitoring in more complex multilayer pipe welding scenarios. It lays the groundwork for predicting and fusing the weld depth in intricate multi-pass pipe welding.</p></div>","PeriodicalId":34313,"journal":{"name":"Journal of Advanced Joining Processes","volume":"9 ","pages":"Article 100199"},"PeriodicalIF":3.8000,"publicationDate":"2024-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2666330924000165/pdfft?md5=a82fa9e12eadfb4154a6a5b593d56fbf&pid=1-s2.0-S2666330924000165-main.pdf","citationCount":"0","resultStr":"{\"title\":\"Prediction of internal welding penetration based on IR thermal image supported by machine vision and ANN-model during automatic robot welding process\",\"authors\":\"Yunfeng Wang ,&nbsp;Wonjoo Lee ,&nbsp;Seungbeom Jang ,&nbsp;Van Doi Truong ,&nbsp;Yuhyeong Jeong ,&nbsp;Chanhee Won ,&nbsp;Jangwook Lee ,&nbsp;Jonghun Yoon\",\"doi\":\"10.1016/j.jajp.2024.100199\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>Welding quality is a critical criterion for evaluating welding operations. Traditional evaluation methods suffer from drawbacks such as lack of objectivity, untimeliness, and high costs. Therefore, real-time monitoring and assessment of the weld pool have become the mainstream trend in welding technology. This study introduces a novel method for defining weld pool width boundaries. It utilizes an infrared (IR) camera to capture the weld pool temperature clusters and employs the Sobel operator for convolution to generate the gradient map of the weld pool temperature clusters. Through enhanced processing in the gradient map, the width boundaries of the weld pool are more effectively detected compared to previous methods. Previous studies defined weld pool width boundaries by identifying characteristic points with the most distinct temperature fluctuations, caused by the different radiative properties of the same material in different states. However, practical tests revealed susceptibility to interference from reflected arc light. The proposed method mitigates the impact of reflected arc light and is applicable to complex multilayer welding scenarios. To address the lag in quality monitoring, reduce welding costs, and achieve real-time monitoring of the weld pool process, we employed machine vision and an artificial neural network (ANN) model. This led to the development of a weld penetration assessment system based on infrared thermal images. The system successfully predicted the penetration depth for 4 mm carbon steel with an accuracy of 86.6 %. This validates the feasibility of estimating and predicting weld performance using the surface temperature characteristics of the weld pool. The newly proposed weld pool boundary definition method holds promise for real-time monitoring in more complex multilayer pipe welding scenarios. It lays the groundwork for predicting and fusing the weld depth in intricate multi-pass pipe welding.</p></div>\",\"PeriodicalId\":34313,\"journal\":{\"name\":\"Journal of Advanced Joining Processes\",\"volume\":\"9 \",\"pages\":\"Article 100199\"},\"PeriodicalIF\":3.8000,\"publicationDate\":\"2024-02-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.sciencedirect.com/science/article/pii/S2666330924000165/pdfft?md5=a82fa9e12eadfb4154a6a5b593d56fbf&pid=1-s2.0-S2666330924000165-main.pdf\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Advanced Joining Processes\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S2666330924000165\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"MATERIALS SCIENCE, MULTIDISCIPLINARY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Advanced Joining Processes","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2666330924000165","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"MATERIALS SCIENCE, MULTIDISCIPLINARY","Score":null,"Total":0}
引用次数: 0

摘要

焊接质量是评估焊接操作的关键标准。传统的评估方法存在不客观、不及时、成本高等缺点。因此,对焊接熔池进行实时监测和评估已成为焊接技术的主流趋势。本研究介绍了一种定义焊接熔池宽度边界的新方法。该方法利用红外(IR)相机捕捉焊池温度簇,并使用 Sobel 运算符进行卷积,生成焊池温度簇的梯度图。与之前的方法相比,通过加强梯度图的处理,可以更有效地检测焊池宽度边界。以往的研究通过识别温度波动最明显的特征点来定义焊池宽度边界,这是由同一材料在不同状态下的不同辐射特性造成的。然而,实际测试表明,这种方法容易受到反射弧光的干扰。所提出的方法可减轻反射弧光的影响,适用于复杂的多层焊接情况。为了解决质量监控滞后的问题,降低焊接成本,实现焊池过程的实时监控,我们采用了机器视觉和人工神经网络(ANN)模型。由此,我们开发出了基于红外热图像的焊缝熔透评估系统。该系统成功预测了 4 毫米碳钢的熔透深度,准确率达 86.6%。这验证了利用焊池表面温度特征来估计和预测焊接性能的可行性。新提出的焊池边界定义方法有望在更复杂的多层管道焊接情况下进行实时监测。它为预测和融合复杂的多道管道焊接中的焊接深度奠定了基础。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Prediction of internal welding penetration based on IR thermal image supported by machine vision and ANN-model during automatic robot welding process

Welding quality is a critical criterion for evaluating welding operations. Traditional evaluation methods suffer from drawbacks such as lack of objectivity, untimeliness, and high costs. Therefore, real-time monitoring and assessment of the weld pool have become the mainstream trend in welding technology. This study introduces a novel method for defining weld pool width boundaries. It utilizes an infrared (IR) camera to capture the weld pool temperature clusters and employs the Sobel operator for convolution to generate the gradient map of the weld pool temperature clusters. Through enhanced processing in the gradient map, the width boundaries of the weld pool are more effectively detected compared to previous methods. Previous studies defined weld pool width boundaries by identifying characteristic points with the most distinct temperature fluctuations, caused by the different radiative properties of the same material in different states. However, practical tests revealed susceptibility to interference from reflected arc light. The proposed method mitigates the impact of reflected arc light and is applicable to complex multilayer welding scenarios. To address the lag in quality monitoring, reduce welding costs, and achieve real-time monitoring of the weld pool process, we employed machine vision and an artificial neural network (ANN) model. This led to the development of a weld penetration assessment system based on infrared thermal images. The system successfully predicted the penetration depth for 4 mm carbon steel with an accuracy of 86.6 %. This validates the feasibility of estimating and predicting weld performance using the surface temperature characteristics of the weld pool. The newly proposed weld pool boundary definition method holds promise for real-time monitoring in more complex multilayer pipe welding scenarios. It lays the groundwork for predicting and fusing the weld depth in intricate multi-pass pipe welding.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
CiteScore
7.10
自引率
9.80%
发文量
58
审稿时长
44 days
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信