Zhenmin Wang , Ying Dong , Liuyi Li , Peng Chi , Danhuan Zhou , Zeguang Zhu , Xiangmiao Wu , Qin Zhang
{"title":"基于辅助任务学习的磁弧吹角实时估算模型","authors":"Zhenmin Wang , Ying Dong , Liuyi Li , Peng Chi , Danhuan Zhou , Zeguang Zhu , Xiangmiao Wu , Qin Zhang","doi":"10.1016/j.jmapro.2024.08.036","DOIUrl":null,"url":null,"abstract":"<div><div>Magnetic arc blow during the welding of submersible pressure hulls can severely impact the weld quality. Real-time estimation of the arc posture by the teaching-replay welding robot is a crucial and challenging step for further correction of the magnetic blow. This paper proposes a lightweight deep learning model capable of real-time estimation of the welding arc posture. The model takes arc images as input and outputs the angle of arc magnetic blow end-to-end. Specifically, to enable the model to learn the prior knowledge of human perception of arc magnetic blow angles, a training strategy utilizing keypoint detection as an auxiliary task has been proposed. This approach enhances the estimation accuracy of the model without incurring additional inference costs. Additionally, an efficient multi-scale attention (EMA) mechanism was integrated into the angle prediction branch to facilitate the learning of long-range feature dependencies. To confirm the effectiveness of the model, an arc magnetic blow image dataset was constructed for training and testing. The experimental results show that the model achieves a cumulative score (<span><math><msub><mi>CS</mi><mn>3</mn></msub></math></span>) of 98.47 % and a mean absolute error (MAE) of 0.9985° during testing. The model achieves an inference speed of 70.49 FPS on an Intel® Core™ i7-8750H CPU, which satisfies the criteria for real-time monitoring.</div></div>","PeriodicalId":16148,"journal":{"name":"Journal of Manufacturing Processes","volume":null,"pages":null},"PeriodicalIF":6.1000,"publicationDate":"2024-09-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Real-time estimation model for magnetic arc blow angle based on auxiliary task learning\",\"authors\":\"Zhenmin Wang , Ying Dong , Liuyi Li , Peng Chi , Danhuan Zhou , Zeguang Zhu , Xiangmiao Wu , Qin Zhang\",\"doi\":\"10.1016/j.jmapro.2024.08.036\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Magnetic arc blow during the welding of submersible pressure hulls can severely impact the weld quality. Real-time estimation of the arc posture by the teaching-replay welding robot is a crucial and challenging step for further correction of the magnetic blow. This paper proposes a lightweight deep learning model capable of real-time estimation of the welding arc posture. The model takes arc images as input and outputs the angle of arc magnetic blow end-to-end. Specifically, to enable the model to learn the prior knowledge of human perception of arc magnetic blow angles, a training strategy utilizing keypoint detection as an auxiliary task has been proposed. This approach enhances the estimation accuracy of the model without incurring additional inference costs. Additionally, an efficient multi-scale attention (EMA) mechanism was integrated into the angle prediction branch to facilitate the learning of long-range feature dependencies. To confirm the effectiveness of the model, an arc magnetic blow image dataset was constructed for training and testing. The experimental results show that the model achieves a cumulative score (<span><math><msub><mi>CS</mi><mn>3</mn></msub></math></span>) of 98.47 % and a mean absolute error (MAE) of 0.9985° during testing. The model achieves an inference speed of 70.49 FPS on an Intel® Core™ i7-8750H CPU, which satisfies the criteria for real-time monitoring.</div></div>\",\"PeriodicalId\":16148,\"journal\":{\"name\":\"Journal of Manufacturing Processes\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":6.1000,\"publicationDate\":\"2024-09-21\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Manufacturing Processes\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S1526612524008673\",\"RegionNum\":1,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, MANUFACTURING\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Manufacturing Processes","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1526612524008673","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, MANUFACTURING","Score":null,"Total":0}
引用次数: 0
摘要
在焊接潜水器压力容器壳体时,磁弧打击会严重影响焊接质量。示教-回放焊接机器人对电弧姿态的实时估计是进一步纠正磁击的关键步骤,也是极具挑战性的一步。本文提出了一种能够实时估计焊接电弧姿态的轻量级深度学习模型。该模型以电弧图像为输入,输出端到端电弧磁吹角。具体而言,为了使模型能够学习人类对电弧磁场角度感知的先验知识,本文提出了一种利用关键点检测作为辅助任务的训练策略。这种方法提高了模型的估计精度,而不会产生额外的推理成本。此外,还在角度预测分支中集成了高效的多尺度注意(EMA)机制,以促进长程特征依赖性的学习。为了证实该模型的有效性,构建了一个弧形磁吹图像数据集进行训练和测试。实验结果表明,该模型在测试过程中的累积得分(CS3)为 98.47%,平均绝对误差(MAE)为 0.9985°。在英特尔® 酷睿™ i7-8750H CPU 上,该模型的推理速度达到 70.49 FPS,满足实时监控的标准。
Real-time estimation model for magnetic arc blow angle based on auxiliary task learning
Magnetic arc blow during the welding of submersible pressure hulls can severely impact the weld quality. Real-time estimation of the arc posture by the teaching-replay welding robot is a crucial and challenging step for further correction of the magnetic blow. This paper proposes a lightweight deep learning model capable of real-time estimation of the welding arc posture. The model takes arc images as input and outputs the angle of arc magnetic blow end-to-end. Specifically, to enable the model to learn the prior knowledge of human perception of arc magnetic blow angles, a training strategy utilizing keypoint detection as an auxiliary task has been proposed. This approach enhances the estimation accuracy of the model without incurring additional inference costs. Additionally, an efficient multi-scale attention (EMA) mechanism was integrated into the angle prediction branch to facilitate the learning of long-range feature dependencies. To confirm the effectiveness of the model, an arc magnetic blow image dataset was constructed for training and testing. The experimental results show that the model achieves a cumulative score () of 98.47 % and a mean absolute error (MAE) of 0.9985° during testing. The model achieves an inference speed of 70.49 FPS on an Intel® Core™ i7-8750H CPU, which satisfies the criteria for real-time monitoring.
期刊介绍:
The aim of the Journal of Manufacturing Processes (JMP) is to exchange current and future directions of manufacturing processes research, development and implementation, and to publish archival scholarly literature with a view to advancing state-of-the-art manufacturing processes and encouraging innovation for developing new and efficient processes. The journal will also publish from other research communities for rapid communication of innovative new concepts. Special-topic issues on emerging technologies and invited papers will also be published.