基于自监督学习和改进型 KCF 的新型激光条纹关键点跟踪器,用于机器人焊缝跟踪

IF 6.1 1区 工程技术 Q1 ENGINEERING, MANUFACTURING
{"title":"基于自监督学习和改进型 KCF 的新型激光条纹关键点跟踪器,用于机器人焊缝跟踪","authors":"","doi":"10.1016/j.jmapro.2024.07.140","DOIUrl":null,"url":null,"abstract":"<div><p>Laser vision based real-time welding seam tracking has emerged as a potent strategy for enabling intelligent robotic welding. And trackers based seam key point tracking algorithms demonstrate remarkable adaptability to complex welding environments. This paper proposed a self-supervised robust KCF (Kernelized Correlation Filter) tracker for seam key point tracking, which could be a novel approach to achieve autonomous seam tracking. Firstly, a self-supervised global-local feature extraction network is constructed, which can guide the model to focus on both global semantic and local texture features of laser stripes, thereby establishing a solid groundwork for stable key point tracking. Subsequently, a robust KCF tracking algorithm is presented. A multi-template enhanced tracker generation strategy is designed, and the corresponding analytical solution is derived, which can improve the tracker's representation capability of stripe features without significantly increasing computational complexity. Experimental results demonstrate that compared to traditional algorithms, the proposed algorithm exhibits advantages in tracking accuracy, stability, and real-time performance. Moreover, since the algorithm minimally relies on manually labeled data, it holds promise as a technological means to achieve fully autonomous seam tracking in actual welding production.</p></div>","PeriodicalId":16148,"journal":{"name":"Journal of Manufacturing Processes","volume":null,"pages":null},"PeriodicalIF":6.1000,"publicationDate":"2024-08-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A novel laser stripe key point tracker based on self-supervised learning and improved KCF for robotic welding seam tracking\",\"authors\":\"\",\"doi\":\"10.1016/j.jmapro.2024.07.140\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>Laser vision based real-time welding seam tracking has emerged as a potent strategy for enabling intelligent robotic welding. And trackers based seam key point tracking algorithms demonstrate remarkable adaptability to complex welding environments. This paper proposed a self-supervised robust KCF (Kernelized Correlation Filter) tracker for seam key point tracking, which could be a novel approach to achieve autonomous seam tracking. Firstly, a self-supervised global-local feature extraction network is constructed, which can guide the model to focus on both global semantic and local texture features of laser stripes, thereby establishing a solid groundwork for stable key point tracking. Subsequently, a robust KCF tracking algorithm is presented. A multi-template enhanced tracker generation strategy is designed, and the corresponding analytical solution is derived, which can improve the tracker's representation capability of stripe features without significantly increasing computational complexity. Experimental results demonstrate that compared to traditional algorithms, the proposed algorithm exhibits advantages in tracking accuracy, stability, and real-time performance. Moreover, since the algorithm minimally relies on manually labeled data, it holds promise as a technological means to achieve fully autonomous seam tracking in actual welding production.</p></div>\",\"PeriodicalId\":16148,\"journal\":{\"name\":\"Journal of Manufacturing Processes\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":6.1000,\"publicationDate\":\"2024-08-14\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of Manufacturing Processes\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S1526612524008028\",\"RegionNum\":1,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, MANUFACTURING\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Manufacturing Processes","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1526612524008028","RegionNum":1,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, MANUFACTURING","Score":null,"Total":0}
引用次数: 0

摘要

基于激光视觉的实时焊缝跟踪已成为实现智能机器人焊接的有效策略。基于焊缝关键点跟踪算法的跟踪器在复杂的焊接环境中表现出卓越的适应性。本文提出了一种用于焊缝关键点跟踪的自监督鲁棒 KCF(核化相关滤波)跟踪器,这可能是实现自主焊缝跟踪的一种新方法。首先,构建了一个自监督的全局-局部特征提取网络,该网络可以引导模型关注激光条纹的全局语义特征和局部纹理特征,从而为稳定的关键点跟踪奠定坚实的基础。随后,提出了一种稳健的 KCF 跟踪算法。设计了一种多模板增强型跟踪器生成策略,并推导出相应的解析解,在不显著增加计算复杂度的情况下,提高了跟踪器对条纹特征的表示能力。实验结果表明,与传统算法相比,所提出的算法在跟踪精度、稳定性和实时性方面都具有优势。此外,由于该算法对人工标注数据的依赖最小,因此有望成为在实际焊接生产中实现完全自主焊缝跟踪的技术手段。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
A novel laser stripe key point tracker based on self-supervised learning and improved KCF for robotic welding seam tracking

Laser vision based real-time welding seam tracking has emerged as a potent strategy for enabling intelligent robotic welding. And trackers based seam key point tracking algorithms demonstrate remarkable adaptability to complex welding environments. This paper proposed a self-supervised robust KCF (Kernelized Correlation Filter) tracker for seam key point tracking, which could be a novel approach to achieve autonomous seam tracking. Firstly, a self-supervised global-local feature extraction network is constructed, which can guide the model to focus on both global semantic and local texture features of laser stripes, thereby establishing a solid groundwork for stable key point tracking. Subsequently, a robust KCF tracking algorithm is presented. A multi-template enhanced tracker generation strategy is designed, and the corresponding analytical solution is derived, which can improve the tracker's representation capability of stripe features without significantly increasing computational complexity. Experimental results demonstrate that compared to traditional algorithms, the proposed algorithm exhibits advantages in tracking accuracy, stability, and real-time performance. Moreover, since the algorithm minimally relies on manually labeled data, it holds promise as a technological means to achieve fully autonomous seam tracking in actual welding production.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Journal of Manufacturing Processes
Journal of Manufacturing Processes ENGINEERING, MANUFACTURING-
CiteScore
10.20
自引率
11.30%
发文量
833
审稿时长
50 days
期刊介绍: The aim of the Journal of Manufacturing Processes (JMP) is to exchange current and future directions of manufacturing processes research, development and implementation, and to publish archival scholarly literature with a view to advancing state-of-the-art manufacturing processes and encouraging innovation for developing new and efficient processes. The journal will also publish from other research communities for rapid communication of innovative new concepts. Special-topic issues on emerging technologies and invited papers will also be published.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信