Xiu Shu, Feng Huang, Zhaobing Qiu, Xinming Zhang, Di Yuan
{"title":"Learning Unsupervised Cross-Domain Model for TIR Target Tracking","authors":"Xiu Shu, Feng Huang, Zhaobing Qiu, Xinming Zhang, Di Yuan","doi":"10.3390/math12182882","DOIUrl":null,"url":null,"abstract":"The limited availability of thermal infrared (TIR) training samples leads to suboptimal target representation by convolutional feature extraction networks, which adversely impacts the accuracy of TIR target tracking methods. To address this issue, we propose an unsupervised cross-domain model (UCDT) for TIR tracking. Our approach leverages labeled training samples from the RGB domain (source domain) to train a general feature extraction network. We then employ a cross-domain model to adapt this network for effective target feature extraction in the TIR domain (target domain). This cross-domain strategy addresses the challenge of limited TIR training samples effectively. Additionally, we utilize an unsupervised learning technique to generate pseudo-labels for unlabeled training samples in the source domain, which helps overcome the limitations imposed by the scarcity of annotated training data. Extensive experiments demonstrate that our UCDT tracking method outperforms existing tracking approaches on the PTB-TIR and LSOTB-TIR benchmarks.","PeriodicalId":2,"journal":{"name":"ACS Applied Bio Materials","volume":null,"pages":null},"PeriodicalIF":4.6000,"publicationDate":"2024-09-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"ACS Applied Bio Materials","FirstCategoryId":"100","ListUrlMain":"https://doi.org/10.3390/math12182882","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"MATERIALS SCIENCE, BIOMATERIALS","Score":null,"Total":0}
引用次数: 0
Abstract
The limited availability of thermal infrared (TIR) training samples leads to suboptimal target representation by convolutional feature extraction networks, which adversely impacts the accuracy of TIR target tracking methods. To address this issue, we propose an unsupervised cross-domain model (UCDT) for TIR tracking. Our approach leverages labeled training samples from the RGB domain (source domain) to train a general feature extraction network. We then employ a cross-domain model to adapt this network for effective target feature extraction in the TIR domain (target domain). This cross-domain strategy addresses the challenge of limited TIR training samples effectively. Additionally, we utilize an unsupervised learning technique to generate pseudo-labels for unlabeled training samples in the source domain, which helps overcome the limitations imposed by the scarcity of annotated training data. Extensive experiments demonstrate that our UCDT tracking method outperforms existing tracking approaches on the PTB-TIR and LSOTB-TIR benchmarks.
热红外(TIR)训练样本的有限性导致卷积特征提取网络的目标表示不理想,从而对 TIR 目标跟踪方法的准确性产生不利影响。为解决这一问题,我们提出了一种用于 TIR 跟踪的无监督跨域模型 (UCDT)。我们的方法利用 RGB 域(源域)的标记训练样本来训练通用特征提取网络。然后,我们采用跨域模型来调整该网络,以便在 TIR 域(目标域)中有效提取目标特征。这种跨域策略有效地解决了 TIR 训练样本有限的难题。此外,我们还利用无监督学习技术为源域中未标注的训练样本生成伪标签,这有助于克服标注训练数据稀缺所带来的限制。大量实验证明,在 PTB-TIR 和 LSOTB-TIR 基准上,我们的 UCDT 跟踪方法优于现有的跟踪方法。