Unsupervised Domain Adaptative SAR Target Detection Based on Feature Decomposition and Uncertainty-Guided Self-Training

IF 4.7 2区 地球科学 Q1 ENGINEERING, ELECTRICAL & ELECTRONIC
Yu Shi;Yi Li;Lan Du;Yuang Du;Yuchen Guo
{"title":"Unsupervised Domain Adaptative SAR Target Detection Based on Feature Decomposition and Uncertainty-Guided Self-Training","authors":"Yu Shi;Yi Li;Lan Du;Yuang Du;Yuchen Guo","doi":"10.1109/JSTARS.2024.3486922","DOIUrl":null,"url":null,"abstract":"This article proposes an unsupervised domain adaptation (UDA) method by transferring knowledge from rich labeled optical domain to unlabeled synthetic aperture radar (SAR) domain, tackling the issue that current deep-learning-based SAR target detection methods rely on abundant labeled SAR images. Specifically, we gradually encode the dependencies across different granularity perspectives including domain invariant representations (DIR) learning based on feature decomposition and domain discriminative representations (DDR) learning based on uncertainty-guided self-training. First, existing methods usually learn the DIR by directly minimizing domain discrepancy between two domains, which is difficult to achieve in practice. Due to the huge difference between the optical and SAR images, rich domain-specific characteristics bring great challenges to learn the DIR. To alleviate the above difficulty, we explicitly model the domain-invariant and domain-specific features in the representations by constructing a network with feature decomposition to better extract the DIR across domains, where only the DIR extracted from optical images and their labels are used to train the domain-shared detector in this stage. Second, even DIR can be extracted, the domain-shared detector will lose some discriminative and valuable features of the SAR domain while minimizing the distribution discrepancy between the SAR and labeled optical domain. In order to achieve the better detection performance for SAR images, a self-training method based on pseudolabels is proposed to learn DDR and train the SAR-dedicated detector. Furthermore, for ensuring the reliability of pseudolabels, we present a novel uncertainty-guided pseudolabel selection strategy, which contains two phases: one is instance uncertainty guided selection, the other is image uncertainty guided selection. Finally, based on measured optical and SAR datasets, we conduct extensive empirical evaluation to verify the effectuality of our proposed method.","PeriodicalId":13116,"journal":{"name":"IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing","volume":"17 ","pages":"20265-20283"},"PeriodicalIF":4.7000,"publicationDate":"2024-11-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10750353","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10750353/","RegionNum":2,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0

Abstract

This article proposes an unsupervised domain adaptation (UDA) method by transferring knowledge from rich labeled optical domain to unlabeled synthetic aperture radar (SAR) domain, tackling the issue that current deep-learning-based SAR target detection methods rely on abundant labeled SAR images. Specifically, we gradually encode the dependencies across different granularity perspectives including domain invariant representations (DIR) learning based on feature decomposition and domain discriminative representations (DDR) learning based on uncertainty-guided self-training. First, existing methods usually learn the DIR by directly minimizing domain discrepancy between two domains, which is difficult to achieve in practice. Due to the huge difference between the optical and SAR images, rich domain-specific characteristics bring great challenges to learn the DIR. To alleviate the above difficulty, we explicitly model the domain-invariant and domain-specific features in the representations by constructing a network with feature decomposition to better extract the DIR across domains, where only the DIR extracted from optical images and their labels are used to train the domain-shared detector in this stage. Second, even DIR can be extracted, the domain-shared detector will lose some discriminative and valuable features of the SAR domain while minimizing the distribution discrepancy between the SAR and labeled optical domain. In order to achieve the better detection performance for SAR images, a self-training method based on pseudolabels is proposed to learn DDR and train the SAR-dedicated detector. Furthermore, for ensuring the reliability of pseudolabels, we present a novel uncertainty-guided pseudolabel selection strategy, which contains two phases: one is instance uncertainty guided selection, the other is image uncertainty guided selection. Finally, based on measured optical and SAR datasets, we conduct extensive empirical evaluation to verify the effectuality of our proposed method.
基于特征分解和不确定性引导的自我训练的无监督领域自适应合成孔径雷达目标探测
目前基于深度学习的合成孔径雷达(SAR)目标检测方法依赖于丰富的标注合成孔径雷达图像,本文针对这一问题,提出了一种无监督域适应(UDA)方法,将丰富的标注光学域知识转移到非标注合成孔径雷达(SAR)域。具体来说,我们从不同的粒度角度逐步编码依赖关系,包括基于特征分解的域不变表征(DIR)学习和基于不确定性引导的自我训练的域判别表征(DDR)学习。首先,现有方法通常通过直接最小化两个域之间的域差异来学习 DIR,这在实践中很难实现。由于光学图像和合成孔径雷达图像之间存在巨大差异,丰富的特定域特征给 DIR 学习带来了巨大挑战。为了缓解上述困难,我们通过构建一个具有特征分解功能的网络,在表征中明确建立域不变特征和域特定特征模型,以更好地提取跨域的 DIR,在此阶段仅使用从光学图像中提取的 DIR 及其标签来训练域共享检测器。其次,即使能提取出 DIR,域共享检测器也会丢失 SAR 域中一些有鉴别力和有价值的特征,同时最大限度地减少 SAR 和标记光学域之间的分布差异。为了实现更好的 SAR 图像检测性能,本文提出了一种基于伪标签的自训练方法来学习 DDR 并训练 SAR 专用检测器。此外,为确保伪标签的可靠性,我们提出了一种新颖的不确定性引导伪标签选择策略,该策略包含两个阶段:一个是实例不确定性引导选择,另一个是图像不确定性引导选择。最后,基于测量的光学和合成孔径雷达数据集,我们进行了广泛的实证评估,以验证我们提出的方法的有效性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
CiteScore
9.30
自引率
10.90%
发文量
563
审稿时长
4.7 months
期刊介绍: The IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing addresses the growing field of applications in Earth observations and remote sensing, and also provides a venue for the rapidly expanding special issues that are being sponsored by the IEEE Geosciences and Remote Sensing Society. The journal draws upon the experience of the highly successful “IEEE Transactions on Geoscience and Remote Sensing” and provide a complementary medium for the wide range of topics in applied earth observations. The ‘Applications’ areas encompasses the societal benefit areas of the Global Earth Observations Systems of Systems (GEOSS) program. Through deliberations over two years, ministers from 50 countries agreed to identify nine areas where Earth observation could positively impact the quality of life and health of their respective countries. Some of these are areas not traditionally addressed in the IEEE context. These include biodiversity, health and climate. Yet it is the skill sets of IEEE members, in areas such as observations, communications, computers, signal processing, standards and ocean engineering, that form the technical underpinnings of GEOSS. Thus, the Journal attracts a broad range of interests that serves both present members in new ways and expands the IEEE visibility into new areas.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信