{"title":"Unsupervised Domain Adaptative SAR Target Detection Based on Feature Decomposition and Uncertainty-Guided Self-Training","authors":"Yu Shi;Yi Li;Lan Du;Yuang Du;Yuchen Guo","doi":"10.1109/JSTARS.2024.3486922","DOIUrl":null,"url":null,"abstract":"This article proposes an unsupervised domain adaptation (UDA) method by transferring knowledge from rich labeled optical domain to unlabeled synthetic aperture radar (SAR) domain, tackling the issue that current deep-learning-based SAR target detection methods rely on abundant labeled SAR images. Specifically, we gradually encode the dependencies across different granularity perspectives including domain invariant representations (DIR) learning based on feature decomposition and domain discriminative representations (DDR) learning based on uncertainty-guided self-training. First, existing methods usually learn the DIR by directly minimizing domain discrepancy between two domains, which is difficult to achieve in practice. Due to the huge difference between the optical and SAR images, rich domain-specific characteristics bring great challenges to learn the DIR. To alleviate the above difficulty, we explicitly model the domain-invariant and domain-specific features in the representations by constructing a network with feature decomposition to better extract the DIR across domains, where only the DIR extracted from optical images and their labels are used to train the domain-shared detector in this stage. Second, even DIR can be extracted, the domain-shared detector will lose some discriminative and valuable features of the SAR domain while minimizing the distribution discrepancy between the SAR and labeled optical domain. In order to achieve the better detection performance for SAR images, a self-training method based on pseudolabels is proposed to learn DDR and train the SAR-dedicated detector. Furthermore, for ensuring the reliability of pseudolabels, we present a novel uncertainty-guided pseudolabel selection strategy, which contains two phases: one is instance uncertainty guided selection, the other is image uncertainty guided selection. Finally, based on measured optical and SAR datasets, we conduct extensive empirical evaluation to verify the effectuality of our proposed method.","PeriodicalId":13116,"journal":{"name":"IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing","volume":"17 ","pages":"20265-20283"},"PeriodicalIF":4.7000,"publicationDate":"2024-11-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10750353","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10750353/","RegionNum":2,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0
Abstract
This article proposes an unsupervised domain adaptation (UDA) method by transferring knowledge from rich labeled optical domain to unlabeled synthetic aperture radar (SAR) domain, tackling the issue that current deep-learning-based SAR target detection methods rely on abundant labeled SAR images. Specifically, we gradually encode the dependencies across different granularity perspectives including domain invariant representations (DIR) learning based on feature decomposition and domain discriminative representations (DDR) learning based on uncertainty-guided self-training. First, existing methods usually learn the DIR by directly minimizing domain discrepancy between two domains, which is difficult to achieve in practice. Due to the huge difference between the optical and SAR images, rich domain-specific characteristics bring great challenges to learn the DIR. To alleviate the above difficulty, we explicitly model the domain-invariant and domain-specific features in the representations by constructing a network with feature decomposition to better extract the DIR across domains, where only the DIR extracted from optical images and their labels are used to train the domain-shared detector in this stage. Second, even DIR can be extracted, the domain-shared detector will lose some discriminative and valuable features of the SAR domain while minimizing the distribution discrepancy between the SAR and labeled optical domain. In order to achieve the better detection performance for SAR images, a self-training method based on pseudolabels is proposed to learn DDR and train the SAR-dedicated detector. Furthermore, for ensuring the reliability of pseudolabels, we present a novel uncertainty-guided pseudolabel selection strategy, which contains two phases: one is instance uncertainty guided selection, the other is image uncertainty guided selection. Finally, based on measured optical and SAR datasets, we conduct extensive empirical evaluation to verify the effectuality of our proposed method.
目前基于深度学习的合成孔径雷达(SAR)目标检测方法依赖于丰富的标注合成孔径雷达图像,本文针对这一问题,提出了一种无监督域适应(UDA)方法,将丰富的标注光学域知识转移到非标注合成孔径雷达(SAR)域。具体来说,我们从不同的粒度角度逐步编码依赖关系,包括基于特征分解的域不变表征(DIR)学习和基于不确定性引导的自我训练的域判别表征(DDR)学习。首先,现有方法通常通过直接最小化两个域之间的域差异来学习 DIR,这在实践中很难实现。由于光学图像和合成孔径雷达图像之间存在巨大差异,丰富的特定域特征给 DIR 学习带来了巨大挑战。为了缓解上述困难,我们通过构建一个具有特征分解功能的网络,在表征中明确建立域不变特征和域特定特征模型,以更好地提取跨域的 DIR,在此阶段仅使用从光学图像中提取的 DIR 及其标签来训练域共享检测器。其次,即使能提取出 DIR,域共享检测器也会丢失 SAR 域中一些有鉴别力和有价值的特征,同时最大限度地减少 SAR 和标记光学域之间的分布差异。为了实现更好的 SAR 图像检测性能,本文提出了一种基于伪标签的自训练方法来学习 DDR 并训练 SAR 专用检测器。此外,为确保伪标签的可靠性,我们提出了一种新颖的不确定性引导伪标签选择策略,该策略包含两个阶段:一个是实例不确定性引导选择,另一个是图像不确定性引导选择。最后,基于测量的光学和合成孔径雷达数据集,我们进行了广泛的实证评估,以验证我们提出的方法的有效性。
期刊介绍:
The IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing addresses the growing field of applications in Earth observations and remote sensing, and also provides a venue for the rapidly expanding special issues that are being sponsored by the IEEE Geosciences and Remote Sensing Society. The journal draws upon the experience of the highly successful “IEEE Transactions on Geoscience and Remote Sensing” and provide a complementary medium for the wide range of topics in applied earth observations. The ‘Applications’ areas encompasses the societal benefit areas of the Global Earth Observations Systems of Systems (GEOSS) program. Through deliberations over two years, ministers from 50 countries agreed to identify nine areas where Earth observation could positively impact the quality of life and health of their respective countries. Some of these are areas not traditionally addressed in the IEEE context. These include biodiversity, health and climate. Yet it is the skill sets of IEEE members, in areas such as observations, communications, computers, signal processing, standards and ocean engineering, that form the technical underpinnings of GEOSS. Thus, the Journal attracts a broad range of interests that serves both present members in new ways and expands the IEEE visibility into new areas.