利用对比伪标签生成技术为多标签遥感图像注释进行领域调整

IF 4.7 2区 地球科学 Q1 ENGINEERING, ELECTRICAL & ELECTRONIC
Rui Huang;Mingyang Ma;Wei Huang
{"title":"利用对比伪标签生成技术为多标签遥感图像注释进行领域调整","authors":"Rui Huang;Mingyang Ma;Wei Huang","doi":"10.1109/JSTARS.2024.3490596","DOIUrl":null,"url":null,"abstract":"Deep-learning-based multilabel remote sensing image annotation (MLRSIA) is receiving increasing attention in recent years. MLRSIA needs a large volume of labeled samples for effective training of the deep models. However, the scarcity of labeled samples is a common challenge in this field. Domain adaptation (DA), aiming to transfer knowledge from label-rich datasets (source domains) to label-scarce datasets (target domains), has become an effective means to address this problem of limited labeled samples. But most of the existing DA models are primarily designed for single-label annotation tasks, leaving the application of DA to multilabel annotation tasks as an open issue. In this article, a DA method for MLRSIA, named contrastive pseudo-label generation (CPLG), is proposed. CPLG mainly consists of two parts: generating and selecting pseudo-labels for the samples in the target domain, and enhancing the cross-domain feature consistency through contrastive learning. Specifically, the soft predictions (or posterior probabilities) and the corresponding pseudo-labels of the target samples are first generated using neighborhood aggregation. Then, a positive and negative pseudo-label selection strategy is designed to refine these pseudo-label. Finally, a contrastive loss is introduced to align the similar sample features between the source and target domains to avoid the pseudo-labels of the target samples being overly biased toward the source domain, further improving the precision of these pseudo-labels. The MLRSIA experiments, conducted across four different DA scenarios on three benchmark datasets, demonstrate the advantages of the proposed CPLG compared to other state-of-the-art methods.","PeriodicalId":13116,"journal":{"name":"IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing","volume":"17 ","pages":"20344-20354"},"PeriodicalIF":4.7000,"publicationDate":"2024-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10741351","citationCount":"0","resultStr":"{\"title\":\"Domain Adaptation for Multilabel Remote Sensing Image Annotation With Contrastive Pseudo-Label Generation\",\"authors\":\"Rui Huang;Mingyang Ma;Wei Huang\",\"doi\":\"10.1109/JSTARS.2024.3490596\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Deep-learning-based multilabel remote sensing image annotation (MLRSIA) is receiving increasing attention in recent years. MLRSIA needs a large volume of labeled samples for effective training of the deep models. However, the scarcity of labeled samples is a common challenge in this field. Domain adaptation (DA), aiming to transfer knowledge from label-rich datasets (source domains) to label-scarce datasets (target domains), has become an effective means to address this problem of limited labeled samples. But most of the existing DA models are primarily designed for single-label annotation tasks, leaving the application of DA to multilabel annotation tasks as an open issue. In this article, a DA method for MLRSIA, named contrastive pseudo-label generation (CPLG), is proposed. CPLG mainly consists of two parts: generating and selecting pseudo-labels for the samples in the target domain, and enhancing the cross-domain feature consistency through contrastive learning. Specifically, the soft predictions (or posterior probabilities) and the corresponding pseudo-labels of the target samples are first generated using neighborhood aggregation. Then, a positive and negative pseudo-label selection strategy is designed to refine these pseudo-label. Finally, a contrastive loss is introduced to align the similar sample features between the source and target domains to avoid the pseudo-labels of the target samples being overly biased toward the source domain, further improving the precision of these pseudo-labels. The MLRSIA experiments, conducted across four different DA scenarios on three benchmark datasets, demonstrate the advantages of the proposed CPLG compared to other state-of-the-art methods.\",\"PeriodicalId\":13116,\"journal\":{\"name\":\"IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing\",\"volume\":\"17 \",\"pages\":\"20344-20354\"},\"PeriodicalIF\":4.7000,\"publicationDate\":\"2024-11-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10741351\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10741351/\",\"RegionNum\":2,\"RegionCategory\":\"地球科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10741351/","RegionNum":2,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0

摘要

基于深度学习的多标签遥感图像标注(MLRSIA)近年来受到越来越多的关注。MLRSIA 需要大量的标注样本来有效训练深度模型。然而,标注样本的稀缺性是该领域面临的共同挑战。领域适应(DA)旨在将知识从标签丰富的数据集(源领域)转移到标签稀缺的数据集(目标领域),已成为解决标签样本有限这一问题的有效手段。但是,现有的大多数 DA 模型主要是针对单标签标注任务设计的,因此 DA 在多标签标注任务中的应用仍是一个未决问题。本文提出了一种用于 MLRSIA 的 DA 方法,命名为对比伪标签生成(CPLG)。CPLG 主要包括两部分:为目标域中的样本生成和选择伪标签,以及通过对比学习增强跨域特征一致性。具体来说,首先利用邻域聚合生成目标样本的软预测(或后验概率)和相应的伪标签。然后,设计一种正负伪标签选择策略来完善这些伪标签。最后,引入对比损失来调整源域和目标域之间相似的样本特征,以避免目标样本的伪标签过于偏向源域,从而进一步提高这些伪标签的精度。在三个基准数据集上进行的四种不同 DA 场景的 MLRSIA 实验证明了所提出的 CPLG 与其他最先进方法相比所具有的优势。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Domain Adaptation for Multilabel Remote Sensing Image Annotation With Contrastive Pseudo-Label Generation
Deep-learning-based multilabel remote sensing image annotation (MLRSIA) is receiving increasing attention in recent years. MLRSIA needs a large volume of labeled samples for effective training of the deep models. However, the scarcity of labeled samples is a common challenge in this field. Domain adaptation (DA), aiming to transfer knowledge from label-rich datasets (source domains) to label-scarce datasets (target domains), has become an effective means to address this problem of limited labeled samples. But most of the existing DA models are primarily designed for single-label annotation tasks, leaving the application of DA to multilabel annotation tasks as an open issue. In this article, a DA method for MLRSIA, named contrastive pseudo-label generation (CPLG), is proposed. CPLG mainly consists of two parts: generating and selecting pseudo-labels for the samples in the target domain, and enhancing the cross-domain feature consistency through contrastive learning. Specifically, the soft predictions (or posterior probabilities) and the corresponding pseudo-labels of the target samples are first generated using neighborhood aggregation. Then, a positive and negative pseudo-label selection strategy is designed to refine these pseudo-label. Finally, a contrastive loss is introduced to align the similar sample features between the source and target domains to avoid the pseudo-labels of the target samples being overly biased toward the source domain, further improving the precision of these pseudo-labels. The MLRSIA experiments, conducted across four different DA scenarios on three benchmark datasets, demonstrate the advantages of the proposed CPLG compared to other state-of-the-art methods.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
CiteScore
9.30
自引率
10.90%
发文量
563
审稿时长
4.7 months
期刊介绍: The IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing addresses the growing field of applications in Earth observations and remote sensing, and also provides a venue for the rapidly expanding special issues that are being sponsored by the IEEE Geosciences and Remote Sensing Society. The journal draws upon the experience of the highly successful “IEEE Transactions on Geoscience and Remote Sensing” and provide a complementary medium for the wide range of topics in applied earth observations. The ‘Applications’ areas encompasses the societal benefit areas of the Global Earth Observations Systems of Systems (GEOSS) program. Through deliberations over two years, ministers from 50 countries agreed to identify nine areas where Earth observation could positively impact the quality of life and health of their respective countries. Some of these are areas not traditionally addressed in the IEEE context. These include biodiversity, health and climate. Yet it is the skill sets of IEEE members, in areas such as observations, communications, computers, signal processing, standards and ocean engineering, that form the technical underpinnings of GEOSS. Thus, the Journal attracts a broad range of interests that serves both present members in new ways and expands the IEEE visibility into new areas.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信