基于特征分解的域适应网络用于跨场景沿海湿地高光谱图像分类

IF 8.6 Q1 REMOTE SENSING
Ziqi Xin , Zhongwei Li , Mingming Xu , Leiquan Wang , Guangbo Ren , Jianbu Wang , Yabin Hu
{"title":"基于特征分解的域适应网络用于跨场景沿海湿地高光谱图像分类","authors":"Ziqi Xin ,&nbsp;Zhongwei Li ,&nbsp;Mingming Xu ,&nbsp;Leiquan Wang ,&nbsp;Guangbo Ren ,&nbsp;Jianbu Wang ,&nbsp;Yabin Hu","doi":"10.1016/j.jag.2024.103850","DOIUrl":null,"url":null,"abstract":"<div><p>At present, domain adaptation (DA) methods have made noteworthy advancements in cross-scene hyperspectral image (HSI) classification. Their success largely hinges on the alignment of distributions between source and target domains, which is a critical step in extracting domain-invariant features. However, this intense focus on domain-invariant feature extraction frequently leads to the neglect of class-discriminative features, limiting their utility in cross-scene coastal wetland classification, where the nuanced identification of different classes is crucial. In this paper, a feature disentanglement based domain adaptation network (FDDAN) is proposed to disentangle and exclude domain-specific features and class-invariant features, thereby obtaining class-specific domain-invariant features for classification tasks. Specifically, a transformer and convolution fusion-based feature extraction network is designed to capture global–local mixed features. To align domain distributions and learn shared features, two corresponding disentanglers separate domain-invariant features and domain-specific features from mixed features. Furthermore, to allow domain-invariant features containing purer category discriminative information, class-invariant features are also segregated. In addition, an adversarial learning strategy between three features is utilized to simultaneously enhance the transferability and discriminability of domain-invariant features. The effectiveness of FDDAN is demonstrated by the experimental results obtained from three cross-scene unmanned aerial vehicle datasets collected in coastal wetlands and a publicly available dataset. We will make our datasets and source code publicly available upon acceptance of the paper.</p></div>","PeriodicalId":73423,"journal":{"name":"International journal of applied earth observation and geoinformation : ITC journal","volume":"129 ","pages":"Article 103850"},"PeriodicalIF":8.6000,"publicationDate":"2024-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S1569843224002048/pdfft?md5=535cf471f43d0f108f9d12c9d08515bb&pid=1-s2.0-S1569843224002048-main.pdf","citationCount":"0","resultStr":"{\"title\":\"Feature disentanglement based domain adaptation network for cross-scene coastal wetland hyperspectral image classification\",\"authors\":\"Ziqi Xin ,&nbsp;Zhongwei Li ,&nbsp;Mingming Xu ,&nbsp;Leiquan Wang ,&nbsp;Guangbo Ren ,&nbsp;Jianbu Wang ,&nbsp;Yabin Hu\",\"doi\":\"10.1016/j.jag.2024.103850\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>At present, domain adaptation (DA) methods have made noteworthy advancements in cross-scene hyperspectral image (HSI) classification. Their success largely hinges on the alignment of distributions between source and target domains, which is a critical step in extracting domain-invariant features. However, this intense focus on domain-invariant feature extraction frequently leads to the neglect of class-discriminative features, limiting their utility in cross-scene coastal wetland classification, where the nuanced identification of different classes is crucial. In this paper, a feature disentanglement based domain adaptation network (FDDAN) is proposed to disentangle and exclude domain-specific features and class-invariant features, thereby obtaining class-specific domain-invariant features for classification tasks. Specifically, a transformer and convolution fusion-based feature extraction network is designed to capture global–local mixed features. To align domain distributions and learn shared features, two corresponding disentanglers separate domain-invariant features and domain-specific features from mixed features. Furthermore, to allow domain-invariant features containing purer category discriminative information, class-invariant features are also segregated. In addition, an adversarial learning strategy between three features is utilized to simultaneously enhance the transferability and discriminability of domain-invariant features. The effectiveness of FDDAN is demonstrated by the experimental results obtained from three cross-scene unmanned aerial vehicle datasets collected in coastal wetlands and a publicly available dataset. We will make our datasets and source code publicly available upon acceptance of the paper.</p></div>\",\"PeriodicalId\":73423,\"journal\":{\"name\":\"International journal of applied earth observation and geoinformation : ITC journal\",\"volume\":\"129 \",\"pages\":\"Article 103850\"},\"PeriodicalIF\":8.6000,\"publicationDate\":\"2024-05-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.sciencedirect.com/science/article/pii/S1569843224002048/pdfft?md5=535cf471f43d0f108f9d12c9d08515bb&pid=1-s2.0-S1569843224002048-main.pdf\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"International journal of applied earth observation and geoinformation : ITC journal\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S1569843224002048\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"REMOTE SENSING\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"International journal of applied earth observation and geoinformation : ITC journal","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1569843224002048","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"REMOTE SENSING","Score":null,"Total":0}
引用次数: 0

摘要

目前,域适应(DA)方法在跨场景高光谱图像(HSI)分类方面取得了显著进展。它们的成功在很大程度上取决于源域和目标域之间分布的一致性,这是提取域不变特征的关键步骤。然而,对域不变特征提取的高度关注经常导致对类区分特征的忽视,从而限制了它们在跨场景沿岸湿地分类中的应用,因为在这种分类中,对不同类别的细微识别至关重要。本文提出了一种基于特征分解的域适应网络(FDDAN),用于分解和排除特定域特征和类不变特征,从而获得用于分类任务的特定类域不变特征。具体来说,设计了一个基于变换器和卷积融合的特征提取网络来捕捉全局-局部混合特征。为了对齐领域分布并学习共享特征,两个相应的分离器将领域不变特征和特定领域特征从混合特征中分离出来。此外,为了使领域不变特征包含更纯粹的类别区分信息,类别不变特征也被分离出来。此外,还利用了三种特征之间的对抗学习策略,以同时增强领域不变特征的可转移性和可辨别性。在沿海湿地采集的三个跨场景无人机数据集和一个公开数据集的实验结果证明了 FDDAN 的有效性。我们将在论文被接受后公开我们的数据集和源代码。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Feature disentanglement based domain adaptation network for cross-scene coastal wetland hyperspectral image classification

At present, domain adaptation (DA) methods have made noteworthy advancements in cross-scene hyperspectral image (HSI) classification. Their success largely hinges on the alignment of distributions between source and target domains, which is a critical step in extracting domain-invariant features. However, this intense focus on domain-invariant feature extraction frequently leads to the neglect of class-discriminative features, limiting their utility in cross-scene coastal wetland classification, where the nuanced identification of different classes is crucial. In this paper, a feature disentanglement based domain adaptation network (FDDAN) is proposed to disentangle and exclude domain-specific features and class-invariant features, thereby obtaining class-specific domain-invariant features for classification tasks. Specifically, a transformer and convolution fusion-based feature extraction network is designed to capture global–local mixed features. To align domain distributions and learn shared features, two corresponding disentanglers separate domain-invariant features and domain-specific features from mixed features. Furthermore, to allow domain-invariant features containing purer category discriminative information, class-invariant features are also segregated. In addition, an adversarial learning strategy between three features is utilized to simultaneously enhance the transferability and discriminability of domain-invariant features. The effectiveness of FDDAN is demonstrated by the experimental results obtained from three cross-scene unmanned aerial vehicle datasets collected in coastal wetlands and a publicly available dataset. We will make our datasets and source code publicly available upon acceptance of the paper.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
International journal of applied earth observation and geoinformation : ITC journal
International journal of applied earth observation and geoinformation : ITC journal Global and Planetary Change, Management, Monitoring, Policy and Law, Earth-Surface Processes, Computers in Earth Sciences
CiteScore
12.00
自引率
0.00%
发文量
0
审稿时长
77 days
期刊介绍: The International Journal of Applied Earth Observation and Geoinformation publishes original papers that utilize earth observation data for natural resource and environmental inventory and management. These data primarily originate from remote sensing platforms, including satellites and aircraft, supplemented by surface and subsurface measurements. Addressing natural resources such as forests, agricultural land, soils, and water, as well as environmental concerns like biodiversity, land degradation, and hazards, the journal explores conceptual and data-driven approaches. It covers geoinformation themes like capturing, databasing, visualization, interpretation, data quality, and spatial uncertainty.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信