Ziqi Xin , Zhongwei Li , Mingming Xu , Leiquan Wang , Guangbo Ren , Jianbu Wang , Yabin Hu
{"title":"基于特征分解的域适应网络用于跨场景沿海湿地高光谱图像分类","authors":"Ziqi Xin , Zhongwei Li , Mingming Xu , Leiquan Wang , Guangbo Ren , Jianbu Wang , Yabin Hu","doi":"10.1016/j.jag.2024.103850","DOIUrl":null,"url":null,"abstract":"<div><p>At present, domain adaptation (DA) methods have made noteworthy advancements in cross-scene hyperspectral image (HSI) classification. Their success largely hinges on the alignment of distributions between source and target domains, which is a critical step in extracting domain-invariant features. However, this intense focus on domain-invariant feature extraction frequently leads to the neglect of class-discriminative features, limiting their utility in cross-scene coastal wetland classification, where the nuanced identification of different classes is crucial. In this paper, a feature disentanglement based domain adaptation network (FDDAN) is proposed to disentangle and exclude domain-specific features and class-invariant features, thereby obtaining class-specific domain-invariant features for classification tasks. Specifically, a transformer and convolution fusion-based feature extraction network is designed to capture global–local mixed features. To align domain distributions and learn shared features, two corresponding disentanglers separate domain-invariant features and domain-specific features from mixed features. Furthermore, to allow domain-invariant features containing purer category discriminative information, class-invariant features are also segregated. In addition, an adversarial learning strategy between three features is utilized to simultaneously enhance the transferability and discriminability of domain-invariant features. The effectiveness of FDDAN is demonstrated by the experimental results obtained from three cross-scene unmanned aerial vehicle datasets collected in coastal wetlands and a publicly available dataset. We will make our datasets and source code publicly available upon acceptance of the paper.</p></div>","PeriodicalId":73423,"journal":{"name":"International journal of applied earth observation and geoinformation : ITC journal","volume":"129 ","pages":"Article 103850"},"PeriodicalIF":8.6000,"publicationDate":"2024-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S1569843224002048/pdfft?md5=535cf471f43d0f108f9d12c9d08515bb&pid=1-s2.0-S1569843224002048-main.pdf","citationCount":"0","resultStr":"{\"title\":\"Feature disentanglement based domain adaptation network for cross-scene coastal wetland hyperspectral image classification\",\"authors\":\"Ziqi Xin , Zhongwei Li , Mingming Xu , Leiquan Wang , Guangbo Ren , Jianbu Wang , Yabin Hu\",\"doi\":\"10.1016/j.jag.2024.103850\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>At present, domain adaptation (DA) methods have made noteworthy advancements in cross-scene hyperspectral image (HSI) classification. Their success largely hinges on the alignment of distributions between source and target domains, which is a critical step in extracting domain-invariant features. However, this intense focus on domain-invariant feature extraction frequently leads to the neglect of class-discriminative features, limiting their utility in cross-scene coastal wetland classification, where the nuanced identification of different classes is crucial. In this paper, a feature disentanglement based domain adaptation network (FDDAN) is proposed to disentangle and exclude domain-specific features and class-invariant features, thereby obtaining class-specific domain-invariant features for classification tasks. Specifically, a transformer and convolution fusion-based feature extraction network is designed to capture global–local mixed features. To align domain distributions and learn shared features, two corresponding disentanglers separate domain-invariant features and domain-specific features from mixed features. Furthermore, to allow domain-invariant features containing purer category discriminative information, class-invariant features are also segregated. In addition, an adversarial learning strategy between three features is utilized to simultaneously enhance the transferability and discriminability of domain-invariant features. The effectiveness of FDDAN is demonstrated by the experimental results obtained from three cross-scene unmanned aerial vehicle datasets collected in coastal wetlands and a publicly available dataset. We will make our datasets and source code publicly available upon acceptance of the paper.</p></div>\",\"PeriodicalId\":73423,\"journal\":{\"name\":\"International journal of applied earth observation and geoinformation : ITC journal\",\"volume\":\"129 \",\"pages\":\"Article 103850\"},\"PeriodicalIF\":8.6000,\"publicationDate\":\"2024-05-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.sciencedirect.com/science/article/pii/S1569843224002048/pdfft?md5=535cf471f43d0f108f9d12c9d08515bb&pid=1-s2.0-S1569843224002048-main.pdf\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"International journal of applied earth observation and geoinformation : ITC journal\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S1569843224002048\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"REMOTE SENSING\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"International journal of applied earth observation and geoinformation : ITC journal","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1569843224002048","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"REMOTE SENSING","Score":null,"Total":0}
Feature disentanglement based domain adaptation network for cross-scene coastal wetland hyperspectral image classification
At present, domain adaptation (DA) methods have made noteworthy advancements in cross-scene hyperspectral image (HSI) classification. Their success largely hinges on the alignment of distributions between source and target domains, which is a critical step in extracting domain-invariant features. However, this intense focus on domain-invariant feature extraction frequently leads to the neglect of class-discriminative features, limiting their utility in cross-scene coastal wetland classification, where the nuanced identification of different classes is crucial. In this paper, a feature disentanglement based domain adaptation network (FDDAN) is proposed to disentangle and exclude domain-specific features and class-invariant features, thereby obtaining class-specific domain-invariant features for classification tasks. Specifically, a transformer and convolution fusion-based feature extraction network is designed to capture global–local mixed features. To align domain distributions and learn shared features, two corresponding disentanglers separate domain-invariant features and domain-specific features from mixed features. Furthermore, to allow domain-invariant features containing purer category discriminative information, class-invariant features are also segregated. In addition, an adversarial learning strategy between three features is utilized to simultaneously enhance the transferability and discriminability of domain-invariant features. The effectiveness of FDDAN is demonstrated by the experimental results obtained from three cross-scene unmanned aerial vehicle datasets collected in coastal wetlands and a publicly available dataset. We will make our datasets and source code publicly available upon acceptance of the paper.
期刊介绍:
The International Journal of Applied Earth Observation and Geoinformation publishes original papers that utilize earth observation data for natural resource and environmental inventory and management. These data primarily originate from remote sensing platforms, including satellites and aircraft, supplemented by surface and subsurface measurements. Addressing natural resources such as forests, agricultural land, soils, and water, as well as environmental concerns like biodiversity, land degradation, and hazards, the journal explores conceptual and data-driven approaches. It covers geoinformation themes like capturing, databasing, visualization, interpretation, data quality, and spatial uncertainty.