{"title":"基于拓扑信息聚合网络的少拍跨域高光谱图像分类","authors":"Kai Shi;Wenzhen Wang;Qichao Liu;Liang Xiao","doi":"10.1109/TGRS.2024.3516772","DOIUrl":null,"url":null,"abstract":"In recent advancements, hyperspectral image (HSI) classification through few-shot learning (FSL) has significantly progressed. Domain adaptation, integrated with FSL, effectively utilizes transferable knowledge from a source domain (SD) with abundant labeled data to excel in classification tasks within a target domain (TD) with scarce labels. However, most existing methods usually use traditional convolutional neural networks (CNNs) to extract local spatial information to characterize and mine feature and distribution information while ignoring the underlying topological relationships among feature classes. Therefore, we propose a topology graph perception cross-domain FSL (TGP-CFSL) framework that leverages graph information aggregation. Specifically, to construct the extended topological relationships of the target, we have designed a topological graph-based multiscale fusion (TGMF) feature extraction module, which is adept at fully mining the topological spatial neighborhood information of the target. Meanwhile, a dual-graph information perception (DGIP) module is designed, which is able to characterize and aggregate intradomain topological relationships in terms of both feature representations and interdomain distribution similarities and to extract higher order domain distribution information for realizing domain alignment. Experimental results on three public HSI datasets demonstrate that the proposed method outperforms existing methods.","PeriodicalId":13213,"journal":{"name":"IEEE Transactions on Geoscience and Remote Sensing","volume":"63 ","pages":"1-15"},"PeriodicalIF":8.6000,"publicationDate":"2024-12-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Topological Information Aggregation Network for Few-Shot Cross-Domain Hyperspectral Image Classification\",\"authors\":\"Kai Shi;Wenzhen Wang;Qichao Liu;Liang Xiao\",\"doi\":\"10.1109/TGRS.2024.3516772\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"In recent advancements, hyperspectral image (HSI) classification through few-shot learning (FSL) has significantly progressed. Domain adaptation, integrated with FSL, effectively utilizes transferable knowledge from a source domain (SD) with abundant labeled data to excel in classification tasks within a target domain (TD) with scarce labels. However, most existing methods usually use traditional convolutional neural networks (CNNs) to extract local spatial information to characterize and mine feature and distribution information while ignoring the underlying topological relationships among feature classes. Therefore, we propose a topology graph perception cross-domain FSL (TGP-CFSL) framework that leverages graph information aggregation. Specifically, to construct the extended topological relationships of the target, we have designed a topological graph-based multiscale fusion (TGMF) feature extraction module, which is adept at fully mining the topological spatial neighborhood information of the target. Meanwhile, a dual-graph information perception (DGIP) module is designed, which is able to characterize and aggregate intradomain topological relationships in terms of both feature representations and interdomain distribution similarities and to extract higher order domain distribution information for realizing domain alignment. Experimental results on three public HSI datasets demonstrate that the proposed method outperforms existing methods.\",\"PeriodicalId\":13213,\"journal\":{\"name\":\"IEEE Transactions on Geoscience and Remote Sensing\",\"volume\":\"63 \",\"pages\":\"1-15\"},\"PeriodicalIF\":8.6000,\"publicationDate\":\"2024-12-13\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Transactions on Geoscience and Remote Sensing\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10798455/\",\"RegionNum\":1,\"RegionCategory\":\"地球科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Geoscience and Remote Sensing","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10798455/","RegionNum":1,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0
摘要
近年来,通过少拍学习(FSL)进行高光谱图像(HSI)分类取得了显著进展。领域自适应与FSL相结合,可以有效地利用具有丰富标记数据的源领域(SD)的可转移知识,从而在具有稀缺标记的目标领域(TD)中出色地完成分类任务。然而,大多数现有方法通常使用传统的卷积神经网络(cnn)来提取局部空间信息来表征和挖掘特征和分布信息,而忽略了特征类之间的底层拓扑关系。因此,我们提出了一种利用图信息聚合的拓扑图感知跨域FSL (TGP-CFSL)框架。具体而言,为了构建目标的扩展拓扑关系,我们设计了一个基于拓扑图的多尺度融合(TGMF)特征提取模块,该模块善于充分挖掘目标的拓扑空间邻域信息。同时,设计了双图信息感知(dual-graph information perception, DGIP)模块,能够从特征表示和域间分布相似度两个方面对域内拓扑关系进行表征和聚合,提取高阶域分布信息,实现域对齐。在三个公共HSI数据集上的实验结果表明,该方法优于现有方法。
Topological Information Aggregation Network for Few-Shot Cross-Domain Hyperspectral Image Classification
In recent advancements, hyperspectral image (HSI) classification through few-shot learning (FSL) has significantly progressed. Domain adaptation, integrated with FSL, effectively utilizes transferable knowledge from a source domain (SD) with abundant labeled data to excel in classification tasks within a target domain (TD) with scarce labels. However, most existing methods usually use traditional convolutional neural networks (CNNs) to extract local spatial information to characterize and mine feature and distribution information while ignoring the underlying topological relationships among feature classes. Therefore, we propose a topology graph perception cross-domain FSL (TGP-CFSL) framework that leverages graph information aggregation. Specifically, to construct the extended topological relationships of the target, we have designed a topological graph-based multiscale fusion (TGMF) feature extraction module, which is adept at fully mining the topological spatial neighborhood information of the target. Meanwhile, a dual-graph information perception (DGIP) module is designed, which is able to characterize and aggregate intradomain topological relationships in terms of both feature representations and interdomain distribution similarities and to extract higher order domain distribution information for realizing domain alignment. Experimental results on three public HSI datasets demonstrate that the proposed method outperforms existing methods.
期刊介绍:
IEEE Transactions on Geoscience and Remote Sensing (TGRS) is a monthly publication that focuses on the theory, concepts, and techniques of science and engineering as applied to sensing the land, oceans, atmosphere, and space; and the processing, interpretation, and dissemination of this information.