基于拓扑信息聚合网络的少拍跨域高光谱图像分类

IF 8.6 1区 地球科学 Q1 ENGINEERING, ELECTRICAL & ELECTRONIC
Kai Shi;Wenzhen Wang;Qichao Liu;Liang Xiao
{"title":"基于拓扑信息聚合网络的少拍跨域高光谱图像分类","authors":"Kai Shi;Wenzhen Wang;Qichao Liu;Liang Xiao","doi":"10.1109/TGRS.2024.3516772","DOIUrl":null,"url":null,"abstract":"In recent advancements, hyperspectral image (HSI) classification through few-shot learning (FSL) has significantly progressed. Domain adaptation, integrated with FSL, effectively utilizes transferable knowledge from a source domain (SD) with abundant labeled data to excel in classification tasks within a target domain (TD) with scarce labels. However, most existing methods usually use traditional convolutional neural networks (CNNs) to extract local spatial information to characterize and mine feature and distribution information while ignoring the underlying topological relationships among feature classes. Therefore, we propose a topology graph perception cross-domain FSL (TGP-CFSL) framework that leverages graph information aggregation. Specifically, to construct the extended topological relationships of the target, we have designed a topological graph-based multiscale fusion (TGMF) feature extraction module, which is adept at fully mining the topological spatial neighborhood information of the target. Meanwhile, a dual-graph information perception (DGIP) module is designed, which is able to characterize and aggregate intradomain topological relationships in terms of both feature representations and interdomain distribution similarities and to extract higher order domain distribution information for realizing domain alignment. Experimental results on three public HSI datasets demonstrate that the proposed method outperforms existing methods.","PeriodicalId":13213,"journal":{"name":"IEEE Transactions on Geoscience and Remote Sensing","volume":"63 ","pages":"1-15"},"PeriodicalIF":8.6000,"publicationDate":"2024-12-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Topological Information Aggregation Network for Few-Shot Cross-Domain Hyperspectral Image Classification\",\"authors\":\"Kai Shi;Wenzhen Wang;Qichao Liu;Liang Xiao\",\"doi\":\"10.1109/TGRS.2024.3516772\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"In recent advancements, hyperspectral image (HSI) classification through few-shot learning (FSL) has significantly progressed. Domain adaptation, integrated with FSL, effectively utilizes transferable knowledge from a source domain (SD) with abundant labeled data to excel in classification tasks within a target domain (TD) with scarce labels. However, most existing methods usually use traditional convolutional neural networks (CNNs) to extract local spatial information to characterize and mine feature and distribution information while ignoring the underlying topological relationships among feature classes. Therefore, we propose a topology graph perception cross-domain FSL (TGP-CFSL) framework that leverages graph information aggregation. Specifically, to construct the extended topological relationships of the target, we have designed a topological graph-based multiscale fusion (TGMF) feature extraction module, which is adept at fully mining the topological spatial neighborhood information of the target. Meanwhile, a dual-graph information perception (DGIP) module is designed, which is able to characterize and aggregate intradomain topological relationships in terms of both feature representations and interdomain distribution similarities and to extract higher order domain distribution information for realizing domain alignment. Experimental results on three public HSI datasets demonstrate that the proposed method outperforms existing methods.\",\"PeriodicalId\":13213,\"journal\":{\"name\":\"IEEE Transactions on Geoscience and Remote Sensing\",\"volume\":\"63 \",\"pages\":\"1-15\"},\"PeriodicalIF\":8.6000,\"publicationDate\":\"2024-12-13\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Transactions on Geoscience and Remote Sensing\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10798455/\",\"RegionNum\":1,\"RegionCategory\":\"地球科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Geoscience and Remote Sensing","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10798455/","RegionNum":1,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0

摘要

近年来,通过少拍学习(FSL)进行高光谱图像(HSI)分类取得了显著进展。领域自适应与FSL相结合,可以有效地利用具有丰富标记数据的源领域(SD)的可转移知识,从而在具有稀缺标记的目标领域(TD)中出色地完成分类任务。然而,大多数现有方法通常使用传统的卷积神经网络(cnn)来提取局部空间信息来表征和挖掘特征和分布信息,而忽略了特征类之间的底层拓扑关系。因此,我们提出了一种利用图信息聚合的拓扑图感知跨域FSL (TGP-CFSL)框架。具体而言,为了构建目标的扩展拓扑关系,我们设计了一个基于拓扑图的多尺度融合(TGMF)特征提取模块,该模块善于充分挖掘目标的拓扑空间邻域信息。同时,设计了双图信息感知(dual-graph information perception, DGIP)模块,能够从特征表示和域间分布相似度两个方面对域内拓扑关系进行表征和聚合,提取高阶域分布信息,实现域对齐。在三个公共HSI数据集上的实验结果表明,该方法优于现有方法。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Topological Information Aggregation Network for Few-Shot Cross-Domain Hyperspectral Image Classification
In recent advancements, hyperspectral image (HSI) classification through few-shot learning (FSL) has significantly progressed. Domain adaptation, integrated with FSL, effectively utilizes transferable knowledge from a source domain (SD) with abundant labeled data to excel in classification tasks within a target domain (TD) with scarce labels. However, most existing methods usually use traditional convolutional neural networks (CNNs) to extract local spatial information to characterize and mine feature and distribution information while ignoring the underlying topological relationships among feature classes. Therefore, we propose a topology graph perception cross-domain FSL (TGP-CFSL) framework that leverages graph information aggregation. Specifically, to construct the extended topological relationships of the target, we have designed a topological graph-based multiscale fusion (TGMF) feature extraction module, which is adept at fully mining the topological spatial neighborhood information of the target. Meanwhile, a dual-graph information perception (DGIP) module is designed, which is able to characterize and aggregate intradomain topological relationships in terms of both feature representations and interdomain distribution similarities and to extract higher order domain distribution information for realizing domain alignment. Experimental results on three public HSI datasets demonstrate that the proposed method outperforms existing methods.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
IEEE Transactions on Geoscience and Remote Sensing
IEEE Transactions on Geoscience and Remote Sensing 工程技术-地球化学与地球物理
CiteScore
11.50
自引率
28.00%
发文量
1912
审稿时长
4.0 months
期刊介绍: IEEE Transactions on Geoscience and Remote Sensing (TGRS) is a monthly publication that focuses on the theory, concepts, and techniques of science and engineering as applied to sensing the land, oceans, atmosphere, and space; and the processing, interpretation, and dissemination of this information.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信