PMGMCN: A Parallel Dynamic Multihop Graph and Composite Multiscale Convolution Network for Hyperspectral Sparse Unmixing

IF 4.7 2区 地球科学 Q1 ENGINEERING, ELECTRICAL & ELECTRONIC
Kewen Qu;Huiyang Wang;Mingming Ding;Xiaojuan Luo;Fangzhou Luo
{"title":"PMGMCN: A Parallel Dynamic Multihop Graph and Composite Multiscale Convolution Network for Hyperspectral Sparse Unmixing","authors":"Kewen Qu;Huiyang Wang;Mingming Ding;Xiaojuan Luo;Fangzhou Luo","doi":"10.1109/JSTARS.2025.3549515","DOIUrl":null,"url":null,"abstract":"In recent years, sparse unmixing (SU) has garnered significant attention in hyperspectral images (HSI) because it does not require endmember estimation, relying instead on prior spectral libraries to represent observed HSI data, which avoids the influence of endmember extraction on unmixing. However, SU methods based on representation models have limited capability in learning nonlinear features, which results in poor abundances estimation performance in complex environments. Recently, inspired by deep learning, SU models based on neural networks have been proposed to more effectively extract and handle nonlinear features. Nevertheless, the convolution strategies employed in existing SU network models lead to insufficient attention to long-range pixel dependencies, consequently resulting in restricted utilization of spatial priors. In view of the abovementioned shortcomings, this article proposes a parallel dynamic multihop graph and composite multiscale convolution network for SU, referred to as PMGMCN. The network combines the advantages of convolutional neural network (CNN) and graph convolutional network (GCN), achieving a complementary and enhanced integration of their characteristics. Specifically, the network captures long-range spatial features through the designed dynamic multihop graph interaction attention module, which is based on GCN, while the composite multiscale convolution spatial–spectral attention module, which is based on CNN, is designed to extract multiscale spatial–spectral information within local regions. In addition, this article introduces an adaptive weighted total variation loss function based on Sobel edge operator and Gaussian function to encourage piecewise smoothness in abundances maps while preserving edge information. Extensive experiments on synthetic and real datasets demonstrate the effectiveness and superiority of the proposed method compared with the state-of-the-art methods.","PeriodicalId":13116,"journal":{"name":"IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing","volume":"18 ","pages":"8438-8456"},"PeriodicalIF":4.7000,"publicationDate":"2025-03-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10937499","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10937499/","RegionNum":2,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0

Abstract

In recent years, sparse unmixing (SU) has garnered significant attention in hyperspectral images (HSI) because it does not require endmember estimation, relying instead on prior spectral libraries to represent observed HSI data, which avoids the influence of endmember extraction on unmixing. However, SU methods based on representation models have limited capability in learning nonlinear features, which results in poor abundances estimation performance in complex environments. Recently, inspired by deep learning, SU models based on neural networks have been proposed to more effectively extract and handle nonlinear features. Nevertheless, the convolution strategies employed in existing SU network models lead to insufficient attention to long-range pixel dependencies, consequently resulting in restricted utilization of spatial priors. In view of the abovementioned shortcomings, this article proposes a parallel dynamic multihop graph and composite multiscale convolution network for SU, referred to as PMGMCN. The network combines the advantages of convolutional neural network (CNN) and graph convolutional network (GCN), achieving a complementary and enhanced integration of their characteristics. Specifically, the network captures long-range spatial features through the designed dynamic multihop graph interaction attention module, which is based on GCN, while the composite multiscale convolution spatial–spectral attention module, which is based on CNN, is designed to extract multiscale spatial–spectral information within local regions. In addition, this article introduces an adaptive weighted total variation loss function based on Sobel edge operator and Gaussian function to encourage piecewise smoothness in abundances maps while preserving edge information. Extensive experiments on synthetic and real datasets demonstrate the effectiveness and superiority of the proposed method compared with the state-of-the-art methods.
基于并行动态多跳图和复合多尺度卷积网络的高光谱稀疏解混
近年来,稀疏解混(SU)在高光谱图像(HSI)中引起了广泛的关注,因为它不需要端元估计,而是依靠先前的光谱库来表示观测到的HSI数据,从而避免了端元提取对解混的影响。然而,基于表示模型的SU方法在学习非线性特征方面能力有限,导致其在复杂环境下的丰度估计性能较差。近年来,受深度学习的启发,人们提出了基于神经网络的SU模型,以更有效地提取和处理非线性特征。然而,现有SU网络模型中使用的卷积策略导致对远程像素依赖关系的关注不足,从而导致空间先验的利用受到限制。针对上述不足,本文提出了一种面向SU的并行动态多跳图复合多尺度卷积网络,称为PMGMCN。该网络结合了卷积神经网络(CNN)和图卷积网络(GCN)的优点,实现了两者特性的互补和增强融合。其中,网络通过设计基于GCN的动态多跳图交互关注模块捕获远程空间特征,基于CNN的复合多尺度卷积空间光谱关注模块提取局部区域内的多尺度空间光谱信息。此外,本文还引入了一种基于Sobel边缘算子和高斯函数的自适应加权总变差损失函数,以在保持边缘信息的同时促进丰度图的分段平滑。在合成数据集和真实数据集上进行的大量实验证明了该方法的有效性和优越性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
CiteScore
9.30
自引率
10.90%
发文量
563
审稿时长
4.7 months
期刊介绍: The IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing addresses the growing field of applications in Earth observations and remote sensing, and also provides a venue for the rapidly expanding special issues that are being sponsored by the IEEE Geosciences and Remote Sensing Society. The journal draws upon the experience of the highly successful “IEEE Transactions on Geoscience and Remote Sensing” and provide a complementary medium for the wide range of topics in applied earth observations. The ‘Applications’ areas encompasses the societal benefit areas of the Global Earth Observations Systems of Systems (GEOSS) program. Through deliberations over two years, ministers from 50 countries agreed to identify nine areas where Earth observation could positively impact the quality of life and health of their respective countries. Some of these are areas not traditionally addressed in the IEEE context. These include biodiversity, health and climate. Yet it is the skill sets of IEEE members, in areas such as observations, communications, computers, signal processing, standards and ocean engineering, that form the technical underpinnings of GEOSS. Thus, the Journal attracts a broad range of interests that serves both present members in new ways and expands the IEEE visibility into new areas.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信