GASSM: Global attention and state space model based end-to-end hyperspectral change detection

IF 3.7 3区 计算机科学 Q2 AUTOMATION & CONTROL SYSTEMS
Yinhe Li , Jinchang Ren , Hang Fu , Genyun Sun
{"title":"GASSM: Global attention and state space model based end-to-end hyperspectral change detection","authors":"Yinhe Li ,&nbsp;Jinchang Ren ,&nbsp;Hang Fu ,&nbsp;Genyun Sun","doi":"10.1016/j.jfranklin.2024.107424","DOIUrl":null,"url":null,"abstract":"<div><div>As an essential task to identify anomalies and monitor changes over time, change detection enables detailed earth observation in remote sensing. By combining both the rich spectral information and spatial image, hyperspectral images (HSI) have offered unique and significant advantages for change detection. However, traditional hyperspectral change detection (HCD) methods, predominantly based on convolutional neural networks (CNNs), struggle with capturing long-range spatial-spectral dependencies due to their limited receptive fields. Whilst transformers based HCD methods are capable of modeling such dependencies, they often suffer from quadratic growth of the computational complexity. Considering the unique capabilities in offering robust long-range sequence modeling yet with linear computational complexity, the emerging Mamba model has provided a promising alternative. Accordingly, we propose a novel approach that integrates the global attention (GA) and state space model (SSM) to form our GASSM network for HCD. The SSM based Mamba block has been introduced to model global spatial-spectral features, followed by a fully connected layer to perform binary classification of detected changes. To the best of our knowledge, this is the first to explore using the Mamba and SSM for HCD. Comprehensive experiments on two publicly available datasets, compared with eight state-of-the-art benchmarks, have validated the efficacy and efficiency of our GASSM model, demonstrating its superiority of high accuracy and stability in HCD.</div></div>","PeriodicalId":17283,"journal":{"name":"Journal of The Franklin Institute-engineering and Applied Mathematics","volume":"362 3","pages":"Article 107424"},"PeriodicalIF":3.7000,"publicationDate":"2025-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of The Franklin Institute-engineering and Applied Mathematics","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0016003224008457","RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}
引用次数: 0

Abstract

As an essential task to identify anomalies and monitor changes over time, change detection enables detailed earth observation in remote sensing. By combining both the rich spectral information and spatial image, hyperspectral images (HSI) have offered unique and significant advantages for change detection. However, traditional hyperspectral change detection (HCD) methods, predominantly based on convolutional neural networks (CNNs), struggle with capturing long-range spatial-spectral dependencies due to their limited receptive fields. Whilst transformers based HCD methods are capable of modeling such dependencies, they often suffer from quadratic growth of the computational complexity. Considering the unique capabilities in offering robust long-range sequence modeling yet with linear computational complexity, the emerging Mamba model has provided a promising alternative. Accordingly, we propose a novel approach that integrates the global attention (GA) and state space model (SSM) to form our GASSM network for HCD. The SSM based Mamba block has been introduced to model global spatial-spectral features, followed by a fully connected layer to perform binary classification of detected changes. To the best of our knowledge, this is the first to explore using the Mamba and SSM for HCD. Comprehensive experiments on two publicly available datasets, compared with eight state-of-the-art benchmarks, have validated the efficacy and efficiency of our GASSM model, demonstrating its superiority of high accuracy and stability in HCD.
求助全文
约1分钟内获得全文 求助全文
来源期刊
CiteScore
7.30
自引率
14.60%
发文量
586
审稿时长
6.9 months
期刊介绍: The Journal of The Franklin Institute has an established reputation for publishing high-quality papers in the field of engineering and applied mathematics. Its current focus is on control systems, complex networks and dynamic systems, signal processing and communications and their applications. All submitted papers are peer-reviewed. The Journal will publish original research papers and research review papers of substance. Papers and special focus issues are judged upon possible lasting value, which has been and continues to be the strength of the Journal of The Franklin Institute.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信