{"title":"GASSM: Global attention and state space model based end-to-end hyperspectral change detection","authors":"Yinhe Li , Jinchang Ren , Hang Fu , Genyun Sun","doi":"10.1016/j.jfranklin.2024.107424","DOIUrl":null,"url":null,"abstract":"<div><div>As an essential task to identify anomalies and monitor changes over time, change detection enables detailed earth observation in remote sensing. By combining both the rich spectral information and spatial image, hyperspectral images (HSI) have offered unique and significant advantages for change detection. However, traditional hyperspectral change detection (HCD) methods, predominantly based on convolutional neural networks (CNNs), struggle with capturing long-range spatial-spectral dependencies due to their limited receptive fields. Whilst transformers based HCD methods are capable of modeling such dependencies, they often suffer from quadratic growth of the computational complexity. Considering the unique capabilities in offering robust long-range sequence modeling yet with linear computational complexity, the emerging Mamba model has provided a promising alternative. Accordingly, we propose a novel approach that integrates the global attention (GA) and state space model (SSM) to form our GASSM network for HCD. The SSM based Mamba block has been introduced to model global spatial-spectral features, followed by a fully connected layer to perform binary classification of detected changes. To the best of our knowledge, this is the first to explore using the Mamba and SSM for HCD. Comprehensive experiments on two publicly available datasets, compared with eight state-of-the-art benchmarks, have validated the efficacy and efficiency of our GASSM model, demonstrating its superiority of high accuracy and stability in HCD.</div></div>","PeriodicalId":17283,"journal":{"name":"Journal of The Franklin Institute-engineering and Applied Mathematics","volume":"362 3","pages":"Article 107424"},"PeriodicalIF":3.7000,"publicationDate":"2025-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of The Franklin Institute-engineering and Applied Mathematics","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0016003224008457","RegionNum":3,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"AUTOMATION & CONTROL SYSTEMS","Score":null,"Total":0}
引用次数: 0
Abstract
As an essential task to identify anomalies and monitor changes over time, change detection enables detailed earth observation in remote sensing. By combining both the rich spectral information and spatial image, hyperspectral images (HSI) have offered unique and significant advantages for change detection. However, traditional hyperspectral change detection (HCD) methods, predominantly based on convolutional neural networks (CNNs), struggle with capturing long-range spatial-spectral dependencies due to their limited receptive fields. Whilst transformers based HCD methods are capable of modeling such dependencies, they often suffer from quadratic growth of the computational complexity. Considering the unique capabilities in offering robust long-range sequence modeling yet with linear computational complexity, the emerging Mamba model has provided a promising alternative. Accordingly, we propose a novel approach that integrates the global attention (GA) and state space model (SSM) to form our GASSM network for HCD. The SSM based Mamba block has been introduced to model global spatial-spectral features, followed by a fully connected layer to perform binary classification of detected changes. To the best of our knowledge, this is the first to explore using the Mamba and SSM for HCD. Comprehensive experiments on two publicly available datasets, compared with eight state-of-the-art benchmarks, have validated the efficacy and efficiency of our GASSM model, demonstrating its superiority of high accuracy and stability in HCD.
期刊介绍:
The Journal of The Franklin Institute has an established reputation for publishing high-quality papers in the field of engineering and applied mathematics. Its current focus is on control systems, complex networks and dynamic systems, signal processing and communications and their applications. All submitted papers are peer-reviewed. The Journal will publish original research papers and research review papers of substance. Papers and special focus issues are judged upon possible lasting value, which has been and continues to be the strength of the Journal of The Franklin Institute.