GLVMamba: A Global–Local Visual State-Space Model for Remote Sensing Image Segmentation

Abstract

Semantic segmentation of remote sensing images (RSIs) has significant advances with the adoption of deep neural networks, taking the advantages of convolutional neural networks (CNNs) in local feature extraction with transformers in global information modeling. However, due to the limitations of CNNs in long-range modeling capabilities and the computational complexity constraints of transformers, remote sensing (RS) semantic segmentation still faces issues such as serious holes, rough edge segmentation, and false and even missed detections caused by the light, shadow, and other factors. To address these issues, we propose a visual state-space (VSS) model called GLVMamba, which uses CNNs as the encoder and the proposed global-local VSS (GLVSS) block as the core decoder. Specifically, the GLVSS block introduces locality forward feedback and shift window mechanism to addresses the deficiency of insufficient modeling of neighboring pixel dependencies of Mamba, which enhances the integration of global and local context during feature reconstruction, boosts object perception capabilities of the model, and effectively refines edge contours. In addition, the scale-aware pyramid pooling (SCPP) module is proposed to fully merge the features from various scales and adaptively fuse and extract the distinguishing features to mitigate the holes and false detections. The GLVMamba effectively captures global-local semantic information and multiscale feature through the GLVSS block and the SCPP module, achieving efficient and accurate RS semantic segmentation. Extensive experiments on two widely used datasets have effectively demonstrated the superiority of our proposed method over the other state-of-the-art methods. The code will be available at https://github.com/Tokisakiwlp/GLVMamba