{"title":"CD-STMamba: Toward Remote Sensing Image Change Detection With Spatio-Temporal Interaction Mamba Model","authors":"Shanwei Liu;Shuaipeng Wang;Wei Zhang;Tao Zhang;Mingming Xu;Muhammad Yasir;Shiqing Wei","doi":"10.1109/JSTARS.2025.3559085","DOIUrl":null,"url":null,"abstract":"Change detection (CD) is a critical Earth observation task. Convolutional neural network (CNN) and Transformer have demonstrated their superior performance in CD tasks. However, the limitations of the limited receptive field of CNN and the high-computational complexity of Transformer remain. Recently, the Mamba architecture, based on state-space models, has demonstrated strong global receptive field capabilities and implements linear time complexity in computational processes. While some researchers have incorporated it into CD tasks, most have neglected the effective application of the Mamba selective scanning algorithm for modeling bitemporal image dependencies, resulting in suboptimal feature learning from bitemporal images. In this article, we propose a CD Mamba model (CD-STMamba), which can efficiently encode and decode bitemporal images interactively from multiple dimensions, thus enabling more accurate CD. Specifically, we propose a spatio-temporal interaction module (STIM), which can interact with bitemporal image features in multiple dimensions and fit with the Mamba architecture, allowing it to fully learn the global contextual information of the bitemporal input image. We also introduce a decoding block called the CD block, which can be fully decoded to learn multiple spatio-temporal relationships based on the characteristics of STIM. This block employs multiple change visual state space blocks internally to decode different spatio-temporal interactions and utilizes the change attention module to capture change features comprehensively for more accurate CD. The proposed CD-STMamba achieved state-of-the-art intersection over union (IoU) on three datasets, Wuhan University Building Change Detection Dataset (91.29% ), Sun Yat-Sen University Change Detection (73.45% ), and Change Detection Dataset (95.56% ).","PeriodicalId":13116,"journal":{"name":"IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing","volume":"18 ","pages":"10471-10485"},"PeriodicalIF":4.7000,"publicationDate":"2025-04-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10959091","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10959091/","RegionNum":2,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0
Abstract
Change detection (CD) is a critical Earth observation task. Convolutional neural network (CNN) and Transformer have demonstrated their superior performance in CD tasks. However, the limitations of the limited receptive field of CNN and the high-computational complexity of Transformer remain. Recently, the Mamba architecture, based on state-space models, has demonstrated strong global receptive field capabilities and implements linear time complexity in computational processes. While some researchers have incorporated it into CD tasks, most have neglected the effective application of the Mamba selective scanning algorithm for modeling bitemporal image dependencies, resulting in suboptimal feature learning from bitemporal images. In this article, we propose a CD Mamba model (CD-STMamba), which can efficiently encode and decode bitemporal images interactively from multiple dimensions, thus enabling more accurate CD. Specifically, we propose a spatio-temporal interaction module (STIM), which can interact with bitemporal image features in multiple dimensions and fit with the Mamba architecture, allowing it to fully learn the global contextual information of the bitemporal input image. We also introduce a decoding block called the CD block, which can be fully decoded to learn multiple spatio-temporal relationships based on the characteristics of STIM. This block employs multiple change visual state space blocks internally to decode different spatio-temporal interactions and utilizes the change attention module to capture change features comprehensively for more accurate CD. The proposed CD-STMamba achieved state-of-the-art intersection over union (IoU) on three datasets, Wuhan University Building Change Detection Dataset (91.29% ), Sun Yat-Sen University Change Detection (73.45% ), and Change Detection Dataset (95.56% ).
期刊介绍:
The IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing addresses the growing field of applications in Earth observations and remote sensing, and also provides a venue for the rapidly expanding special issues that are being sponsored by the IEEE Geosciences and Remote Sensing Society. The journal draws upon the experience of the highly successful “IEEE Transactions on Geoscience and Remote Sensing” and provide a complementary medium for the wide range of topics in applied earth observations. The ‘Applications’ areas encompasses the societal benefit areas of the Global Earth Observations Systems of Systems (GEOSS) program. Through deliberations over two years, ministers from 50 countries agreed to identify nine areas where Earth observation could positively impact the quality of life and health of their respective countries. Some of these are areas not traditionally addressed in the IEEE context. These include biodiversity, health and climate. Yet it is the skill sets of IEEE members, in areas such as observations, communications, computers, signal processing, standards and ocean engineering, that form the technical underpinnings of GEOSS. Thus, the Journal attracts a broad range of interests that serves both present members in new ways and expands the IEEE visibility into new areas.