Xiaoyang Zhang;Kaihui Dong;Dapeng Cheng;Zhen Hua;Jinjiang Li
{"title":"STWANet: Spatio-Temporal Wavelet Attention Aggregation Network for Remote Sensing Change Detection","authors":"Xiaoyang Zhang;Kaihui Dong;Dapeng Cheng;Zhen Hua;Jinjiang Li","doi":"10.1109/JSTARS.2025.3551093","DOIUrl":null,"url":null,"abstract":"Existing change detection techniques exhibit significant deficiencies in the recognition of building edges and detailed textures, making it challenging to accurately distinguish building boundaries from the background. Consequently, these methods struggle to precisely capture complex building contours and subtle texture variations. To address this problem, a spatio-temporal wavelet attention aggregation network (STWANet) is proposed in this article. This network uses a pretrained Resnet18 to extract multiscale features to obtain features with sufficient spatial details and semantic information. We introduce the spatio-temporal differential self-attention module to extract the spatio-temporal difference information between two multiscale temporal features, and the introduction of the self-Attention mechanism is able to focus on the regions with the most significant changes in the multiscale feature maps. In order to extract the changes of detailed features such as building edges, we introduce the wavelet feature enhancement module (WFEM) to enhance the representation of the frequency domain feature information of the changing features, especially the enhancement of high-frequency detail information (e.g., building edges). In order to make up for the shortcomings of WFEM in capturing specific details and global spatial features, we also introduce the dual attention aggregation module to extract the feature information of the changing areas in parallel with WFEM, which can process the spatial context information in a more detailed way, and can better retain the detailed features, especially the complex spatial structure and shape information. spatial structure and shape information. We verify the effectiveness and advancement of STWANet on three classical datasets (LEVIR-CD, WHU-CD, GZ-CD), and the experimental results show that STWANet reaches the state-of-the-art performance level.","PeriodicalId":13116,"journal":{"name":"IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing","volume":"18 ","pages":"8813-8830"},"PeriodicalIF":4.7000,"publicationDate":"2025-03-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10924762","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10924762/","RegionNum":2,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0
Abstract
Existing change detection techniques exhibit significant deficiencies in the recognition of building edges and detailed textures, making it challenging to accurately distinguish building boundaries from the background. Consequently, these methods struggle to precisely capture complex building contours and subtle texture variations. To address this problem, a spatio-temporal wavelet attention aggregation network (STWANet) is proposed in this article. This network uses a pretrained Resnet18 to extract multiscale features to obtain features with sufficient spatial details and semantic information. We introduce the spatio-temporal differential self-attention module to extract the spatio-temporal difference information between two multiscale temporal features, and the introduction of the self-Attention mechanism is able to focus on the regions with the most significant changes in the multiscale feature maps. In order to extract the changes of detailed features such as building edges, we introduce the wavelet feature enhancement module (WFEM) to enhance the representation of the frequency domain feature information of the changing features, especially the enhancement of high-frequency detail information (e.g., building edges). In order to make up for the shortcomings of WFEM in capturing specific details and global spatial features, we also introduce the dual attention aggregation module to extract the feature information of the changing areas in parallel with WFEM, which can process the spatial context information in a more detailed way, and can better retain the detailed features, especially the complex spatial structure and shape information. spatial structure and shape information. We verify the effectiveness and advancement of STWANet on three classical datasets (LEVIR-CD, WHU-CD, GZ-CD), and the experimental results show that STWANet reaches the state-of-the-art performance level.
期刊介绍:
The IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing addresses the growing field of applications in Earth observations and remote sensing, and also provides a venue for the rapidly expanding special issues that are being sponsored by the IEEE Geosciences and Remote Sensing Society. The journal draws upon the experience of the highly successful “IEEE Transactions on Geoscience and Remote Sensing” and provide a complementary medium for the wide range of topics in applied earth observations. The ‘Applications’ areas encompasses the societal benefit areas of the Global Earth Observations Systems of Systems (GEOSS) program. Through deliberations over two years, ministers from 50 countries agreed to identify nine areas where Earth observation could positively impact the quality of life and health of their respective countries. Some of these are areas not traditionally addressed in the IEEE context. These include biodiversity, health and climate. Yet it is the skill sets of IEEE members, in areas such as observations, communications, computers, signal processing, standards and ocean engineering, that form the technical underpinnings of GEOSS. Thus, the Journal attracts a broad range of interests that serves both present members in new ways and expands the IEEE visibility into new areas.