STWANet: Spatio-Temporal Wavelet Attention Aggregation Network for Remote Sensing Change Detection

IF 4.7 2区 地球科学 Q1 ENGINEERING, ELECTRICAL & ELECTRONIC
Xiaoyang Zhang;Kaihui Dong;Dapeng Cheng;Zhen Hua;Jinjiang Li
{"title":"STWANet: Spatio-Temporal Wavelet Attention Aggregation Network for Remote Sensing Change Detection","authors":"Xiaoyang Zhang;Kaihui Dong;Dapeng Cheng;Zhen Hua;Jinjiang Li","doi":"10.1109/JSTARS.2025.3551093","DOIUrl":null,"url":null,"abstract":"Existing change detection techniques exhibit significant deficiencies in the recognition of building edges and detailed textures, making it challenging to accurately distinguish building boundaries from the background. Consequently, these methods struggle to precisely capture complex building contours and subtle texture variations. To address this problem, a spatio-temporal wavelet attention aggregation network (STWANet) is proposed in this article. This network uses a pretrained Resnet18 to extract multiscale features to obtain features with sufficient spatial details and semantic information. We introduce the spatio-temporal differential self-attention module to extract the spatio-temporal difference information between two multiscale temporal features, and the introduction of the self-Attention mechanism is able to focus on the regions with the most significant changes in the multiscale feature maps. In order to extract the changes of detailed features such as building edges, we introduce the wavelet feature enhancement module (WFEM) to enhance the representation of the frequency domain feature information of the changing features, especially the enhancement of high-frequency detail information (e.g., building edges). In order to make up for the shortcomings of WFEM in capturing specific details and global spatial features, we also introduce the dual attention aggregation module to extract the feature information of the changing areas in parallel with WFEM, which can process the spatial context information in a more detailed way, and can better retain the detailed features, especially the complex spatial structure and shape information. spatial structure and shape information. We verify the effectiveness and advancement of STWANet on three classical datasets (LEVIR-CD, WHU-CD, GZ-CD), and the experimental results show that STWANet reaches the state-of-the-art performance level.","PeriodicalId":13116,"journal":{"name":"IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing","volume":"18 ","pages":"8813-8830"},"PeriodicalIF":4.7000,"publicationDate":"2025-03-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10924762","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10924762/","RegionNum":2,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0

Abstract

Existing change detection techniques exhibit significant deficiencies in the recognition of building edges and detailed textures, making it challenging to accurately distinguish building boundaries from the background. Consequently, these methods struggle to precisely capture complex building contours and subtle texture variations. To address this problem, a spatio-temporal wavelet attention aggregation network (STWANet) is proposed in this article. This network uses a pretrained Resnet18 to extract multiscale features to obtain features with sufficient spatial details and semantic information. We introduce the spatio-temporal differential self-attention module to extract the spatio-temporal difference information between two multiscale temporal features, and the introduction of the self-Attention mechanism is able to focus on the regions with the most significant changes in the multiscale feature maps. In order to extract the changes of detailed features such as building edges, we introduce the wavelet feature enhancement module (WFEM) to enhance the representation of the frequency domain feature information of the changing features, especially the enhancement of high-frequency detail information (e.g., building edges). In order to make up for the shortcomings of WFEM in capturing specific details and global spatial features, we also introduce the dual attention aggregation module to extract the feature information of the changing areas in parallel with WFEM, which can process the spatial context information in a more detailed way, and can better retain the detailed features, especially the complex spatial structure and shape information. spatial structure and shape information. We verify the effectiveness and advancement of STWANet on three classical datasets (LEVIR-CD, WHU-CD, GZ-CD), and the experimental results show that STWANet reaches the state-of-the-art performance level.
用于遥感变化检测的时空小波关注聚合网络
现有的变化检测技术在建筑物边缘和细节纹理的识别方面存在明显不足,难以准确区分建筑物边界和背景。因此,这些方法很难精确捕捉复杂的建筑轮廓和微妙的纹理变化。为了解决这一问题,本文提出了一种时空小波注意力聚合网络。该网络使用预训练的Resnet18提取多尺度特征,以获得具有足够空间细节和语义信息的特征。引入时空差异自注意模块提取两个多尺度时间特征之间的时空差异信息,引入自注意机制能够聚焦多尺度特征图中变化最显著的区域。为了提取建筑边缘等细节特征的变化,我们引入了小波特征增强模块(WFEM)来增强变化特征的频域特征信息的表示,特别是对建筑边缘等高频细节信息的增强。为了弥补WFEM在捕获特定细节和全局空间特征方面的不足,我们还引入了双注意聚合模块,与WFEM并行提取变化区域的特征信息,可以更细致地处理空间上下文信息,更好地保留细节特征,特别是复杂的空间结构和形状信息。空间结构和形状信息。我们在三个经典数据集(LEVIR-CD、WHU-CD、GZ-CD)上验证了STWANet的有效性和先进性,实验结果表明,STWANet达到了最先进的性能水平。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
CiteScore
9.30
自引率
10.90%
发文量
563
审稿时长
4.7 months
期刊介绍: The IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing addresses the growing field of applications in Earth observations and remote sensing, and also provides a venue for the rapidly expanding special issues that are being sponsored by the IEEE Geosciences and Remote Sensing Society. The journal draws upon the experience of the highly successful “IEEE Transactions on Geoscience and Remote Sensing” and provide a complementary medium for the wide range of topics in applied earth observations. The ‘Applications’ areas encompasses the societal benefit areas of the Global Earth Observations Systems of Systems (GEOSS) program. Through deliberations over two years, ministers from 50 countries agreed to identify nine areas where Earth observation could positively impact the quality of life and health of their respective countries. Some of these are areas not traditionally addressed in the IEEE context. These include biodiversity, health and climate. Yet it is the skill sets of IEEE members, in areas such as observations, communications, computers, signal processing, standards and ocean engineering, that form the technical underpinnings of GEOSS. Thus, the Journal attracts a broad range of interests that serves both present members in new ways and expands the IEEE visibility into new areas.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信