{"title":"TSMGA: Temporal-Spatial Multiscale Graph Attention Network for Remote Sensing Change Detection","authors":"Xiaoyang Zhang;Genji Yuan;Zhen Hua;Jinjiang Li","doi":"10.1109/JSTARS.2025.3526785","DOIUrl":null,"url":null,"abstract":"In the field of remote sensing change detection, accurately capturing temporal change information and efficiently integrating multilevel information is a major challenge. In order to extend the sensory domain and optimize the information fusion, the model is able to capture temporal-spatial change features more accurately and improve the accuracy of change detection. In this article, we propose a temporal-spatial multiscale graph attention network (TSMGA), specifically, TSMGA employs a pair of pretrained ResNet18 for effective multiscale feature extraction, and in order to enhance the disparity information of the bitemporal images, we also design the temporal fusion block to emphasize the changed areas. The spatial and channel features of multiscale disparity features are enhanced by multiscale spatial-channel aggregation module. To enable more robust and efficient exploration of more global contextual information, we are inspired to introduce shortest path graph attention, which allows for a more informative and complete exploration of the global context, and furthermore allows for more efficient gathering information from far-off neighbors to the central node. In order to ensure comprehensive utilization of local and global features and to significantly improve the clarity and detail retention of the output image, global context residual fusion module (GCRFM) is designed, GCRFM efficiently utilizes the complementary information of the feature maps for fusing and recovering spatial details and variation information. We validate the effectiveness and advancement of TSMGA on three classical datasets (LEVIR-CD, WHU-CD, GZ-CD), and the experimental results show that TSMGA achieves the state-of-the-art performance level.","PeriodicalId":13116,"journal":{"name":"IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing","volume":"18 ","pages":"3696-3712"},"PeriodicalIF":4.7000,"publicationDate":"2025-01-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10829977","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10829977/","RegionNum":2,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0
Abstract
In the field of remote sensing change detection, accurately capturing temporal change information and efficiently integrating multilevel information is a major challenge. In order to extend the sensory domain and optimize the information fusion, the model is able to capture temporal-spatial change features more accurately and improve the accuracy of change detection. In this article, we propose a temporal-spatial multiscale graph attention network (TSMGA), specifically, TSMGA employs a pair of pretrained ResNet18 for effective multiscale feature extraction, and in order to enhance the disparity information of the bitemporal images, we also design the temporal fusion block to emphasize the changed areas. The spatial and channel features of multiscale disparity features are enhanced by multiscale spatial-channel aggregation module. To enable more robust and efficient exploration of more global contextual information, we are inspired to introduce shortest path graph attention, which allows for a more informative and complete exploration of the global context, and furthermore allows for more efficient gathering information from far-off neighbors to the central node. In order to ensure comprehensive utilization of local and global features and to significantly improve the clarity and detail retention of the output image, global context residual fusion module (GCRFM) is designed, GCRFM efficiently utilizes the complementary information of the feature maps for fusing and recovering spatial details and variation information. We validate the effectiveness and advancement of TSMGA on three classical datasets (LEVIR-CD, WHU-CD, GZ-CD), and the experimental results show that TSMGA achieves the state-of-the-art performance level.
期刊介绍:
The IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing addresses the growing field of applications in Earth observations and remote sensing, and also provides a venue for the rapidly expanding special issues that are being sponsored by the IEEE Geosciences and Remote Sensing Society. The journal draws upon the experience of the highly successful “IEEE Transactions on Geoscience and Remote Sensing” and provide a complementary medium for the wide range of topics in applied earth observations. The ‘Applications’ areas encompasses the societal benefit areas of the Global Earth Observations Systems of Systems (GEOSS) program. Through deliberations over two years, ministers from 50 countries agreed to identify nine areas where Earth observation could positively impact the quality of life and health of their respective countries. Some of these are areas not traditionally addressed in the IEEE context. These include biodiversity, health and climate. Yet it is the skill sets of IEEE members, in areas such as observations, communications, computers, signal processing, standards and ocean engineering, that form the technical underpinnings of GEOSS. Thus, the Journal attracts a broad range of interests that serves both present members in new ways and expands the IEEE visibility into new areas.