Wenkai Yan;Yikun Liu;Mingsong Li;Ruifan Zhang;Gongping Yang
{"title":"Laplacian Pyramid Network With Hybrid Encoder and Edge Guidance for Remote Sensing Change Detection","authors":"Wenkai Yan;Yikun Liu;Mingsong Li;Ruifan Zhang;Gongping Yang","doi":"10.1109/JSTARS.2024.3491762","DOIUrl":null,"url":null,"abstract":"Remote sensing change detection (CD) is a crucial task for observing and analyzing dynamic land cover alterations. Many CD methods based on deep learning demonstrate strong performance, but their effectiveness is influenced by the choice of encoder and the challenge of accurately delineating the edges of change regions. In this article, we propose a Laplacian pyramid network with hybrid encoder and edge guidance (HE-LPNet) to solve these issues. Specifically, the hybrid encoder combines the advantages of convolutional neural networks and transformer, resulting in extracted features that are more fine-grained. Meanwhile, the hybrid encoder incorporates the vision foundation models, leading to enhanced generalization of the overall model. In addition to feature extraction, the image is processed to generate a Laplacian pyramid, which is then fused with the features extracted by the hybrid encoder to enhance the salient features at the pixel-level. In the decoder stage, weighted guided attention is designed to selectively apply channel and spatial attention to the fused features, improving the network's ability to discriminate change regions. Furthermore, we present an edge-guided loss to capture edge information in change regions. To validate the effectiveness of the proposed HE-LPNet, extensive experiments are conducted on three high-resolution remote sensing CD datasets. The experimental results demonstrate that our method surpasses other state-of-the-art CD methods.","PeriodicalId":13116,"journal":{"name":"IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing","volume":"18 ","pages":"160-175"},"PeriodicalIF":4.7000,"publicationDate":"2024-11-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10742519","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10742519/","RegionNum":2,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0
Abstract
Remote sensing change detection (CD) is a crucial task for observing and analyzing dynamic land cover alterations. Many CD methods based on deep learning demonstrate strong performance, but their effectiveness is influenced by the choice of encoder and the challenge of accurately delineating the edges of change regions. In this article, we propose a Laplacian pyramid network with hybrid encoder and edge guidance (HE-LPNet) to solve these issues. Specifically, the hybrid encoder combines the advantages of convolutional neural networks and transformer, resulting in extracted features that are more fine-grained. Meanwhile, the hybrid encoder incorporates the vision foundation models, leading to enhanced generalization of the overall model. In addition to feature extraction, the image is processed to generate a Laplacian pyramid, which is then fused with the features extracted by the hybrid encoder to enhance the salient features at the pixel-level. In the decoder stage, weighted guided attention is designed to selectively apply channel and spatial attention to the fused features, improving the network's ability to discriminate change regions. Furthermore, we present an edge-guided loss to capture edge information in change regions. To validate the effectiveness of the proposed HE-LPNet, extensive experiments are conducted on three high-resolution remote sensing CD datasets. The experimental results demonstrate that our method surpasses other state-of-the-art CD methods.
遥感变化检测(CD)是观测和分析土地覆被动态变化的一项重要任务。许多基于深度学习的变化检测方法都表现出很强的性能,但其有效性受到编码器选择和准确划分变化区域边缘的挑战的影响。在本文中,我们提出了一种具有混合编码器和边缘引导功能的拉普拉斯金字塔网络(HE-LPNet)来解决这些问题。具体来说,混合编码器结合了卷积神经网络和变换器的优势,从而提取出更精细的特征。同时,混合编码器结合了视觉基础模型,从而增强了整体模型的泛化能力。除了特征提取外,图像经过处理后还会生成拉普拉斯金字塔,然后与混合编码器提取的特征融合,以增强像素级的突出特征。在解码器阶段,我们设计了加权引导注意力,对融合后的特征选择性地应用通道和空间注意力,从而提高了网络分辨变化区域的能力。此外,我们还提出了一种边缘引导损失,以捕捉变化区域的边缘信息。为了验证所提出的 HE-LPNet 的有效性,我们在三个高分辨率遥感 CD 数据集上进行了大量实验。实验结果表明,我们的方法超越了其他最先进的 CD 方法。
期刊介绍:
The IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing addresses the growing field of applications in Earth observations and remote sensing, and also provides a venue for the rapidly expanding special issues that are being sponsored by the IEEE Geosciences and Remote Sensing Society. The journal draws upon the experience of the highly successful “IEEE Transactions on Geoscience and Remote Sensing” and provide a complementary medium for the wide range of topics in applied earth observations. The ‘Applications’ areas encompasses the societal benefit areas of the Global Earth Observations Systems of Systems (GEOSS) program. Through deliberations over two years, ministers from 50 countries agreed to identify nine areas where Earth observation could positively impact the quality of life and health of their respective countries. Some of these are areas not traditionally addressed in the IEEE context. These include biodiversity, health and climate. Yet it is the skill sets of IEEE members, in areas such as observations, communications, computers, signal processing, standards and ocean engineering, that form the technical underpinnings of GEOSS. Thus, the Journal attracts a broad range of interests that serves both present members in new ways and expands the IEEE visibility into new areas.