Laplacian Pyramid Network With Hybrid Encoder and Edge Guidance for Remote Sensing Change Detection

IF 4.7 2区 地球科学 Q1 ENGINEERING, ELECTRICAL & ELECTRONIC
Wenkai Yan;Yikun Liu;Mingsong Li;Ruifan Zhang;Gongping Yang
{"title":"Laplacian Pyramid Network With Hybrid Encoder and Edge Guidance for Remote Sensing Change Detection","authors":"Wenkai Yan;Yikun Liu;Mingsong Li;Ruifan Zhang;Gongping Yang","doi":"10.1109/JSTARS.2024.3491762","DOIUrl":null,"url":null,"abstract":"Remote sensing change detection (CD) is a crucial task for observing and analyzing dynamic land cover alterations. Many CD methods based on deep learning demonstrate strong performance, but their effectiveness is influenced by the choice of encoder and the challenge of accurately delineating the edges of change regions. In this article, we propose a Laplacian pyramid network with hybrid encoder and edge guidance (HE-LPNet) to solve these issues. Specifically, the hybrid encoder combines the advantages of convolutional neural networks and transformer, resulting in extracted features that are more fine-grained. Meanwhile, the hybrid encoder incorporates the vision foundation models, leading to enhanced generalization of the overall model. In addition to feature extraction, the image is processed to generate a Laplacian pyramid, which is then fused with the features extracted by the hybrid encoder to enhance the salient features at the pixel-level. In the decoder stage, weighted guided attention is designed to selectively apply channel and spatial attention to the fused features, improving the network's ability to discriminate change regions. Furthermore, we present an edge-guided loss to capture edge information in change regions. To validate the effectiveness of the proposed HE-LPNet, extensive experiments are conducted on three high-resolution remote sensing CD datasets. The experimental results demonstrate that our method surpasses other state-of-the-art CD methods.","PeriodicalId":13116,"journal":{"name":"IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing","volume":"18 ","pages":"160-175"},"PeriodicalIF":4.7000,"publicationDate":"2024-11-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10742519","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10742519/","RegionNum":2,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0

Abstract

Remote sensing change detection (CD) is a crucial task for observing and analyzing dynamic land cover alterations. Many CD methods based on deep learning demonstrate strong performance, but their effectiveness is influenced by the choice of encoder and the challenge of accurately delineating the edges of change regions. In this article, we propose a Laplacian pyramid network with hybrid encoder and edge guidance (HE-LPNet) to solve these issues. Specifically, the hybrid encoder combines the advantages of convolutional neural networks and transformer, resulting in extracted features that are more fine-grained. Meanwhile, the hybrid encoder incorporates the vision foundation models, leading to enhanced generalization of the overall model. In addition to feature extraction, the image is processed to generate a Laplacian pyramid, which is then fused with the features extracted by the hybrid encoder to enhance the salient features at the pixel-level. In the decoder stage, weighted guided attention is designed to selectively apply channel and spatial attention to the fused features, improving the network's ability to discriminate change regions. Furthermore, we present an edge-guided loss to capture edge information in change regions. To validate the effectiveness of the proposed HE-LPNet, extensive experiments are conducted on three high-resolution remote sensing CD datasets. The experimental results demonstrate that our method surpasses other state-of-the-art CD methods.
具有混合编码器和边缘引导功能的拉普拉奇金字塔网络用于遥感变化检测
遥感变化检测(CD)是观测和分析土地覆被动态变化的一项重要任务。许多基于深度学习的变化检测方法都表现出很强的性能,但其有效性受到编码器选择和准确划分变化区域边缘的挑战的影响。在本文中,我们提出了一种具有混合编码器和边缘引导功能的拉普拉斯金字塔网络(HE-LPNet)来解决这些问题。具体来说,混合编码器结合了卷积神经网络和变换器的优势,从而提取出更精细的特征。同时,混合编码器结合了视觉基础模型,从而增强了整体模型的泛化能力。除了特征提取外,图像经过处理后还会生成拉普拉斯金字塔,然后与混合编码器提取的特征融合,以增强像素级的突出特征。在解码器阶段,我们设计了加权引导注意力,对融合后的特征选择性地应用通道和空间注意力,从而提高了网络分辨变化区域的能力。此外,我们还提出了一种边缘引导损失,以捕捉变化区域的边缘信息。为了验证所提出的 HE-LPNet 的有效性,我们在三个高分辨率遥感 CD 数据集上进行了大量实验。实验结果表明,我们的方法超越了其他最先进的 CD 方法。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
CiteScore
9.30
自引率
10.90%
发文量
563
审稿时长
4.7 months
期刊介绍: The IEEE Journal of Selected Topics in Applied Earth Observations and Remote Sensing addresses the growing field of applications in Earth observations and remote sensing, and also provides a venue for the rapidly expanding special issues that are being sponsored by the IEEE Geosciences and Remote Sensing Society. The journal draws upon the experience of the highly successful “IEEE Transactions on Geoscience and Remote Sensing” and provide a complementary medium for the wide range of topics in applied earth observations. The ‘Applications’ areas encompasses the societal benefit areas of the Global Earth Observations Systems of Systems (GEOSS) program. Through deliberations over two years, ministers from 50 countries agreed to identify nine areas where Earth observation could positively impact the quality of life and health of their respective countries. Some of these are areas not traditionally addressed in the IEEE context. These include biodiversity, health and climate. Yet it is the skill sets of IEEE members, in areas such as observations, communications, computers, signal processing, standards and ocean engineering, that form the technical underpinnings of GEOSS. Thus, the Journal attracts a broad range of interests that serves both present members in new ways and expands the IEEE visibility into new areas.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信