{"title":"GCD-DDPM: A Generative Change Detection Model Based on Difference-Feature-Guided DDPM","authors":"Yihan Wen;Xianping Ma;Xiaokang Zhang;Man-On Pun","doi":"10.1109/TGRS.2024.3381752","DOIUrl":null,"url":null,"abstract":"Deep learning (DL)-based methods have recently shown great promise in bitemporal change detection (CD). Existing discriminative methods based on convolutional neural networks (CNNs) and Transformers rely on discriminative representation learning for change recognition while struggling with exploring local and long-range contextual dependencies. As a result, it is still challenging to obtain fine-grained and robust CD maps in diverse ground scenes. To cope with this challenge, this work proposes a generative CD model called GCD-DDPM to directly generate CD maps by exploiting the denoising diffusion probabilistic model (DDPM), instead of classifying each pixel into changed or unchanged categories. Furthermore, the difference conditional encoder (DCE), is designed to guide the generation of CD maps by exploiting multilevel difference features. Leveraging the variational inference (VI) procedure, GCD-DDPM can adaptively recalibrate the CD results through an iterative inference process, while accurately distinguishing subtle and irregular changes in diverse scenes. Finally, a noise suppression-based semantic enhancer (NSSE) is specifically designed to mitigate noise in the current step’s change-aware feature representations from the CD Encoder. This refinement, serving as an attention map, can guide subsequent iterations while enhancing CD accuracy. Extensive experiments on four high-resolution CD datasets (CDD) confirm the superior performance of the proposed GCD-DDPM. The code for this work will be available at \n<uri>https://github.com/udrs/GCD</uri>\n.","PeriodicalId":13213,"journal":{"name":"IEEE Transactions on Geoscience and Remote Sensing","volume":"62 ","pages":"1-16"},"PeriodicalIF":8.6000,"publicationDate":"2024-03-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Geoscience and Remote Sensing","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10479050/","RegionNum":1,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0
Abstract
Deep learning (DL)-based methods have recently shown great promise in bitemporal change detection (CD). Existing discriminative methods based on convolutional neural networks (CNNs) and Transformers rely on discriminative representation learning for change recognition while struggling with exploring local and long-range contextual dependencies. As a result, it is still challenging to obtain fine-grained and robust CD maps in diverse ground scenes. To cope with this challenge, this work proposes a generative CD model called GCD-DDPM to directly generate CD maps by exploiting the denoising diffusion probabilistic model (DDPM), instead of classifying each pixel into changed or unchanged categories. Furthermore, the difference conditional encoder (DCE), is designed to guide the generation of CD maps by exploiting multilevel difference features. Leveraging the variational inference (VI) procedure, GCD-DDPM can adaptively recalibrate the CD results through an iterative inference process, while accurately distinguishing subtle and irregular changes in diverse scenes. Finally, a noise suppression-based semantic enhancer (NSSE) is specifically designed to mitigate noise in the current step’s change-aware feature representations from the CD Encoder. This refinement, serving as an attention map, can guide subsequent iterations while enhancing CD accuracy. Extensive experiments on four high-resolution CD datasets (CDD) confirm the superior performance of the proposed GCD-DDPM. The code for this work will be available at
https://github.com/udrs/GCD
.
最近,基于深度学习(DL)的方法在位时变化检测(CD)领域大有可为。现有的基于卷积神经网络(CNN)和变换器的判别方法依赖于变化识别的判别表征学习,但在探索局部和长程上下文依赖关系方面却举步维艰。因此,要在不同的地面场景中获得细粒度和稳健的 CD 地图仍然具有挑战性。为了应对这一挑战,本研究提出了一种称为 GCD-DDPM 的生成式 CD 模型,利用去噪扩散概率模型(DDPM)直接生成 CD 地图,而不是将每个像素划分为变化或不变的类别。此外,差分条件编码器(DCE)旨在利用多级差分特征来指导生成 CD 地图。利用变异推理(VI)程序,GCD-DDPM 可以通过迭代推理过程自适应地重新校准 CD 结果,同时准确区分不同场景中的细微和不规则变化。最后,专门设计了一个基于噪声抑制的语义增强器(NSSE),以减轻当前步骤中来自 CD 编码器的变化感知特征表征中的噪声。这种改进作为一种注意力地图,可以指导后续迭代,同时提高 CD 的准确性。在四个高分辨率 CD 数据集 (CDD) 上进行的广泛实验证实了所提出的 GCD-DDPM 的卓越性能。这项工作的代码将发布在 https://github.com/udrs/GCD 网站上。
期刊介绍:
IEEE Transactions on Geoscience and Remote Sensing (TGRS) is a monthly publication that focuses on the theory, concepts, and techniques of science and engineering as applied to sensing the land, oceans, atmosphere, and space; and the processing, interpretation, and dissemination of this information.