Triple-Branch Difference Fusion Network for Land Cover Change Detection With Heterogeneous Remote Sensing Images

IF 4.4
Zhiyong Lv;Yifan Zhang;Jiake Li;Wanting Wang;Cheng Shi
{"title":"Triple-Branch Difference Fusion Network for Land Cover Change Detection With Heterogeneous Remote Sensing Images","authors":"Zhiyong Lv;Yifan Zhang;Jiake Li;Wanting Wang;Cheng Shi","doi":"10.1109/LGRS.2026.3704412","DOIUrl":null,"url":null,"abstract":"Land cover change detection (LCCD) from multimodal remote sensing images (MRSIs) is crucial for environmental monitoring, disaster response, and urban analysis, but it is still challenging due to the heterogeneous imaging mechanisms of different sensors. In particular, direct pixel-wise comparison across modalities is often unreliable. To address this issue, we propose a triple-branch difference fusion network (TBDFN) for multimodal LCCD. TBDFN is composed of two key components. First, a modality conversion module is designed to alleviate the modality discrepancy via cross-modal transformation, which blends content information from one modality with style characteristics from the other to improve cross-modal consistency. Second, built upon the converted representations, a triple-branch fusion architecture is developed to extract temporal difference features from synthetic aperture radar (SAR) and optical imagery, while the same-time cross-modal difference (ST-CMD) module explicitly models intermodality differences within each temporal phase. The three types of difference features are subsequently aggregated to generate the final change map. Experiments on four datasets, with comparisons against six representative methods, demonstrate that TBDFN achieves superior qualitative and quantitative results, validating its effectiveness and robustness for multimodal LCCD. Our proposed method has, respectively, increased the overall accuracy (OA) rate by 1.29%, 0.17%, 1.07%, and 0.13%. The code of the proposed approach can be available at <uri>https://github.com/ImgSciGroup/2026-TBDFN</uri>","PeriodicalId":91017,"journal":{"name":"IEEE geoscience and remote sensing letters : a publication of the IEEE Geoscience and Remote Sensing Society","volume":"23 ","pages":"6013405-6013405"},"PeriodicalIF":4.4000,"publicationDate":"2026-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE geoscience and remote sensing letters : a publication of the IEEE Geoscience and Remote Sensing Society","FirstCategoryId":"1085","ListUrlMain":"https://ieeexplore.ieee.org/document/11568534/","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2026/6/16 0:00:00","PubModel":"Epub","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

Land cover change detection (LCCD) from multimodal remote sensing images (MRSIs) is crucial for environmental monitoring, disaster response, and urban analysis, but it is still challenging due to the heterogeneous imaging mechanisms of different sensors. In particular, direct pixel-wise comparison across modalities is often unreliable. To address this issue, we propose a triple-branch difference fusion network (TBDFN) for multimodal LCCD. TBDFN is composed of two key components. First, a modality conversion module is designed to alleviate the modality discrepancy via cross-modal transformation, which blends content information from one modality with style characteristics from the other to improve cross-modal consistency. Second, built upon the converted representations, a triple-branch fusion architecture is developed to extract temporal difference features from synthetic aperture radar (SAR) and optical imagery, while the same-time cross-modal difference (ST-CMD) module explicitly models intermodality differences within each temporal phase. The three types of difference features are subsequently aggregated to generate the final change map. Experiments on four datasets, with comparisons against six representative methods, demonstrate that TBDFN achieves superior qualitative and quantitative results, validating its effectiveness and robustness for multimodal LCCD. Our proposed method has, respectively, increased the overall accuracy (OA) rate by 1.29%, 0.17%, 1.07%, and 0.13%. The code of the proposed approach can be available at https://github.com/ImgSciGroup/2026-TBDFN
异质遥感影像土地覆盖变化检测的三分支差分融合网络
基于多模态遥感影像的土地覆盖变化检测(LCCD)对于环境监测、灾害响应和城市分析至关重要,但由于不同传感器的成像机制存在差异,因此仍然具有挑战性。特别是,跨模式的直接逐像素比较通常是不可靠的。为了解决这个问题,我们提出了一种用于多模态LCCD的三分支差分融合网络(TBDFN)。TBDFN由两个关键部分组成。首先,设计了一个情态转换模块,通过跨情态转换来缓解情态差异,将一种情态的内容信息与另一种情态的风格特征融合在一起,以提高跨情态的一致性。其次,在转换表征的基础上,开发了三分支融合架构,从合成孔径雷达(SAR)和光学图像中提取时间差异特征,同时跨模态差异(ST-CMD)模块明确地模拟每个时间相位内的模态差异。这三种类型的差异特征随后被聚合以生成最终的变更图。在4个数据集上进行了实验,并与6种代表性方法进行了比较,结果表明TBDFN在定性和定量上都取得了较好的效果,验证了该方法对多模态LCCD的有效性和鲁棒性。该方法的总体准确率(OA)分别提高了1.29%、0.17%、1.07%和0.13%。所提出的方法的代码可以在https://github.com/ImgSciGroup/2026-TBDFN上获得
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书