基于CNN和Mamba的局部和全局特征集成半监督变化检测

IF 5.6 2区 工程技术 Q1 ENGINEERING, ELECTRICAL & ELECTRONIC
Ze Zhang;Yue Zhou;Linqing Huang;Xue Jiang;Guozheng Xu;Xingzhao Liu
{"title":"基于CNN和Mamba的局部和全局特征集成半监督变化检测","authors":"Ze Zhang;Yue Zhou;Linqing Huang;Xue Jiang;Guozheng Xu;Xingzhao Liu","doi":"10.1109/TIM.2025.3573775","DOIUrl":null,"url":null,"abstract":"Semi-supervised change detection (SSCD) has become increasingly important in remote sensing image (RSI) analysis due to the scarcity of labeled data. While state-of-the-art SSCD methods have achieved notable results through pseudo-labeling and weak-to-strong consistency regularization with various perturbations, they face several inherent limitations: 1) learners (models or architectures with the same design) often focus exclusively on either local or global features, which fails to capture the intricate bi-temporal difference feature; 2) low-quality pseudo-labels, often resulting from inadequate learner diversity or suboptimal perturbations, struggle to reflect accurate changes, exacerbating confirmation bias; and 3) a predominant emphasis on pixel-level consistency overlooks broader image context, limiting the ability to capture complex, large-scale spatiotemporal changes. To address these challenges, we propose a novel SSCD framework, cross-supervision with convolutional neural network and Mamba (CSCM), which adopts the convolutional neural network (CNN) and Mamba as two independent learners within a cross-supervision mechanism, enabling the integration of local and global feature representations. The CNN excels at capturing fine-grained local details, while Mamba efficiently models long-range dependencies with linear complexity, making it particularly well-suited for processing large-scale RSIs. To enhance the collaboration between these architectures, we introduce the cross-architecture fusion module (CAFM), which fuses difference features extracted by the CNN and Mamba, combining local sensitivity with global awareness to produce refined pseudo-labels. Additionally, we incorporate instance-level global consistency to capture broader image context, ensuring a more comprehensive understanding of spatiotemporal changes beyond pixel-level consistency. Extensive experiments on three public datasets demonstrate that our approach significantly enhances CD accuracy and training efficiency, outperforming several state-of-the-art methods.","PeriodicalId":13341,"journal":{"name":"IEEE Transactions on Instrumentation and Measurement","volume":"74 ","pages":"1-15"},"PeriodicalIF":5.6000,"publicationDate":"2025-06-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Integrating Local and Global Features via CNN and Mamba for Semi-Supervised Change Detection\",\"authors\":\"Ze Zhang;Yue Zhou;Linqing Huang;Xue Jiang;Guozheng Xu;Xingzhao Liu\",\"doi\":\"10.1109/TIM.2025.3573775\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Semi-supervised change detection (SSCD) has become increasingly important in remote sensing image (RSI) analysis due to the scarcity of labeled data. While state-of-the-art SSCD methods have achieved notable results through pseudo-labeling and weak-to-strong consistency regularization with various perturbations, they face several inherent limitations: 1) learners (models or architectures with the same design) often focus exclusively on either local or global features, which fails to capture the intricate bi-temporal difference feature; 2) low-quality pseudo-labels, often resulting from inadequate learner diversity or suboptimal perturbations, struggle to reflect accurate changes, exacerbating confirmation bias; and 3) a predominant emphasis on pixel-level consistency overlooks broader image context, limiting the ability to capture complex, large-scale spatiotemporal changes. To address these challenges, we propose a novel SSCD framework, cross-supervision with convolutional neural network and Mamba (CSCM), which adopts the convolutional neural network (CNN) and Mamba as two independent learners within a cross-supervision mechanism, enabling the integration of local and global feature representations. The CNN excels at capturing fine-grained local details, while Mamba efficiently models long-range dependencies with linear complexity, making it particularly well-suited for processing large-scale RSIs. To enhance the collaboration between these architectures, we introduce the cross-architecture fusion module (CAFM), which fuses difference features extracted by the CNN and Mamba, combining local sensitivity with global awareness to produce refined pseudo-labels. Additionally, we incorporate instance-level global consistency to capture broader image context, ensuring a more comprehensive understanding of spatiotemporal changes beyond pixel-level consistency. Extensive experiments on three public datasets demonstrate that our approach significantly enhances CD accuracy and training efficiency, outperforming several state-of-the-art methods.\",\"PeriodicalId\":13341,\"journal\":{\"name\":\"IEEE Transactions on Instrumentation and Measurement\",\"volume\":\"74 \",\"pages\":\"1-15\"},\"PeriodicalIF\":5.6000,\"publicationDate\":\"2025-06-02\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Transactions on Instrumentation and Measurement\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/11018868/\",\"RegionNum\":2,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Instrumentation and Measurement","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/11018868/","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0

摘要

由于标记数据的稀缺性,半监督变化检测(SSCD)在遥感图像分析中越来越重要。虽然最先进的SSCD方法通过各种扰动的伪标记和弱到强一致性正则化取得了显著的结果,但它们面临着几个固有的局限性:1)学习者(具有相同设计的模型或架构)通常只关注局部或全局特征,这无法捕获复杂的双时差特征;2)低质量的伪标签,通常是由于学习者多样性不足或次优扰动造成的,难以反映准确的变化,加剧了确认偏差;3)主要强调像素级一致性忽略了更广泛的图像背景,限制了捕捉复杂的大尺度时空变化的能力。为了解决这些挑战,我们提出了一种新的SSCD框架,即卷积神经网络和曼巴的交叉监督(CSCM),该框架在交叉监督机制中采用卷积神经网络(CNN)和曼巴作为两个独立的学习器,实现了局部和全局特征表示的整合。CNN擅长于捕获细粒度的局部细节,而Mamba则有效地模拟线性复杂性的远程依赖关系,使其特别适合处理大规模的rsi。为了增强这些架构之间的协作,我们引入了跨架构融合模块(CAFM),该模块融合了CNN和Mamba提取的差异特征,将局部灵敏度与全局感知相结合,产生精细的伪标签。此外,我们结合实例级全局一致性来捕获更广泛的图像上下文,确保更全面地理解像素级一致性之外的时空变化。在三个公共数据集上进行的大量实验表明,我们的方法显著提高了CD的准确性和训练效率,优于几种最先进的方法。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Integrating Local and Global Features via CNN and Mamba for Semi-Supervised Change Detection
Semi-supervised change detection (SSCD) has become increasingly important in remote sensing image (RSI) analysis due to the scarcity of labeled data. While state-of-the-art SSCD methods have achieved notable results through pseudo-labeling and weak-to-strong consistency regularization with various perturbations, they face several inherent limitations: 1) learners (models or architectures with the same design) often focus exclusively on either local or global features, which fails to capture the intricate bi-temporal difference feature; 2) low-quality pseudo-labels, often resulting from inadequate learner diversity or suboptimal perturbations, struggle to reflect accurate changes, exacerbating confirmation bias; and 3) a predominant emphasis on pixel-level consistency overlooks broader image context, limiting the ability to capture complex, large-scale spatiotemporal changes. To address these challenges, we propose a novel SSCD framework, cross-supervision with convolutional neural network and Mamba (CSCM), which adopts the convolutional neural network (CNN) and Mamba as two independent learners within a cross-supervision mechanism, enabling the integration of local and global feature representations. The CNN excels at capturing fine-grained local details, while Mamba efficiently models long-range dependencies with linear complexity, making it particularly well-suited for processing large-scale RSIs. To enhance the collaboration between these architectures, we introduce the cross-architecture fusion module (CAFM), which fuses difference features extracted by the CNN and Mamba, combining local sensitivity with global awareness to produce refined pseudo-labels. Additionally, we incorporate instance-level global consistency to capture broader image context, ensuring a more comprehensive understanding of spatiotemporal changes beyond pixel-level consistency. Extensive experiments on three public datasets demonstrate that our approach significantly enhances CD accuracy and training efficiency, outperforming several state-of-the-art methods.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
IEEE Transactions on Instrumentation and Measurement
IEEE Transactions on Instrumentation and Measurement 工程技术-工程:电子与电气
CiteScore
9.00
自引率
23.20%
发文量
1294
审稿时长
3.9 months
期刊介绍: Papers are sought that address innovative solutions to the development and use of electrical and electronic instruments and equipment to measure, monitor and/or record physical phenomena for the purpose of advancing measurement science, methods, functionality and applications. The scope of these papers may encompass: (1) theory, methodology, and practice of measurement; (2) design, development and evaluation of instrumentation and measurement systems and components used in generating, acquiring, conditioning and processing signals; (3) analysis, representation, display, and preservation of the information obtained from a set of measurements; and (4) scientific and technical support to establishment and maintenance of technical standards in the field of Instrumentation and Measurement.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信