Superpixel-aware credible dual-expert learning for land cover mapping using historical land cover product

IF 10.6 1区 地球科学 Q1 GEOGRAPHY, PHYSICAL
Yujia Chen , Guo Zhang , Hao Cui , Xue Li , Shasha Hou , Chunyang Zhu , Zhigang Xie , Deren Li
{"title":"Superpixel-aware credible dual-expert learning for land cover mapping using historical land cover product","authors":"Yujia Chen ,&nbsp;Guo Zhang ,&nbsp;Hao Cui ,&nbsp;Xue Li ,&nbsp;Shasha Hou ,&nbsp;Chunyang Zhu ,&nbsp;Zhigang Xie ,&nbsp;Deren Li","doi":"10.1016/j.isprsjprs.2025.02.014","DOIUrl":null,"url":null,"abstract":"<div><div>One of the key solutions to the challenge of collecting training labels for high-resolution remote sensing images is to leverage prior information from historical land cover products, which includes knowledge derived from both same- and low-resolution land cover products (relative to the targeted images). However, employing these products as training labels directly fails to yield encouraging results in the pixel-level training process due to the widespread existence of complex noise labels. These noise labels can be categorized into scale-response noise labels, resulting from resolution discrepancies, and model-cognitive noise labels, caused by misclassifications from historical classification models or temporal changes. To address these noise labels, we propose employing superpixels as training units to mitigate scale-response and small-scale model-cognitive noise labels. The large-scale model-cognitive noise labels might then be adaptively optimized during the training process by integrating multi-source knowledge. Accordingly, we design a superpixel-aware credible dual-expert weakly supervised learning (SCDWSL) approach for high-resolution land cover mapping. Our method utilizes the multi-scale contextual information perception capabilities of superpixels and integrates credible assessment from dual-expert knowledge framework to hierarchically tackle various noise labels. To validate the effectiveness of SCDWSL, we conduct experiments using the WorldCover with a resolution of 10-m as labels. First, we evaluate its capacity to handle both scale-response and model-cognitive noise using the National Agricultural Imagery Program dataset and GaoFen-2 image (1-m resolution). Secondly, we assess its performance on addressing model-cognitive noise alone using Sentinel-2 data. Extensive experiments demonstrate that SCDWSL outperforms existing weakly supervised methods across three datasets, highlighting its unique advantages and applicability on large-scale land cover mapping.</div></div>","PeriodicalId":50269,"journal":{"name":"ISPRS Journal of Photogrammetry and Remote Sensing","volume":"223 ","pages":"Pages 296-316"},"PeriodicalIF":10.6000,"publicationDate":"2025-03-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"ISPRS Journal of Photogrammetry and Remote Sensing","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0924271625000644","RegionNum":1,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"GEOGRAPHY, PHYSICAL","Score":null,"Total":0}
引用次数: 0

Abstract

One of the key solutions to the challenge of collecting training labels for high-resolution remote sensing images is to leverage prior information from historical land cover products, which includes knowledge derived from both same- and low-resolution land cover products (relative to the targeted images). However, employing these products as training labels directly fails to yield encouraging results in the pixel-level training process due to the widespread existence of complex noise labels. These noise labels can be categorized into scale-response noise labels, resulting from resolution discrepancies, and model-cognitive noise labels, caused by misclassifications from historical classification models or temporal changes. To address these noise labels, we propose employing superpixels as training units to mitigate scale-response and small-scale model-cognitive noise labels. The large-scale model-cognitive noise labels might then be adaptively optimized during the training process by integrating multi-source knowledge. Accordingly, we design a superpixel-aware credible dual-expert weakly supervised learning (SCDWSL) approach for high-resolution land cover mapping. Our method utilizes the multi-scale contextual information perception capabilities of superpixels and integrates credible assessment from dual-expert knowledge framework to hierarchically tackle various noise labels. To validate the effectiveness of SCDWSL, we conduct experiments using the WorldCover with a resolution of 10-m as labels. First, we evaluate its capacity to handle both scale-response and model-cognitive noise using the National Agricultural Imagery Program dataset and GaoFen-2 image (1-m resolution). Secondly, we assess its performance on addressing model-cognitive noise alone using Sentinel-2 data. Extensive experiments demonstrate that SCDWSL outperforms existing weakly supervised methods across three datasets, highlighting its unique advantages and applicability on large-scale land cover mapping.
基于历史土地覆盖产品的超像素感知可信双专家学习土地覆盖制图
为高分辨率遥感图像收集训练标签的挑战,关键解决方案之一是利用历史土地覆盖产品的先验信息,其中包括来自相同分辨率和低分辨率土地覆盖产品的知识(相对于目标图像)。然而,在像素级训练过程中,由于复杂噪声标签的普遍存在,直接使用这些产品作为训练标签并不能产生令人鼓舞的结果。这些噪声标签可以分为尺度-响应噪声标签(由于分辨率差异)和模型-认知噪声标签(由于历史分类模型或时间变化的错误分类)。为了解决这些噪声标签,我们建议使用超像素作为训练单元来减轻尺度响应和小规模模型认知噪声标签。通过整合多源知识,可以在训练过程中对大规模模型认知噪声标签进行自适应优化。因此,我们设计了一种用于高分辨率土地覆盖制图的超像素感知可信双专家弱监督学习(SCDWSL)方法。该方法利用超像素的多尺度上下文信息感知能力,结合双专家知识框架的可信评估,分层处理各种噪声标签。为了验证SCDWSL的有效性,我们使用分辨率为10米的WorldCover作为标签进行了实验。首先,我们使用国家农业图像计划数据集和高分二号图像(1米分辨率)评估了其处理尺度响应和模型认知噪声的能力。其次,我们使用Sentinel-2数据评估其在单独处理模型认知噪声方面的性能。大量的实验表明,SCDWSL在三个数据集上优于现有的弱监督方法,突出了其独特的优势和在大尺度土地覆盖制图中的适用性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
ISPRS Journal of Photogrammetry and Remote Sensing
ISPRS Journal of Photogrammetry and Remote Sensing 工程技术-成像科学与照相技术
CiteScore
21.00
自引率
6.30%
发文量
273
审稿时长
40 days
期刊介绍: The ISPRS Journal of Photogrammetry and Remote Sensing (P&RS) serves as the official journal of the International Society for Photogrammetry and Remote Sensing (ISPRS). It acts as a platform for scientists and professionals worldwide who are involved in various disciplines that utilize photogrammetry, remote sensing, spatial information systems, computer vision, and related fields. The journal aims to facilitate communication and dissemination of advancements in these disciplines, while also acting as a comprehensive source of reference and archive. P&RS endeavors to publish high-quality, peer-reviewed research papers that are preferably original and have not been published before. These papers can cover scientific/research, technological development, or application/practical aspects. Additionally, the journal welcomes papers that are based on presentations from ISPRS meetings, as long as they are considered significant contributions to the aforementioned fields. In particular, P&RS encourages the submission of papers that are of broad scientific interest, showcase innovative applications (especially in emerging fields), have an interdisciplinary focus, discuss topics that have received limited attention in P&RS or related journals, or explore new directions in scientific or professional realms. It is preferred that theoretical papers include practical applications, while papers focusing on systems and applications should include a theoretical background.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信