Efficient metric-resolution land cover mapping using open-access low resolution annotations with prototype learning and modified Segment Anything model
W.Y. Shi, H.G. Sui, C.L. Zhang, N. Zhou, M.T. Zhou, J.X. Wang, Z.T. Du
{"title":"Efficient metric-resolution land cover mapping using open-access low resolution annotations with prototype learning and modified Segment Anything model","authors":"W.Y. Shi, H.G. Sui, C.L. Zhang, N. Zhou, M.T. Zhou, J.X. Wang, Z.T. Du","doi":"10.1016/j.isprsjprs.2025.03.021","DOIUrl":null,"url":null,"abstract":"<div><div>Large-scale metric-resolution land cover mapping is crucial for a detailed understanding of large areas of the Earth surface, supporting fine-scale decision-making in sectors such as agriculture, forestry, and conservation. Despite advances in remote sensing technology, this type of mapping is often limited by a lack of high-quality manually labeled data. To address this issue, here we propose a novel framework called Segment Anything Model with Prototype Learning and Enhanced Refinement (SAMPLER), using open-access and lower-resolution land cover products (LCPs) as labels for metric-resolution land cover mapping. Specifically, SAMPLER is built upon Segment Anything Model (SAM), leveraging its advanced feature extraction capability for precise and stable segmentation across diverse scenarios. To bridge the resolution gap between LCPs and metric-resolution imagery, we designed the class prototype-based object-oriented decoder (CPO-Decoder) to accurately classify small-scale features and maintain spectral consistency, effectively managing complex intra- and inter-class variations by dynamically aligning object-level features with semantic prototypes. Additionally, a label refinement strategy iteratively updates noisy LCP labels by replacing low-confidence annotations with high-precision model predictions, thereby mitigating label ambiguity caused by coarse resolution and enabling the model to progressively adapt to fine-scale features while improving classification accuracy throughout the training process. This framework exhibits exceptional adaptability and performance across various sensor types and diverse geographic regions, achieving an overall accuracy (OA) of 85.3% and a frequency-weighted intersection over union (FWIoU) of 74.7% across four study areas, with an OA increase from 5.6% to 9.5% and an FWIoU enhancement from 5.2% to 11.8% relative to the original LCP labels. Comparative experiments demonstrate that the proposed SAMPLER outperforms other deep learning models by up to 6.9% in OA and 9.8% in FWIoU. Ablation experiments further prove the effectiveness of CPO-Decoder, prototype learning and label-iterative-refined strategy. The overall results highlight the potential of SAMPLER for efficient metric-resolution land cover mapping at a large scale without manually labeled data, providing a valuable tool for fine-scale applications from environmental conservation to urban planning.</div></div>","PeriodicalId":50269,"journal":{"name":"ISPRS Journal of Photogrammetry and Remote Sensing","volume":"224 ","pages":"Pages 19-41"},"PeriodicalIF":10.6000,"publicationDate":"2025-03-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"ISPRS Journal of Photogrammetry and Remote Sensing","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0924271625001194","RegionNum":1,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"GEOGRAPHY, PHYSICAL","Score":null,"Total":0}
引用次数: 0
Abstract
Large-scale metric-resolution land cover mapping is crucial for a detailed understanding of large areas of the Earth surface, supporting fine-scale decision-making in sectors such as agriculture, forestry, and conservation. Despite advances in remote sensing technology, this type of mapping is often limited by a lack of high-quality manually labeled data. To address this issue, here we propose a novel framework called Segment Anything Model with Prototype Learning and Enhanced Refinement (SAMPLER), using open-access and lower-resolution land cover products (LCPs) as labels for metric-resolution land cover mapping. Specifically, SAMPLER is built upon Segment Anything Model (SAM), leveraging its advanced feature extraction capability for precise and stable segmentation across diverse scenarios. To bridge the resolution gap between LCPs and metric-resolution imagery, we designed the class prototype-based object-oriented decoder (CPO-Decoder) to accurately classify small-scale features and maintain spectral consistency, effectively managing complex intra- and inter-class variations by dynamically aligning object-level features with semantic prototypes. Additionally, a label refinement strategy iteratively updates noisy LCP labels by replacing low-confidence annotations with high-precision model predictions, thereby mitigating label ambiguity caused by coarse resolution and enabling the model to progressively adapt to fine-scale features while improving classification accuracy throughout the training process. This framework exhibits exceptional adaptability and performance across various sensor types and diverse geographic regions, achieving an overall accuracy (OA) of 85.3% and a frequency-weighted intersection over union (FWIoU) of 74.7% across four study areas, with an OA increase from 5.6% to 9.5% and an FWIoU enhancement from 5.2% to 11.8% relative to the original LCP labels. Comparative experiments demonstrate that the proposed SAMPLER outperforms other deep learning models by up to 6.9% in OA and 9.8% in FWIoU. Ablation experiments further prove the effectiveness of CPO-Decoder, prototype learning and label-iterative-refined strategy. The overall results highlight the potential of SAMPLER for efficient metric-resolution land cover mapping at a large scale without manually labeled data, providing a valuable tool for fine-scale applications from environmental conservation to urban planning.
期刊介绍:
The ISPRS Journal of Photogrammetry and Remote Sensing (P&RS) serves as the official journal of the International Society for Photogrammetry and Remote Sensing (ISPRS). It acts as a platform for scientists and professionals worldwide who are involved in various disciplines that utilize photogrammetry, remote sensing, spatial information systems, computer vision, and related fields. The journal aims to facilitate communication and dissemination of advancements in these disciplines, while also acting as a comprehensive source of reference and archive.
P&RS endeavors to publish high-quality, peer-reviewed research papers that are preferably original and have not been published before. These papers can cover scientific/research, technological development, or application/practical aspects. Additionally, the journal welcomes papers that are based on presentations from ISPRS meetings, as long as they are considered significant contributions to the aforementioned fields.
In particular, P&RS encourages the submission of papers that are of broad scientific interest, showcase innovative applications (especially in emerging fields), have an interdisciplinary focus, discuss topics that have received limited attention in P&RS or related journals, or explore new directions in scientific or professional realms. It is preferred that theoretical papers include practical applications, while papers focusing on systems and applications should include a theoretical background.