{"title":"基于多级特征融合和伪标记的半监督遥感场景分类方法","authors":"Jiangfan Feng , Hongxin Luo , Zhujun Gu","doi":"10.1016/j.jag.2024.104335","DOIUrl":null,"url":null,"abstract":"<div><div>Remote Sensing Image (RSI) scene classification plays a pivotal role in diverse applications such as land cover mapping, urban planning, and environmental monitoring. Traditional deep learning approaches, however, heavily rely on abundant labeled data, which is often costly and challenging to acquire. Semi-supervised learning emerges as a cost-effective alternative, yet existing methods frequently overlook the intricate characteristics of remote sensing data, such as multi-scale features and complex spatial patterns, thereby limiting their ability to effectively address these challenges. In this study, a novel Scene Semi-Supervised Method (SSSM) is introduced, marking a significant advancement in both network architecture and semi-supervised techniques. At the core of the SSSM framework lies the Multi-Level Feature Fusion Network (MFFN), meticulously designed to extract and integrate complex features from remote sensing data across diverse scales and locations. To optimize the utilization of pseudo-labels and minimize mislabeling, the Pseudo-Label Multi-Level Sampling strategy (PMLS) is proposed, a probabilistic approach that selectively identifies high-quality pseudo-labels to enhance training. Rigorous experiments conducted on three benchmark datasets reveal that the SSSM method significantly improves classification accuracy, achieving an increase of 3%–5% on a specific dataset compared to existing approaches. This accomplishment underscores the effectiveness of the MFFN design and the semi-supervised strategy in tackling the complexities of remote sensing scene classification. In summary, the MFFN-driven pseudo-label framework presented in this research pioneers a cutting-edge and promising new direction for semi-supervised remote sensing scene classification.</div></div>","PeriodicalId":73423,"journal":{"name":"International journal of applied earth observation and geoinformation : ITC journal","volume":"136 ","pages":"Article 104335"},"PeriodicalIF":7.6000,"publicationDate":"2025-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Improving semi-supervised remote sensing scene classification via Multilevel Feature Fusion and pseudo-labeling\",\"authors\":\"Jiangfan Feng , Hongxin Luo , Zhujun Gu\",\"doi\":\"10.1016/j.jag.2024.104335\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Remote Sensing Image (RSI) scene classification plays a pivotal role in diverse applications such as land cover mapping, urban planning, and environmental monitoring. Traditional deep learning approaches, however, heavily rely on abundant labeled data, which is often costly and challenging to acquire. Semi-supervised learning emerges as a cost-effective alternative, yet existing methods frequently overlook the intricate characteristics of remote sensing data, such as multi-scale features and complex spatial patterns, thereby limiting their ability to effectively address these challenges. In this study, a novel Scene Semi-Supervised Method (SSSM) is introduced, marking a significant advancement in both network architecture and semi-supervised techniques. At the core of the SSSM framework lies the Multi-Level Feature Fusion Network (MFFN), meticulously designed to extract and integrate complex features from remote sensing data across diverse scales and locations. To optimize the utilization of pseudo-labels and minimize mislabeling, the Pseudo-Label Multi-Level Sampling strategy (PMLS) is proposed, a probabilistic approach that selectively identifies high-quality pseudo-labels to enhance training. Rigorous experiments conducted on three benchmark datasets reveal that the SSSM method significantly improves classification accuracy, achieving an increase of 3%–5% on a specific dataset compared to existing approaches. This accomplishment underscores the effectiveness of the MFFN design and the semi-supervised strategy in tackling the complexities of remote sensing scene classification. In summary, the MFFN-driven pseudo-label framework presented in this research pioneers a cutting-edge and promising new direction for semi-supervised remote sensing scene classification.</div></div>\",\"PeriodicalId\":73423,\"journal\":{\"name\":\"International journal of applied earth observation and geoinformation : ITC journal\",\"volume\":\"136 \",\"pages\":\"Article 104335\"},\"PeriodicalIF\":7.6000,\"publicationDate\":\"2025-02-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"International journal of applied earth observation and geoinformation : ITC journal\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S1569843224006939\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"REMOTE SENSING\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"International journal of applied earth observation and geoinformation : ITC journal","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1569843224006939","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"REMOTE SENSING","Score":null,"Total":0}
Improving semi-supervised remote sensing scene classification via Multilevel Feature Fusion and pseudo-labeling
Remote Sensing Image (RSI) scene classification plays a pivotal role in diverse applications such as land cover mapping, urban planning, and environmental monitoring. Traditional deep learning approaches, however, heavily rely on abundant labeled data, which is often costly and challenging to acquire. Semi-supervised learning emerges as a cost-effective alternative, yet existing methods frequently overlook the intricate characteristics of remote sensing data, such as multi-scale features and complex spatial patterns, thereby limiting their ability to effectively address these challenges. In this study, a novel Scene Semi-Supervised Method (SSSM) is introduced, marking a significant advancement in both network architecture and semi-supervised techniques. At the core of the SSSM framework lies the Multi-Level Feature Fusion Network (MFFN), meticulously designed to extract and integrate complex features from remote sensing data across diverse scales and locations. To optimize the utilization of pseudo-labels and minimize mislabeling, the Pseudo-Label Multi-Level Sampling strategy (PMLS) is proposed, a probabilistic approach that selectively identifies high-quality pseudo-labels to enhance training. Rigorous experiments conducted on three benchmark datasets reveal that the SSSM method significantly improves classification accuracy, achieving an increase of 3%–5% on a specific dataset compared to existing approaches. This accomplishment underscores the effectiveness of the MFFN design and the semi-supervised strategy in tackling the complexities of remote sensing scene classification. In summary, the MFFN-driven pseudo-label framework presented in this research pioneers a cutting-edge and promising new direction for semi-supervised remote sensing scene classification.
期刊介绍:
The International Journal of Applied Earth Observation and Geoinformation publishes original papers that utilize earth observation data for natural resource and environmental inventory and management. These data primarily originate from remote sensing platforms, including satellites and aircraft, supplemented by surface and subsurface measurements. Addressing natural resources such as forests, agricultural land, soils, and water, as well as environmental concerns like biodiversity, land degradation, and hazards, the journal explores conceptual and data-driven approaches. It covers geoinformation themes like capturing, databasing, visualization, interpretation, data quality, and spatial uncertainty.