Wei Han;Zunlin Fu;Shuanglin Xiao;Xiongwei Zheng;Xiaohui Huang;Yi Wang;Jining Yan;Sheng Wang;Dongmei Yan
{"title":"Dual-Model Collaboration Consistency Semi-Supervised Learning for Few-Shot Lithology Interpretation","authors":"Wei Han;Zunlin Fu;Shuanglin Xiao;Xiongwei Zheng;Xiaohui Huang;Yi Wang;Jining Yan;Sheng Wang;Dongmei Yan","doi":"10.1109/TGRS.2024.3504571","DOIUrl":null,"url":null,"abstract":"Geological environment remote sensing (GERS) interpretation contributes to lithological mapping, disaster prediction, soil erosion monitoring, and so on. However, the rich diversity, complex distribution, interclass similarities, and uncertainties in data quality of geological elements pose challenges to GERS interpretation. In addition, current automatic feature extraction of GERS elements, which rely on deep learning (DL) and remote sensing (RS) information process technologies, often require sufficient labeled data. Due to the enormous labor cost and specialized expertise needed, labeled GERS samples are limited to training the data-driven models. To tackle the above challenges, we introduce the semi-supervised dual-model progressive self-training (DM-ProST) framework. This framework employs two DL networks with different initializations as evaluator models to correct each other. A sample filtering strategy is then implemented to evaluate the quality of unlabeled samples, selecting high-quality and reliable ones to expand the training set. In addition, a fully connected conditional random field (CRF) module is incorporated to optimize DL network prediction maps, thereby enhancing the boundary performance of segmentation results. The framework utilizes a multitask loss function that combines consistency loss with cross-entropy, enabling the models to learn discriminative GERS features. This process accurately generates pseudo-labels and achieves precise lithology mapping of GERS with a small amount of annotation samples. Finally, we conducted an experimental evaluation on the Landsat 8 dataset in Xinjiang, China, and massive experiments proved the effectiveness of DM-ProST.","PeriodicalId":13213,"journal":{"name":"IEEE Transactions on Geoscience and Remote Sensing","volume":"62 ","pages":"1-14"},"PeriodicalIF":7.5000,"publicationDate":"2024-11-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Geoscience and Remote Sensing","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10764756/","RegionNum":1,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
引用次数: 0
Abstract
Geological environment remote sensing (GERS) interpretation contributes to lithological mapping, disaster prediction, soil erosion monitoring, and so on. However, the rich diversity, complex distribution, interclass similarities, and uncertainties in data quality of geological elements pose challenges to GERS interpretation. In addition, current automatic feature extraction of GERS elements, which rely on deep learning (DL) and remote sensing (RS) information process technologies, often require sufficient labeled data. Due to the enormous labor cost and specialized expertise needed, labeled GERS samples are limited to training the data-driven models. To tackle the above challenges, we introduce the semi-supervised dual-model progressive self-training (DM-ProST) framework. This framework employs two DL networks with different initializations as evaluator models to correct each other. A sample filtering strategy is then implemented to evaluate the quality of unlabeled samples, selecting high-quality and reliable ones to expand the training set. In addition, a fully connected conditional random field (CRF) module is incorporated to optimize DL network prediction maps, thereby enhancing the boundary performance of segmentation results. The framework utilizes a multitask loss function that combines consistency loss with cross-entropy, enabling the models to learn discriminative GERS features. This process accurately generates pseudo-labels and achieves precise lithology mapping of GERS with a small amount of annotation samples. Finally, we conducted an experimental evaluation on the Landsat 8 dataset in Xinjiang, China, and massive experiments proved the effectiveness of DM-ProST.
期刊介绍:
IEEE Transactions on Geoscience and Remote Sensing (TGRS) is a monthly publication that focuses on the theory, concepts, and techniques of science and engineering as applied to sensing the land, oceans, atmosphere, and space; and the processing, interpretation, and dissemination of this information.