{"title":"基于BALD方法的贝叶斯CNN主动学习用于高光谱图像分类","authors":"Mahmood Siddeeq Qadir, G. Bilgin","doi":"10.58496/mjbd/2023/008","DOIUrl":null,"url":null,"abstract":"Deep learning DL techniques have recently been used to examine the classification of remote sensing data like hyperspectral images HSI. However, DL models are difficult to obtain since they rely largely on a large number of labeled training data. Therefore, a current challenge in the field of HSI classification is how to effectively incorporate DL models in constrained labeled data. The Bayesian Convolutional Neural Networks BCNN method is robust against overfitting on small datasets. One of the key methods for automating data selection is active learning AL, which has gained popularity in recent decades. By choosing the most informative samples, AL aims to reduce the costly data labeling procedure and build a robust training set that is resource-efficient. In this work, we aim to improve the performance of BCNN using AL method to build a competitive classifier considering the Bayesian Active Learning Disagreement BALD acquisition function (Dropout Bayesian Active Learning by Disagreement), which incorporates model uncertainty information. In a previous work, BCNN was built and applied on Pavia datasets giving 99.7% classification accuracy. For comparison traditional BCNN with BALD, The techniques were applied on the Indian Pines dataset. The average accuracy of the classification had increased from 90% to 98% using BALD method.","PeriodicalId":325612,"journal":{"name":"Mesopotamian Journal of Big Data","volume":"246 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-06-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Active learning with Bayesian CNN using the BALD method for Hyperspectral Image Classification\",\"authors\":\"Mahmood Siddeeq Qadir, G. Bilgin\",\"doi\":\"10.58496/mjbd/2023/008\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Deep learning DL techniques have recently been used to examine the classification of remote sensing data like hyperspectral images HSI. However, DL models are difficult to obtain since they rely largely on a large number of labeled training data. Therefore, a current challenge in the field of HSI classification is how to effectively incorporate DL models in constrained labeled data. The Bayesian Convolutional Neural Networks BCNN method is robust against overfitting on small datasets. One of the key methods for automating data selection is active learning AL, which has gained popularity in recent decades. By choosing the most informative samples, AL aims to reduce the costly data labeling procedure and build a robust training set that is resource-efficient. In this work, we aim to improve the performance of BCNN using AL method to build a competitive classifier considering the Bayesian Active Learning Disagreement BALD acquisition function (Dropout Bayesian Active Learning by Disagreement), which incorporates model uncertainty information. In a previous work, BCNN was built and applied on Pavia datasets giving 99.7% classification accuracy. For comparison traditional BCNN with BALD, The techniques were applied on the Indian Pines dataset. The average accuracy of the classification had increased from 90% to 98% using BALD method.\",\"PeriodicalId\":325612,\"journal\":{\"name\":\"Mesopotamian Journal of Big Data\",\"volume\":\"246 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-06-07\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Mesopotamian Journal of Big Data\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.58496/mjbd/2023/008\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Mesopotamian Journal of Big Data","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.58496/mjbd/2023/008","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
摘要
深度学习DL技术最近被用于检查遥感数据的分类,如高光谱图像HSI。然而,深度学习模型很难获得,因为它们很大程度上依赖于大量标记的训练数据。因此,当前HSI分类领域面临的挑战是如何有效地将深度学习模型整合到约束标记数据中。贝叶斯卷积神经网络BCNN方法对小数据集的过拟合具有鲁棒性。自动化数据选择的关键方法之一是主动学习人工智能,这在近几十年来得到了普及。通过选择信息量最大的样本,人工智能旨在减少昂贵的数据标记过程,并建立一个资源高效的鲁棒训练集。在这项工作中,我们的目标是利用人工智能方法建立一个竞争分类器,考虑贝叶斯主动学习分歧BALD获取函数(Dropout Bayesian Active Learning by different),该函数包含模型不确定性信息,以提高BCNN的性能。在之前的一项工作中,BCNN被构建并应用在Pavia数据集上,分类准确率达到99.7%。为了比较传统的BCNN和BALD,将这些技术应用于Indian Pines数据集。采用BALD方法分类的平均准确率由90%提高到98%。
Active learning with Bayesian CNN using the BALD method for Hyperspectral Image Classification
Deep learning DL techniques have recently been used to examine the classification of remote sensing data like hyperspectral images HSI. However, DL models are difficult to obtain since they rely largely on a large number of labeled training data. Therefore, a current challenge in the field of HSI classification is how to effectively incorporate DL models in constrained labeled data. The Bayesian Convolutional Neural Networks BCNN method is robust against overfitting on small datasets. One of the key methods for automating data selection is active learning AL, which has gained popularity in recent decades. By choosing the most informative samples, AL aims to reduce the costly data labeling procedure and build a robust training set that is resource-efficient. In this work, we aim to improve the performance of BCNN using AL method to build a competitive classifier considering the Bayesian Active Learning Disagreement BALD acquisition function (Dropout Bayesian Active Learning by Disagreement), which incorporates model uncertainty information. In a previous work, BCNN was built and applied on Pavia datasets giving 99.7% classification accuracy. For comparison traditional BCNN with BALD, The techniques were applied on the Indian Pines dataset. The average accuracy of the classification had increased from 90% to 98% using BALD method.