Uncertainty quantification in multi-class image classification using chest X-ray images of COVID-19 and pneumonia.

IF 3 Q2 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE
Frontiers in Artificial Intelligence Pub Date : 2024-09-18 eCollection Date: 2024-01-01 DOI:10.3389/frai.2024.1410841
Albert Whata, Katlego Dibeco, Kudakwashe Madzima, Ibidun Obagbuwa
{"title":"Uncertainty quantification in multi-class image classification using chest X-ray images of COVID-19 and pneumonia.","authors":"Albert Whata, Katlego Dibeco, Kudakwashe Madzima, Ibidun Obagbuwa","doi":"10.3389/frai.2024.1410841","DOIUrl":null,"url":null,"abstract":"<p><p>This paper investigates uncertainty quantification (UQ) techniques in multi-class classification of chest X-ray images (COVID-19, Pneumonia, and Normal). We evaluate Bayesian Neural Networks (BNN) and the Deep Neural Network with UQ (DNN with UQ) techniques, including Monte Carlo dropout, Ensemble Bayesian Neural Network (EBNN), Ensemble Monte Carlo (EMC) dropout, across different evaluation metrics. Our analysis reveals that DNN with UQ, especially EBNN and EMC dropout, consistently outperform BNNs. For example, in Class 0 vs. All, EBNN achieved a <i>U</i>Acc of 92.6%, <i>U</i>AUC-ROC of 95.0%, and a Brier Score of 0.157, significantly surpassing BNN's performance. Similarly, EMC Dropout excelled in Class 1 vs. All with a <i>U</i>Acc of 83.5%, <i>U</i>AUC-ROC of 95.8%, and a Brier Score of 0.165. These advanced models demonstrated higher accuracy, better discriaminative capability, and more accurate probabilistic predictions. Our findings highlight the efficacy of DNN with UQ in enhancing model reliability and interpretability, making them highly suitable for critical healthcare applications like chest X-ray imageQ6 classification.</p>","PeriodicalId":33315,"journal":{"name":"Frontiers in Artificial Intelligence","volume":"7 ","pages":"1410841"},"PeriodicalIF":3.0000,"publicationDate":"2024-09-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11445153/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Frontiers in Artificial Intelligence","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.3389/frai.2024.1410841","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2024/1/1 0:00:00","PubModel":"eCollection","JCR":"Q2","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0

Abstract

This paper investigates uncertainty quantification (UQ) techniques in multi-class classification of chest X-ray images (COVID-19, Pneumonia, and Normal). We evaluate Bayesian Neural Networks (BNN) and the Deep Neural Network with UQ (DNN with UQ) techniques, including Monte Carlo dropout, Ensemble Bayesian Neural Network (EBNN), Ensemble Monte Carlo (EMC) dropout, across different evaluation metrics. Our analysis reveals that DNN with UQ, especially EBNN and EMC dropout, consistently outperform BNNs. For example, in Class 0 vs. All, EBNN achieved a UAcc of 92.6%, UAUC-ROC of 95.0%, and a Brier Score of 0.157, significantly surpassing BNN's performance. Similarly, EMC Dropout excelled in Class 1 vs. All with a UAcc of 83.5%, UAUC-ROC of 95.8%, and a Brier Score of 0.165. These advanced models demonstrated higher accuracy, better discriaminative capability, and more accurate probabilistic predictions. Our findings highlight the efficacy of DNN with UQ in enhancing model reliability and interpretability, making them highly suitable for critical healthcare applications like chest X-ray imageQ6 classification.

使用 COVID-19 和肺炎的胸部 X 光图像进行多类图像分类的不确定性量化。
本文研究了胸部 X 光图像(COVID-19、肺炎和正常)多类分类中的不确定性量化(UQ)技术。我们评估了贝叶斯神经网络(BNN)和具有 UQ 的深度神经网络(DNN with UQ)技术,包括蒙特卡罗剔除、集合贝叶斯神经网络(EBNN)、集合蒙特卡罗剔除(EMC),以及不同的评估指标。我们的分析表明,具有 UQ 的 DNN,尤其是 EBNN 和 EMC dropout,始终优于 BNN。例如,在 Class 0 vs. All 中,EBNN 的 UAcc 为 92.6%,UAUC-ROC 为 95.0%,Brier Score 为 0.157,大大超过了 BNN 的表现。同样,EMC Dropout 在 Class 1 vs. All 中表现出色,UAcc 为 83.5%,UAUC-ROC 为 95.8%,Brier Score 为 0.165。这些高级模型表现出了更高的准确性、更好的判别能力和更准确的概率预测。我们的研究结果凸显了带有 UQ 的 DNN 在增强模型可靠性和可解释性方面的功效,使其非常适合胸部 X 光图像Q6 分类等关键医疗应用。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
CiteScore
6.10
自引率
2.50%
发文量
272
审稿时长
13 weeks
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信