Uncertainty Quantification and Quality Control for Heatmap-Based Landmark Detection Models

Yong Feng;Jinzhu Yang;Lingzhi Tang;Song Sun;Yonghuai Wang
{"title":"Uncertainty Quantification and Quality Control for Heatmap-Based Landmark Detection Models","authors":"Yong Feng;Jinzhu Yang;Lingzhi Tang;Song Sun;Yonghuai Wang","doi":"10.1109/TMI.2025.3564267","DOIUrl":null,"url":null,"abstract":"Uncertainty quantification is a vital aspect of explainable artificial intelligence that fosters clinician trust in medical applications and facilitates timely interventions, leading to safer and more reliable outcomes. Although deep learning models have reached clinically acceptable accuracy in anatomical landmark detection, their predictions remain susceptible to contextual noise due to the small size of the target structures, making uncertainty quantification more challenging than in classification and segmentation tasks. This paper presents an end-to-end uncertainty quantification method tailored for heatmap-based anatomical landmark detection models, designed to improve both interpretability and controllability in clinical applications. Leveraging Dempster-Shafer Theory and Subjective Logic Theory, we implement probability assignment and uncertainty quantification through a single forward pass to ensure computational efficiency. We introduce an evidence map that captures the strength of landmark evidence, alongside an uncertainty map that calibrates predicted probabilities within the Subjective Logic framework. The interaction between these two components, facilitated by a cross-attention mechanism, further improves landmark detection accuracy and enhances the effectiveness of uncertainty quantification. Experimental results demonstrate that the proposed method maintains detection accuracy, even in noisy environments, while outperforming state-of-the-art methods in terms of uncertainty quantification and quality control. Furthermore, the model effectively identifies out-of-distribution data solely through calibrated probabilities when encountering inconsistencies in multi-center data and novel data, underscoring its potential for clinical applications. The source code is available at github.com/warmestwind/CalibratedSL","PeriodicalId":94033,"journal":{"name":"IEEE transactions on medical imaging","volume":"44 8","pages":"3451-3463"},"PeriodicalIF":0.0000,"publicationDate":"2025-04-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE transactions on medical imaging","FirstCategoryId":"1085","ListUrlMain":"https://ieeexplore.ieee.org/document/10977010/","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

Uncertainty quantification is a vital aspect of explainable artificial intelligence that fosters clinician trust in medical applications and facilitates timely interventions, leading to safer and more reliable outcomes. Although deep learning models have reached clinically acceptable accuracy in anatomical landmark detection, their predictions remain susceptible to contextual noise due to the small size of the target structures, making uncertainty quantification more challenging than in classification and segmentation tasks. This paper presents an end-to-end uncertainty quantification method tailored for heatmap-based anatomical landmark detection models, designed to improve both interpretability and controllability in clinical applications. Leveraging Dempster-Shafer Theory and Subjective Logic Theory, we implement probability assignment and uncertainty quantification through a single forward pass to ensure computational efficiency. We introduce an evidence map that captures the strength of landmark evidence, alongside an uncertainty map that calibrates predicted probabilities within the Subjective Logic framework. The interaction between these two components, facilitated by a cross-attention mechanism, further improves landmark detection accuracy and enhances the effectiveness of uncertainty quantification. Experimental results demonstrate that the proposed method maintains detection accuracy, even in noisy environments, while outperforming state-of-the-art methods in terms of uncertainty quantification and quality control. Furthermore, the model effectively identifies out-of-distribution data solely through calibrated probabilities when encountering inconsistencies in multi-center data and novel data, underscoring its potential for clinical applications. The source code is available at github.com/warmestwind/CalibratedSL
基于热图的地标检测模型的不确定性量化与质量控制
不确定性量化是可解释人工智能的一个重要方面,它可以培养临床医生对医疗应用的信任,促进及时干预,从而产生更安全、更可靠的结果。尽管深度学习模型在解剖标志检测方面达到了临床可接受的准确性,但由于目标结构的小尺寸,它们的预测仍然容易受到上下文噪声的影响,使得不确定性量化比分类和分割任务更具挑战性。本文提出了一种针对基于热图的解剖地标检测模型量身定制的端到端不确定性量化方法,旨在提高临床应用中的可解释性和可控性。利用Dempster-Shafer理论和主观逻辑理论,我们通过单次前传实现概率分配和不确定性量化,以确保计算效率。我们引入了一个证据图,它捕获了具有里程碑意义的证据的强度,以及一个在主观逻辑框架内校准预测概率的不确定性图。这两个分量之间的相互作用通过交叉注意机制促进,进一步提高了地标检测的准确性,增强了不确定度量化的有效性。实验结果表明,即使在嘈杂的环境中,该方法也能保持检测精度,同时在不确定度量化和质量控制方面优于目前最先进的方法。此外,当遇到多中心数据和新数据的不一致时,该模型仅通过校准的概率就能有效地识别出分布外的数据,强调了其临床应用的潜力。源代码可从github.com/warmestwind/CalibratedSL获得
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信