贝叶斯Kolmogorov-Arnold网络:基于概率样条分解的不确定性感知可解释建模

IF 3.1 3区 物理与天体物理 Q2 PHYSICS, MULTIDISCIPLINARY
Masoud Muhammed Hassan
{"title":"贝叶斯Kolmogorov-Arnold网络:基于概率样条分解的不确定性感知可解释建模","authors":"Masoud Muhammed Hassan","doi":"10.1016/j.physa.2025.131041","DOIUrl":null,"url":null,"abstract":"<div><div>Deep learning has emerged as an essential tool in many industries, including healthcare. Traditional deep learning models lack interpretability and omit to take prediction uncertainty into account, two crucial components of clinical decision-making. In order to produce explainable and uncertainty-aware predictions, we present Bayesian Kolmogorov-Arnold Networks (Bayesian-KANs), a novel neural architecture that rigorously implements the Kolmogorov-Arnold representation theorem while providing quantified uncertainty estimates. Unlike existing KAN implementations, our method formally connects each network component to the theorem's mathematical structure through probabilistic splines. It introduces Bayesian uncertainty quantification in both inner (<span><math><mi>ψ</mi></math></span>) and outer (<span><math><mi>φ</mi></math></span>) functions, and hence enables interpretable feature interaction analysis via uncertainty-aware decomposition. We evaluated Bayesian-KANs on four benchmark medical datasets: Pima Indians Diabetes, Cleveland Heart Disease, Breast Cancer Wisconsin (Diagnostic), and Hepatitis, and observed consistently superior performance over baseline models. Bayesian-KAN achieves accuracies of 80.1 %, 85.7 %, 96.2 %, and 88.5 %, respectively, with significantly tighter confidence intervals and higher AUC-ROC and F1 scores. Comparative analyses showed that Bayesian-KAN not only outperforms logistic regression, SVMs, traditional neural networks, and deterministic KANs in predictive accuracy, but also provides more calibrated and trustworthy uncertainty estimates. Additionally, Bayesian-KAN successfully highlights clinically relevant features in all datasets, enhancing transparency in decision-making. Moreover, Bayesian-KANs' capacity to represent aleatoric and epistemic uncertainty guarantees doctors receive more solid and trustworthy decision support. Our Bayesian strategy improves the interpretability of the model and considerably minimises overfitting, which is important for tiny and imbalanced medical datasets, according to experimental results. We present possible expansions to further use Bayesian-KANs in more complicated multimodal datasets and address the significance of these discoveries for future research in building reliable AI systems for healthcare. This work paves the way for a new paradigm in deep learning model deployment in vital sectors where transparency and reliability are crucial.</div></div>","PeriodicalId":20152,"journal":{"name":"Physica A: Statistical Mechanics and its Applications","volume":"680 ","pages":"Article 131041"},"PeriodicalIF":3.1000,"publicationDate":"2025-10-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Bayesian Kolmogorov-Arnold networks: Uncertainty-aware interpretable modeling through probabilistic spline decomposition\",\"authors\":\"Masoud Muhammed Hassan\",\"doi\":\"10.1016/j.physa.2025.131041\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Deep learning has emerged as an essential tool in many industries, including healthcare. Traditional deep learning models lack interpretability and omit to take prediction uncertainty into account, two crucial components of clinical decision-making. In order to produce explainable and uncertainty-aware predictions, we present Bayesian Kolmogorov-Arnold Networks (Bayesian-KANs), a novel neural architecture that rigorously implements the Kolmogorov-Arnold representation theorem while providing quantified uncertainty estimates. Unlike existing KAN implementations, our method formally connects each network component to the theorem's mathematical structure through probabilistic splines. It introduces Bayesian uncertainty quantification in both inner (<span><math><mi>ψ</mi></math></span>) and outer (<span><math><mi>φ</mi></math></span>) functions, and hence enables interpretable feature interaction analysis via uncertainty-aware decomposition. We evaluated Bayesian-KANs on four benchmark medical datasets: Pima Indians Diabetes, Cleveland Heart Disease, Breast Cancer Wisconsin (Diagnostic), and Hepatitis, and observed consistently superior performance over baseline models. Bayesian-KAN achieves accuracies of 80.1 %, 85.7 %, 96.2 %, and 88.5 %, respectively, with significantly tighter confidence intervals and higher AUC-ROC and F1 scores. Comparative analyses showed that Bayesian-KAN not only outperforms logistic regression, SVMs, traditional neural networks, and deterministic KANs in predictive accuracy, but also provides more calibrated and trustworthy uncertainty estimates. Additionally, Bayesian-KAN successfully highlights clinically relevant features in all datasets, enhancing transparency in decision-making. Moreover, Bayesian-KANs' capacity to represent aleatoric and epistemic uncertainty guarantees doctors receive more solid and trustworthy decision support. Our Bayesian strategy improves the interpretability of the model and considerably minimises overfitting, which is important for tiny and imbalanced medical datasets, according to experimental results. We present possible expansions to further use Bayesian-KANs in more complicated multimodal datasets and address the significance of these discoveries for future research in building reliable AI systems for healthcare. This work paves the way for a new paradigm in deep learning model deployment in vital sectors where transparency and reliability are crucial.</div></div>\",\"PeriodicalId\":20152,\"journal\":{\"name\":\"Physica A: Statistical Mechanics and its Applications\",\"volume\":\"680 \",\"pages\":\"Article 131041\"},\"PeriodicalIF\":3.1000,\"publicationDate\":\"2025-10-14\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Physica A: Statistical Mechanics and its Applications\",\"FirstCategoryId\":\"101\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0378437125006934\",\"RegionNum\":3,\"RegionCategory\":\"物理与天体物理\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"PHYSICS, MULTIDISCIPLINARY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Physica A: Statistical Mechanics and its Applications","FirstCategoryId":"101","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0378437125006934","RegionNum":3,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"PHYSICS, MULTIDISCIPLINARY","Score":null,"Total":0}
引用次数: 0

摘要

深度学习已成为包括医疗保健在内的许多行业的重要工具。传统的深度学习模型缺乏可解释性,并且忽略了预测的不确定性,这是临床决策的两个关键组成部分。为了产生可解释的和不确定性感知的预测,我们提出了贝叶斯Kolmogorov-Arnold网络(Bayesian- kans),这是一种新的神经结构,它严格实现了Kolmogorov-Arnold表示定理,同时提供了量化的不确定性估计。与现有的KAN实现不同,我们的方法通过概率样条将每个网络组件正式连接到定理的数学结构。它在内部(ψ)和外部(φ)函数中引入贝叶斯不确定性量化,从而通过不确定性感知分解实现可解释的特征交互分析。我们评估了贝叶斯- kans在四个基准医疗数据集:皮马印第安人糖尿病,克利夫兰心脏病,乳腺癌威斯康星(诊断)和肝炎,并观察到一贯优于基线模型的性能。贝叶斯- kan的准确率分别为80.1%、85.7%、96.2%和88.5%,置信区间明显更紧凑,AUC-ROC和F1得分更高。对比分析表明,贝叶斯kan不仅在预测精度上优于逻辑回归、支持向量机、传统神经网络和确定性kan,而且提供了更校准和可信的不确定性估计。此外,贝叶斯kan成功地突出了所有数据集的临床相关特征,提高了决策的透明度。此外,贝叶斯- kans表示任意和认知不确定性的能力保证医生得到更可靠和值得信赖的决策支持。根据实验结果,我们的贝叶斯策略提高了模型的可解释性,并大大减少了过拟合,这对于微小和不平衡的医疗数据集很重要。我们提出了在更复杂的多模态数据集中进一步使用贝叶斯- kans的可能扩展,并解决了这些发现对未来研究构建可靠的医疗保健人工智能系统的意义。这项工作为在透明度和可靠性至关重要的关键部门部署深度学习模型的新范例铺平了道路。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Bayesian Kolmogorov-Arnold networks: Uncertainty-aware interpretable modeling through probabilistic spline decomposition
Deep learning has emerged as an essential tool in many industries, including healthcare. Traditional deep learning models lack interpretability and omit to take prediction uncertainty into account, two crucial components of clinical decision-making. In order to produce explainable and uncertainty-aware predictions, we present Bayesian Kolmogorov-Arnold Networks (Bayesian-KANs), a novel neural architecture that rigorously implements the Kolmogorov-Arnold representation theorem while providing quantified uncertainty estimates. Unlike existing KAN implementations, our method formally connects each network component to the theorem's mathematical structure through probabilistic splines. It introduces Bayesian uncertainty quantification in both inner (ψ) and outer (φ) functions, and hence enables interpretable feature interaction analysis via uncertainty-aware decomposition. We evaluated Bayesian-KANs on four benchmark medical datasets: Pima Indians Diabetes, Cleveland Heart Disease, Breast Cancer Wisconsin (Diagnostic), and Hepatitis, and observed consistently superior performance over baseline models. Bayesian-KAN achieves accuracies of 80.1 %, 85.7 %, 96.2 %, and 88.5 %, respectively, with significantly tighter confidence intervals and higher AUC-ROC and F1 scores. Comparative analyses showed that Bayesian-KAN not only outperforms logistic regression, SVMs, traditional neural networks, and deterministic KANs in predictive accuracy, but also provides more calibrated and trustworthy uncertainty estimates. Additionally, Bayesian-KAN successfully highlights clinically relevant features in all datasets, enhancing transparency in decision-making. Moreover, Bayesian-KANs' capacity to represent aleatoric and epistemic uncertainty guarantees doctors receive more solid and trustworthy decision support. Our Bayesian strategy improves the interpretability of the model and considerably minimises overfitting, which is important for tiny and imbalanced medical datasets, according to experimental results. We present possible expansions to further use Bayesian-KANs in more complicated multimodal datasets and address the significance of these discoveries for future research in building reliable AI systems for healthcare. This work paves the way for a new paradigm in deep learning model deployment in vital sectors where transparency and reliability are crucial.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
CiteScore
7.20
自引率
9.10%
发文量
852
审稿时长
6.6 months
期刊介绍: Physica A: Statistical Mechanics and its Applications Recognized by the European Physical Society Physica A publishes research in the field of statistical mechanics and its applications. Statistical mechanics sets out to explain the behaviour of macroscopic systems by studying the statistical properties of their microscopic constituents. Applications of the techniques of statistical mechanics are widespread, and include: applications to physical systems such as solids, liquids and gases; applications to chemical and biological systems (colloids, interfaces, complex fluids, polymers and biopolymers, cell physics); and other interdisciplinary applications to for instance biological, economical and sociological systems.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信