{"title":"Bayesian Kolmogorov-Arnold networks: Uncertainty-aware interpretable modeling through probabilistic spline decomposition","authors":"Masoud Muhammed Hassan","doi":"10.1016/j.physa.2025.131041","DOIUrl":null,"url":null,"abstract":"<div><div>Deep learning has emerged as an essential tool in many industries, including healthcare. Traditional deep learning models lack interpretability and omit to take prediction uncertainty into account, two crucial components of clinical decision-making. In order to produce explainable and uncertainty-aware predictions, we present Bayesian Kolmogorov-Arnold Networks (Bayesian-KANs), a novel neural architecture that rigorously implements the Kolmogorov-Arnold representation theorem while providing quantified uncertainty estimates. Unlike existing KAN implementations, our method formally connects each network component to the theorem's mathematical structure through probabilistic splines. It introduces Bayesian uncertainty quantification in both inner (<span><math><mi>ψ</mi></math></span>) and outer (<span><math><mi>φ</mi></math></span>) functions, and hence enables interpretable feature interaction analysis via uncertainty-aware decomposition. We evaluated Bayesian-KANs on four benchmark medical datasets: Pima Indians Diabetes, Cleveland Heart Disease, Breast Cancer Wisconsin (Diagnostic), and Hepatitis, and observed consistently superior performance over baseline models. Bayesian-KAN achieves accuracies of 80.1 %, 85.7 %, 96.2 %, and 88.5 %, respectively, with significantly tighter confidence intervals and higher AUC-ROC and F1 scores. Comparative analyses showed that Bayesian-KAN not only outperforms logistic regression, SVMs, traditional neural networks, and deterministic KANs in predictive accuracy, but also provides more calibrated and trustworthy uncertainty estimates. Additionally, Bayesian-KAN successfully highlights clinically relevant features in all datasets, enhancing transparency in decision-making. Moreover, Bayesian-KANs' capacity to represent aleatoric and epistemic uncertainty guarantees doctors receive more solid and trustworthy decision support. Our Bayesian strategy improves the interpretability of the model and considerably minimises overfitting, which is important for tiny and imbalanced medical datasets, according to experimental results. We present possible expansions to further use Bayesian-KANs in more complicated multimodal datasets and address the significance of these discoveries for future research in building reliable AI systems for healthcare. This work paves the way for a new paradigm in deep learning model deployment in vital sectors where transparency and reliability are crucial.</div></div>","PeriodicalId":20152,"journal":{"name":"Physica A: Statistical Mechanics and its Applications","volume":"680 ","pages":"Article 131041"},"PeriodicalIF":3.1000,"publicationDate":"2025-10-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Physica A: Statistical Mechanics and its Applications","FirstCategoryId":"101","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0378437125006934","RegionNum":3,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"PHYSICS, MULTIDISCIPLINARY","Score":null,"Total":0}
引用次数: 0
Abstract
Deep learning has emerged as an essential tool in many industries, including healthcare. Traditional deep learning models lack interpretability and omit to take prediction uncertainty into account, two crucial components of clinical decision-making. In order to produce explainable and uncertainty-aware predictions, we present Bayesian Kolmogorov-Arnold Networks (Bayesian-KANs), a novel neural architecture that rigorously implements the Kolmogorov-Arnold representation theorem while providing quantified uncertainty estimates. Unlike existing KAN implementations, our method formally connects each network component to the theorem's mathematical structure through probabilistic splines. It introduces Bayesian uncertainty quantification in both inner () and outer () functions, and hence enables interpretable feature interaction analysis via uncertainty-aware decomposition. We evaluated Bayesian-KANs on four benchmark medical datasets: Pima Indians Diabetes, Cleveland Heart Disease, Breast Cancer Wisconsin (Diagnostic), and Hepatitis, and observed consistently superior performance over baseline models. Bayesian-KAN achieves accuracies of 80.1 %, 85.7 %, 96.2 %, and 88.5 %, respectively, with significantly tighter confidence intervals and higher AUC-ROC and F1 scores. Comparative analyses showed that Bayesian-KAN not only outperforms logistic regression, SVMs, traditional neural networks, and deterministic KANs in predictive accuracy, but also provides more calibrated and trustworthy uncertainty estimates. Additionally, Bayesian-KAN successfully highlights clinically relevant features in all datasets, enhancing transparency in decision-making. Moreover, Bayesian-KANs' capacity to represent aleatoric and epistemic uncertainty guarantees doctors receive more solid and trustworthy decision support. Our Bayesian strategy improves the interpretability of the model and considerably minimises overfitting, which is important for tiny and imbalanced medical datasets, according to experimental results. We present possible expansions to further use Bayesian-KANs in more complicated multimodal datasets and address the significance of these discoveries for future research in building reliable AI systems for healthcare. This work paves the way for a new paradigm in deep learning model deployment in vital sectors where transparency and reliability are crucial.
期刊介绍:
Physica A: Statistical Mechanics and its Applications
Recognized by the European Physical Society
Physica A publishes research in the field of statistical mechanics and its applications.
Statistical mechanics sets out to explain the behaviour of macroscopic systems by studying the statistical properties of their microscopic constituents.
Applications of the techniques of statistical mechanics are widespread, and include: applications to physical systems such as solids, liquids and gases; applications to chemical and biological systems (colloids, interfaces, complex fluids, polymers and biopolymers, cell physics); and other interdisciplinary applications to for instance biological, economical and sociological systems.