Adam Kotter, Samir Abdelrahman, Yi-Ki Jacob Wan, Karl Madaras-Kelly, Keaton L Morgan, Chin Fung Kelvin Kan, Guilherme Del Fiol
{"title":"Improved Interpretability Without Performance Reduction in a Sepsis Prediction Risk Score.","authors":"Adam Kotter, Samir Abdelrahman, Yi-Ki Jacob Wan, Karl Madaras-Kelly, Keaton L Morgan, Chin Fung Kelvin Kan, Guilherme Del Fiol","doi":"10.3390/diagnostics15030307","DOIUrl":null,"url":null,"abstract":"<p><p><b>Objective</b>: Sepsis is a life-threatening response to infection and a major cause of hospital mortality. Machine learning (ML) models have demonstrated better sepsis prediction performance than integer risk scores but are less widely used in clinical settings, in part due to lower interpretability. This study aimed to improve the interpretability of an ML-based model without reducing its performance in non-ICU sepsis prediction. <b>Methods</b>: A logistic regression model was trained to predict sepsis onset and then converted into a more interpretable integer point system, STEWS, using its regression coefficients. We compared STEWS with the logistic regression model using PPV at 90% sensitivity. <b>Results</b>: STEWS was significantly equivalent to logistic regression using the two one-sided tests procedure (0.051 vs. 0.051; <i>p</i> = 0.004). <b>Conclusions</b>: STEWS demonstrated equivalent performance to a comparable logistic regression model for non-ICU sepsis prediction, suggesting that converting ML models into more interpretable forms does not necessarily reduce predictive power.</p>","PeriodicalId":11225,"journal":{"name":"Diagnostics","volume":"15 3","pages":""},"PeriodicalIF":3.0000,"publicationDate":"2025-01-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11817530/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Diagnostics","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.3390/diagnostics15030307","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"MEDICINE, GENERAL & INTERNAL","Score":null,"Total":0}
引用次数: 0
Abstract
Objective: Sepsis is a life-threatening response to infection and a major cause of hospital mortality. Machine learning (ML) models have demonstrated better sepsis prediction performance than integer risk scores but are less widely used in clinical settings, in part due to lower interpretability. This study aimed to improve the interpretability of an ML-based model without reducing its performance in non-ICU sepsis prediction. Methods: A logistic regression model was trained to predict sepsis onset and then converted into a more interpretable integer point system, STEWS, using its regression coefficients. We compared STEWS with the logistic regression model using PPV at 90% sensitivity. Results: STEWS was significantly equivalent to logistic regression using the two one-sided tests procedure (0.051 vs. 0.051; p = 0.004). Conclusions: STEWS demonstrated equivalent performance to a comparable logistic regression model for non-ICU sepsis prediction, suggesting that converting ML models into more interpretable forms does not necessarily reduce predictive power.
DiagnosticsBiochemistry, Genetics and Molecular Biology-Clinical Biochemistry
CiteScore
4.70
自引率
8.30%
发文量
2699
审稿时长
19.64 days
期刊介绍:
Diagnostics (ISSN 2075-4418) is an international scholarly open access journal on medical diagnostics. It publishes original research articles, reviews, communications and short notes on the research and development of medical diagnostics. There is no restriction on the length of the papers. Our aim is to encourage scientists to publish their experimental and theoretical research in as much detail as possible. Full experimental and/or methodological details must be provided for research articles.