Risk prediction of sepsis-associated acute kidney injury: development, validation of a machine learning model with multicenter data.

IF 5.5 3区 医学 Q2 MEDICAL INFORMATICS
Renzhi Tan, Yongchen Li, Diman Mai, Jingwen Liu, Yushuang Wei, Chao Wang, Zengnan Mo
{"title":"Risk prediction of sepsis-associated acute kidney injury: development, validation of a machine learning model with multicenter data.","authors":"Renzhi Tan, Yongchen Li, Diman Mai, Jingwen Liu, Yushuang Wei, Chao Wang, Zengnan Mo","doi":"10.1186/s12911-026-03620-z","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Sepsis-associated acute kidney injury (SA-AKI) is a common and severe complication in intensive care unit (ICU) patients, with high incidence and mortality. Conventional diagnostic indicators, such as serum creatinine and urine output, have limitations in early identification. Existing machine learning (ML)-based prediction models are mostly single-center and lack interpretability, highlighting the clinical need for reliable and applicable early prediction tools.</p><p><strong>Methods: </strong>Data were collected from the Medical Information Mart for Intensive Care IV (MIMIC-IV), eICU Collaborative Research Database (eICU-CRD), and Bobai County People's Hospital ICU (BB-ICU). Eligible patients were those meeting the Sepsis-3.0 criteria, with SA-AKI as the primary outcome. Ten core variables were selected from 83 indicators measured within 24 h of ICU admission through a four-step screening process. Six ML algorithms were optimized using grid search and five-fold cross-validation. Model performance was evaluated using receiver operating characteristic (ROC) curves, calibration curves, and decision curve analysis (DCA). The optimal model was interpreted via SHAP, externally validated, and translated into a web-based calculator using the Shiny framework.</p><p><strong>Results: </strong>The incidence of SA-AKI was 45.1% in MIMIC-IV, 28.1% in eICU-CRD, and 34.1% in BB-ICU. The XGBoost model performed best, with an internal area under the curve (AUC) of 0.72 and external validation AUCs of 0.82 (eICU-CRD) and 0.84 (BB-ICU). The XGBoost model also showed balanced classification metrics (sensitivity 0.73, specificity 0.60), a calibration curve close to the diagonal, and the highest net benefit in DCA. SHAP analysis identified partial thromboplastin time (PTT), creatinine, 24-hour urine output, and SAPSII as the key predictive factors.</p><p><strong>Conclusions: </strong>The ML model developed in this study demonstrates good discriminative ability, calibration, and clinical applicability. SHAP improves the model's interpretability, and the web-based tool supports early SA-AKI risk stratification. This study provides a technical basis for addressing the clinical challenge of early SA-AKI prediction.</p>","PeriodicalId":9340,"journal":{"name":"BMC Medical Informatics and Decision Making","volume":" ","pages":""},"PeriodicalIF":5.5000,"publicationDate":"2026-06-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC13587423/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"BMC Medical Informatics and Decision Making","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1186/s12911-026-03620-z","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"MEDICAL INFORMATICS","Score":null,"Total":0}
引用次数: 0

Abstract

Background: Sepsis-associated acute kidney injury (SA-AKI) is a common and severe complication in intensive care unit (ICU) patients, with high incidence and mortality. Conventional diagnostic indicators, such as serum creatinine and urine output, have limitations in early identification. Existing machine learning (ML)-based prediction models are mostly single-center and lack interpretability, highlighting the clinical need for reliable and applicable early prediction tools.

Methods: Data were collected from the Medical Information Mart for Intensive Care IV (MIMIC-IV), eICU Collaborative Research Database (eICU-CRD), and Bobai County People's Hospital ICU (BB-ICU). Eligible patients were those meeting the Sepsis-3.0 criteria, with SA-AKI as the primary outcome. Ten core variables were selected from 83 indicators measured within 24 h of ICU admission through a four-step screening process. Six ML algorithms were optimized using grid search and five-fold cross-validation. Model performance was evaluated using receiver operating characteristic (ROC) curves, calibration curves, and decision curve analysis (DCA). The optimal model was interpreted via SHAP, externally validated, and translated into a web-based calculator using the Shiny framework.

Results: The incidence of SA-AKI was 45.1% in MIMIC-IV, 28.1% in eICU-CRD, and 34.1% in BB-ICU. The XGBoost model performed best, with an internal area under the curve (AUC) of 0.72 and external validation AUCs of 0.82 (eICU-CRD) and 0.84 (BB-ICU). The XGBoost model also showed balanced classification metrics (sensitivity 0.73, specificity 0.60), a calibration curve close to the diagonal, and the highest net benefit in DCA. SHAP analysis identified partial thromboplastin time (PTT), creatinine, 24-hour urine output, and SAPSII as the key predictive factors.

Conclusions: The ML model developed in this study demonstrates good discriminative ability, calibration, and clinical applicability. SHAP improves the model's interpretability, and the web-based tool supports early SA-AKI risk stratification. This study provides a technical basis for addressing the clinical challenge of early SA-AKI prediction.

脓毒症相关急性肾损伤的风险预测:多中心数据的机器学习模型的开发和验证。
背景:脓毒症相关急性肾损伤(SA-AKI)是重症监护病房(ICU)患者常见且严重的并发症,具有较高的发病率和死亡率。传统的诊断指标,如血清肌酐和尿量,在早期识别有局限性。现有的基于机器学习(ML)的预测模型大多是单中心的,缺乏可解释性,这突出了临床对可靠和适用的早期预测工具的需求。方法:从重症监护医学信息市场IV (MIMIC-IV)、eICU合作研究数据库(eICU- crd)和博白县人民医院ICU (BB-ICU)中收集数据。符合脓毒症3.0标准的患者,以SA-AKI为主要结局。通过四步筛选过程,从ICU入院24小时内测量的83项指标中选择10项核心变量。采用网格搜索和五重交叉验证对6种ML算法进行了优化。采用受试者工作特征(ROC)曲线、校正曲线和决策曲线分析(DCA)评价模型的性能。最优模型通过SHAP解释,外部验证,并使用Shiny框架转换为基于web的计算器。结果:MIMIC-IV组SA-AKI发生率为45.1%,eICU-CRD组为28.1%,BB-ICU组为34.1%。XGBoost模型表现最佳,其内部曲线下面积(AUC)为0.72,外部验证AUC为0.82 (eICU-CRD)和0.84 (BB-ICU)。XGBoost模型还具有平衡的分类指标(灵敏度0.73,特异性0.60),校准曲线接近对角线,并且在DCA中具有最高的净效益。SHAP分析确定部分凝血活素时间(PTT)、肌酐、24小时尿量和SAPSII是关键的预测因素。结论:本研究建立的ML模型具有良好的判别能力、校准能力和临床适用性。SHAP提高了模型的可解释性,基于网络的工具支持早期SA-AKI风险分层。本研究为解决早期SA-AKI预测的临床挑战提供了技术基础。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
CiteScore
7.20
自引率
5.70%
发文量
297
审稿时长
1 months
期刊介绍: BMC Medical Informatics and Decision Making is an open access journal publishing original peer-reviewed research articles in relation to the design, development, implementation, use, and evaluation of health information technologies and decision-making for human health.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信
小红书