{"title":"Machine Learning-Based Mortality Prediction for Acute Gastrointestinal Bleeding Patients Admitted to Intensive Care Unit.","authors":"Zhou Liu, Liang Zhang, Gui-Jun Jiang, Qian-Qian Chen, Yan-Guang Hou, Wei Wu, Muskaan Malik, Guang Li, Li-Ying Zhan","doi":"10.1007/s11596-025-00022-6","DOIUrl":null,"url":null,"abstract":"<p><strong>Objective: </strong>The study aimed to develop machine learning (ML) models to predict the mortality of patients with acute gastrointestinal bleeding (AGIB) in the intensive care unit (ICU) and compared their prognostic performance with that of Acute Physiology and Chronic Health Evaluation II (APACHE-II) score.</p><p><strong>Methods: </strong>A total of 961 AGIB patients admitted to the ICU of Renmin Hospital of Wuhan University from January 2020 to December 2023 were enrolled. Patients were randomly divided into the training cohort (n = 768) and the validation cohort (n = 193). Clinical data were collected within the first 24 h of ICU admission. ML models were constructed using Python V.3.7 package, employing 3 different algorithms: XGBoost, Random Forest (RF) and Gradient Boosting Decision Tree (GBDT). The area under the receiver operating characteristic (ROC) curve (AUC) was used to evaluate the performance of different models.</p><p><strong>Results: </strong>A total of 94 patients died with an overall mortality of 9.78% (11.32% in the training cohort and 8.96% in the validation cohort). Among the 3 ML models, the GBDT algorithm demonstrated the highest predictive performance, achieving an AUC of 0.95 (95% CI 0.90-0.99), while the AUCs of XGBoost and RF models were 0.89 (95% CI 0.82-0.96) and 0.90 (95% CI 0.84-0.96), respectively. In comparison, the APACHE-II model achieved an AUC of 0.74 (95% CI 0.69-0.87), with a specificity of 70.97% (95% CI 64.07-77.01). When APACHE-II score was incorporated into the GBDT algorithm, the ensemble model achieved an AUC of 0.98 (95% CI 0.96-0.99) with a sensitivity of 85.71% and a specificity up to 95.15%.</p><p><strong>Conclusions: </strong>The GBDT model serves as a reliable tool for accurately predicting the in-hospital mortality for AGIB patients. When integrated with the APACHE-II score, the ensemble GBDT algorithm further enhances predictive accuracy and provides valuable insights for prognostic evaluation.</p>","PeriodicalId":10820,"journal":{"name":"Current Medical Science","volume":" ","pages":"70-81"},"PeriodicalIF":2.0000,"publicationDate":"2025-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Current Medical Science","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1007/s11596-025-00022-6","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2025/2/27 0:00:00","PubModel":"Epub","JCR":"Q3","JCRName":"MEDICINE, RESEARCH & EXPERIMENTAL","Score":null,"Total":0}
引用次数: 0
Abstract
Objective: The study aimed to develop machine learning (ML) models to predict the mortality of patients with acute gastrointestinal bleeding (AGIB) in the intensive care unit (ICU) and compared their prognostic performance with that of Acute Physiology and Chronic Health Evaluation II (APACHE-II) score.
Methods: A total of 961 AGIB patients admitted to the ICU of Renmin Hospital of Wuhan University from January 2020 to December 2023 were enrolled. Patients were randomly divided into the training cohort (n = 768) and the validation cohort (n = 193). Clinical data were collected within the first 24 h of ICU admission. ML models were constructed using Python V.3.7 package, employing 3 different algorithms: XGBoost, Random Forest (RF) and Gradient Boosting Decision Tree (GBDT). The area under the receiver operating characteristic (ROC) curve (AUC) was used to evaluate the performance of different models.
Results: A total of 94 patients died with an overall mortality of 9.78% (11.32% in the training cohort and 8.96% in the validation cohort). Among the 3 ML models, the GBDT algorithm demonstrated the highest predictive performance, achieving an AUC of 0.95 (95% CI 0.90-0.99), while the AUCs of XGBoost and RF models were 0.89 (95% CI 0.82-0.96) and 0.90 (95% CI 0.84-0.96), respectively. In comparison, the APACHE-II model achieved an AUC of 0.74 (95% CI 0.69-0.87), with a specificity of 70.97% (95% CI 64.07-77.01). When APACHE-II score was incorporated into the GBDT algorithm, the ensemble model achieved an AUC of 0.98 (95% CI 0.96-0.99) with a sensitivity of 85.71% and a specificity up to 95.15%.
Conclusions: The GBDT model serves as a reliable tool for accurately predicting the in-hospital mortality for AGIB patients. When integrated with the APACHE-II score, the ensemble GBDT algorithm further enhances predictive accuracy and provides valuable insights for prognostic evaluation.
目的:建立机器学习(ML)模型预测重症监护病房(ICU)急性消化道出血(AGIB)患者的死亡率,并将其预后表现与急性生理与慢性健康评估II (APACHE-II)评分进行比较。方法:选取2020年1月至2023年12月武汉大学人民医院ICU收治的AGIB患者961例。患者随机分为训练组(n = 768)和验证组(n = 193)。在ICU入院前24小时内收集临床资料。使用Python V.3.7包构建ML模型,采用3种不同的算法:XGBoost、Random Forest (RF)和Gradient Boosting Decision Tree (GBDT)。采用受试者工作特征曲线下面积(AUC)来评价不同模型的性能。结果:94例患者死亡,总死亡率为9.78%(训练组11.32%,验证组8.96%)。在3 ML模型中,GBDT算法表现出最高的预测性能,AUC为0.95 (95% CI 0.90-0.99),而XGBoost和RF模型的AUC分别为0.89 (95% CI 0.82-0.96)和0.90 (95% CI 0.84-0.96)。相比之下,APACHE-II模型的AUC为0.74 (95% CI 0.69-0.87),特异性为70.97% (95% CI 64.07-77.01)。当将APACHE-II评分纳入GBDT算法时,集成模型的AUC为0.98 (95% CI 0.96-0.99),灵敏度为85.71%,特异性为95.15%。结论:GBDT模型是准确预测AGIB患者住院死亡率的可靠工具。当与APACHE-II评分相结合时,集成GBDT算法进一步提高了预测准确性,并为预后评估提供了有价值的见解。
期刊介绍:
Current Medical Science provides a forum for peer-reviewed papers in the medical sciences, to promote academic exchange between Chinese researchers and doctors and their foreign counterparts. The journal covers the subjects of biomedicine such as physiology, biochemistry, molecular biology, pharmacology, pathology and pathophysiology, etc., and clinical research, such as surgery, internal medicine, obstetrics and gynecology, pediatrics and otorhinolaryngology etc. The articles appearing in Current Medical Science are mainly in English, with a very small number of its papers in German, to pay tribute to its German founder. This journal is the only medical periodical in Western languages sponsored by an educational institution located in the central part of China.