Qing-Bo Zeng, En-Lan Peng, Ye Zhou, Qing-Wei Lin, Lin-Cui Zhong, Long-Ping He, Nian-Qing Zhang, Jing-Chun Song
{"title":"Explainable machine learning model for predicting septic shock in critically sepsis patients based on coagulation indexes: A multicenter cohort study.","authors":"Qing-Bo Zeng, En-Lan Peng, Ye Zhou, Qing-Wei Lin, Lin-Cui Zhong, Long-Ping He, Nian-Qing Zhang, Jing-Chun Song","doi":"10.1016/j.cjtee.2024.08.012","DOIUrl":null,"url":null,"abstract":"<p><strong>Purpose: </strong>Septic shock is associated with high mortality and poor outcomes among sepsis patients with coagulopathy. Although traditional statistical methods or machine learning (ML) algorithms have been proposed to predict septic shock, these potential approaches have never been systematically compared. The present work aimed to develop and compare models to predict septic shock among patients with sepsis.</p><p><strong>Methods: </strong>It is a retrospective cohort study based on 484 patients with sepsis who were admitted to our intensive care units between May 2018 and November 2022. Patients from the 908th Hospital of Chinese PLA Logistical Support Force and Nanchang Hongdu Hospital of Traditional Chinese Medicine were respectively allocated to training (n=311) and validation (n=173) sets. All clinical and laboratory data of sepsis patients characterized by comprehensive coagulation indexes were collected. We developed 5 models based on ML algorithms and 1 model based on a traditional statistical method to predict septic shock in the training cohort. The performance of all models was assessed using the area under the receiver operating characteristic curve and calibration plots. Decision curve analysis was used to evaluate the net benefit of the models. The validation set was applied to verify the predictive accuracy of the models. This study also used SHapley Additive exPlanations method to assess variable importance and explain the prediction made by a ML algorithm.</p><p><strong>Results: </strong>Among all patients, 37.2% experienced septic shock. The characteristic curves of the 6 models ranged from 0.833 to 0.962 and 0.630 to 0.744 in the training and validation sets, respectively. The model with the best prediction performance was based on the support vector machine (SVM) algorithm, which was constructed by age, tissue plasminogen activator-inhibitor complex, prothrombin time, international normalized ratio, white blood cells, and platelet counts. The SVM model showed good calibration and discrimination and a greater net benefit in decision curve analysis.</p><p><strong>Conclusion: </strong>The SVM algorithm may be superior to other ML and traditional statistical algorithms for predicting septic shock. Physicians can better understand the reliability of the predictive model by SHapley Additive exPlanations value analysis.</p>","PeriodicalId":51555,"journal":{"name":"Chinese Journal of Traumatology","volume":" ","pages":""},"PeriodicalIF":1.9000,"publicationDate":"2025-03-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Chinese Journal of Traumatology","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1016/j.cjtee.2024.08.012","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ORTHOPEDICS","Score":null,"Total":0}
引用次数: 0
Abstract
Purpose: Septic shock is associated with high mortality and poor outcomes among sepsis patients with coagulopathy. Although traditional statistical methods or machine learning (ML) algorithms have been proposed to predict septic shock, these potential approaches have never been systematically compared. The present work aimed to develop and compare models to predict septic shock among patients with sepsis.
Methods: It is a retrospective cohort study based on 484 patients with sepsis who were admitted to our intensive care units between May 2018 and November 2022. Patients from the 908th Hospital of Chinese PLA Logistical Support Force and Nanchang Hongdu Hospital of Traditional Chinese Medicine were respectively allocated to training (n=311) and validation (n=173) sets. All clinical and laboratory data of sepsis patients characterized by comprehensive coagulation indexes were collected. We developed 5 models based on ML algorithms and 1 model based on a traditional statistical method to predict septic shock in the training cohort. The performance of all models was assessed using the area under the receiver operating characteristic curve and calibration plots. Decision curve analysis was used to evaluate the net benefit of the models. The validation set was applied to verify the predictive accuracy of the models. This study also used SHapley Additive exPlanations method to assess variable importance and explain the prediction made by a ML algorithm.
Results: Among all patients, 37.2% experienced septic shock. The characteristic curves of the 6 models ranged from 0.833 to 0.962 and 0.630 to 0.744 in the training and validation sets, respectively. The model with the best prediction performance was based on the support vector machine (SVM) algorithm, which was constructed by age, tissue plasminogen activator-inhibitor complex, prothrombin time, international normalized ratio, white blood cells, and platelet counts. The SVM model showed good calibration and discrimination and a greater net benefit in decision curve analysis.
Conclusion: The SVM algorithm may be superior to other ML and traditional statistical algorithms for predicting septic shock. Physicians can better understand the reliability of the predictive model by SHapley Additive exPlanations value analysis.
期刊介绍:
Chinese Journal of Traumatology (CJT, ISSN 1008-1275) was launched in 1998 and is a peer-reviewed English journal authorized by Chinese Association of Trauma, Chinese Medical Association. It is multidisciplinary and designed to provide the most current and relevant information for both the clinical and basic research in the field of traumatic medicine. CJT primarily publishes expert forums, original papers, case reports and so on. Topics cover trauma system and management, surgical procedures, acute care, rehabilitation, post-traumatic complications, translational medicine, traffic medicine and other related areas. The journal especially emphasizes clinical application, technique, surgical video, guideline, recommendations for more effective surgical approaches.