Jeffrey Balian , Sara Sakowitz MS, MPH , Arjun Verma BS , Amulya Vadlakonda BS , Emma Cruz , Konmal Ali , Peyman Benharash MD
{"title":"基于机器学习的体外膜肺氧合术后再住院预测模型","authors":"Jeffrey Balian , Sara Sakowitz MS, MPH , Arjun Verma BS , Amulya Vadlakonda BS , Emma Cruz , Konmal Ali , Peyman Benharash MD","doi":"10.1016/j.sopen.2024.04.003","DOIUrl":null,"url":null,"abstract":"<div><h3>Background</h3><p>Despite increasing utilization and survival benefit over the last decade, extracorporeal membrane oxygenation (ECMO) remains resource-intensive with significant complications and rehospitalization risk. We thus utilized machine learning (ML) to develop prediction models for 90-day nonelective readmission following ECMO.</p></div><div><h3>Methods</h3><p>All adult patients receiving ECMO who survived index hospitalization were tabulated from the 2016–2020 Nationwide Readmissions Database. Extreme Gradient Boosting (XGBoost) models were developed to identify features associated with readmission following ECMO. Area under the receiver operating characteristic (AUROC), mean Average Precision (mAP), and the Brier score were calculated to estimate model performance relative to logistic regression (LR). Shapley Additive Explanation summary (SHAP) plots evaluated the relative impact of each factor on the model. An additional sensitivity analysis solely included patient comorbidities and indication for ECMO as potential model covariates.</p></div><div><h3>Results</h3><p>Of ∼22,947 patients, 4495 (19.6 %) were readmitted nonelectively within 90 days. The XGBoost model exhibited superior discrimination (AUROC 0.64 vs 0.49), classification accuracy (mAP 0.30 vs 0.20) and calibration (Brier score 0.154 vs 0.165, all P < 0.001) in predicting readmission compared to LR. SHAP plots identified duration of index hospitalization, undergoing heart/lung transplantation, and Medicare insurance to be associated with increased odds of readmission. Upon sub-analysis, XGBoost demonstrated superior disclination compared to LR (AUROC 0.61 vs 0.60, P < 0.05). Chronic liver disease and frailty were linked with increased odds of nonelective readmission.</p></div><div><h3>Conclusions</h3><p>ML outperformed LR in predicting readmission following ECMO. Future work is needed to identify other factors linked with readmission and further optimize post-ECMO care among this cohort.</p></div>","PeriodicalId":74892,"journal":{"name":"Surgery open science","volume":"19 ","pages":"Pages 125-130"},"PeriodicalIF":1.4000,"publicationDate":"2024-04-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2589845024000538/pdfft?md5=b16fabd665e514f87c6396c48ad4addd&pid=1-s2.0-S2589845024000538-main.pdf","citationCount":"0","resultStr":"{\"title\":\"Machine learning based predictive modeling of readmissions following extracorporeal membrane oxygenation hospitalizations\",\"authors\":\"Jeffrey Balian , Sara Sakowitz MS, MPH , Arjun Verma BS , Amulya Vadlakonda BS , Emma Cruz , Konmal Ali , Peyman Benharash MD\",\"doi\":\"10.1016/j.sopen.2024.04.003\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><h3>Background</h3><p>Despite increasing utilization and survival benefit over the last decade, extracorporeal membrane oxygenation (ECMO) remains resource-intensive with significant complications and rehospitalization risk. We thus utilized machine learning (ML) to develop prediction models for 90-day nonelective readmission following ECMO.</p></div><div><h3>Methods</h3><p>All adult patients receiving ECMO who survived index hospitalization were tabulated from the 2016–2020 Nationwide Readmissions Database. Extreme Gradient Boosting (XGBoost) models were developed to identify features associated with readmission following ECMO. Area under the receiver operating characteristic (AUROC), mean Average Precision (mAP), and the Brier score were calculated to estimate model performance relative to logistic regression (LR). Shapley Additive Explanation summary (SHAP) plots evaluated the relative impact of each factor on the model. An additional sensitivity analysis solely included patient comorbidities and indication for ECMO as potential model covariates.</p></div><div><h3>Results</h3><p>Of ∼22,947 patients, 4495 (19.6 %) were readmitted nonelectively within 90 days. The XGBoost model exhibited superior discrimination (AUROC 0.64 vs 0.49), classification accuracy (mAP 0.30 vs 0.20) and calibration (Brier score 0.154 vs 0.165, all P < 0.001) in predicting readmission compared to LR. SHAP plots identified duration of index hospitalization, undergoing heart/lung transplantation, and Medicare insurance to be associated with increased odds of readmission. Upon sub-analysis, XGBoost demonstrated superior disclination compared to LR (AUROC 0.61 vs 0.60, P < 0.05). Chronic liver disease and frailty were linked with increased odds of nonelective readmission.</p></div><div><h3>Conclusions</h3><p>ML outperformed LR in predicting readmission following ECMO. Future work is needed to identify other factors linked with readmission and further optimize post-ECMO care among this cohort.</p></div>\",\"PeriodicalId\":74892,\"journal\":{\"name\":\"Surgery open science\",\"volume\":\"19 \",\"pages\":\"Pages 125-130\"},\"PeriodicalIF\":1.4000,\"publicationDate\":\"2024-04-10\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.sciencedirect.com/science/article/pii/S2589845024000538/pdfft?md5=b16fabd665e514f87c6396c48ad4addd&pid=1-s2.0-S2589845024000538-main.pdf\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Surgery open science\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S2589845024000538\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"SURGERY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Surgery open science","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2589845024000538","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"SURGERY","Score":null,"Total":0}
引用次数: 0
摘要
背景尽管在过去十年中,体外膜肺氧合(ECMO)的使用率和存活率不断提高,但它仍然是一种资源密集型治疗,具有显著的并发症和再住院风险。因此,我们利用机器学习(ML)开发了ECMO术后90天非选择性再入院的预测模型。方法从2016-2020年全国再入院数据库中统计了所有接受ECMO且在指数住院中存活的成年患者。开发了极端梯度提升(XGBoost)模型,以确定与 ECMO 后再入院相关的特征。计算了接受者操作特征下面积(AUROC)、平均精度(mAP)和布赖尔评分,以估计模型相对于逻辑回归(LR)的性能。Shapley Additive Explanation summary (SHAP) 图评估了各因素对模型的相对影响。结果 在 22947 名患者中,有 4495 人(19.6%)在 90 天内再次非选择性入院。与 LR 相比,XGBoost 模型在预测再入院方面表现出更高的区分度(AUROC 0.64 vs 0.49)、分类准确性(mAP 0.30 vs 0.20)和校准性(Brier score 0.154 vs 0.165,所有 P < 0.001)。SHAP 图显示,指数住院时间、接受心肺移植手术和医疗保险与再入院几率增加有关。经过子分析,XGBoost 与 LR 相比,显示出更优越的预测能力(AUROC 0.61 vs 0.60,P < 0.05)。慢性肝病和体弱与非选择性再入院的几率增加有关。未来需要开展工作,确定与再入院相关的其他因素,并进一步优化该人群的 ECMO 术后护理。
Machine learning based predictive modeling of readmissions following extracorporeal membrane oxygenation hospitalizations
Background
Despite increasing utilization and survival benefit over the last decade, extracorporeal membrane oxygenation (ECMO) remains resource-intensive with significant complications and rehospitalization risk. We thus utilized machine learning (ML) to develop prediction models for 90-day nonelective readmission following ECMO.
Methods
All adult patients receiving ECMO who survived index hospitalization were tabulated from the 2016–2020 Nationwide Readmissions Database. Extreme Gradient Boosting (XGBoost) models were developed to identify features associated with readmission following ECMO. Area under the receiver operating characteristic (AUROC), mean Average Precision (mAP), and the Brier score were calculated to estimate model performance relative to logistic regression (LR). Shapley Additive Explanation summary (SHAP) plots evaluated the relative impact of each factor on the model. An additional sensitivity analysis solely included patient comorbidities and indication for ECMO as potential model covariates.
Results
Of ∼22,947 patients, 4495 (19.6 %) were readmitted nonelectively within 90 days. The XGBoost model exhibited superior discrimination (AUROC 0.64 vs 0.49), classification accuracy (mAP 0.30 vs 0.20) and calibration (Brier score 0.154 vs 0.165, all P < 0.001) in predicting readmission compared to LR. SHAP plots identified duration of index hospitalization, undergoing heart/lung transplantation, and Medicare insurance to be associated with increased odds of readmission. Upon sub-analysis, XGBoost demonstrated superior disclination compared to LR (AUROC 0.61 vs 0.60, P < 0.05). Chronic liver disease and frailty were linked with increased odds of nonelective readmission.
Conclusions
ML outperformed LR in predicting readmission following ECMO. Future work is needed to identify other factors linked with readmission and further optimize post-ECMO care among this cohort.