Jeffrey Balian , Sara Sakowitz MS, MPH , Arjun Verma BS , Amulya Vadlakonda BS , Emma Cruz , Konmal Ali , Peyman Benharash MD
{"title":"Machine learning based predictive modeling of readmissions following extracorporeal membrane oxygenation hospitalizations","authors":"Jeffrey Balian , Sara Sakowitz MS, MPH , Arjun Verma BS , Amulya Vadlakonda BS , Emma Cruz , Konmal Ali , Peyman Benharash MD","doi":"10.1016/j.sopen.2024.04.003","DOIUrl":null,"url":null,"abstract":"<div><h3>Background</h3><p>Despite increasing utilization and survival benefit over the last decade, extracorporeal membrane oxygenation (ECMO) remains resource-intensive with significant complications and rehospitalization risk. We thus utilized machine learning (ML) to develop prediction models for 90-day nonelective readmission following ECMO.</p></div><div><h3>Methods</h3><p>All adult patients receiving ECMO who survived index hospitalization were tabulated from the 2016–2020 Nationwide Readmissions Database. Extreme Gradient Boosting (XGBoost) models were developed to identify features associated with readmission following ECMO. Area under the receiver operating characteristic (AUROC), mean Average Precision (mAP), and the Brier score were calculated to estimate model performance relative to logistic regression (LR). Shapley Additive Explanation summary (SHAP) plots evaluated the relative impact of each factor on the model. An additional sensitivity analysis solely included patient comorbidities and indication for ECMO as potential model covariates.</p></div><div><h3>Results</h3><p>Of ∼22,947 patients, 4495 (19.6 %) were readmitted nonelectively within 90 days. The XGBoost model exhibited superior discrimination (AUROC 0.64 vs 0.49), classification accuracy (mAP 0.30 vs 0.20) and calibration (Brier score 0.154 vs 0.165, all P < 0.001) in predicting readmission compared to LR. SHAP plots identified duration of index hospitalization, undergoing heart/lung transplantation, and Medicare insurance to be associated with increased odds of readmission. Upon sub-analysis, XGBoost demonstrated superior disclination compared to LR (AUROC 0.61 vs 0.60, P < 0.05). Chronic liver disease and frailty were linked with increased odds of nonelective readmission.</p></div><div><h3>Conclusions</h3><p>ML outperformed LR in predicting readmission following ECMO. Future work is needed to identify other factors linked with readmission and further optimize post-ECMO care among this cohort.</p></div>","PeriodicalId":74892,"journal":{"name":"Surgery open science","volume":"19 ","pages":"Pages 125-130"},"PeriodicalIF":1.4000,"publicationDate":"2024-04-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2589845024000538/pdfft?md5=b16fabd665e514f87c6396c48ad4addd&pid=1-s2.0-S2589845024000538-main.pdf","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Surgery open science","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2589845024000538","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"SURGERY","Score":null,"Total":0}
引用次数: 0
Abstract
Background
Despite increasing utilization and survival benefit over the last decade, extracorporeal membrane oxygenation (ECMO) remains resource-intensive with significant complications and rehospitalization risk. We thus utilized machine learning (ML) to develop prediction models for 90-day nonelective readmission following ECMO.
Methods
All adult patients receiving ECMO who survived index hospitalization were tabulated from the 2016–2020 Nationwide Readmissions Database. Extreme Gradient Boosting (XGBoost) models were developed to identify features associated with readmission following ECMO. Area under the receiver operating characteristic (AUROC), mean Average Precision (mAP), and the Brier score were calculated to estimate model performance relative to logistic regression (LR). Shapley Additive Explanation summary (SHAP) plots evaluated the relative impact of each factor on the model. An additional sensitivity analysis solely included patient comorbidities and indication for ECMO as potential model covariates.
Results
Of ∼22,947 patients, 4495 (19.6 %) were readmitted nonelectively within 90 days. The XGBoost model exhibited superior discrimination (AUROC 0.64 vs 0.49), classification accuracy (mAP 0.30 vs 0.20) and calibration (Brier score 0.154 vs 0.165, all P < 0.001) in predicting readmission compared to LR. SHAP plots identified duration of index hospitalization, undergoing heart/lung transplantation, and Medicare insurance to be associated with increased odds of readmission. Upon sub-analysis, XGBoost demonstrated superior disclination compared to LR (AUROC 0.61 vs 0.60, P < 0.05). Chronic liver disease and frailty were linked with increased odds of nonelective readmission.
Conclusions
ML outperformed LR in predicting readmission following ECMO. Future work is needed to identify other factors linked with readmission and further optimize post-ECMO care among this cohort.