The development of a C5.0 machine learning model in a limited data set to predict early mortality in patients with ARDS undergoing an initial session of prone positioning.
David M Hannon, Jaffar David Abbas Syed, Bairbre McNicholas, Michael Madden, John G Laffey
{"title":"The development of a C5.0 machine learning model in a limited data set to predict early mortality in patients with ARDS undergoing an initial session of prone positioning.","authors":"David M Hannon, Jaffar David Abbas Syed, Bairbre McNicholas, Michael Madden, John G Laffey","doi":"10.1186/s40635-024-00682-z","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Acute Respiratory Distress Syndrome (ARDS) has a high morbidity and mortality. One therapy that can decrease mortality is ventilation in the prone position (PP). Patients undergoing PP are amongst the sickest, and there is a need for early identification of patients at particularly high risk of death. These patients may benefit from an in-depth review of treatment or consideration of rescue therapies. We report the development of a machine learning model trained to predict early mortality in patients undergoing prone positioning as part of the management of their ARDS.</p><p><strong>Methods: </strong>Prospectively collected clinical data were analysed retrospectively from a single tertiary ICU. The records of patients who underwent an initial session of prone positioning whilst receiving invasive mechanical ventilation were identified (n = 131). The decision to perform prone positioning was based on the criteria in the PROSEVA study. A C5.0 classifier algorithm with adaptive boosting was trained on data gathered before, during, and after initial proning. Data was split between training (85% of data) and testing (15% of data). Hyperparameter tuning was achieved through a grid-search using a maximal entropy configuration. Predictions for 7-day mortality after initial proning session were made on the training and testing data.</p><p><strong>Results: </strong>The model demonstrated good performance in predicting 7-day mortality (AUROC: 0.89 training, 0.78 testing). Seven variables were used for prediction. Sensitivity was 0.80 and specificity was 0.67 on the testing data set. Patients predicted to survive had 13.3% mortality, while those predicted to die had 66.67% mortality. Among patients in whom the model predicted patient would survive to day 7 based on their response, mortality at day 7 was 13.3%. Conversely, if the model predicted the patient would not survive to day 7, mortality was 66.67%.</p><p><strong>Conclusions: </strong>This proof-of-concept study shows that with a limited data set, a C5.0 classifier can predict 7-day mortality from a number of variables, including the response to initial proning, and identify a cohort at significantly higher risk of death. This can help identify patients failing conventional therapies who may benefit from a thorough review of their management, including consideration of rescue treatments, such as extracorporeal membrane oxygenation. This study shows the potential of a machine learning model to identify ARDS patients at high risk of early mortality following PP. This information can guide clinicians in tailoring treatment strategies and considering rescue therapies. Further validation in larger cohorts is needed.</p>","PeriodicalId":13750,"journal":{"name":"Intensive Care Medicine Experimental","volume":"12 1","pages":"103"},"PeriodicalIF":2.8000,"publicationDate":"2024-11-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11564488/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Intensive Care Medicine Experimental","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1186/s40635-024-00682-z","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"CRITICAL CARE MEDICINE","Score":null,"Total":0}
引用次数: 0
Abstract
Background: Acute Respiratory Distress Syndrome (ARDS) has a high morbidity and mortality. One therapy that can decrease mortality is ventilation in the prone position (PP). Patients undergoing PP are amongst the sickest, and there is a need for early identification of patients at particularly high risk of death. These patients may benefit from an in-depth review of treatment or consideration of rescue therapies. We report the development of a machine learning model trained to predict early mortality in patients undergoing prone positioning as part of the management of their ARDS.
Methods: Prospectively collected clinical data were analysed retrospectively from a single tertiary ICU. The records of patients who underwent an initial session of prone positioning whilst receiving invasive mechanical ventilation were identified (n = 131). The decision to perform prone positioning was based on the criteria in the PROSEVA study. A C5.0 classifier algorithm with adaptive boosting was trained on data gathered before, during, and after initial proning. Data was split between training (85% of data) and testing (15% of data). Hyperparameter tuning was achieved through a grid-search using a maximal entropy configuration. Predictions for 7-day mortality after initial proning session were made on the training and testing data.
Results: The model demonstrated good performance in predicting 7-day mortality (AUROC: 0.89 training, 0.78 testing). Seven variables were used for prediction. Sensitivity was 0.80 and specificity was 0.67 on the testing data set. Patients predicted to survive had 13.3% mortality, while those predicted to die had 66.67% mortality. Among patients in whom the model predicted patient would survive to day 7 based on their response, mortality at day 7 was 13.3%. Conversely, if the model predicted the patient would not survive to day 7, mortality was 66.67%.
Conclusions: This proof-of-concept study shows that with a limited data set, a C5.0 classifier can predict 7-day mortality from a number of variables, including the response to initial proning, and identify a cohort at significantly higher risk of death. This can help identify patients failing conventional therapies who may benefit from a thorough review of their management, including consideration of rescue treatments, such as extracorporeal membrane oxygenation. This study shows the potential of a machine learning model to identify ARDS patients at high risk of early mortality following PP. This information can guide clinicians in tailoring treatment strategies and considering rescue therapies. Further validation in larger cohorts is needed.