Predictive modeling of perioperative patient deterioration: combining unanticipated ICU admissions and mortality for improved risk prediction.

IF 2 3区 医学 Q2 ANESTHESIOLOGY
Tom H G F Bakkes, Eveline H J Mestrom, Nassim Ourahou, Uzay Kaymak, Paulo J de Andrade Serra, Massimo Mischi, Arthur R Bouwman, Simona Turco
{"title":"Predictive modeling of perioperative patient deterioration: combining unanticipated ICU admissions and mortality for improved risk prediction.","authors":"Tom H G F Bakkes, Eveline H J Mestrom, Nassim Ourahou, Uzay Kaymak, Paulo J de Andrade Serra, Massimo Mischi, Arthur R Bouwman, Simona Turco","doi":"10.1186/s13741-024-00420-9","DOIUrl":null,"url":null,"abstract":"<p><strong>Objective: </strong>This paper presents a comprehensive analysis of perioperative patient deterioration by developing predictive models that evaluate unanticipated ICU admissions and in-hospital mortality both as distinct and combined outcomes.</p><p><strong>Materials and methods: </strong>With less than 1% of cases resulting in at least one of these outcomes, we investigated 98 features to identify their role in predicting patient deterioration, using univariate analyses. Additionally, multivariate analyses were performed by employing logistic regression (LR) with LASSO regularization. We also assessed classification models, including non-linear classifiers like Support Vector Machines, Random Forest, and XGBoost.</p><p><strong>Results: </strong>During evaluation, careful attention was paid to the data imbalance therefore multiple evaluation metrics were used, which are less sensitive to imbalance. These metrics included the area under the receiver operating characteristics, precision-recall and kappa curves, and the precision, sensitivity, kappa, and F1-score. Combining unanticipated ICU admissions and mortality into a single outcome improved predictive performance overall. However, this led to reduced accuracy in predicting individual forms of deterioration, with LR showing the best performance for the combined prediction.</p><p><strong>Discussion: </strong>The study underscores the significance of specific perioperative features in predicting patient deterioration, especially revealed by univariate analysis. Importantly, interpretable models like logistic regression outperformed complex classifiers, suggesting their practicality. Especially, when combined in an ensemble model for predicting multiple forms of deterioration. These findings were mostly limited by the large imbalance in data as post-operative deterioration is a rare occurrence. Future research should therefore focus on capturing more deterioration events and possibly extending validation to multi-center studies.</p><p><strong>Conclusions: </strong>This work demonstrates the potential for accurate prediction of perioperative patient deterioration, highlighting the importance of several perioperative features and the practicality of interpretable models like logistic regression, and ensemble models for the prediction of several outcome types. In future clinical practice these data-driven prediction models might form the basis for post-operative risk stratification by providing an evidence-based assessment of risk.</p>","PeriodicalId":19764,"journal":{"name":"Perioperative Medicine","volume":"13 1","pages":"66"},"PeriodicalIF":2.0000,"publicationDate":"2024-07-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11220961/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Perioperative Medicine","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1186/s13741-024-00420-9","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ANESTHESIOLOGY","Score":null,"Total":0}
引用次数: 0

Abstract

Objective: This paper presents a comprehensive analysis of perioperative patient deterioration by developing predictive models that evaluate unanticipated ICU admissions and in-hospital mortality both as distinct and combined outcomes.

Materials and methods: With less than 1% of cases resulting in at least one of these outcomes, we investigated 98 features to identify their role in predicting patient deterioration, using univariate analyses. Additionally, multivariate analyses were performed by employing logistic regression (LR) with LASSO regularization. We also assessed classification models, including non-linear classifiers like Support Vector Machines, Random Forest, and XGBoost.

Results: During evaluation, careful attention was paid to the data imbalance therefore multiple evaluation metrics were used, which are less sensitive to imbalance. These metrics included the area under the receiver operating characteristics, precision-recall and kappa curves, and the precision, sensitivity, kappa, and F1-score. Combining unanticipated ICU admissions and mortality into a single outcome improved predictive performance overall. However, this led to reduced accuracy in predicting individual forms of deterioration, with LR showing the best performance for the combined prediction.

Discussion: The study underscores the significance of specific perioperative features in predicting patient deterioration, especially revealed by univariate analysis. Importantly, interpretable models like logistic regression outperformed complex classifiers, suggesting their practicality. Especially, when combined in an ensemble model for predicting multiple forms of deterioration. These findings were mostly limited by the large imbalance in data as post-operative deterioration is a rare occurrence. Future research should therefore focus on capturing more deterioration events and possibly extending validation to multi-center studies.

Conclusions: This work demonstrates the potential for accurate prediction of perioperative patient deterioration, highlighting the importance of several perioperative features and the practicality of interpretable models like logistic regression, and ensemble models for the prediction of several outcome types. In future clinical practice these data-driven prediction models might form the basis for post-operative risk stratification by providing an evidence-based assessment of risk.

围手术期患者病情恶化的预测建模:结合非预期的重症监护病房入院率和死亡率,改进风险预测。
摘要本文通过建立预测模型,对围术期患者病情恶化情况进行了全面分析,该模型将非预期的重症监护病房入院和院内死亡率作为不同的结果和综合结果进行评估:由于只有不到 1%的病例至少会导致其中一种结果,我们使用单变量分析法调查了 98 个特征,以确定它们在预测患者病情恶化方面的作用。此外,我们还采用带有 LASSO 正则化的逻辑回归(LR)进行了多变量分析。我们还评估了分类模型,包括支持向量机、随机森林和 XGBoost 等非线性分类器:在评估过程中,我们仔细关注了数据的不平衡性,因此使用了多种对不平衡性不太敏感的评估指标。这些指标包括接收者操作特征曲线、精确度-召回曲线和卡帕曲线下的面积,以及精确度、灵敏度、卡帕和 F1 分数。将非预期的重症监护室入院率和死亡率合并为一个结果总体上提高了预测性能。但是,这导致预测个别恶化形式的准确性降低,而 LR 在综合预测中表现最佳:讨论:该研究强调了围手术期特定特征在预测患者病情恶化方面的重要性,尤其是通过单变量分析所揭示的特征。重要的是,逻辑回归等可解释模型的表现优于复杂的分类器,这表明了它们的实用性。尤其是在组合成一个集合模型来预测多种形式的病情恶化时。这些发现主要受限于数据的严重不平衡,因为术后病情恶化很少发生。因此,未来的研究应侧重于捕捉更多的恶化事件,并在可能的情况下将验证扩展到多中心研究:这项工作展示了准确预测围手术期患者病情恶化的潜力,强调了几个围手术期特征的重要性以及逻辑回归等可解释模型的实用性,以及用于预测几种结果类型的集合模型。在未来的临床实践中,这些数据驱动的预测模型可以提供基于证据的风险评估,从而为术后风险分层奠定基础。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
3.80%
发文量
55
审稿时长
10 weeks
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信