Evaluating the effectiveness of a sliding window technique in machine learning models for mortality prediction in ICU cardiac arrest patients

IF 3.7 2区 医学 Q2 COMPUTER SCIENCE, INFORMATION SYSTEMS
Lihi Danay , Roni Ramon-Gonen , Maria Gorodetski , David G. Schwartz
{"title":"Evaluating the effectiveness of a sliding window technique in machine learning models for mortality prediction in ICU cardiac arrest patients","authors":"Lihi Danay ,&nbsp;Roni Ramon-Gonen ,&nbsp;Maria Gorodetski ,&nbsp;David G. Schwartz","doi":"10.1016/j.ijmedinf.2024.105565","DOIUrl":null,"url":null,"abstract":"<div><p>Extensive research has been devoted to predicting ICU mortality, to assist clinical teams managing critical patients. Electronic health records (EHR) contain both static and dynamic medical data, with the latter accumulating during ICU stays. Existing models often rely on a fixed time window (e.g., first 24 h) for prediction, potentially missing vital post-24-hour data. The present study aims to improve mortality prediction for ICU patients following Cardiac Arrest (CA) using a dynamic sliding window approach that accommodates evolving data characteristics.</p><p>Our cohort included 2331 CA patients, of whom 684 died in the ICU and 1647 survived. Applying the sliding window technique, we created six different time windows and used each separately for model training and validation. We compared our results to a baseline accumulative window.</p><p>The different time windows created by the sliding window technique differed in their prediction performance and outperformed the baseline 24-hour window significantly. The XGBoost model outperformed all other models, with the 30–42 h time window achieving the best results (AUC = 0.8, accuracy = 0.77).</p><p>Our work shows that the sliding window technique is effective in improving mortality prediction. We demonstrated how important time-window selection is and showed that enhancing it can save time and thus improve mortality prediction. These findings promise to improve the clinical team’s efficiency in prioritizing patients and giving greater attention to higher-risk patients.</p><p>To conclude, mortality prediction in the ICU can be improved if we consider alternative time windows instead of the 24-hour window, which is currently the most widely accepted among scoring systems today.</p></div>","PeriodicalId":54950,"journal":{"name":"International Journal of Medical Informatics","volume":null,"pages":null},"PeriodicalIF":3.7000,"publicationDate":"2024-07-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Journal of Medical Informatics","FirstCategoryId":"3","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1386505624002284","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"COMPUTER SCIENCE, INFORMATION SYSTEMS","Score":null,"Total":0}
引用次数: 0

Abstract

Extensive research has been devoted to predicting ICU mortality, to assist clinical teams managing critical patients. Electronic health records (EHR) contain both static and dynamic medical data, with the latter accumulating during ICU stays. Existing models often rely on a fixed time window (e.g., first 24 h) for prediction, potentially missing vital post-24-hour data. The present study aims to improve mortality prediction for ICU patients following Cardiac Arrest (CA) using a dynamic sliding window approach that accommodates evolving data characteristics.

Our cohort included 2331 CA patients, of whom 684 died in the ICU and 1647 survived. Applying the sliding window technique, we created six different time windows and used each separately for model training and validation. We compared our results to a baseline accumulative window.

The different time windows created by the sliding window technique differed in their prediction performance and outperformed the baseline 24-hour window significantly. The XGBoost model outperformed all other models, with the 30–42 h time window achieving the best results (AUC = 0.8, accuracy = 0.77).

Our work shows that the sliding window technique is effective in improving mortality prediction. We demonstrated how important time-window selection is and showed that enhancing it can save time and thus improve mortality prediction. These findings promise to improve the clinical team’s efficiency in prioritizing patients and giving greater attention to higher-risk patients.

To conclude, mortality prediction in the ICU can be improved if we consider alternative time windows instead of the 24-hour window, which is currently the most widely accepted among scoring systems today.

Abstract Image

评估滑动窗口技术在重症监护室心脏骤停患者死亡率预测机器学习模型中的有效性
大量研究致力于预测重症监护病房的死亡率,以协助临床团队管理危重病人。电子健康记录(EHR)包含静态和动态医疗数据,后者在重症监护室住院期间不断积累。现有模型通常依赖于固定的时间窗口(如前 24 小时)进行预测,可能会遗漏 24 小时后的重要数据。本研究旨在使用一种动态滑动窗口方法来改进对心脏骤停(CA)后重症监护室患者的死亡率预测,这种方法能适应不断变化的数据特征。我们的队列包括 2331 名 CA 患者,其中 684 人死于重症监护室,1647 人存活。应用滑动窗口技术,我们创建了六个不同的时间窗口,并分别用于模型训练和验证。我们将结果与基线累积窗口进行了比较。滑动窗口技术创建的不同时间窗口在预测性能上存在差异,其预测结果明显优于基线 24 小时窗口。XGBoost 模型的表现优于所有其他模型,其中 30-42 小时时间窗的结果最好(AUC = 0.8,准确率 = 0.77)。我们的研究表明,滑动窗口技术能有效改善死亡率预测。我们证明了时间窗选择的重要性,并表明加强时间窗选择能节省时间,从而改善死亡率预测。这些研究结果有望提高临床团队对患者进行优先排序的效率,并对高风险患者给予更多关注。总之,如果我们考虑其他时间窗,而不是目前最广泛接受的 24 小时窗,重症监护室的死亡率预测就能得到改善。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
International Journal of Medical Informatics
International Journal of Medical Informatics 医学-计算机:信息系统
CiteScore
8.90
自引率
4.10%
发文量
217
审稿时长
42 days
期刊介绍: International Journal of Medical Informatics provides an international medium for dissemination of original results and interpretative reviews concerning the field of medical informatics. The Journal emphasizes the evaluation of systems in healthcare settings. The scope of journal covers: Information systems, including national or international registration systems, hospital information systems, departmental and/or physician''s office systems, document handling systems, electronic medical record systems, standardization, systems integration etc.; Computer-aided medical decision support systems using heuristic, algorithmic and/or statistical methods as exemplified in decision theory, protocol development, artificial intelligence, etc. Educational computer based programs pertaining to medical informatics or medicine in general; Organizational, economic, social, clinical impact, ethical and cost-benefit aspects of IT applications in health care.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信