Improving the Predictive Accuracy of the National Early Warning Score 2: Protocol for Algorithm Refinement.

IF 1.5 Q3 HEALTH CARE SCIENCES & SERVICES
Chris Plummer, Cen Cong, Madison Milne-Ives, Lynsey Threlfall, Peta Le Roux, Edward Meinert
{"title":"Improving the Predictive Accuracy of the National Early Warning Score 2: Protocol for Algorithm Refinement.","authors":"Chris Plummer, Cen Cong, Madison Milne-Ives, Lynsey Threlfall, Peta Le Roux, Edward Meinert","doi":"10.2196/70303","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>The National Early Warning Score 2 (NEWS2) has been widely adopted for predicting patient deterioration in health care settings using routinely collected physiological observations. The use of NEWS2 has been shown to reduce in-hospital mortality, but it has limited accuracy in the prediction of clinically important outcomes, especially over longer time periods.</p><p><strong>Objective: </strong>This project aims to improve the predictive accuracy of the NEWS2 scoring system, particularly its accuracy over more than 24 hours and its predictive value in older patients and children. It will investigate whether using the currently collected data differently and the inclusion of additional data would result in an improved algorithm.</p><p><strong>Methods: </strong>The study will use historical patient data from the Newcastle upon Tyne Hospitals NHS Foundation Trust, including observational data (eg, vital signs), BMI- related data, and other outcome-related variables (eg, mortality rates) to train and test an algorithm to predict the risk of key clinical outcomes, including mortality, intensive therapy unit admission, sepsis, and cardiac arrest, to demonstrate a proof of concept for a modified scoring system. The algorithm's performance will be assessed based on its accuracy, precision, F<sub>1</sub>-score, area under the curve, and receiver operating characteristic curve.</p><p><strong>Results: </strong>The study is expected to start in April 2025. The findings are expected to be produced by the end of 2026 and will be disseminated at symposia, conferences, and in journal publications.</p><p><strong>Conclusions: </strong>The refined NEWS2 algorithm will address limited accuracy in predicting clinical deterioration beyond 24 hours in the original system by incorporating additional variables. Improved accuracy in the early detection of deterioration can lead to timely interventions, potentially reducing mortality and adverse clinical events. The enhanced algorithm also has the potential to be integrated into existing clinical decision support systems to facilitate health care professionals' decision-making.</p><p><strong>International registered report identifier (irrid): </strong>PRR1-10.2196/70303.</p>","PeriodicalId":14755,"journal":{"name":"JMIR Research Protocols","volume":"14 ","pages":"e70303"},"PeriodicalIF":1.5000,"publicationDate":"2025-07-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"JMIR Research Protocols","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.2196/70303","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"HEALTH CARE SCIENCES & SERVICES","Score":null,"Total":0}
引用次数: 0

Abstract

Background: The National Early Warning Score 2 (NEWS2) has been widely adopted for predicting patient deterioration in health care settings using routinely collected physiological observations. The use of NEWS2 has been shown to reduce in-hospital mortality, but it has limited accuracy in the prediction of clinically important outcomes, especially over longer time periods.

Objective: This project aims to improve the predictive accuracy of the NEWS2 scoring system, particularly its accuracy over more than 24 hours and its predictive value in older patients and children. It will investigate whether using the currently collected data differently and the inclusion of additional data would result in an improved algorithm.

Methods: The study will use historical patient data from the Newcastle upon Tyne Hospitals NHS Foundation Trust, including observational data (eg, vital signs), BMI- related data, and other outcome-related variables (eg, mortality rates) to train and test an algorithm to predict the risk of key clinical outcomes, including mortality, intensive therapy unit admission, sepsis, and cardiac arrest, to demonstrate a proof of concept for a modified scoring system. The algorithm's performance will be assessed based on its accuracy, precision, F1-score, area under the curve, and receiver operating characteristic curve.

Results: The study is expected to start in April 2025. The findings are expected to be produced by the end of 2026 and will be disseminated at symposia, conferences, and in journal publications.

Conclusions: The refined NEWS2 algorithm will address limited accuracy in predicting clinical deterioration beyond 24 hours in the original system by incorporating additional variables. Improved accuracy in the early detection of deterioration can lead to timely interventions, potentially reducing mortality and adverse clinical events. The enhanced algorithm also has the potential to be integrated into existing clinical decision support systems to facilitate health care professionals' decision-making.

International registered report identifier (irrid): PRR1-10.2196/70303.

提高国家预警评分2的预测准确性:算法改进方案。
背景:国家早期预警评分2 (NEWS2)已被广泛采用,在卫生保健机构通过常规收集的生理观察来预测患者的恶化。使用NEWS2已被证明可以降低住院死亡率,但它在预测临床重要结果方面的准确性有限,特别是在较长时间内。目的:本项目旨在提高NEWS2评分系统的预测准确性,特别是其24小时以上的准确性及其对老年患者和儿童的预测价值。它将调查是否以不同的方式使用当前收集的数据以及包含额外的数据会导致改进的算法。方法:该研究将使用来自纽卡斯尔泰恩医院NHS基金会信托的历史患者数据,包括观察数据(如生命体征),BMI相关数据和其他结果相关变量(如死亡率)来训练和测试一种算法,以预测关键临床结果的风险,包括死亡率,强化治疗单元入院,败血症和心脏骤停,以证明改进评分系统的概念证明。该算法的性能将根据其准确度、精密度、f1评分、曲线下面积和接收者工作特征曲线进行评估。结果:该研究预计于2025年4月开始。研究结果预计将于2026年底完成,并将在专题讨论会、会议和期刊出版物上发布。结论:改进的NEWS2算法将通过纳入额外的变量来解决预测原始系统24小时后临床恶化的有限准确性。提高早期发现病情恶化的准确性可导致及时干预,从而有可能降低死亡率和不良临床事件。增强的算法也有可能被整合到现有的临床决策支持系统中,以促进卫生保健专业人员的决策。国际注册报告标识符(irrid): PRR1-10.2196/70303。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
CiteScore
2.40
自引率
5.90%
发文量
414
审稿时长
12 weeks
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信