Prospective validation of a hospital triage predictive model to decrease undertriage: an EAST multicenter study.

IF 2.1 Q3 CRITICAL CARE MEDICINE
Trauma Surgery & Acute Care Open Pub Date : 2024-05-02 eCollection Date: 2024-01-01 DOI:10.1136/tsaco-2023-001280
Elise A Biesboer, Courtney J Pokrzywa, Basil S Karam, Benjamin Chen, Aniko Szabo, Bi Qing Teng, Matthew D Bernard, Andrew Bernard, Sharfuddin Chowdhury, Al-Hasher E Hayudini, Michal A Radomski, Stephanie Doris, Brian K Yorkgitis, Jennifer Mull, Benjamin W Weston, Mark R Hemmila, Christopher J Tignanelli, Marc A de Moya, Rachel S Morris
{"title":"Prospective validation of a hospital triage predictive model to decrease undertriage: an EAST multicenter study.","authors":"Elise A Biesboer, Courtney J Pokrzywa, Basil S Karam, Benjamin Chen, Aniko Szabo, Bi Qing Teng, Matthew D Bernard, Andrew Bernard, Sharfuddin Chowdhury, Al-Hasher E Hayudini, Michal A Radomski, Stephanie Doris, Brian K Yorkgitis, Jennifer Mull, Benjamin W Weston, Mark R Hemmila, Christopher J Tignanelli, Marc A de Moya, Rachel S Morris","doi":"10.1136/tsaco-2023-001280","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Tiered trauma team activation (TTA) allows systems to optimally allocate resources to an injured patient. Target undertriage and overtriage rates of <5% and <35% are difficult for centers to achieve, and performance variability exists. The objective of this study was to optimize and externally validate a previously developed hospital trauma triage prediction model to predict the need for emergent intervention in 6 hours (NEI-6), an indicator of need for a full TTA.</p><p><strong>Methods: </strong>The model was previously developed and internally validated using data from 31 US trauma centers. Data were collected prospectively at five sites using a mobile application which hosted the NEI-6 model. A weighted multiple logistic regression model was used to retrain and optimize the model using the original data set and a portion of data from one of the prospective sites. The remaining data from the five sites were designated for external validation. The area under the receiver operating characteristic curve (AUROC) and the area under the precision-recall curve (AUPRC) were used to assess the validation cohort. Subanalyses were performed for age, race, and mechanism of injury.</p><p><strong>Results: </strong>14 421 patients were included in the training data set and 2476 patients in the external validation data set across five sites. On validation, the model had an overall undertriage rate of 9.1% and overtriage rate of 53.7%, with an AUROC of 0.80 and an AUPRC of 0.63. Blunt injury had an undertriage rate of 8.8%, whereas penetrating injury had 31.2%. For those aged ≥65, the undertriage rate was 8.4%, and for Black or African American patients the undertriage rate was 7.7%.</p><p><strong>Conclusion: </strong>The optimized and externally validated NEI-6 model approaches the recommended undertriage and overtriage rates while significantly reducing variability of TTA across centers for blunt trauma patients. The model performs well for populations that traditionally have high rates of undertriage.</p><p><strong>Level of evidence: </strong>2.</p>","PeriodicalId":23307,"journal":{"name":"Trauma Surgery & Acute Care Open","volume":"9 1","pages":"e001280"},"PeriodicalIF":2.1000,"publicationDate":"2024-05-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11086287/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Trauma Surgery & Acute Care Open","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1136/tsaco-2023-001280","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2024/1/1 0:00:00","PubModel":"eCollection","JCR":"Q3","JCRName":"CRITICAL CARE MEDICINE","Score":null,"Total":0}
引用次数: 0

Abstract

Background: Tiered trauma team activation (TTA) allows systems to optimally allocate resources to an injured patient. Target undertriage and overtriage rates of <5% and <35% are difficult for centers to achieve, and performance variability exists. The objective of this study was to optimize and externally validate a previously developed hospital trauma triage prediction model to predict the need for emergent intervention in 6 hours (NEI-6), an indicator of need for a full TTA.

Methods: The model was previously developed and internally validated using data from 31 US trauma centers. Data were collected prospectively at five sites using a mobile application which hosted the NEI-6 model. A weighted multiple logistic regression model was used to retrain and optimize the model using the original data set and a portion of data from one of the prospective sites. The remaining data from the five sites were designated for external validation. The area under the receiver operating characteristic curve (AUROC) and the area under the precision-recall curve (AUPRC) were used to assess the validation cohort. Subanalyses were performed for age, race, and mechanism of injury.

Results: 14 421 patients were included in the training data set and 2476 patients in the external validation data set across five sites. On validation, the model had an overall undertriage rate of 9.1% and overtriage rate of 53.7%, with an AUROC of 0.80 and an AUPRC of 0.63. Blunt injury had an undertriage rate of 8.8%, whereas penetrating injury had 31.2%. For those aged ≥65, the undertriage rate was 8.4%, and for Black or African American patients the undertriage rate was 7.7%.

Conclusion: The optimized and externally validated NEI-6 model approaches the recommended undertriage and overtriage rates while significantly reducing variability of TTA across centers for blunt trauma patients. The model performs well for populations that traditionally have high rates of undertriage.

Level of evidence: 2.

前瞻性验证医院分诊预测模型以减少误诊:EAST 多中心研究。
背景:分级创伤团队激活(TTA)可使系统为受伤患者优化分配资源。方法:利用美国 31 个创伤中心的数据开发并在内部验证了该模型:该模型之前已开发完成,并利用来自 31 个美国创伤中心的数据进行了内部验证。我们在五个地点使用移动应用程序(其中包含 NEI-6 模型)对数据进行了前瞻性收集。利用原始数据集和其中一个前瞻性医疗点的部分数据,采用加权多元逻辑回归模型对模型进行了重新训练和优化。五个站点的其余数据被指定用于外部验证。接收者操作特征曲线下面积(AUROC)和精确度-召回曲线下面积(AUPRC)用于评估验证队列。对年龄、种族和受伤机制进行了子分析:14 421 名患者被纳入训练数据集,2476 名患者被纳入五个地点的外部验证数据集。经过验证,该模型的总体漏诊率为 9.1%,误诊率为 53.7%,AUROC 为 0.80,AUPRC 为 0.63。钝器伤的误诊率为 8.8%,而穿透伤的误诊率为 31.2%。对于年龄≥65岁的患者,误诊率为8.4%,而对于黑人或非裔美国人患者,误诊率为7.7%:结论:经过优化和外部验证的 NEI-6 模型接近推荐的少诊和多诊率,同时显著降低了各中心对钝性创伤患者的 TTA 变异性。该模型在传统上误诊率较高的人群中表现良好。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
CiteScore
3.70
自引率
5.00%
发文量
71
审稿时长
12 weeks
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信