Nicola Bonadia, Piergiacomo Maria Cacciamani Fanelli, Davide Antonio Della Polla, Valeria Maccauro, Giuseppe De Matteis, Andrea Piccioni, Antonio Gasbarrini, Claudio Sandroni, Francesco Franceschi, Marcello Covino
{"title":"Assessing Risk of Early ICU Admission or Death at Emergency Department Triage: Clinical Judgment Versus Early Warning Scores.","authors":"Nicola Bonadia, Piergiacomo Maria Cacciamani Fanelli, Davide Antonio Della Polla, Valeria Maccauro, Giuseppe De Matteis, Andrea Piccioni, Antonio Gasbarrini, Claudio Sandroni, Francesco Franceschi, Marcello Covino","doi":"10.1111/acem.70377","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Early Warning Scores (EWS) are widely used to standardize the identification of clinical deterioration, yet their comparative performance against clinical judgment in Emergency Department (ED) triage remains uncertain. We aimed to evaluate whether commonly used EWS match or outperform clinical judgment in predicting early adverse outcomes.</p><p><strong>Methods: </strong>We conducted a retrospective observational study including 361,927 adult ED presentations at a tertiary-care academic center from 2015 to 2024. Clinical judgment was operationalized as the triage category assigned at the initial evaluation. Five EWS (NEWS, NEWS2, MEWS, REMS, and ViEWS) were computed using vital signs recorded at ED presentation. The primary outcome was a composite of 24-h mortality or intensive care unit (ICU) admission. Discrimination, calibration, decision curve analysis, and reclassification metrics were used to compare models.</p><p><strong>Results: </strong>The primary outcome occurred in 1.17% of patients. Discriminatory performance was highest for ViEWS (AUC 0.875) and clinical judgment (AUC 0.872), with no significant difference between them. Other EWS demonstrated significantly lower AUCs. In precision-recall and threshold-based analyses, clinical judgment maintained higher specificity at higher-risk thresholds while preserving adequate sensitivity. Decision curve analysis showed comparable or greater net benefit for clinical judgment than for all tested EWS across clinically relevant thresholds. Reclassification metrics showed no improvement with EWS over clinical judgment.</p><p><strong>Conclusion: </strong>Commonly used EWS did not clearly outperform triage clinical judgment in predicting early ICU admission or death. These findings support further investigation of how structured scores and clinical judgment may provide complementary information, particularly in identifying patients whose risk may be modified by timely escalation of care.</p>","PeriodicalId":7105,"journal":{"name":"Academic Emergency Medicine","volume":"33 7","pages":"e70377"},"PeriodicalIF":3.2000,"publicationDate":"2026-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC13374591/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Academic Emergency Medicine","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1111/acem.70377","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"EMERGENCY MEDICINE","Score":null,"Total":0}
引用次数: 0
Abstract
Background: Early Warning Scores (EWS) are widely used to standardize the identification of clinical deterioration, yet their comparative performance against clinical judgment in Emergency Department (ED) triage remains uncertain. We aimed to evaluate whether commonly used EWS match or outperform clinical judgment in predicting early adverse outcomes.
Methods: We conducted a retrospective observational study including 361,927 adult ED presentations at a tertiary-care academic center from 2015 to 2024. Clinical judgment was operationalized as the triage category assigned at the initial evaluation. Five EWS (NEWS, NEWS2, MEWS, REMS, and ViEWS) were computed using vital signs recorded at ED presentation. The primary outcome was a composite of 24-h mortality or intensive care unit (ICU) admission. Discrimination, calibration, decision curve analysis, and reclassification metrics were used to compare models.
Results: The primary outcome occurred in 1.17% of patients. Discriminatory performance was highest for ViEWS (AUC 0.875) and clinical judgment (AUC 0.872), with no significant difference between them. Other EWS demonstrated significantly lower AUCs. In precision-recall and threshold-based analyses, clinical judgment maintained higher specificity at higher-risk thresholds while preserving adequate sensitivity. Decision curve analysis showed comparable or greater net benefit for clinical judgment than for all tested EWS across clinically relevant thresholds. Reclassification metrics showed no improvement with EWS over clinical judgment.
Conclusion: Commonly used EWS did not clearly outperform triage clinical judgment in predicting early ICU admission or death. These findings support further investigation of how structured scores and clinical judgment may provide complementary information, particularly in identifying patients whose risk may be modified by timely escalation of care.
期刊介绍:
Academic Emergency Medicine (AEM) is the official monthly publication of the Society for Academic Emergency Medicine (SAEM) and publishes information relevant to the practice, educational advancements, and investigation of emergency medicine. It is the second-largest peer-reviewed scientific journal in the specialty of emergency medicine.
The goal of AEM is to advance the science, education, and clinical practice of emergency medicine, to serve as a voice for the academic emergency medicine community, and to promote SAEM''s goals and objectives. Members and non-members worldwide depend on this journal for translational medicine relevant to emergency medicine, as well as for clinical news, case studies and more.
Each issue contains information relevant to the research, educational advancements, and practice in emergency medicine. Subject matter is diverse, including preclinical studies, clinical topics, health policy, and educational methods. The research of SAEM members contributes significantly to the scientific content and development of the journal.