The National Emergency Department Overcrowding Scale and Perceived Staff Workload: Evidence for Construct Validity in a Pediatric Setting.

Abstract

Objective: The aim of the study is to determine if there is a correlation between perceived staff workload, measured by the NASA Task Load Index (TLX), and the National Emergency Department Overcrowding Scale (NEDOCS) in a pediatric ED.

Methods: We collected staff questionnaires in a large, urban pediatric ED to assess perceived workload on each of six different TLX subscales, which we weighted evenly to create an overall estimate of workload. We evaluated the correlation between individual TLX responses and NEDOCS overall and by staff subgroup. Additionally, we analyzed: (1) the correlation between mean TLX responses and NEDOCS within a given hour and (2) the performance of a logistic regression model, using TLX as a predictor for "severely overcrowded," as measured by NEDOCS.

Results: Four hundred one questionnaires between 6/2018 and 1/2019 demonstrated significant variation between concurrently collected TLX responses and an overall poor correlation between perceived workload and NEDOCS (R2 0.096 [95% confidence interval, 0.048-0.16]). TLX responses by subgroups of fellows (n = 4, R2 0.96) and patient financial advisors (n = 15, R2 0.58) demonstrated the highest correlation with NEDOCS. Taking mean TLX responses within a given hour, during periods with NEDOCS >60 (extremely busy or overcrowded), a polynomial trend line matched the data best (R2 0.638). On logistic regression, the TLX predicts "severely overcrowded" with an area under the curve of the receiver operating characteristic of 0.731.

Conclusions: NEDOCS does not have a strong correlation with individual responses on questionnaires of perceived workload for staff in a pediatric ED. NEDOCS, as a measure of overcrowding, may be better correlated with perceived workload during periods with elevated crowding or when interpreted categorically as yes/no "severely overcrowded".