Fahd A Ahmad, Lorin R Browne, Nicolaus W Glomb, Monica Harding, Lawrence J Cook, Rebecca K Burger, Pradip P Chaudhari, Alexander J Rogers, Caleb E Ward, Daniel Rubalcava, Kenneth Yen, Nathan Kuppermann, Julie C Leonard
{"title":"Interrater reliability between surgeons and pediatric emergency providers in the cervical spine assessment of injured children.","authors":"Fahd A Ahmad, Lorin R Browne, Nicolaus W Glomb, Monica Harding, Lawrence J Cook, Rebecca K Burger, Pradip P Chaudhari, Alexander J Rogers, Caleb E Ward, Daniel Rubalcava, Kenneth Yen, Nathan Kuppermann, Julie C Leonard","doi":"10.1097/TA.0000000000004695","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Cervical spine injury (CSI) is uncommon in children but an important consideration during trauma evaluation. The Pediatric Emergency Care Applied Research Network (PECARN) derived and validated a CSI prediction rule to guide cervical spine imaging decisions in children after blunt trauma. Our objective was to determine the interrater reliability between EM providers and surgeons for history and physical examination findings used to evaluate children for CSI after blunt trauma.</p><p><strong>Methods: </strong>This was a planned secondary analysis of a prospective, observational multicenter study that enrolled children aged 0 year to 17 years evaluated for blunt trauma in 18 PECARN emergency departments (EDs). We collected data on injury mechanisms, history and physical examination findings, imaging ordered, and suspicion of CSI from EM and surgery providers. Kappa, prevalence, and bias-adjusted kappa (PABAK) were used to compare interrater reliability of variables associated with CSI.</p><p><strong>Results: </strong>Surgeons cared for 8,041 of the 22,430 children enrolled in the parent study. About 18.6% (1494/8041) had data collection forms completed by both EM providers and surgeons and were included in the analysis. Agreement between EM and surgery providers per kappa was moderate (kappa 0.41-0.6) to substantial (kappa 0.61-0.8), while PABAK analyses showed substantial to almost perfect agreement for variables in the PECARN CSI prediction rule. There was agreement between EM and surgery providers in overall clinical suspicion for CSI in 64.2% (959/1494) of patients. Retrospective application of the PECARN Rule indicated that ED and surgical provider assessments would have led to the same imaging decision in 73.7% (1101/1494) of patients.</p><p><strong>Conclusion: </strong>We identified moderate to substantial agreement between EM providers and surgeons for clinical findings that comprise the PECARN Cervical Spine Injury Prediction Rule. Agreement between providers during shared decision-making will strengthen the use of the prediction rule and may lead to decreased cervical spine imaging in EDs.</p><p><strong>Level of evidence: </strong>Prognostic and Epidemiologic; Level II.</p>","PeriodicalId":17453,"journal":{"name":"Journal of Trauma and Acute Care Surgery","volume":" ","pages":""},"PeriodicalIF":2.9000,"publicationDate":"2025-06-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Trauma and Acute Care Surgery","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1097/TA.0000000000004695","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"CRITICAL CARE MEDICINE","Score":null,"Total":0}
引用次数: 0
Abstract
Background: Cervical spine injury (CSI) is uncommon in children but an important consideration during trauma evaluation. The Pediatric Emergency Care Applied Research Network (PECARN) derived and validated a CSI prediction rule to guide cervical spine imaging decisions in children after blunt trauma. Our objective was to determine the interrater reliability between EM providers and surgeons for history and physical examination findings used to evaluate children for CSI after blunt trauma.
Methods: This was a planned secondary analysis of a prospective, observational multicenter study that enrolled children aged 0 year to 17 years evaluated for blunt trauma in 18 PECARN emergency departments (EDs). We collected data on injury mechanisms, history and physical examination findings, imaging ordered, and suspicion of CSI from EM and surgery providers. Kappa, prevalence, and bias-adjusted kappa (PABAK) were used to compare interrater reliability of variables associated with CSI.
Results: Surgeons cared for 8,041 of the 22,430 children enrolled in the parent study. About 18.6% (1494/8041) had data collection forms completed by both EM providers and surgeons and were included in the analysis. Agreement between EM and surgery providers per kappa was moderate (kappa 0.41-0.6) to substantial (kappa 0.61-0.8), while PABAK analyses showed substantial to almost perfect agreement for variables in the PECARN CSI prediction rule. There was agreement between EM and surgery providers in overall clinical suspicion for CSI in 64.2% (959/1494) of patients. Retrospective application of the PECARN Rule indicated that ED and surgical provider assessments would have led to the same imaging decision in 73.7% (1101/1494) of patients.
Conclusion: We identified moderate to substantial agreement between EM providers and surgeons for clinical findings that comprise the PECARN Cervical Spine Injury Prediction Rule. Agreement between providers during shared decision-making will strengthen the use of the prediction rule and may lead to decreased cervical spine imaging in EDs.
Level of evidence: Prognostic and Epidemiologic; Level II.
期刊介绍:
The Journal of Trauma and Acute Care Surgery® is designed to provide the scientific basis to optimize care of the severely injured and critically ill surgical patient. Thus, the Journal has a high priority for basic and translation research to fulfill this objectives. Additionally, the Journal is enthusiastic to publish randomized prospective clinical studies to establish care predicated on a mechanistic foundation. Finally, the Journal is seeking systematic reviews, guidelines and algorithms that incorporate the best evidence available.