Education Research: Junior Neurology Residents Achieve Competency but Not Mastery After a Brief Acute Ischemic Stroke Simulation Course

Abstract

Simulation bootcamps are used to onboard neurology trainees. It is not known whether these bootcamps result in competency for acute ischemic stroke (AIS).For this prospective, single-center pre-post educational intervention study, the Angoff standard setting method was used to determine a Minimum Passing Score (MPS) and Mastery Score for 2 AIS simulations. Junior neurology residents completed precourse knowledge and confidence assessments and had traditional didactic teaching. A week later, each resident completed the first scored AIS simulation. Each resident then practiced stroke care in an unscored simulation. Two to 8 weeks later, each resident was evaluated in an unannounced AIS simulation (the post-test). Postgraduate year (PGY)-3 adult neurology senior residents also completed a knowledge and confidence assessment and were scored on just the AIS post-test case. Using independent and pairedttests, respectively, we compared the junior residents' retention test performance to their baseline assessment and to senior residents' performance.Thirteen junior residents (9 PGY-2 adult neurology residents and 4 PGY-3 child neurology residents) participated in the course. Only 3 junior residents (23%) initially achieved the MPS in the first AIS simulation. After the simulation course, 9 junior residents (69%) achieved the MPS threshold. Although none achieved mastery, junior residents' mean performance score in the simulation improved (mean score preintervention [SD] = 10.3 [2.8] vs mean score postintervention [SD] = 15.7 [2.6],p< 0.001) and their confidence increased (mean score preintervention [SD] = 3.3 [1.9] vs mean score postintervention [SD] = 4.9 [1.2],p< 0.001,d= 1.7). Eight PGY-3 adult neurology residents were scored on the AIS post-test. Five reached MPS (63%), and 1 demonstrated mastery. The simulation scores of the postcourse juniors and seniors were similar (junior resident mean score [SD] = 15.7 [2.6] vs senior resident mean score [SD] = 16.0 [2.5],p= 0.793).A brief AIS simulation course may improve junior residents' performance and confidence to a level comparable with senior residents, although not to mastery.