A Comparison of Telesimulation Using the Virtual Resus Room and In Situ Simulation in Pediatric Emergency Medicine.

Abstract

Objectives: During the COVID-19 pandemic, there was a marked shift toward telesimulation in medical education. Limited studies exist comparing the effectiveness of online and offline simulation education. The goals of this study are to evaluate active learners' perceived effectiveness of telesimulation versus in situ simulation and to identify potential shortcomings of existing online teaching platforms.

Methods: Through participant evaluations after a simulation, we compared telesimulation using the Virtual Resus Room (VRR) to in situ simulation in the domains of (1) self-efficacy, (2) fidelity, (3) educational value, and (4) teaching quality. Study subjects included medical and pharmacy residents and medical students completing their pediatric emergency medicine rotation at two children's hospitals as well as nurses, nurse practitioners, and physician assistants who were recently hired and orienting to their new roles in the emergency department. Learners used a modified Michigan Standard Simulation Experience Scale to evaluate either a telesimulation or in situ simulation case. Survey responses were compared using Wilcoxon rank sum tests with Bonferroni correction for multiple comparisons.

Results: In overall assessment, in situ simulation was rated higher than telesimulation. There were significant differences noted related to perceived realism, utility in training device-related skills, and utility in training team-building skills. All P values were less than 0.0036. There were no significant differences between simulation types in perception of physical examination fidelity, instructor adequacy, or self-efficacy.

Conclusions: Telesimulation using the VRR is comparable to in situ simulation in learners' perception of improvement in self-efficacy and of teaching quality for pediatric emergency medicine topics. However, participants felt less able to practice tactile and communication skills virtually. Further innovation is needed to improve learners' experience with fidelity and educational value.