A comparison of objective structured clinical examinations (OSCEs) for medical students, modified during the COVID-19 pandemic.

Abstract

Introduction and aims: Objective structured clinical examinations (OSCEs) are an integral part of medical education assessment. The advanced clinical skills (ACS) OSCE examines clinical skills in psychiatry, general practice, obstetrics and gynaecology and paediatrics for fourth-year medical students at the University of Galway. This study compares results between the 2019 OSCE, and two subsequent OSCEs (2020 and 2021) modified to varying degrees secondary to the COVID-19 pandemic. We also examined student's satisfaction and perspectives regarding both modified OSCEs.

Materials and methods: Anonymised results between the 2019 (128 min), 2020 (56 min) and 2021 (96 min) ACS OSCEs were compared, and student feedback pertaining to the 2020 and 2021 OSCEs was analysed.

Results: A higher total mean mark OSCE result was achieved at the 2020 OSCE (62.95%) compared to the 2019 (59.35%) and 2021 (58.89%) OSCEs (F = 31.83, p < 0.001), with significantly more first-class honours marks attained in 2020 (11.5%) compared to 2019 and 2021 (both 1%) (p < 0.001). Measures of reliability were consistent across all years. A majority of students in both 2020 and 2021 reported the OSCE to be safe, well-coordinated, and fair, but similar numbers of students from both 2020 and 2021 expressed concern that face masks impeded their communication skills.

Conclusion: This study demonstrates the feasibility of conducting a modified reliable OSCE during a pandemic. Conducting a 96-min OSCE demonstrated similar results to the pre-COVID-19 pandemic 128-min OSCE, in contrast to a 56-min OSCE where potentially inflated marks were attained.