Self-Assessment Versus Peer-Assessment in Microsurgery Learning: A Comparative Retrospective Study in a Surgery Residents Cohort.

Abstract

INTRODUCTION In surgical learning, self-assessment allows the physician to identify and improve his strong and weak points. However, its scientific validity has yet to be demonstrated. The aim of this study was to analyze if there is a link between self-assessment accuracy and improvement in surgical skills. We make the hypothesis that an accurate self-assessment allows a greater improvement MATERIAL AND METHOD: We set up a retrospective cohort study at the tertiary University Hospital of Angers. Between 2019 and 2021, twenty-eight surgery residents took part into a microsurgery program and were included in the study. For two weeks, they performed anastomosis training on inert material and living anesthetized rats under microscope. Each resident was evaluated during the workshop by senior surgeons on 10 items: movement stability and fluidity, instrument manipulation, needles, dissection, clamp setting, vessel manipulation, suture, checking before clamp removal, checking after clamp removal, watertighness. Self-assessment was performed by the residents with the same grid, at the end of the workshop. Residents' and senior's evaluations were double-blind. We retrospectively analyzed the concordance between senior objective assessment and self-assessment, and the effect of an accurate self-assessment on technical improvement. RESULTS Data for twenty-five residents were analyzed, 14 were female (56%). The mean age was 29 years. Surgical specialties were orthopedics (44%), maxillofacial surgery (45.4%), neurosurgery (12%), gynecology (4%) and vascular surgery (4%). According to Cohen's kappa coefficient, 14 residents (56%) underestimated themselves, 7 (28%) were concordant with peer-assessment and 4 (16%) overestimated themselves. The concordance between self and peer assessment during sessions was positive for the most objective items, and negative for the most subjective items. Technical skills improvement in term of peer-assessment averages was positive for each item in each group, without statistical differences between groups. CONCLUSION We found that the ability to self-assess in a fast-track microsurgery module for surgery residents varied according to analyzed gestures. We demonstrated an improvement in term of self-assessment for objective items, and a decrease for subjective items. However, we didn't find any relation between improvement curve and the accuracy of self-assessment.