Developing a Holistic Rubric for Surgery Residency Interview Evaluations: A Pilot Study for Interview Use

Abstract

Objective

This pilot study evaluated the impact of a revised interview scoring form, incorporating holistic elements, on the assessment of surgical residency applicants.

Design

The study was deemed IRB-exempt. The study team revised the institution’s surgery residency interview scoring form to incorporate best practice factors for a more holistic applicant review. ANOVA analysis (p < 0.05) was conducted to compare scores between the old and new forms. Setting: Academic surgical residency program.

Participants

Fifteen total blinded applicants' files from match years 2019 to 2021 were reviewed using the new holistic interview scoring form.

Results

Statistical analysis revealed only minor score differences for 4 applicants, with no notable directional bias. The incorporation of holistic elements did not significantly alter overall scoring outcomes.

Conclusions

The introduction of a holistic interview scoring form aligns with efforts to promote inclusivity in residency selection. Adding nontraditional assessment criteria, such as life experiences, growth mindset, and teamwork, the overall scoring outcomes remained consistent with the previous form. This suggests that traditional and holistic assessment factors can coexist without compromising the fairness of the interview process. Evaluation and revision of interview scoring forms is feasible for any program specialty and is recommended to ensure ongoing inclusion in resident selection practices.