Does Academic Intervention Impact ABS Qualifying Examination Results?

Abstract

Objectives

To assess the impact of a focused academic support program on American Board of Surgery In-Training Examination (ABSITE) scores and Qualifying Examination (QE) outcomes.

Methods

A mandatory intervention program was begun in April 2001 for residents with ABSITE Total Test (TT) percentiles <31. Program elements included: 1) individual faculty mentoring and personal learning plan 2) QE videotape review sessions 3) Surgical Education and Self-Assessment Program (SESAP) 4) monthly rotation evaluations, and 5) quarterly status feedback. A free medical evaluation was offered. Mock orals participation, educational psychologist consultation, and voluntary followup mentoring were added later. Study data were reviewed for 2003-2005 Chief Residents including ABSITE scores, QE results, conference attendance, rotation Overall Performance ratings, and resident surgeon case volumes. Results were compared for the academic intervention (AI) and no intervention (NI) groups.

Results

Fifteen residents graduated during the study period. Eight residents completed nine interventions; seven returned to TT percentiles >30 (7/8, 88%). First post-intervention ABSITE gains were large compared to NI and national peer groups. Standard Score (SS) TT gains were maintained until residency completion by four AI residents. Median AI PGY-5 TT percentile was 32 and three scores were ≤25. Six AI residents (6/8, 75%) and all NI residents (7/7, 100%) passed the QE on their first attempts. AI and NI groups were similar for conference attendance, rotation evaluations, and operative log totals.

Conclusions

A focused academic support intervention for residents with marginal ABSITE TT percentiles can produce immediate substantial gains. Gains are variably maintained through remaining residency years. PGY-5 TT percentiles ≤25, seen with three AI residents (3/8, 38%), are associated with a 40% first QE failure rate. Therefore, our 75% QE first-time pass rate for AI residents argues for intervention success.