Identification, Characterization, and Ranking of Candidate Metrics for Selection to Anesthesiology Residency: An Iterative Survey of Program Directors.

Background: The primary aim of this study was to identify and stratify candidate metrics used by anesthesiology residency program directors (PDs) to develop their residency rank lists through the National Resident Matching Program.

Methods: Sixteen PDs comprised the participants, selected for diversity in geography and program size. We used a 3-round iterative survey to identify and stratify candidate metrics. In the first round, participants listed metrics they planned to use to evaluate candidates. In the second round, metrics from the first round were ranked by importance, and criteria were solicited to define an exceptional, strong, average, marginal, and uncompetitive candidate for each metric. In the third round, aggregated results were presented and participants refined their rankings.

Results: Of the 16 PDs selected, 15 participated in the first and second survey rounds, and 10 in the third. Eighteen candidate metrics were indicated by 8 or more PDs for residency selection. All 10 PDs from the final round identified passing Step 1 of the United States Medical Licensing Exam (USMLE) and the absence of "red flags" like a failed rotation as key selection metrics, both averaging an importance score of 4.9 out of 5. Other metrics identified by all PDs included clerkship evaluation comments, USMLE Step 2 scores, class rank, letters of recommendation, personal statement, and program and geographical signals.

Conclusions: The study reveals key metrics anesthesiology residency PDs use for candidate ranking, which may offer candidates insights into their competitiveness for anesthesiology residency.