Implementation, Reach, and Effectiveness of the Direct Observation of Residents in Clinic Program.

Abstract

Background: Direct observation is important, yet medical residents are rarely observed. We implemented and evaluated a direct observation program in resident clinics to increase the frequency of observation and feedback and improve perceptions about direct observation.

Methods: We assigned faculty as observers in our resident clinics between June 2019 and February 2020. We surveyed residents and faculty before and after the program. Faculty completed a form for each observation performed. We analyzed surveys to examine changes in barriers, frequency and type of observations and feedback, and attitudes toward observation. The analytical sample included 38 and 37 pre- and postresident surveys, respectively, and 20 and 25 pre- and postfaculty surveys, respectively.

Results: Resident survey response rates were 32.3% (40/124) pre- and 30.7% (39/127) postintervention. Most residents (76% [pre], 86% [post], P = 0.258) reported being observed in at least one of the four areas: history, examination, counseling, or wrap-up. We received observation tracking forms on 68% of eligible residents. Observed history taking increased from 30% to 79% after the program (P = 0.0010). Survey response rates for faculty were 64.7% (22/34) pre- and 67.5% (25/37) postintervention. Fewer faculty reported time (80% [pre], 52% [post], P = 0.051) and competing demands (65% [pre], 52% [post], P = 0.380) as barriers postintervention. Fewer faculty postintervention viewed observation as a valuable teaching tool (100% [pre], 79% [post], P = 0.0534). All faculty who did not view observation as valuable were the least experienced.

Discussion: Assigning faculty as observers can increase observation, especially in history taking, though data suggest an increase in negative perceptions of observation by faculty.