An Exploratory Comparison of Three Treatment Fidelity Assessment Methods: Time Sampling, Event Recording, and Post-observation Checklist

Abstract

ABSTRACT When assessed, treatment fidelity is most often evaluated by checklists of intervention steps after an observation session, though estimates can vary depending on how intervention steps are operationalized and rated. A more straightforward approach may involve the adoption of direct observation methods such as time sampling or event recording, which are regularly used to evaluate student behavior. This study explores the utility of using time sampling and event recording in comparison to the traditional post-observation checklist method. Five paraeducator consultees’ treatment fidelity of behavior support plans for students with autism was assessed by post-observation ratings. In addition, 15-sec whole-interval recording of treatment fidelity across intervention steps and event recording of prompts (an intervention step for all plans) were collected throughout the observation session. To compare treatment fidelity data, we present visual analysis, associated quantitative metrics, and correlations. Implications for future treatment fidelity assessment research and consultation practice are described.