Documenting the implementation gap, part 1: Use of fidelity supports in programs indexed in the California evidence-based clearinghouse

Abstract

ABSTRACT There is an implementation gap in which more is known about what works to support implementation than what is done in practice. This paper uses information from programs rated on the California Evidence-Based Clearinghouse (CEBC), a web-based repository of information on the evidence base for programs that serve children and families, to examine the extent of this gap as it relates to the availability of fidelity measurement implementation supports. Fidelity measures and materials supplied during the CEBC data collection process by representatives of programs rated on the CEBC Scientific Rating Scale as having well-supported, supported, or promising research evidence were examined. Over 30% of these programs did not have a fidelity assessment approach. For the rest, using the available data, the program’s fidelity characteristics, including source, type, and frequency of use, were coded. The extent to which fidelity supports are incorporated into these programs remains variable. No relationship was found between the level of scientific rating and the existence of fidelity measures. Overall, a range of fidelity strategies were used, including those considered gold standard (e.g., live or video observation). However, rarely are these strategies required. Results underscore the substantial implementation gap as it applies to fidelity measurement.