Determining the process components of impact assessment in health and social program implementation: A scoping review of theories, models and frameworks.

Abstract

Objectives: Health and social service research impact analysis play a pivotal role in demonstrating research value. Impact analysis of programs, interventions, or policies in real-world settings is complex. There are many implementation evaluation theories, models, and frameworks (TMF) and researchers find choosing one challenging. Our objective was to systematically scope TMFs, review and chart key components of the process of implementation impact analysis to identify gaps.

Study design: A scoping review was undertaken and reported using PRISMA-ScR guidelines.

Methods: Systematic literature searches were conducted for impact analysis and impact assessment TMFs in MEDLINE, SCOPUS databases, hand searches, and expert directed search (2010-2024). Peer-reviewed articles were eligible for inclusion if they described an implementation evaluation TMF in English and used in the real world. Data extracted by the study team was charted in an Excel spreadsheet.

Results: The review identified 71 relevant papers which included a theory (n = 6), model (n = 14), or framework (n = 51). Most considered resources and/or results, whereas only 25 % considered implementation process components. Ten frameworks were deemed comprehensive and covered at least two phases of implementation and five components. Most frameworks had not developed or tested practical tools to facilitate use of the framework.

Conclusions: No frameworks were identified that incorporated all phases of implementation, nor key components of the process in each phase of implementation research. The findings highlight the need to identify key components and develop a taxonomy, glossary and tools to assess the process components of implementation in real world settings.