Engaging stakeholders to retrospectively discern implementation strategies to support program evaluation: Proposed method and case study

IF 1.5 4区社会学 Q2 SOCIAL SCIENCES, INTERDISCIPLINARY

Evaluation and Program Planning Pub Date : 2023-12-14 DOI:10.1016/j.evalprogplan.2023.102398

Jacob T. Painter , Rebecca A. Raciborski , Monica M. Matthieu , Ciara M. Oliver , David A. Adkins , Kimberly K. Garner

{"title":"Engaging stakeholders to retrospectively discern implementation strategies to support program evaluation: Proposed method and case study","authors":"Jacob T. Painter , Rebecca A. Raciborski , Monica M. Matthieu , Ciara M. Oliver , David A. Adkins , Kimberly K. Garner","doi":"10.1016/j.evalprogplan.2023.102398","DOIUrl":null,"url":null,"abstract":"<div><h3>Background</h3><p>Availability of evidence-based practices (EBPs) is critical for improving health care outcomes, but diffusion can be challenging. Implementation activities increase the adoption of EBPs and support sustainability. However, when implementation activities are a part of quality improvement processes, evaluation of the time and cost associated with these activities is challenged by the need for a correct classification of these activities to a known taxonomy of implementation strategies by implementation actors.</p></div><div><h3>Design</h3><p>Observational study of a four-stage, stakeholder-engaged process for identifying implementation activities and estimating the associated costs.</p></div><div><h3>Results</h3><p>A national initiative in the Veterans Health Administration (VHA) to improve Advance Care Planning (ACP) via Group Visits (ACP-GV) for rural veterans identified 49 potential implementation activities. Evaluators translated and reduced these to 14 strategies used across three groups with the aid of implementation actors. Data were collected to determine the total implementation effort and applied cost estimates to estimate the budget impact of implementation for VHA.</p></div><div><h3>Limitations</h3><p>Recall bias may influence the identification of potential implementation activities.</p></div><div><h3>Conclusions</h3><p>This process improved understanding of the implementation effort and allowed estimation of ACP-GV 's budget impact.</p></div><div><h3>Implications</h3><p>A four-stage, stakeholder-engaged methodology can be applied to other initiatives when a pragmatic evaluation of implementation efforts is needed.</p></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"103 ","pages":"Article 102398"},"PeriodicalIF":1.5000,"publicationDate":"2023-12-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Evaluation and Program Planning","FirstCategoryId":"90","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0149718923001751","RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"SOCIAL SCIENCES, INTERDISCIPLINARY","Score":null,"Total":0}

引用次数: 0

Abstract

Background

Availability of evidence-based practices (EBPs) is critical for improving health care outcomes, but diffusion can be challenging. Implementation activities increase the adoption of EBPs and support sustainability. However, when implementation activities are a part of quality improvement processes, evaluation of the time and cost associated with these activities is challenged by the need for a correct classification of these activities to a known taxonomy of implementation strategies by implementation actors.

Design

Observational study of a four-stage, stakeholder-engaged process for identifying implementation activities and estimating the associated costs.

Results

A national initiative in the Veterans Health Administration (VHA) to improve Advance Care Planning (ACP) via Group Visits (ACP-GV) for rural veterans identified 49 potential implementation activities. Evaluators translated and reduced these to 14 strategies used across three groups with the aid of implementation actors. Data were collected to determine the total implementation effort and applied cost estimates to estimate the budget impact of implementation for VHA.

Limitations

Recall bias may influence the identification of potential implementation activities.

Conclusions

This process improved understanding of the implementation effort and allowed estimation of ACP-GV 's budget impact.

Implications

A four-stage, stakeholder-engaged methodology can be applied to other initiatives when a pragmatic evaluation of implementation efforts is needed.

查看原文本刊更多论文

让利益相关者参与回溯性探索实施策略，以支持计划评估：建议的方法和案例研究

背景循证实践（EBPs）的可获得性对于改善医疗保健结果至关重要，但推广可能具有挑战性。实施活动可提高 EBPs 的采用率并支持其可持续性。然而，当实施活动是质量改进过程的一部分时，评估与这些活动相关的时间和成本就面临着挑战，因为实施者需要根据已知的实施策略分类法对这些活动进行正确分类。结果退伍军人健康管理局（VHA）的一项全国性倡议通过集体访问（ACP-GV）改善农村退伍军人的预先护理计划（ACP），确定了 49 项潜在的实施活动。评估人员在实施人员的协助下，将这些活动转化并缩减为 14 项策略，并在三个小组中使用。通过收集数据来确定总的实施工作，并应用成本估算来估算实施工作对退伍军人事务部预算的影响。结论这一过程提高了对实施工作的理解，并允许对 ACP-GV 的预算影响进行估算。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

Evaluation and Program Planning SOCIAL SCIENCES, INTERDISCIPLINARY-

CiteScore

3.10

自引率

6.20%

发文量

112

期刊介绍： Evaluation and Program Planning is based on the principle that the techniques and methods of evaluation and planning transcend the boundaries of specific fields and that relevant contributions to these areas come from people representing many different positions, intellectual traditions, and interests. In order to further the development of evaluation and planning, we publish articles from the private and public sectors in a wide range of areas: organizational development and behavior, training, planning, human resource development, health and mental, social services, mental retardation, corrections, substance abuse, and education.