Development and feasibility testing of an implementation evaluation tool: Recommendations from the managing epilepsy well (MEW) network research collaborative

Abstract

Aims

The Managing Epilepsy Well (MEW) Network has led the development, testing and scale-up of epilepsy self-management (ESM). The MEW Integrated Database (MEW DB) is a pooled repository of archival studies that facilitates aggregate analysis. This report describes an implementation evaluation tool for ESM adopters.

Methods

Publicly available materials on program implementation, adoption and sustainability as well as readiness surveys used by the MEW Network were reviewed, as were content domains and format styles relevant to ESM implementation. Requirements for data Tiers included: 1) survey Tier should be short (≤6 items) and completed quickly (< 3 min), 2) question and response format should be consistent, 3) data elements are relevant to ESM adopters and 4) the tool should be applicable across ESM programs. Iterative review, discussion and item-ranking yielded a final set of 3 distinct data element Tiers.

Results

Implementation data elements assess the characteristics of organization that may be a potential ESM adopter (Tier 1), organizational readiness to ESM implementation (Tier 2) and perceptions of ESM program effects or impact by adopters at the individual and program levels (Tier 3). There are 18 data elements, 6 elements in each Tier. Organizational characteristics reflect health disparities among people with epilepsy and common comorbidities. Implementation readiness barriers include motivational factors, training and resources. Implementation experience/outcomes include perceived ESM duration, credibility, impact, likability and effectiveness.

Conclusions

A brief and practical implementation evaluation tool for ESM has potential value and important clinical and policy implications in advancing care for people with epilepsy.