Intervention fidelity assessment: A sub-study of the Norfolk Diabetes Prevention Study (NDPS)

Abstract

Background

Previous research has shown that lifestyle modification can delay or prevent the onset of type 2 diabetes in high-risk individuals. The Norfolk Diabetes Prevention Study (NDPS) was a parallel, three-arm, randomized controlled trial with up to 46 months follow-up that tested a group-delivered, theory-based lifestyle intervention to reduce the incidence of type 2 diabetes in high-risk groups. The current study aimed to evaluate if the NDPS intervention was delivered to an acceptable standard and if any part(s) of the delivery required improvement.

Methods

A sub-sample of 30, 25 for inter-rater reliability and audio-recordings of the NDPS intervention education sessions were assessed independently by two reviewers (CT, TW) using a 12-item checklist. Each item was scored on a 0–5 scale, with a score of 3 being defined as ‘adequate delivery’. Inter-rater reliability was assessed. Analysis of covariance (ANCOVA) was used to assess changes in intervention fidelity as the facilitators gained experience.

Results

Inter-rater agreement was acceptable (86%). A mean score of 3.47 (SD = .38) was achieved across all items of the fidelity checklist and across all intervention facilitators (n = 6). There was an apparent trend for intervention fidelity scores to decrease with experience; however, this trend was non-significant (p > .05) across all domains in this small sample.

Conclusion

The NDPS was delivered to an acceptable standard by all Diabetes Prevention Facilitators. Further research is needed to better understand how the intervention's delivery characteristics can be optimized and how they might vary over time.