Strategies for enhancing the implementation of school-based policies or practices targeting diet, physical activity, obesity, tobacco or alcohol use.

Abstract

Background: A range of school-based interventions are effective in improving student diet and physical activity (e.g. school food policy interventions and classroom physical activity interventions), and reducing obesity, tobacco use and/or alcohol use (e.g. tobacco control programmes and alcohol education programmes). However, schools are frequently unsuccessful in implementing such evidence-based interventions.

Objectives: The primary review objective is to evaluate the effectiveness of strategies aiming to improve school implementation of interventions to address students' (aged 5 to 18 years) diet, physical activity, obesity, tobacco use and/or alcohol use. The secondary objectives are to: 1. determine whether the effects are different based on the characteristics of the intervention including school type and the health behaviour or risk factor targeted by the intervention; 2. describe any unintended consequences and adverse effects of strategies on schools, school staff or students; and 3. describe the cost or cost-effectiveness of strategies.

Search methods: We searched CENTRAL, MEDLINE (Ovid), Embase (Ovid), five additional databases, the World Health Organization (WHO) International Clinical Trials Registry Platform (ICTRP), and the US National Institutes of Health registry (clinicaltrials.gov). The latest search was between 1 May 2021 and 30 June 2023 to identify any relevant trials published since the last published review.

Selection criteria: We defined 'implementation' as the use of strategies to adopt and integrate evidence-based health interventions and to change practice patterns within specific settings. We included any randomised controlled trial (RCT) or cluster-RCT conducted on any scale, in a school setting, with a parallel control group that compared a strategy to improve the implementation of policies or practices to address diet, physical activity, obesity, tobacco use and/or alcohol use by students (aged 5 to 18 years) to no active implementation strategy (i.e. no intervention, inclusive of usual practice, minimal support) or a different implementation strategy.

Data collection and analysis: We used standard Cochrane methods. Given the large number of outcomes reported, we selected and included the effects of a single outcome measure for each trial for the primary outcome using a decision hierarchy (i.e. continuous over dichotomous, most valid, total score over subscore). Where possible, we calculated standardised mean differences (SMDs) to account for variable outcome measures with 95% confidence intervals (CI). We conducted meta-analyses using a random-effects model. Where we could not combine data in meta-analysis, we followed recommended Cochrane methods and reported results in accordance with 'Synthesis without meta-analysis' (SWiM) guidelines. We conducted assessments of risk of bias and evaluated the certainty of evidence (GRADE approach) using Cochrane procedures.

Main results: We included an additional 14 trials in this update, bringing the total number of included trials in the review to 39 trials with 83 trial arms and 6489 participants. Of these, the majority were conducted in Australia and the USA (n = 15 each). Nine were RCTs and 30 were cluster-RCTs. Twelve trials tested strategies to implement healthy eating practices; 17 physical activity, two tobacco, one alcohol, and seven a combination of risk factors. All trials used multiple implementation strategies, the most common being educational materials, educational meetings, and education outreach visits, or academic detailing. Of the 39 included trials, we judged 26 as having high risks of bias, 11 as having some concerns, and two as having low risk of bias across all domains. Pooled analyses found, relative to a control (no active implementation strategy), the use of implementation strategies probably results in a large increase in the implementation of interventions in schools (SMD 0.95, 95% CI 0.71, 1.19; I² = 78%; 30 trials, 4912 participants; moderate-certainty evidence). This is equivalent to a 0.76 increase in the implementation of seven physical activity intervention components when the SMD is re-expressed using an implementation measure from a selected included trial. Subgroup analyses by school type and targeted health behaviour or risk factor did not identify any differential effects, and only one study was included that was implemented at scale. Compared to a control (no active implementation strategy), no unintended consequences or adverse effects of interventions were identified in the 11 trials that reported assessing them (1595 participants; moderate-certainty evidence). Nine trials compared costs between groups with and without an implementation strategy and the results of these comparisons were mixed (2136 participants; low-certainty evidence). A lack of consistent terminology describing implementation strategies was an important limitation of the review.

Authors' conclusions: We found the use of implementation strategies probably results in large increases in implementation of interventions targeting healthy eating, physical activity, tobacco and/or alcohol use. While the effectiveness of individual implementation strategies could not be determined, such examination will likely be possible in future updates as data from new trials can be synthesised. Such research will further guide efforts to facilitate the translation of evidence into practice in this setting. The review will be maintained as a living systematic review.