Differences in the Effectiveness of Three OHS Training Delivery Methods

Background

Methods of delivering occupational safety and health (OSH) training have shifted from in-person to online. Widespread delivery of a standardized OSH training course in three modalities in the province of Ontario, Canada allowed measurement of differences in their effectiveness.

Methods

Learners (N = 899) self-selected into face-to-face (F2F) instructor-led learning, online instructor-led synchronous distance learning, or online self-paced e-learning. Pre- and post-training surveys collected information on knowledge and other measures. Multiple regression analyses compared modalities on knowledge achievement (0%–100% scale; the primary outcome), engagement, perceived utility, perceived applicability, self-efficacy, and intention-to-use.

Results

F2F learners achieved a statistically significant 2.5% (95% CI: 0.3%, 4.7%) higher post-training knowledge score than distance learners (Cohen's d = 0.23, which is considered small). A statistically insignificant difference of 0.4% (95%: −1.4%, 2.3%) was seen between e-learners and distance learners. Collaborating training providers regarded these differences as not meaningful in practice. Statistically significant differences between modalities were seen for engagement, perceived utility, and self-efficacy. Scores of F2F learners were more favorable than scores of distance learners, which were, in turn, more favorable than scores of e-learners.

Conclusions

This study provides evidence that there are small to no differences among F2F, distance and e-learning in their ability to ensure knowledge achievement among learners. This finding is likely generalizable to other well-designed short-term OSH training aimed at acquiring new knowledge. More research is needed to understand whether there are important differences across these modalities in basic OHS skill acquisition and transfer of learning to the workplace.