Testing the Effects of a Utility Value Intervention in an Online Research Methods Course: A Conceptual Replication of Hulleman et al. (2017, Study 2)

Abstract

Background

Utility-value (UV) classroom interventions typically involve students completing assignments that involve writing about the usefulness of the course material. They are widely recommended and have received some empirical support.

Objective

This study tested the effectiveness of a UV intervention in an online research methods course. It was a conceptual replication of a study by Hulleman et al. (2017, Study 2).

Method

Students (N = 264) were randomly assigned to complete three assignments that required them to write about the usefulness of course material or three assignments that required them to summarize course material. The groups were compared in terms of their scores on a research methods knowledge test, their final papers, their final exams, and their final point totals, along with measures of the interestingness and usefulness of the course material.

Results

There were no differences between conditions on any of the outcome variables.

Conclusion

The UV intervention was ineffective. Further research is needed to establish the conditions under which such interventions are and are not effective.

Teaching Implications

UV interventions do not necessarily improve student performance. Instructors who use them should consider doing so in a way that allows for an assessment of their effect in their local context.