Research participation effects and where to find them: a systematic review of studies on alcohol

Abstract

Objectives

The term ‘research participation effects’ (RPEs) is intended to capture features and artifacts of study design that may affect measured outcomes in ways that introduce bias into research findings, impacting inference and outcome validity. This systematic review aims to identify which RPEs have been studied in the context of alcohol research and provide an overview of estimates of RPEs on self-reported alcohol consumption.

Study Design and Setting

This systematic review summarizes the available evidence on RPEs in alcohol research.

Results

Twenty-seven reports were included in the review. The reports included randomized controlled trials (RCTs), studies-within-a-trial, between-subjects experiments, and qualitative investigations. A range of RPEs were addressed as follows: assessment reactivity (N = 15), being randomized to a waiting list control group (N = 3), the impact of obtaining informed consent (N = 2), experimentally induced social desirability (N = 3), and the Hawthorne effect, either specifically by name (N = 2, one quantitative, one qualitative) or described as general RPE presence (N = 2). The literature provided proportionally stronger evidence in favor of assessment reactivity and waiting list designs affecting alcohol outcomes, contrary to obtaining informed consent or inducing social desirability.

Conclusion

Variation in study quality, terminology, and outcome measures hinder comprehensive understanding and discussion of RPEs at present. Improved knowledge of RPEs and their potential long-term consequences in alcohol research, including a unified lexicon, would enhance trial design and improve the certainty of evidence in alcohol research.