Promoting the use of research evidence from websites: optimising microsurveys as feedback loops to drive improvement.

Abstract

Background: Educators' use of research evidence (URE) from intermediary websites is not well understood. Current studies measure URE through periodic, retrospective user reports or by passively tracking website usage, neither of which adequately inform the continuous improvement efforts of intermediaries. This study examines the feasibility of microsurveys - brief, behaviour-triggered surveys embedded within websites - as a tool for assessing and informing the improvement of URE. Specifically, this article explores configurations to optimise microsurvey response rates.

Methods: A plug-in embedded microsurveys across web pages. Microsurveys included a five-point Likert emoticon rating scale and an open-ended follow-up. Four pilot studies tested variations in: (a) question wording, (b) time delays before triggering, (c) number of clicks, and (d) optimised conditions integrating the best configurations. Chi-square tests and logistic regression analysed differences in response rates and relationships between conditions, scores and response rates.

Results: Response rates improved by discarding low-performing (that is, low response rate) questions, selecting better time delays, and reducing the number of clicks to complete the microsurvey. Likert scale response rates increased from 4.18 per cent to 11.31 per cent under optimised conditions. Follow-up response rates remained stable, with higher engagement associated with favourable Likert scores.

Conclusions: This study establishes the potential of microsurveys for measuring URE from intermediary websites, achieving response rates understood to yield reliable estimates for informing the promotion of evidence in practice. Future research should explore additional configurations to further optimise response rate, integrate microsurveys with observational and behavioural data to assess validity, and study integrating microsurvey feedback into organisational change processes.