The Daily Lives of Crowdsourced U.S. Respondents: A Time Use Comparison of MTurk, Prolific, and ATUS.

Abstract

Amazon's Mechanical Turk (MTurk) and Prolific are popular online platforms for connecting academic researchers with respondents. A broad literature has sought to assess the extent to which these respondents are representative of the U.S. population in terms of their demographic background, yet no work has assessed the representativeness of their daily lives. The authors provide this analysis by collecting time diaries from 136 MTurk and 156 Prolific respondents, which they compare with diary responses from 468 contemporaneous responses to the American Time Use Survey (ATUS). Responses from MTurk and Prolific respondents include several notable differences relative to ATUS responses, including doing less housework and care work, spending less time traveling, spending more time at home, and spending more time alone. In general, MTurk respondents worked more than ATUS respondents, and Prolific respondents spent more time in leisure. These differences persist even after adjusting for demographic differences. The present findings highlight time use as a potential major source of differences across samples that go beyond demographic differences. Thus, scholars interested in these samples should consider how time use may moderate processes of interest.