Investigating Variation in Replicability: A “Many Labs” Replication Project

IF 1.2 4区心理学 Q4 PSYCHOLOGY, SOCIAL

Social Psychology Pub Date : 2022-02-07 DOI:10.1027/1864-9335/A000178

R. A. Klein, Kate A. Ratliff, M. Vianello, Reginald B. Adams, Š. Bahník, M. Bernstein, K. Bocian, M. Brandt, B. Brooks, C. Brumbaugh, Z. Cemalcilar, Jesse J. Chandler, Winnee Cheong, W. E. Davis, T. Devos, M. Eisner, Natalia Frankowska, D. Furrow, E. Galliani, F. Hasselman, Joshua A. Hicks, James F. Hovermale, S. J. Hunt, Jeffrey R. Huntsinger, H. Ijzerman, Melissa-Sue John, Jennifer A. Joy-Gaba, H. Kappes, Lacy E. Krueger, Jaime L. Kurtz, C. Levitan, Robyn K. Mallett, Wendy L. Morris, A. J. Nelson, J. Nier, Grant Packard, Ronaldo Pilati, Abraham M. Rutchick, Kathleen Schmidt, Jeanine L. M. Skorinko, Robert W. Smith, Troy G Steiner, Justin Storbeck, Lyn M. Van Swol, Donna M. Thompson, A. V. Veer, L. Vaughn, M. Vranka, A. Wichman, Julie A. Woodzicka, Brian A. Nosek

{"title":"Investigating Variation in Replicability: A “Many Labs” Replication Project","authors":"R. A. Klein, Kate A. Ratliff, M. Vianello, Reginald B. Adams, Š. Bahník, M. Bernstein, K. Bocian, M. Brandt, B. Brooks, C. Brumbaugh, Z. Cemalcilar, Jesse J. Chandler, Winnee Cheong, W. E. Davis, T. Devos, M. Eisner, Natalia Frankowska, D. Furrow, E. Galliani, F. Hasselman, Joshua A. Hicks, James F. Hovermale, S. J. Hunt, Jeffrey R. Huntsinger, H. Ijzerman, Melissa-Sue John, Jennifer A. Joy-Gaba, H. Kappes, Lacy E. Krueger, Jaime L. Kurtz, C. Levitan, Robyn K. Mallett, Wendy L. Morris, A. J. Nelson, J. Nier, Grant Packard, Ronaldo Pilati, Abraham M. Rutchick, Kathleen Schmidt, Jeanine L. M. Skorinko, Robert W. Smith, Troy G Steiner, Justin Storbeck, Lyn M. Van Swol, Donna M. Thompson, A. V. Veer, L. Vaughn, M. Vranka, A. Wichman, Julie A. Woodzicka, Brian A. Nosek","doi":"10.1027/1864-9335/A000178","DOIUrl":null,"url":null,"abstract":"Although replication is a central tenet of science, direct replications are rare in psychology. This research tested variation in the replicability of thirteen classic and contemporary effects across 36 independent samples totaling 6,344 participants. In the aggregate, ten effects replicated consistently. One effect – imagined contact reducing prejudice – showed weak support for replicability. And two effects – flag priming influencing conservatism and currency priming influencing system justification – did not replicate. We compared whether the conditions such as lab versus online or U.S. versus international sample predicted effect magnitudes. By and large they did not. The results of this small sample of effects suggest that replicability is more dependent on the effect itself than on the sample and setting used to investigate the effect.","PeriodicalId":47278,"journal":{"name":"Social Psychology","volume":null,"pages":null},"PeriodicalIF":1.2000,"publicationDate":"2022-02-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"867","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Social Psychology","FirstCategoryId":"102","ListUrlMain":"https://doi.org/10.1027/1864-9335/A000178","RegionNum":4,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q4","JCRName":"PSYCHOLOGY, SOCIAL","Score":null,"Total":0}

引用次数: 867

Abstract

Although replication is a central tenet of science, direct replications are rare in psychology. This research tested variation in the replicability of thirteen classic and contemporary effects across 36 independent samples totaling 6,344 participants. In the aggregate, ten effects replicated consistently. One effect – imagined contact reducing prejudice – showed weak support for replicability. And two effects – flag priming influencing conservatism and currency priming influencing system justification – did not replicate. We compared whether the conditions such as lab versus online or U.S. versus international sample predicted effect magnitudes. By and large they did not. The results of this small sample of effects suggest that replicability is more dependent on the effect itself than on the sample and setting used to investigate the effect.

查看原文本刊更多论文

研究可复制性的变异:一个“多实验室”复制项目

虽然复制是科学的核心原则，但在心理学中直接复制是罕见的。这项研究在36个独立样本中测试了13种经典和当代效应的可重复性变化，共有6344名参与者。总的来说，有10种效应是一致的。其中一个效应——想象中的接触会减少偏见——显示出对可复制性的微弱支持。两种效应——标志启动影响保守主义和货币启动影响制度正当性——没有复制。我们比较了实验室与在线或美国与国际样本等条件是否预测了影响程度。总的来说，他们没有。这种小样本效应的结果表明，可复制性更多地取决于效应本身，而不是用于调查效应的样本和环境。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

Social Psychology PSYCHOLOGY, SOCIAL-

CiteScore

3.20

自引率

0.00%

发文量