{"title":"Drawing Generalizable Conclusions From Multilevel Models: Commentary on","authors":"Joshua L. Fiechter","doi":"10.1177/09567976241245411","DOIUrl":null,"url":null,"abstract":"In a recently published article, Van de Calseyde and Efendić (2022) argue that inner-crowd wisdom (i.e., the reduction in error afforded by aggregating two estimates from a given person relative to a single initial estimate from that person) is enhanced when people are instructed to adopt the perspective of someone with whom they disagree prior to making a second estimate. Here, I present a reanalysis of Van de Calseyde and Efendić’s data and argue that evidence supporting their primary claim spuriously arises from anticonservative multilevel models. Specifically, Van de Calseyde and Efendić assess their data via random-intercept models and fail to account for item-level effects of experimental condition. Such an approach generally allows analysts to reap the enhanced statistical power of multilevel models without implementing appropriate checks on that power; in this case, underestimation of item-level variance appears to have driven an illusory benefit of perspective taking.","PeriodicalId":20745,"journal":{"name":"Psychological Science","volume":"53 1","pages":""},"PeriodicalIF":4.8000,"publicationDate":"2024-05-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Psychological Science","FirstCategoryId":"102","ListUrlMain":"https://doi.org/10.1177/09567976241245411","RegionNum":1,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"PSYCHOLOGY, MULTIDISCIPLINARY","Score":null,"Total":0}
引用次数: 0
Abstract
In a recently published article, Van de Calseyde and Efendić (2022) argue that inner-crowd wisdom (i.e., the reduction in error afforded by aggregating two estimates from a given person relative to a single initial estimate from that person) is enhanced when people are instructed to adopt the perspective of someone with whom they disagree prior to making a second estimate. Here, I present a reanalysis of Van de Calseyde and Efendić’s data and argue that evidence supporting their primary claim spuriously arises from anticonservative multilevel models. Specifically, Van de Calseyde and Efendić assess their data via random-intercept models and fail to account for item-level effects of experimental condition. Such an approach generally allows analysts to reap the enhanced statistical power of multilevel models without implementing appropriate checks on that power; in this case, underestimation of item-level variance appears to have driven an illusory benefit of perspective taking.
期刊介绍:
Psychological Science, the flagship journal of The Association for Psychological Science (previously the American Psychological Society), is a leading publication in the field with a citation ranking/impact factor among the top ten worldwide. It publishes authoritative articles covering various domains of psychological science, including brain and behavior, clinical science, cognition, learning and memory, social psychology, and developmental psychology. In addition to full-length articles, the journal features summaries of new research developments and discussions on psychological issues in government and public affairs. "Psychological Science" is published twelve times annually.