{"title":"The Burden for High-Quality Online Data Collection Lies With Researchers, Not Recruitment Platforms","authors":"Christine Cuskley, Justin Sulik","doi":"10.1177/17456916241242734","DOIUrl":"https://doi.org/10.1177/17456916241242734","url":null,"abstract":"A recent article in Perspectives on Psychological Science (Webb & Tangney, 2022) reported a study in which just 2.6% of participants recruited on Amazon’s Mechanical Turk (MTurk) were deemed “valid.” The authors highlighted some well-established limitations of MTurk, but their central claims—that MTurk is “too good to be true” and that it captured “only 14 human beings . . . [out of] N = 529”—are radically misleading, yet have been repeated widely. This commentary aims to (a) correct the record (i.e., by showing that Webb and Tangney’s approach to data collection led to unusually low data quality) and (b) offer a shift in perspective for running high-quality studies online. Negative attitudes toward MTurk sometimes reflect a fundamental misunderstanding of what the platform offers and how it should be used in research. Beyond pointing to research that details strategies for effective design and recruitment on MTurk, we stress that MTurk is not suitable for every study. Effective use requires specific expertise and design considerations. Like all tools used in research—from advanced hardware to specialist software—the tool itself places constraints on what one should use it for. Ultimately, high-quality data is the responsibility of the researcher, not the crowdsourcing platform.","PeriodicalId":19757,"journal":{"name":"Perspectives on Psychological Science","volume":"8 1","pages":""},"PeriodicalIF":12.6,"publicationDate":"2024-04-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140636777","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Travis M. Seale-Carlisle, Adele Quigley-McBride, Jennifer E. F. Teitcher, William E. Crozier, Chad S. Dodson, Brandon L. Garrett
{"title":"New Insights on Expert Opinion About Eyewitness Memory Research","authors":"Travis M. Seale-Carlisle, Adele Quigley-McBride, Jennifer E. F. Teitcher, William E. Crozier, Chad S. Dodson, Brandon L. Garrett","doi":"10.1177/17456916241234837","DOIUrl":"https://doi.org/10.1177/17456916241234837","url":null,"abstract":"Experimental psychologists investigating eyewitness memory have periodically gathered their thoughts on a variety of eyewitness memory phenomena. Courts and other stakeholders of eyewitness research rely on the expert opinions reflected in these surveys to make informed decisions. However, the last survey of this sort was published more than 20 years ago, and the science of eyewitness memory has developed since that time. Stakeholders need a current database of expert opinions to make informed decisions. In this article, we provide that update. We surveyed 76 scientists for their opinions on eyewitness memory phenomena. We compared these current expert opinions to expert opinions from the past several decades. We found that experts today share many of the same opinions as experts in the past and have more nuanced thoughts about two issues. Experts in the past endorsed the idea that confidence is weakly related to accuracy, but experts today acknowledge the potential diagnostic value of initial confidence collected from a properly administered lineup. In addition, experts in the past may have favored sequential over simultaneous lineup presentation, but experts today are divided on this issue. We believe this new survey will prove useful to the court and to other stakeholders of eyewitness research.","PeriodicalId":19757,"journal":{"name":"Perspectives on Psychological Science","volume":"210 1","pages":""},"PeriodicalIF":12.6,"publicationDate":"2024-04-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140620465","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"\"When\" Versus \"Whether\" Gender/Sex Differences: Insights From Psychological Research on Negotiation, Risk-Taking, and Leadership.","authors":"Hannah R Bowles, Jens Mazei, Heidi H Liu","doi":"10.1177/17456916241231584","DOIUrl":"https://doi.org/10.1177/17456916241231584","url":null,"abstract":"<p><p>We present a conceptual framework of situational moderators of gender/sex effects in negotiation, risk-taking, and leadership-three masculine-stereotypic domains associated with gender/sex gaps in pay and authority. We propose that greater situational ambiguity and higher relevance and salience of gender/sex increase the likelihood of gender/sex-linked behaviors in these domains. We argue that greater ambiguity increases the extent to which actors and audiences must search inwardly (e.g., mental schema, past experience) or outwardly (e.g., social norms) for cues on how to behave or evaluate a situation and thereby widens the door for gender/sex-linked influences. Correspondingly, we propose that gender/sex effects on behavior and evaluations in these domains will be more likely when gender/sex is more relevant and salient to the setting or task. We propose further that these two situational moderators may work jointly or interactively to influence the likelihood of gender/sex effects in negotiation, risk-taking, and leadership. We conclude by discussing applications of our conceptual framework to psychological science and its translation to practice, including directions for future research.</p>","PeriodicalId":19757,"journal":{"name":"Perspectives on Psychological Science","volume":" ","pages":"17456916241231584"},"PeriodicalIF":12.6,"publicationDate":"2024-03-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140158718","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Communities of Knowledge in Trouble.","authors":"Nathaniel Rabb, Mugur Geana, Steven Sloman","doi":"10.1177/17456916231187997","DOIUrl":"10.1177/17456916231187997","url":null,"abstract":"<p><p>The community-of-knowledge framework explains the extraordinary success of the human species, despite individual members' demonstrably shallow understanding of many topics, by appealing to outsourcing. People follow the cues of members of their community because understanding of phenomena is generally distributed across the group. Typically, communities do possess the relevant knowledge, but it is possible in principle for communities to send cues despite lacking knowledge-a weakness in the system's design. COVID-19 in the United States offered a natural experiment in collective-knowledge development because a novel phenomenon arrived at a moment of intense division in political partisanship. We review evidence from the pandemic showing that the thought leaders of the two partisan groups sent radically different messages about COVID, which were, in turn, reinforced by close community members (family, friends, etc.). We show that although actual understanding of the individual plays a role in a key COVID-mitigation behavior (vaccination), it plays a smaller role than perceived understanding of thought leaders and beliefs about COVID-related behaviors of close community members. We discuss implications for theory and practice when all communities are in the same epistemic circumstance-relying on the testimony of others.</p>","PeriodicalId":19757,"journal":{"name":"Perspectives on Psychological Science","volume":" ","pages":"432-443"},"PeriodicalIF":12.6,"publicationDate":"2024-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9965241","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Cameron Martel, Jennifer Allen, Gordon Pennycook, David G Rand
{"title":"Crowds Can Effectively Identify Misinformation at Scale.","authors":"Cameron Martel, Jennifer Allen, Gordon Pennycook, David G Rand","doi":"10.1177/17456916231190388","DOIUrl":"10.1177/17456916231190388","url":null,"abstract":"<p><p>Identifying successful approaches for reducing the belief and spread of online misinformation is of great importance. Social media companies currently rely largely on professional fact-checking as their primary mechanism for identifying falsehoods. However, professional fact-checking has notable limitations regarding coverage and speed. In this article, we summarize research suggesting that the \"wisdom of crowds\" can be harnessed successfully to help identify misinformation at scale. Despite potential concerns about the abilities of laypeople to assess information quality, recent evidence demonstrates that aggregating judgments of groups of laypeople, or crowds, can effectively identify low-quality news sources and inaccurate news posts: Crowd ratings are strongly correlated with fact-checker ratings across a variety of studies using different designs, stimulus sets, and subject pools. We connect these experimental findings with recent attempts to deploy crowdsourced fact-checking in the field, and we close with recommendations and future directions for translating crowdsourced ratings into effective interventions.</p>","PeriodicalId":19757,"journal":{"name":"Perspectives on Psychological Science","volume":" ","pages":"477-488"},"PeriodicalIF":12.6,"publicationDate":"2024-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10078151","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"The Psychology of Collectives.","authors":"David Garcia, Mirta Galesic, Henrik Olsson","doi":"10.1177/17456916231201139","DOIUrl":"10.1177/17456916231201139","url":null,"abstract":"","PeriodicalId":19757,"journal":{"name":"Perspectives on Psychological Science","volume":" ","pages":"316-319"},"PeriodicalIF":12.6,"publicationDate":"2024-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"50158498","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A Network Approach to Investigate the Dynamics of Individual and Collective Beliefs: Advances and Applications of the BENDING Model.","authors":"Madalina Vlasceanu, Ari M Dyckovsky, Alin Coman","doi":"10.1177/17456916231185776","DOIUrl":"10.1177/17456916231185776","url":null,"abstract":"<p><p>Changing entrenched beliefs to alter people's behavior and increase societal welfare has been at the forefront of behavioral-science research, but with limited success. Here, we propose a new framework of characterizing beliefs as a multidimensional system of interdependent mental representations across three cognitive structures (e.g., beliefs, evidence, and perceived norms) that are dynamically influenced by complex informational landscapes: the BENDING (Beliefs, Evidence, Norms, Dynamic Information Networked Graphs) model. This account of individual and collective beliefs helps explain beliefs' resilience to interventions and suggests that a promising avenue for increasing the effectiveness of misinformation-reduction efforts might involve graph-based representations of communities' belief systems. This framework also opens new avenues for future research with meaningful implications for some of the most critical challenges facing modern society, from the climate crisis to pandemic preparedness.</p>","PeriodicalId":19757,"journal":{"name":"Perspectives on Psychological Science","volume":" ","pages":"444-453"},"PeriodicalIF":12.6,"publicationDate":"2024-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9856982","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Understanding Collective Intelligence: Investigating the Role of Collective Memory, Attention, and Reasoning Processes.","authors":"Anita Williams Woolley, Pranav Gupta","doi":"10.1177/17456916231191534","DOIUrl":"10.1177/17456916231191534","url":null,"abstract":"<p><p>As society has come to rely on groups and technology to address many of its most challenging problems, there is a growing need to understand how technology-enabled, distributed, and dynamic collectives can be designed to solve a wide range of problems over time in the face of complex and changing environmental conditions-an ability we define as \"collective intelligence.\" We describe recent research on the Transaction Systems Model of Collective Intelligence (TSM-CI) that integrates literature from diverse areas of psychology to conceptualize the underpinnings of collective intelligence. The TSM-CI articulates the development and mutual adaptation of transactive memory, transactive attention, and transactive reasoning systems that together support the emergence and maintenance of collective intelligence. We also review related research on computational indicators of transactive-system functioning based on collaborative process behaviors that enable agent-based teammates to diagnose and potentially intervene to address developing issues. We conclude by discussing future directions in developing the TSM-CI to support research on developing collective human-machine intelligence and to identify ways to design technology to enhance it.</p>","PeriodicalId":19757,"journal":{"name":"Perspectives on Psychological Science","volume":" ","pages":"344-354"},"PeriodicalIF":12.6,"publicationDate":"2024-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10114220","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Thalia Wheatley, Mark A Thornton, Arjen Stolk, Luke J Chang
{"title":"The Emerging Science of Interacting Minds.","authors":"Thalia Wheatley, Mark A Thornton, Arjen Stolk, Luke J Chang","doi":"10.1177/17456916231200177","DOIUrl":"10.1177/17456916231200177","url":null,"abstract":"<p><p>For over a century, psychology has focused on uncovering mental processes of a single individual. However, humans rarely navigate the world in isolation. The most important determinants of successful development, mental health, and our individual traits and preferences arise from interacting with other individuals. Social interaction underpins who we are, how we think, and how we behave. Here we discuss the key methodological challenges that have limited progress in establishing a robust science of how minds interact and the new tools that are beginning to overcome these challenges. A deep understanding of the human mind requires studying the context within which it originates and exists: social interaction.</p>","PeriodicalId":19757,"journal":{"name":"Perspectives on Psychological Science","volume":" ","pages":"355-373"},"PeriodicalIF":10.5,"publicationDate":"2024-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10932833/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138808386","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Polarization and the Psychology of Collectives.","authors":"Simon A Levin, Elke U Weber","doi":"10.1177/17456916231186614","DOIUrl":"10.1177/17456916231186614","url":null,"abstract":"<p><p>Achieving global sustainability in the face of climate change, pandemics, and other global systemic threats will require collective intelligence and collective action beyond what we are currently experiencing. Increasing polarization within nations and populist trends that undercut international cooperation make the problem even harder. Allegiance within groups is often strengthened because of conflict among groups, leading to a form of polarization termed \"affective.\" Hope for addressing these global problems will require recognition of the commonality in threats facing all groups collective intelligence that integrates relevant inputs from all sources but fights misinformation and coordinated, cooperative collective action. Elinor Ostrom's notion of polycentric governance, involving centers of decision-making from the local to the global in a complex interacting framework, may provide a possible pathway to achieve these goals.</p>","PeriodicalId":19757,"journal":{"name":"Perspectives on Psychological Science","volume":" ","pages":"335-343"},"PeriodicalIF":12.6,"publicationDate":"2024-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9960703","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}