Social Psychological Bulletin最新文献_第2页

On the importance of modeling the invisible world of underlying effect sizes 对基本效应大小的隐形世界进行建模的重要性

Social Psychological Bulletin Pub Date : 2023-11-17 DOI: 10.32872/spb.9981

Brent M Wilson, J. Wixted

{"title":"On the importance of modeling the invisible world of underlying effect sizes","authors":"Brent M Wilson, J. Wixted","doi":"10.32872/spb.9981","DOIUrl":"https://doi.org/10.32872/spb.9981","url":null,"abstract":"The headline findings from the Open Science Collaboration (2015)―namely, that 36% of original experiments replicated at p < .05, with the overall replication effect sizes being half as large as the original effects―cannot be meaningfully interpreted without a formal model. A simple model-based approach might ask: what would the state of original science be and what would replication results show if original experiments tested true effects half the time (prior odds = 1), true effects had a medium effect size (Cohen’s δ = 0.50), and power to detect true effects was 50%? Assuming no questionable research practices, 91% of p < .05 findings in the original literature would be true positives. However, only 58% of original p < .05 findings would be expected to replicate using the Open Science Collaboration approach, and the replication effects overall would be only ~60% as large as the original effects. A minor variant of this model yields an expected replication rate of only 45%, with overall replication effect sizes dropping by half. If the state of original science is as grim as a non-model-based (i.e., intuitive) interpretation of the Open Science Collaboration data suggests, should it be this easy to largely account for those findings using a model in which 91% of statistically significant findings in the original science literature are true positives? Claims that the findings reported by the Open Science Collaboration indicate a replication crisis should not be based solely on intuition but should instead be accompanied by a specific model that supports that interpretation.","PeriodicalId":32922,"journal":{"name":"Social Psychological Bulletin","volume":"12 4","pages":""},"PeriodicalIF":0.0,"publicationDate":"2023-11-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139263677","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Evading open science: The black box of student data collection 逃避开放科学：学生数据收集的黑匣子

Social Psychological Bulletin Pub Date : 2023-11-17 DOI: 10.32872/spb.9411

Tobias Ludwig, M. S. Altenmüller, Leonhard Falk Florentin Schramm, Mathias Twardawski

{"title":"Evading open science: The black box of student data collection","authors":"Tobias Ludwig, M. S. Altenmüller, Leonhard Falk Florentin Schramm, Mathias Twardawski","doi":"10.32872/spb.9411","DOIUrl":"https://doi.org/10.32872/spb.9411","url":null,"abstract":"While Open Science has arguably initiated positive changes at some stages of the research process (e.g., increasing transparency through preregistration), problematic behaviors during data collection are still almost impossible to detect and pose a great risk to the validity and integrity of psychological research—especially, when researchers use data collected by others (e.g., students). Exploring students’ and supervisors’ perspectives, the present registered report enlightens this “black box” of student data collection, focusing on questionable research practices and research misconduct (QRP/M). The majority of students did not report having engaged in any problematic behaviors during data collection, but some QRP/M—ranging from somewhat questionable to highly fraudulent—seem quite common (e.g., telling participants the hypothesis beforehand, participating in one’s own survey). We provide an overview of students’ reported and supervisors’ suspected data collection QRP/M, explore potential drivers for these behaviors based on the fraud triangle model (including pressures, opportunities, and rationalizations), and report how students and supervisors perceive the eligibility of student data for further uses (e.g., scientific publications). Moreover, we explore the role of the student-supervisor relationship (e.g., communication and expectations) and Open Science practices in student projects. In summary, our findings suggest the potential scientific value of data from student projects. Fostering transparent communication regarding expectations, experiences, and intentions between supervisors and students might further contribute to strengthening this prospect.","PeriodicalId":32922,"journal":{"name":"Social Psychological Bulletin","volume":"38 6","pages":""},"PeriodicalIF":0.0,"publicationDate":"2023-11-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139265739","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Introduction to special topic “Is psychology self-correcting? Reflections on the credibility revolution in social and personality psychology” 特别专题 "心理学是自我矫正的吗？对社会和人格心理学公信力革命的思考"

Social Psychological Bulletin Pub Date : 2023-11-17 DOI: 10.32872/spb.12927

S. Vazire, Brian Nosek

引用次数: 0

The “replication crisis” and trust in psychological science: How reforms shape public trust in psychology 复制危机 "与对心理科学的信任：改革如何塑造公众对心理学的信任

Social Psychological Bulletin Pub Date : 2023-11-17 DOI: 10.32872/spb.9665

Nicole Methner, Barbara Dahme, Claudia Menzel

{"title":"The “replication crisis” and trust in psychological science: How reforms shape public trust in psychology","authors":"Nicole Methner, Barbara Dahme, Claudia Menzel","doi":"10.32872/spb.9665","DOIUrl":"https://doi.org/10.32872/spb.9665","url":null,"abstract":"Failed replications can jeopardize public trust in psychological science and recent findings cast doubt on the idea that self-corrections and reforms can rebuild this trust. These findings are in contrast to trust repair research that proposes changes in transparency, norms, and policies as trust repair mechanisms. This raises the question of whether the used experimental material is one reason behind these unexpected findings. Previous studies used short texts that may give too little information on the replication crisis and initiated reforms in the field. In a pre-registered experiment (N = 390), we, therefore, tested whether comprehensive information about the replication crisis and reforms increases public trust in psychology, compared to a control condition that only informs about the replication crisis. To give comprehensive information, we created an animated video for each experimental condition. After watching the video, participants indicated their trust in researchers, trust in past research findings, and trust in current research findings. As expected and in line with trust repair research, information about reforms increased trust in researchers and in current (vs. past) research, compared with information about the replication crisis and its causes only. We discuss the generalizability of our results and implications for communicating the replication crisis to the public.","PeriodicalId":32922,"journal":{"name":"Social Psychological Bulletin","volume":"10 1-2","pages":""},"PeriodicalIF":0.0,"publicationDate":"2023-11-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139263828","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Hits and misses in the last decade of open science: Researchers from different subfields and career stages offer personal reflections and suggestions 过去十年开放科学的成功与失败：来自不同子领域和职业阶段的研究人员提出个人反思和建议

Social Psychological Bulletin Pub Date : 2023-11-17 DOI: 10.32872/spb.9681

Jennifer Beer, Paul Eastwick, Jin X. Goh

{"title":"Hits and misses in the last decade of open science: Researchers from different subfields and career stages offer personal reflections and suggestions","authors":"Jennifer Beer, Paul Eastwick, Jin X. Goh","doi":"10.32872/spb.9681","DOIUrl":"https://doi.org/10.32872/spb.9681","url":null,"abstract":"The success of Open Science in addressing the replication crisis and restoring credibility in psychology can be understood more completely by examining the successes and challenges of adapting the recommended best practices by researchers at different types of institutions, different career stages, and from different subfields within social and personality psychology. In this article, we offer personal reflections about the impact and future of the Open Science movement in a conversational form between three researchers at varying career stages who focus on different subdisciplines (relationship science, diversity science, and social neuroscience and social cognition) and work at universities that place a different emphasis on research (relative to teaching and service). We see many successes of the open science movement, but we also note that implementation has trailed behind its full potential because (a) the incentive structures of our existing rigid system remain misaligned with some open-science goals, and (b) some open science solutions were designed by researchers with certain types of scientific practices in mind. We all feel encouraged by the focus on larger samples, greater data sharing, and pre-registration both for experimental design and analytical decisions. However, there are areas that need attention. Our perspective is that the open science movement has not been as strong of an ally as it could be to another goal of psychological science: increasing diversity, equity, and inclusion. Additionally, more careful consideration of how to facilitate data sharing and pre-registration is needed and may necessitate a shift in the incentive structure of our field.","PeriodicalId":32922,"journal":{"name":"Social Psychological Bulletin","volume":"31 2","pages":""},"PeriodicalIF":0.0,"publicationDate":"2023-11-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139264344","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Psychology’s reform movement needs a reconceptualization of scientific expertise 心理学改革运动需要重新认识科学专业知识

Social Psychological Bulletin Pub Date : 2023-11-17 DOI: 10.32872/spb.10303

Duygu Uygun Tunç, M. Tunç

{"title":"Psychology’s reform movement needs a reconceptualization of scientific expertise","authors":"Duygu Uygun Tunç, M. Tunç","doi":"10.32872/spb.10303","DOIUrl":"https://doi.org/10.32872/spb.10303","url":null,"abstract":"Science is supposed to be a self-correcting endeavor, but who is “the scientific expert” that corrects faulty science? We grouped traditional conceptualizations of expertise in psychology under three classes (substantialist, implicitist, and social conventionalist), and then examined how these approaches affect scientific self-correction in reference to various components of the credibility crisis such as fraud/QRPs, the inadequate number of replication studies, challenges facing big team science, and perverse incentives. Our investigation pointed out several problems with the traditional views. First, traditional views conceptualize expertise as something possessed, not performed, ignoring the epistemic responsibility of experts. Second, expertise is conceived as an exclusively individual quality, which contradicts the socially distributed nature of scientific inquiry. Third, some aspects of expertise are taken to be implicit or relative to the established research practices in a field, which leads to disputes over replicability and makes it difficult to criticize mindless scientific rituals. Lastly, a conflation of expertise with eminence in practice creates an incentive structure that undermines the goal of self-correction in science. We suggest, instead, that we conceive an expert as a reliable informant. Following the extended virtue account of expertise, we propose a non-individualist and a performance-based model, and discuss why it does not suffer from the same problems as traditional approaches, and why it is more compatible with the reform movement's goal of creating a credible psychological science through self-correction.","PeriodicalId":32922,"journal":{"name":"Social Psychological Bulletin","volume":"2 3","pages":""},"PeriodicalIF":0.0,"publicationDate":"2023-11-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139264797","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Investigating lay perceptions of psychological measures: A registered report 调查外行人对心理测量的看法：登记报告

Social Psychological Bulletin Pub Date : 2023-11-17 DOI: 10.32872/spb.9383

Joseph Mason, Madeleine Pownall, Amy Palmer, F. Azevedo

{"title":"Investigating lay perceptions of psychological measures: A registered report","authors":"Joseph Mason, Madeleine Pownall, Amy Palmer, F. Azevedo","doi":"10.32872/spb.9383","DOIUrl":"https://doi.org/10.32872/spb.9383","url":null,"abstract":"In recent years, the reliability and validity of psychology measurement practices has been called into question, as part of an ongoing reappraisal of the robustness, reproducibility, and transparency of psychological research. While useful progress has been made, to date, the majority of discussions surrounding psychology’s measurement crisis have involved technical, quantitative investigations into the validity, reliability, and statistical robustness of psychological measures. This registered report offers a seldom-heard qualitative perspective on these ongoing debates, critically exploring members of the general public’s (i.e., non-experts) lay perceptions of widely used measures in psychology. Using a combination of cognitive interviews and a think aloud study protocol, participants (n = 23) completed one of three popular psychology measures. Participants reflected on each of the measures, discussed the contents, and provided perceptions of what the measures are designed to test. Coding of the think aloud protocols showed that participants across the measures had issues in interpreting and responding to items. Thematic analysis of the cognitive interviews identified three dominant themes that each relate to lay perceptions of psychology measurements. These were: (1) participants’ grappling with attempting to ‘capture their multiple selves’ in the questionnaires, (2) participants perceiving the questionnaire method as generally ‘missing nuance and richness’ and (3) exposing the ‘hidden labour of questionnaires’. These findings are discussed in the context of psychology’s measurement reform.","PeriodicalId":32922,"journal":{"name":"Social Psychological Bulletin","volume":"51 2","pages":""},"PeriodicalIF":0.0,"publicationDate":"2023-11-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139265468","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Strategic ambiguity in the social sciences 社会科学中的战略模糊性

Social Psychological Bulletin Pub Date : 2023-11-17 DOI: 10.32872/spb.9923

W. Frankenhuis, Karthik Panchanathan, P. Smaldino

{"title":"Strategic ambiguity in the social sciences","authors":"W. Frankenhuis, Karthik Panchanathan, P. Smaldino","doi":"10.32872/spb.9923","DOIUrl":"https://doi.org/10.32872/spb.9923","url":null,"abstract":"In the wake of the replication crisis, there have been calls to increase the clarity and precision of theory in the social sciences. Here, we argue that the effects of these calls may be limited due to incentives favoring ambiguous theory. Intentionally or not, scientists can exploit theoretical ambiguities to make support for a claim appear stronger than it is. Practices include theory stretching, interpreting an ambiguous claim more expansively to absorb data outside of the scope of the original claim, and post-hoc precision, interpreting an ambiguous claim more narrowly so it appears more precisely aligned with the data. These practices lead to the overestimation of evidence for the original claim and create the appearance of consistent support and progressive research programs, which may in turn be rewarded by journals, funding agencies, and hiring committees. Selection for ambiguous research can occur even when scientists act in good faith. Although ambiguity might be inevitable or even useful in the early stages of theory construction, scientists should aim for increased clarity as knowledge advances. Science benefits from transparently communicating about known ambiguities. To attain transparency about ambiguity, we provide a set of recommendations for authors, reviewers, and journals. We conclude with suggestions for research on how scientists use strategic ambiguity to advance their careers and the ways in which norms, incentives, and practices favor strategic ambiguity. Our paper ends with a simple mathematical model exploring the conditions in which high-ambiguity theories are favored over low-ambiguity theories, providing a basis for future analyses.","PeriodicalId":32922,"journal":{"name":"Social Psychological Bulletin","volume":"9 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2023-11-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139263558","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Assessing the reliability of an infrared thermography protocol to assess cold-induced Brown Adipose Tissue activation in french psychology students 评估红外热成像协议的可靠性，以评估冷诱导棕色脂肪组织激活在法国心理学学生

Social Psychological Bulletin Pub Date : 2023-10-12 DOI: 10.32872/spb.10461

Nathan Vidal, Joseph T. Costello, Blandine Ribotta, Lilas Gurgand, Hans IJzerman

{"title":"Assessing the reliability of an infrared thermography protocol to assess cold-induced Brown Adipose Tissue activation in french psychology students","authors":"Nathan Vidal, Joseph T. Costello, Blandine Ribotta, Lilas Gurgand, Hans IJzerman","doi":"10.32872/spb.10461","DOIUrl":"https://doi.org/10.32872/spb.10461","url":null,"abstract":"<p xmlns=\"http://www.ncbi.nlm.nih.gov/JATS1\">The authors use infrared thermography measurements of skin temperature to non-invasively assess the heat production of Brown Adipose Tissue (BAT). In species other than humans, BAT has been linked to maternal care, and may thus be crucial for understanding differences in attachment security. Whereas early BAT research measured its relative presence in the human body through radioactive tracers, researchers have recently used infrared thermography measurement of skin temperature in cold conditions to study BAT thermogenesis outside of medical facilities. Infrared thermography relies on comparing skin temperature in the supraclavicular region (where a BAT depot is located) with skin temperature in the sternal region (which contains no BAT depots) in cold conditions, when the supraclavicular BAT depot produces heat. We replicated an infrared thermography protocol, which previously reported an increase of 0.2 °C in supraclavicular (vs. sternal) skin temperature in cold (vs. control) conditions in only 7 adults, which probably led to overestimation of the effect. With a much larger sample size (N = 94 young adults) and a similar protocol, we did not find any significant variation in relative, Cohen’s d = 0.10, 95% CI [-0.31, 0.50], or absolute supraclavicular skin temperature, Cohen’s d = 0.11, 95% CI [-0.30, 0.52]. Using conditional random forests, we also excluded a variety of alternative explanations for why the method failed to achieve an effect. This protocol of infrared thermography cannot measure BAT thermogenesis and is thus not recommended for future studies to study individual differences in attachment.","PeriodicalId":32922,"journal":{"name":"Social Psychological Bulletin","volume":"171 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-10-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135970101","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Natural hazard versus natural disaster: Does framing the event affect preparedness intentions, attitudes, and behaviour? 自然灾害与自然灾害:事件框架是否会影响准备意图、态度和行为?

Social Psychological Bulletin Pub Date : 2023-10-10 DOI: 10.32872/spb.8357

Lauren J. Vinnell, Taciano L. Milfont, John McClure

{"title":"Natural hazard versus natural disaster: Does framing the event affect preparedness intentions, attitudes, and behaviour?","authors":"Lauren J. Vinnell, Taciano L. Milfont, John McClure","doi":"10.32872/spb.8357","DOIUrl":"https://doi.org/10.32872/spb.8357","url":null,"abstract":"<p xmlns=\"http://www.ncbi.nlm.nih.gov/JATS1\">Even when perception of risks such as earthquakes is high, preparation is generally low. Previous research shows relatively minor changes in the framing of target issues can impact decisions. In the area of risk, the terms “natural hazards” and “natural disasters” are used inconsistently. Using the Theory of Planned Behaviour as a framework, we conducted an online experiment with a large community sample from Wellington, Aotearoa New Zealand (N = 604) to examine possible framing effects. Half of the participants were asked about their attitudes and intentions regarding preparing for natural hazards and half about natural disasters. We found few significant differences in mean factor scores between the two groups, suggesting that people have attitudes and perceptions of similar strength for both natural hazards and natural disasters. However, half of the factors in structural equation modelling differed in significance or valence between the two conditions and intentions to prepare were positively associated with information-seeking behaviour only for the natural hazards frame, not the natural disaster frame. These findings suggest that the way in which these issues are framed meaningfully impacts how intentions form and translate to actual behaviour. It is possible that participants understood disaster as manifested, devastating impacts of a natural event rather than the potential for impact implied by the term hazard. Such interpretations could influence perceptions of preventability, and therefore preparation. These findings have critical implications for public information campaigns and interventions aimed at increasing preparedness for the risk posed by natural hazards.","PeriodicalId":32922,"journal":{"name":"Social Psychological Bulletin","volume":"42 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-10-10","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"136357218","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0