{"title":"A Practical Significance Bias in Laypeople's Evaluation of Scientific Findings.","authors":"Audrey L Michal, Priti Shah","doi":"10.1177/09567976241231506","DOIUrl":null,"url":null,"abstract":"<p><p>People often rely on scientific findings to help them make decisions-however, failing to report effect magnitudes might lead to a potential bias in assuming findings are practically significant. Across two online studies (Prolific; <i>N</i> = 800), we measured U.S. adults' endorsements of expensive interventions described in media reports that led to effects that were small, large, or of unreported magnitude between groups. Participants who viewed interventions with unreported effect magnitudes were more likely to endorse interventions compared with those who viewed interventions with small effects and were just as likely to endorse interventions as those who viewed interventions with large effects, suggesting a practical significance bias. When effect magnitudes were reported, participants on average adjusted their evaluations accordingly. However, some individuals, such as those with low numeracy skills, were more likely than others to act on small effects, even when explicitly prompted to first consider the meaningfulness of the effect.</p>","PeriodicalId":20745,"journal":{"name":"Psychological Science","volume":" ","pages":"315-327"},"PeriodicalIF":4.8000,"publicationDate":"2024-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Psychological Science","FirstCategoryId":"102","ListUrlMain":"https://doi.org/10.1177/09567976241231506","RegionNum":1,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2024/3/4 0:00:00","PubModel":"Epub","JCR":"Q1","JCRName":"PSYCHOLOGY, MULTIDISCIPLINARY","Score":null,"Total":0}
引用次数: 0
Abstract
People often rely on scientific findings to help them make decisions-however, failing to report effect magnitudes might lead to a potential bias in assuming findings are practically significant. Across two online studies (Prolific; N = 800), we measured U.S. adults' endorsements of expensive interventions described in media reports that led to effects that were small, large, or of unreported magnitude between groups. Participants who viewed interventions with unreported effect magnitudes were more likely to endorse interventions compared with those who viewed interventions with small effects and were just as likely to endorse interventions as those who viewed interventions with large effects, suggesting a practical significance bias. When effect magnitudes were reported, participants on average adjusted their evaluations accordingly. However, some individuals, such as those with low numeracy skills, were more likely than others to act on small effects, even when explicitly prompted to first consider the meaningfulness of the effect.
期刊介绍:
Psychological Science, the flagship journal of The Association for Psychological Science (previously the American Psychological Society), is a leading publication in the field with a citation ranking/impact factor among the top ten worldwide. It publishes authoritative articles covering various domains of psychological science, including brain and behavior, clinical science, cognition, learning and memory, social psychology, and developmental psychology. In addition to full-length articles, the journal features summaries of new research developments and discussions on psychological issues in government and public affairs. "Psychological Science" is published twelve times annually.