{"title":"Balanced examination of positive publication bias impact.","authors":"Mark Louie F Ramos","doi":"10.1080/08989621.2025.2538066","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Positive publication bias is the tendency to favor studies that reject null hypotheses for publication and is widely regarded as detrimental to research enterprise quality. However, this view oversimplifies the interplay between selection biases and the statistical properties of hypothesis testing.</p><p><strong>Methods: </strong>Using theoretical models under varying assumptions about the research landscape in terms of the truth values of hypotheses investigated, we examine how increasing bias towards publishing studies with statistically significant results over those without inflates false positive rate while improving true positive rate of studies found in published literature.</p><p><strong>Results: </strong>We demonstrate that even when most null hypotheses being investigated in a research field are true, a preference for publishing studies with statistically significant results when choosing among many articles that are each investigating different topics substantially increases the proportion of published true positives while only modestly inflating the proportion of published false positives. This is true so long as individual research studies are being conducted at reasonable significance level and power relative to the research landscape.</p><p><strong>Conclusion: </strong>Observed positive publication bias based on the proportion of published studies with positive results compared to unpublished studies is not inherently harmful to the research enterprise when publishers and researchers are acting competently and in good faith.</p>","PeriodicalId":50927,"journal":{"name":"Accountability in Research-Policies and Quality Assurance","volume":" ","pages":"1-21"},"PeriodicalIF":4.0000,"publicationDate":"2025-07-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Accountability in Research-Policies and Quality Assurance","FirstCategoryId":"98","ListUrlMain":"https://doi.org/10.1080/08989621.2025.2538066","RegionNum":1,"RegionCategory":"哲学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"MEDICAL ETHICS","Score":null,"Total":0}
引用次数: 0
Abstract
Background: Positive publication bias is the tendency to favor studies that reject null hypotheses for publication and is widely regarded as detrimental to research enterprise quality. However, this view oversimplifies the interplay between selection biases and the statistical properties of hypothesis testing.
Methods: Using theoretical models under varying assumptions about the research landscape in terms of the truth values of hypotheses investigated, we examine how increasing bias towards publishing studies with statistically significant results over those without inflates false positive rate while improving true positive rate of studies found in published literature.
Results: We demonstrate that even when most null hypotheses being investigated in a research field are true, a preference for publishing studies with statistically significant results when choosing among many articles that are each investigating different topics substantially increases the proportion of published true positives while only modestly inflating the proportion of published false positives. This is true so long as individual research studies are being conducted at reasonable significance level and power relative to the research landscape.
Conclusion: Observed positive publication bias based on the proportion of published studies with positive results compared to unpublished studies is not inherently harmful to the research enterprise when publishers and researchers are acting competently and in good faith.
期刊介绍:
Accountability in Research: Policies and Quality Assurance is devoted to the examination and critical analysis of systems for maximizing integrity in the conduct of research. It provides an interdisciplinary, international forum for the development of ethics, procedures, standards policies, and concepts to encourage the ethical conduct of research and to enhance the validity of research results.
The journal welcomes views on advancing the integrity of research in the fields of general and multidisciplinary sciences, medicine, law, economics, statistics, management studies, public policy, politics, sociology, history, psychology, philosophy, ethics, and information science.
All submitted manuscripts are subject to initial appraisal by the Editor, and if found suitable for further consideration, to peer review by independent, anonymous expert referees.