{"title":"Addressing selective reporting bias in meta-analysis of dependent effect sizes: A tutorial in R.","authors":"Man Chen,James E Pustejovsky","doi":"10.1037/met0000841","DOIUrl":null,"url":null,"abstract":"Selective reporting bias arises when findings from primary research studies are incompletely reported and where the likelihood that a result is reported depends on the magnitude or statistical significance of the effect. When applied to selectively reported data, conventional meta-analytic models can produce systematically biased parameter estimates. Various statistical methods have been proposed for dealing with selective reporting in univariate meta-analysis, where each primary study contributes a single effect size estimate. However, fewer methods have been developed for handling selective reporting and publication bias in meta-analysis with dependent effect sizes, which are a common feature of meta-analyses in psychology. In this tutorial, we provide a guide for how to investigate potential selective reporting in meta-analyses of dependent effects, focusing on diagnosis and correction of selection reporting bias. We review several recently developed methods including a regression-based adjustment technique, a step-function selection model, and a sensitivity analysis approach. We demonstrate the implementation of these methods in the R statistical environment using data from two recent meta-analyses as examples. We discuss the application and interpretation of the methods, highlighting their strengths and limitations. (PsycInfo Database Record (c) 2026 APA, all rights reserved).","PeriodicalId":20782,"journal":{"name":"Psychological methods","volume":"79 1","pages":""},"PeriodicalIF":7.5000,"publicationDate":"2026-07-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Psychological methods","FirstCategoryId":"102","ListUrlMain":"https://doi.org/10.1037/met0000841","RegionNum":1,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"PSYCHOLOGY, MULTIDISCIPLINARY","Score":null,"Total":0}
引用次数: 0
Abstract
Selective reporting bias arises when findings from primary research studies are incompletely reported and where the likelihood that a result is reported depends on the magnitude or statistical significance of the effect. When applied to selectively reported data, conventional meta-analytic models can produce systematically biased parameter estimates. Various statistical methods have been proposed for dealing with selective reporting in univariate meta-analysis, where each primary study contributes a single effect size estimate. However, fewer methods have been developed for handling selective reporting and publication bias in meta-analysis with dependent effect sizes, which are a common feature of meta-analyses in psychology. In this tutorial, we provide a guide for how to investigate potential selective reporting in meta-analyses of dependent effects, focusing on diagnosis and correction of selection reporting bias. We review several recently developed methods including a regression-based adjustment technique, a step-function selection model, and a sensitivity analysis approach. We demonstrate the implementation of these methods in the R statistical environment using data from two recent meta-analyses as examples. We discuss the application and interpretation of the methods, highlighting their strengths and limitations. (PsycInfo Database Record (c) 2026 APA, all rights reserved).
期刊介绍:
Psychological Methods is devoted to the development and dissemination of methods for collecting, analyzing, understanding, and interpreting psychological data. Its purpose is the dissemination of innovations in research design, measurement, methodology, and quantitative and qualitative analysis to the psychological community; its further purpose is to promote effective communication about related substantive and methodological issues. The audience is expected to be diverse and to include those who develop new procedures, those who are responsible for undergraduate and graduate training in design, measurement, and statistics, as well as those who employ those procedures in research.