{"title":"A default Bayes factor for testing null hypotheses about the fixed effects of linear two-level models.","authors":"Nikola Sekulovski, Herbert Hoijtink","doi":"10.1037/met0000573","DOIUrl":null,"url":null,"abstract":"<p><p>Testing null hypotheses of the form \"β = 0,\" by the use of various Null Hypothesis Significance Tests (rendering a dichotomous reject/not reject decision), is considered standard practice when evaluating the individual parameters of statistical models. Bayes factors for testing these (and other) hypotheses allow users to quantify the evidence in the data that is in favor of a hypothesis. Unfortunately, when testing equality-contained hypotheses, the Bayes factors are sensitive to the specification of prior distributions, which may be hard to specify by applied researchers. The paper proposes a default Bayes factor with clear operating characteristics when used for testing whether the fixed parameters of linear two-level models are equal to zero. This is achieved by generalizing an already existing approach for linear regression. The generalization requires: (a) the sample size for which a new estimator for the effective sample size in two-level models containing random slopes is proposed; (b) the effect size for the fixed effects for which the so-called <i>marginal R</i>² for the fixed effects is used. Implementing the aforementioned requirements in a small simulation study shows that the Bayes factor yields clear operating characteristics regardless of the value for sample size and the estimation method. The paper gives practical examples and access to an easy-to-use wrapper function to calculate Bayes factors for hypotheses with respect to the fixed coefficients of linear two-level models by using the R package bain. (PsycInfo Database Record (c) 2025 APA, all rights reserved).</p>","PeriodicalId":20782,"journal":{"name":"Psychological methods","volume":" ","pages":"579-598"},"PeriodicalIF":7.6000,"publicationDate":"2025-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Psychological methods","FirstCategoryId":"102","ListUrlMain":"https://doi.org/10.1037/met0000573","RegionNum":1,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2023/4/27 0:00:00","PubModel":"Epub","JCR":"Q1","JCRName":"PSYCHOLOGY, MULTIDISCIPLINARY","Score":null,"Total":0}
引用次数: 0
Abstract
Testing null hypotheses of the form "β = 0," by the use of various Null Hypothesis Significance Tests (rendering a dichotomous reject/not reject decision), is considered standard practice when evaluating the individual parameters of statistical models. Bayes factors for testing these (and other) hypotheses allow users to quantify the evidence in the data that is in favor of a hypothesis. Unfortunately, when testing equality-contained hypotheses, the Bayes factors are sensitive to the specification of prior distributions, which may be hard to specify by applied researchers. The paper proposes a default Bayes factor with clear operating characteristics when used for testing whether the fixed parameters of linear two-level models are equal to zero. This is achieved by generalizing an already existing approach for linear regression. The generalization requires: (a) the sample size for which a new estimator for the effective sample size in two-level models containing random slopes is proposed; (b) the effect size for the fixed effects for which the so-called marginal R² for the fixed effects is used. Implementing the aforementioned requirements in a small simulation study shows that the Bayes factor yields clear operating characteristics regardless of the value for sample size and the estimation method. The paper gives practical examples and access to an easy-to-use wrapper function to calculate Bayes factors for hypotheses with respect to the fixed coefficients of linear two-level models by using the R package bain. (PsycInfo Database Record (c) 2025 APA, all rights reserved).
期刊介绍:
Psychological Methods is devoted to the development and dissemination of methods for collecting, analyzing, understanding, and interpreting psychological data. Its purpose is the dissemination of innovations in research design, measurement, methodology, and quantitative and qualitative analysis to the psychological community; its further purpose is to promote effective communication about related substantive and methodological issues. The audience is expected to be diverse and to include those who develop new procedures, those who are responsible for undergraduate and graduate training in design, measurement, and statistics, as well as those who employ those procedures in research.