{"title":"The denominator chooses the estimand: A target-population true-score framework for standardized mean differences.","authors":"Daiki Nakamura","doi":"10.1037/met0000875","DOIUrl":null,"url":null,"abstract":"<p><p>The standardized mean difference (SMD) is a workhorse effect-size index across psychology, education, and the behavioral sciences, but its denominator embeds estimand-level commitments-about reliability, sample heterogeneity, and the reference scale on which the effect is interpreted-that are rarely made explicit. We treat the choice of SMD denominator as an estimand-level choice (Lundberg et al., 2021) and develop the latent true-score and target-population-anchored geometric SMD (LTG-SMD): an SMD in which the denominator is the geometric mean of group-specific true-score standard deviations in an explicitly chosen target reference population. An algebraic decomposition relates LTG-SMD to Hedges's g through two transparent factors-a reliability factor and a study-to-target factor-that show exactly when conventional SMDs converge with LTG-SMD and when they diverge. We develop plug-in estimation with both analytic delta-method confidence intervals and bias-corrected nonparametric bootstrap intervals, evaluate finite-sample properties across 1,152 simulation conditions, and illustrate the framework in three empirical settings spanning a high-reliability educational trial with a holdout reference, a moderate-reliability brief personality scale with an external reference, and a 23-site Many Labs 2 replication using a cross-site reference. The framework has direct implications for meta-analysis and multisite research: Anchoring effects to a common target reference separates one important source of denominator-driven heterogeneity from substantive heterogeneity, though it does not address all sources of measurement or design heterogeneity. LTG-SMD is offered as a complementary estimand, not a universal replacement for conventional SMDs. (PsycInfo Database Record (c) 2026 APA, all rights reserved).</p>","PeriodicalId":20782,"journal":{"name":"Psychological methods","volume":" ","pages":""},"PeriodicalIF":7.5000,"publicationDate":"2026-09-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Psychological methods","FirstCategoryId":"102","ListUrlMain":"https://doi.org/10.1037/met0000875","RegionNum":1,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"PSYCHOLOGY, MULTIDISCIPLINARY","Score":null,"Total":0}
引用次数: 0
Abstract
The standardized mean difference (SMD) is a workhorse effect-size index across psychology, education, and the behavioral sciences, but its denominator embeds estimand-level commitments-about reliability, sample heterogeneity, and the reference scale on which the effect is interpreted-that are rarely made explicit. We treat the choice of SMD denominator as an estimand-level choice (Lundberg et al., 2021) and develop the latent true-score and target-population-anchored geometric SMD (LTG-SMD): an SMD in which the denominator is the geometric mean of group-specific true-score standard deviations in an explicitly chosen target reference population. An algebraic decomposition relates LTG-SMD to Hedges's g through two transparent factors-a reliability factor and a study-to-target factor-that show exactly when conventional SMDs converge with LTG-SMD and when they diverge. We develop plug-in estimation with both analytic delta-method confidence intervals and bias-corrected nonparametric bootstrap intervals, evaluate finite-sample properties across 1,152 simulation conditions, and illustrate the framework in three empirical settings spanning a high-reliability educational trial with a holdout reference, a moderate-reliability brief personality scale with an external reference, and a 23-site Many Labs 2 replication using a cross-site reference. The framework has direct implications for meta-analysis and multisite research: Anchoring effects to a common target reference separates one important source of denominator-driven heterogeneity from substantive heterogeneity, though it does not address all sources of measurement or design heterogeneity. LTG-SMD is offered as a complementary estimand, not a universal replacement for conventional SMDs. (PsycInfo Database Record (c) 2026 APA, all rights reserved).
期刊介绍:
Psychological Methods is devoted to the development and dissemination of methods for collecting, analyzing, understanding, and interpreting psychological data. Its purpose is the dissemination of innovations in research design, measurement, methodology, and quantitative and qualitative analysis to the psychological community; its further purpose is to promote effective communication about related substantive and methodological issues. The audience is expected to be diverse and to include those who develop new procedures, those who are responsible for undergraduate and graduate training in design, measurement, and statistics, as well as those who employ those procedures in research.