Xinran Song, Qian Zhang, Kaizong Ye, Antonio R Linero
{"title":"Automatic Mediation Analysis Under Measurement Error Via Bayesian Machine Learning.","authors":"Xinran Song, Qian Zhang, Kaizong Ye, Antonio R Linero","doi":"10.1080/00273171.2026.2660129","DOIUrl":"10.1080/00273171.2026.2660129","url":null,"abstract":"<p><p>This paper considers the problem of causal mediation analysis (CMA) when the outcome, mediator, or both are modeled as latent variables that are measured with error from multiple indicators. Traditional structural equation modeling approaches rely on restrictive parametric assumptions and struggle to capture nonlinear relationships or interactions among covariates, outcomes, and mediators; additionally, accounting for measurement error is difficult when nonlinearities are present. We address these challenges using Bayesian causal mediation forests to model the structural relationships, which were shown by Linero and Zhang to perform well for estimating mediation effects. To infer the latent variables, we consider (a) a full hierarchical Bayesian model and (b) an approximation based on composite scores that is easier to implement. We evaluate our approach through simulation experiments and apply our methodology to data from the Advanced Cognitive Training for Independent and Vital Elderly (ACTIVE) study, which is a publicly available, large-scale, multi-site randomized controlled trial designed to evaluate the effectiveness of cognitive training interventions in order to improve the cognitive abilities of older adults. We find a nonlinear relationship between the ability to perform daily activities (the outcome) and reasoning ability (the mediator), with reasoning training improving the outcome through the mediator.</p>","PeriodicalId":53155,"journal":{"name":"Multivariate Behavioral Research","volume":" ","pages":"830-848"},"PeriodicalIF":3.5,"publicationDate":"2026-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"147823416","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Generalizing Causal Effects to a Target Population Without Individual-Level Data from the Target Population.","authors":"Wen Wei Loh, Dongning Ren","doi":"10.1080/00273171.2026.2683348","DOIUrl":"10.1080/00273171.2026.2683348","url":null,"abstract":"<p><p>Generalizability is a perennial concern in randomized studies. While randomized studies are the gold standard for establishing causality, study samples are rarely representative of broader populations due to factors such as convenience sampling, participant self-selection, and researchers' inclusion or exclusion criteria. To strengthen the generalizability of randomized experiments, the framework of causal effect generalizability provides a solution. However, existing methods require accessing representative individual-level data from the target population, which is often unavailable due to limited resources, data access restrictions, or privacy concerns. In this paper, we develop a novel method to generalize causal effects using only summary statistics on covariates from the target population. We illustrate the estimator using a real-world study by generalizing the impact of a climate change behavioral intervention from the study sample to a broader population. By avoiding the need for individual-level data from the target population, our method offers a practical tool for generalizing causal findings from randomized studies. We hope that the proposed method helps build more accurate theories and enhance the policy relevance of behavioral and psychological research.</p>","PeriodicalId":53155,"journal":{"name":"Multivariate Behavioral Research","volume":" ","pages":"910-920"},"PeriodicalIF":3.5,"publicationDate":"2026-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148220699","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Exploring the Use of Multiple Imputation for Handling Missing Covariates in Meta-Regression with Dependent Effect Sizes.","authors":"Jihyun Lee, S Natasha Beretvas, Brian T Keller","doi":"10.1080/00273171.2026.2673547","DOIUrl":"10.1080/00273171.2026.2673547","url":null,"abstract":"<p><p>Meta-analysts frequently encounter missing covariate values, which can complicate valid estimation of meta-regression models. In practice, missing data are managed often through ad hoc deletion approaches, which can reduce the validity of statistical inferences. More advanced missing data handling approaches such as multiple imputation (MI) remain underutilized, particularly in meta-analyses with dependent effect sizes within studies. This study expands the use of MI techniques for handling missing covariates in such contexts. Specifically, this study introduces adapted multilevel MI approaches that are expected to better accommodate the structure of meta-analytic data with dependent effect sizes and associated model. The study presents Monte Carlo computer simulations that compare the performance of different MI techniques including single-level and multilevel agnostic MI methods as well as multilevel substantive model-based MI and ad hoc deletion approaches. The results generally supported the use of the MI approach over deletion approaches when the dependent structure is well specified in the imputation procedure. This study demonstrates the feasibility of the use of MI techniques and underscores the importance of incorporating the hierarchical structure into the meta-regression model when analyzing dependent effect sizes with missing covariate values. Implications of the study and directions for future research are discussed.</p>","PeriodicalId":53155,"journal":{"name":"Multivariate Behavioral Research","volume":" ","pages":"885-909"},"PeriodicalIF":3.5,"publicationDate":"2026-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148037510","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Lijin Zhang, Charles Rahal, Klint Kanopka, Esther Ulitzsch, Zhiyong Zhang, Benjamin W Domingue
{"title":"Evaluating Model Predictive Performance in Confirmatory Factor Analysis with Binary Outcomes Using the InterModel Vigorish.","authors":"Lijin Zhang, Charles Rahal, Klint Kanopka, Esther Ulitzsch, Zhiyong Zhang, Benjamin W Domingue","doi":"10.1080/00273171.2026.2645212","DOIUrl":"10.1080/00273171.2026.2645212","url":null,"abstract":"<p><p>Confirmatory Factor Analysis (CFA) has been widely used to assess the fit of theoretical measurement models to observed data. We introduce the InterModel Vigorish (IMV) to the field; a predictive fit index that offers novel perspectives for model comparison. The IMV complements traditional fit indices by offering additional information to support model evaluation, with a particular emphasis on a model's generalizability to the hold-out data. It also yields an interpretable and intuitive metric that facilitates meaningful comparisons. We extend it into the CFA framework with binary outcomes and conduct four simulation studies to evaluate its effectiveness. The simulation results suggest that IMV effectively gauges model misspecification, offering insights both at the scale and item levels. As designed, it is insensitive to changes in sample size. By focusing on predictive accuracy, the IMV discourages overfitting. It also enables item-level comparisons, offering richer diagnostic information. To facilitate the practical application of IMV, we offer an empirical example that demonstrates its efficacy in applied research. The paper is accompanied by an R package to further advance the use of the IMV in the CFA space.</p>","PeriodicalId":53155,"journal":{"name":"Multivariate Behavioral Research","volume":" ","pages":"745-764"},"PeriodicalIF":3.5,"publicationDate":"2026-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"147576489","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Phillip Sherlock, Maxwell Mansolf, Julie Hofheimer, Christine W Hockett, Thomas G O'Connor, Danielle Roubinov, J Carolyn Graff, Jin-Shei Lai, Nicole R Bush, Rosalind J Wright, Yueh-Hsiu Mathilda Chiu
{"title":"Beyond Linear Risk: A Machine Learning Approach to Understanding Perinatal Depression in Context.","authors":"Phillip Sherlock, Maxwell Mansolf, Julie Hofheimer, Christine W Hockett, Thomas G O'Connor, Danielle Roubinov, J Carolyn Graff, Jin-Shei Lai, Nicole R Bush, Rosalind J Wright, Yueh-Hsiu Mathilda Chiu","doi":"10.1080/00273171.2026.2661244","DOIUrl":"10.1080/00273171.2026.2661244","url":null,"abstract":"<p><p>The goal of this study was to investigate the contextual nature of prenatal depression (PND) and postpartum depression (PPD). We report an investigation of maternal PND and PPD using nonrandomly clustered data from 8,936 mothers in 16 cohorts in the Environmental influences on Child Health Outcomes (ECHO) Cohort. We used a recursive partitioning algorithm (ctree) to account for differential effects arising from predictor and effect heterogeneity across cohort to identify contexts, and the characteristics comprising these contexts, associated with PND and PPD. Consistent with Bronfenbrenner's bioecological systems framework, risk factors for PND and PPD are heterogeneously and synergistically present in context: the same variables did not consistently present as risk factors across groups. Findings from this study support the idea that the presence or absence of medical (and sociodemographic) risks do not have simple associations with perinatal depression. To that end, no univariate predictors of PND and PPD can be said to constitute risk absent the broader context of mothers' lives. Thus, a more useful research question than \"which variables increase risk for PPD?\" is \"in what contexts, or in which subgroups, does a particular risk or set of risks contribute to perinatal depression?\"</p>","PeriodicalId":53155,"journal":{"name":"Multivariate Behavioral Research","volume":" ","pages":"849-864"},"PeriodicalIF":3.5,"publicationDate":"2026-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC13221726/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"147823444","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Fair and Robust Estimation of Heterogeneous Treatment Effects for Optimal Policies in Multilevel Studies.","authors":"Youmi Suk, Chan Park, Chenguang Pan, Kwangho Kim","doi":"10.1080/00273171.2026.2669081","DOIUrl":"10.1080/00273171.2026.2669081","url":null,"abstract":"<p><p>Recently, there have been growing efforts in developing fair algorithms for treatment effect estimation and optimal treatment recommendations to mitigate discriminatory biases against disadvantaged groups. While most of this work has focused on addressing discrimination due to individual-level sensitive variables (e.g., race/ethnicity), it overlooks the broader impact of societal structures and cultural norms (e.g., structural racism) beyond the individual level. In this paper, we formalize the concept of multilevel fairness for estimating heterogeneous treatment effects to improve fairness in optimal policies. Specifically, we propose a general framework for the estimation of conditional average treatment effects under multilevel fairness constraints that incorporate sensitive variables from multiple structural levels. Using this framework, we analyze the tradeoff between fairness and the maximum achievable utility by the optimal policy. We evaluate the effectiveness of our framework through a simulation study and a real data study on advanced math courses using data from the High School Longitudinal Study of 2009.</p>","PeriodicalId":53155,"journal":{"name":"Multivariate Behavioral Research","volume":" ","pages":"865-884"},"PeriodicalIF":3.5,"publicationDate":"2026-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"147950212","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Single-Level Bifactor Models as Implicit Multilevel Factor Models Without a Bifactor Structure.","authors":"Christian L L Strauss, Kristopher J Preacher","doi":"10.1080/00273171.2026.2659610","DOIUrl":"10.1080/00273171.2026.2659610","url":null,"abstract":"<p><p>It is well-known that bifactor structures are over-represented as preferred solutions in measurement modeling. This study explores the extent to which unmodeled clustering of observations in larger social or organization units (e.g., students clustered in schools) offers a partial explanation for this phenomenon. We investigate the overlap between bifactor confirmatory factor models and multilevel confirmatory factor analysis fit to identically structured data formats. Structural symmetries between these models are identified, leading to a series of postulates regarding expected differences across modeling frameworks. Next, through simulation and empirical data analysis, we demonstrate that bifactor solutions can emerge as artifacts of conflated level-1 and level-2 effects when clustering is ignored, causing invalid interpretations of factors. Specifically, results suggest that when bifactor models are fit to clustered data with one level-2 factor and multiple level-1 factors, general factor loadings are typically inflated, leading to greater support for the misspecified bifactor solution. We encourage researchers to consider multilevel measurement models as alternative explanations for bifactor solutions, so factors are accurately interpreted at the correct level of analysis.</p>","PeriodicalId":53155,"journal":{"name":"Multivariate Behavioral Research","volume":" ","pages":"788-805"},"PeriodicalIF":3.5,"publicationDate":"2026-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"147823498","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A Modularized Higher-Order Diagnostic Classification Model for Clustered Attribute Hierarchies.","authors":"Minho Lee, Yon Soo Suh","doi":"10.1080/00273171.2026.2683356","DOIUrl":"10.1080/00273171.2026.2683356","url":null,"abstract":"<p><p>Recognizing that complex networks of skills typically exhibit hierarchical and modular organization, this article presents a Modularized Higher-Order Diagnostic Classification Model (MHO-DCM) designed to capture hierarchical relationships among attributes organized into clustered subdomains. Central to the proposed method is a representation of attribute hierarchies in which attributes are grouped into cognitively coherent subgraphs nested within a single higher-order ability continuum. We adopt a nominal response model framework in item response theory and leverage standard maximum likelihood estimation (MLE). In parallel, we demonstrate that sequential higher-order latent structural models can likewise be implemented in a modularized fashion within an MLE framework. The performance of the proposed models is examined through simulation studies assessing parameter recovery, classification accuracy, and null rejection rates of goodness-of-fit measures. An empirical demonstration showcases how the framework can be applied in practice, highlighting its advantages in flexibility, interpretability, and the richer diagnostic insights it affords.</p>","PeriodicalId":53155,"journal":{"name":"Multivariate Behavioral Research","volume":" ","pages":"921-945"},"PeriodicalIF":3.5,"publicationDate":"2026-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148273853","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Generalizability Theory Applied to Daily Relationship Quality: Substantive and Statistical Directions.","authors":"Madison Shea Smith, Susan C South","doi":"10.1080/00273171.2026.2683364","DOIUrl":"10.1080/00273171.2026.2683364","url":null,"abstract":"<p><p>Measuring daily romantic relationship quality is important for understanding conflict, support, and satisfaction processes in near real-time. Although there now exists a great deal of research on determinants and outcomes of daily relationship quality, these investigations often rely on several untested assumptions regarding sources of, and consistency in, variability. In this study, we tested the variance components for daily relationship quality, how consistent these measurements are, and whether they are impacted by individual differences in attachment security. Six daily, nonexperimental self-reports of relationship satisfaction and functioning (e.g., conflict) from 101 couples were analyzed using generalizability theory. Results demonstrate a large amount of residual in daily reports of relationship quality, yet significant portions of variance attributable to person- and day-level processes. Variance proportions also changed depending on the index of relationship functioning examined, and individual differences in attachment security moderated these results. Lastly, daily reports of relationship satisfaction are relatively stable when submitted to models using persons as the object of measurement. These findings have implications for planning and interpreting future diary and ecological momentary assessment/experience sampling method studies.</p>","PeriodicalId":53155,"journal":{"name":"Multivariate Behavioral Research","volume":" ","pages":"946-960"},"PeriodicalIF":3.5,"publicationDate":"2026-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC13449769/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148303970","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"A Comparison of Regularization, Alignment, and a Traditional Method for Estimating Structural Relationships Across Two Groups.","authors":"Emma Somer, Carl F Falk, Milica Miočević","doi":"10.1080/00273171.2026.2650840","DOIUrl":"10.1080/00273171.2026.2650840","url":null,"abstract":"<p><p>Establishing the correct partial measurement invariance model is crucial for ensuring unbiased comparisons of relationships between latent variables across multiple groups. While traditional approaches rely on detecting noninvariant items followed by estimation of structural relationships, more recently, approaches that estimate latent parameters without prior knowledge of anchor items have been developed. Specifically, regularization and alignment are powerful approaches that can be used to estimate multiple group structural models. This study compares a traditional sequential search based on multiple-group CFA (MGCFA) to alignment, lasso, elastic net, and ridge regression for estimating the correlation and means between latent variables without pre-specifying anchor items. In the simulation study, we varied the percentage, magnitude, and pattern of noninvariance, sample size, number of indicators, and correlation value and evaluated the bias and efficiency of the methods in terms of the recovery of the factor correlation, means, and item parameters for a two-group model. Results indicated that elastic net led to less biased and more efficient estimates under higher proportions of noninvariance, while alignment performed better under low to modest noninvariance. We provide recommendations for researchers estimating latent correlations and means under different levels of measurement invariance.</p>","PeriodicalId":53155,"journal":{"name":"Multivariate Behavioral Research","volume":" ","pages":"765-787"},"PeriodicalIF":3.5,"publicationDate":"2026-09-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"147634713","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}