{"title":"Supplemental Material for Moving From Exploratory to Confirmatory Network Analysis: An Evaluation of Structural Equation Modeling Fit Indices and Cutoff Values in Network Psychometrics","authors":"","doi":"10.1037/met0000760.supp","DOIUrl":"https://doi.org/10.1037/met0000760.supp","url":null,"abstract":"","PeriodicalId":20782,"journal":{"name":"Psychological methods","volume":"32 1","pages":""},"PeriodicalIF":7.0,"publicationDate":"2025-06-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144304493","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Dynamic measurement invariance cutoffs for two-group fit index differences.","authors":"Daniel McNeish","doi":"10.1037/met0000767","DOIUrl":"https://doi.org/10.1037/met0000767","url":null,"abstract":"<p><p>Measurement invariance is investigated to ensure that a measurement scale functions similarly across different groups. A prevailing approach is to fit a series of multiple-group confirmatory factor models and then compare differences in fit indices of constrained and unconstrained models. Common recommendations are that a difference in comparative fit index ΔCFI above -.01 or a difference in the root-mean-square error of approximation ΔRMSEA less than .01 suggests evidence of invariance. In this article, we review the methodological literature that highlights that these widely used cutoffs do not generalize well. Specifically, the distributions of fit index differences expand or contract based on model and data characteristics, making any single cutoff unlikely to maintain desirable performance across a wide range of conditions. To address this, we propose a method called dynamic measurement invariance (DMI) cutoffs, which is an extension of dynamic fit index cutoffs originally devised to accommodate related issues in single-group models. DMI generalizes the procedure used in the seminal Cheung and Rensvold (2002) study by executing a simulation based on the researcher's specific model and data characteristics. DMI derives custom fit index difference cutoffs with optimal performance for the model being evaluated. The article explains the method and provides simulations and empirical examples to demonstrate its potential contribution, as well as ways in which it could be extended to expand its scope and utility. Open-source software is also provided to improve the accessibility of the method. (PsycInfo Database Record (c) 2025 APA, all rights reserved).</p>","PeriodicalId":20782,"journal":{"name":"Psychological methods","volume":" ","pages":""},"PeriodicalIF":7.6,"publicationDate":"2025-06-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144286401","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Neural text embeddings in psychological research: A guide with examples in R.","authors":"Louis Teitelbaum, Almog Simchon","doi":"10.1037/met0000768","DOIUrl":"https://doi.org/10.1037/met0000768","url":null,"abstract":"<p><p>In this guide, we review neural embedding models and compare three methods of quantifying psychological constructs for use with embeddings: distributed dictionary representation, contextualized construct representation, and a novel approach: correlational anchored vectors. We aim to cultivate an intuition for the geometric properties of neural embeddings and a sensitivity to methodological problems that can arise in their use. We argue that while large language model embeddings have the advantage of contextualization, decontextualized word embeddings may have more ability to generalize across text genres when using cosine or dot product similarity metrics. The three methods of operationalizing psychological constructs in vector space likewise each have their advantages in particular applications. We recommend distributed dictionary representation, which derives a vector representation from a word list, for quantifying abstract constructs relating to the overall feel of a text, especially when the research requires that these constructs generalize across multiple genres of text. We recommend contextualized construct representation, which derives a representation from a questionnaire, for cases in which texts are relatively similar in content to the embedded questionnaire, such as experiments in which participants are asked to respond to a related prompt. Correlational anchored vectors, which derives a representation from labeled examples, requires suitably large and reliable training data. (PsycInfo Database Record (c) 2025 APA, all rights reserved).</p>","PeriodicalId":20782,"journal":{"name":"Psychological methods","volume":" ","pages":""},"PeriodicalIF":7.6,"publicationDate":"2025-06-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144286402","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Pablo F. Cáncer, Manuel Arnold, Eduardo Estrada, Manuel C. Voelkle
{"title":"Continuous-time structural equation model forests.","authors":"Pablo F. Cáncer, Manuel Arnold, Eduardo Estrada, Manuel C. Voelkle","doi":"10.1037/met0000766","DOIUrl":"https://doi.org/10.1037/met0000766","url":null,"abstract":"","PeriodicalId":20782,"journal":{"name":"Psychological methods","volume":"1 1","pages":""},"PeriodicalIF":7.0,"publicationDate":"2025-06-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144229370","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Improved estimation of autoregressive models through contextual impulses and robust modeling.","authors":"Janne K. Adolf, Eva Ceulemans","doi":"10.1037/met0000761","DOIUrl":"https://doi.org/10.1037/met0000761","url":null,"abstract":"","PeriodicalId":20782,"journal":{"name":"Psychological methods","volume":"17 1","pages":""},"PeriodicalIF":7.0,"publicationDate":"2025-06-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144229369","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Utilizing primary study quality in meta-analyses in psychology: A step-by-step tutorial.","authors":"Ronny Scherer, Valentin Emslander","doi":"10.1037/met0000751","DOIUrl":"https://doi.org/10.1037/met0000751","url":null,"abstract":"","PeriodicalId":20782,"journal":{"name":"Psychological methods","volume":"70 1","pages":""},"PeriodicalIF":7.0,"publicationDate":"2025-06-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144229368","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Supplemental Material for Improved Estimation of Autoregressive Models Through Contextual Impulses and Robust Modeling","authors":"","doi":"10.1037/met0000761.supp","DOIUrl":"https://doi.org/10.1037/met0000761.supp","url":null,"abstract":"","PeriodicalId":20782,"journal":{"name":"Psychological methods","volume":"10 1","pages":""},"PeriodicalIF":7.0,"publicationDate":"2025-06-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144229377","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Joshua B Gilbert, Benjamin W Domingue, James S Kim
{"title":"Estimating causal effects on psychological networks using item response theory.","authors":"Joshua B Gilbert, Benjamin W Domingue, James S Kim","doi":"10.1037/met0000764","DOIUrl":"https://doi.org/10.1037/met0000764","url":null,"abstract":"<p><p>Network models in which each variable interacts with the others in a complex system have emerged as an important alternative to latent variable models in psychometric research. However, confirmatory methods for group network comparison can be limited by practical constraints, such as the computational intractability of the Ising model in large networks. In this study, we demonstrate how to estimate causal effects on network state and strength when direct network estimation is not feasible by leveraging the mathematical equivalencies between the Ising model and item response theory (IRT) models. We demonstrate through simulation that a two-parameter logistic explanatory IRT model can simultaneously recover causal effects on network state and strength. We first apply the method to a single empirical example of a vocabulary assessment from a content literacy intervention to demonstrate model building and interpretation strategies. We then replicate our approach with 72 empirical data sets from randomized controlled trials with item-level outcome data in education, economics, health, and related fields. Our results show that causal effects on network strength are both common and uncorrelated with effects on network state, suggesting that causal network models can provide new insight into the impact of interventions in the social and behavioral sciences. (PsycInfo Database Record (c) 2025 APA, all rights reserved).</p>","PeriodicalId":20782,"journal":{"name":"Psychological methods","volume":" ","pages":""},"PeriodicalIF":7.6,"publicationDate":"2025-06-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144199866","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Supplemental Material for Utilizing Primary Study Quality in Meta-Analyses in Psychology: A Step-by-Step Tutorial","authors":"","doi":"10.1037/met0000751.supp","DOIUrl":"https://doi.org/10.1037/met0000751.supp","url":null,"abstract":"","PeriodicalId":20782,"journal":{"name":"Psychological methods","volume":"43 1","pages":""},"PeriodicalIF":7.0,"publicationDate":"2025-06-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144229376","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Psychological methodsPub Date : 2025-06-01Epub Date: 2023-03-27DOI: 10.1037/met0000576
Moritz Breit, Julian Preuß, Vsevolod Scherrer, Franzis Preckel
{"title":"Why the use of segmented regression analysis to explore change in relations between variables is problematic: A simulation study.","authors":"Moritz Breit, Julian Preuß, Vsevolod Scherrer, Franzis Preckel","doi":"10.1037/met0000576","DOIUrl":"10.1037/met0000576","url":null,"abstract":"<p><p>Relations between variables can take different forms like linearity, piecewise linearity, or nonlinearity. Segmented regression analyses (SRA) are specialized statistical methods that detect breaks in the relationship between variables. They are commonly used in the social sciences for exploratory analyses. However, many relations may not be best described by a breakpoint and a resulting piecewise linear relation, but rather by a nonlinearity. In the present simulation study, we examined the application of SRA-specifically the Davies test-in the presence of various forms of nonlinearity. We found that moderate and strong degrees of nonlinearity led to a frequent identification of statistically significant breakpoints and that the identified breakpoints were widely distributed. The results clearly indicate that SRA cannot be used for exploratory analyses. We propose alternative statistical methods for exploratory analyses and outline the conditions for the legitimate use of SRA in the social sciences. (PsycInfo Database Record (c) 2025 APA, all rights reserved).</p>","PeriodicalId":20782,"journal":{"name":"Psychological methods","volume":" ","pages":"622-635"},"PeriodicalIF":7.6,"publicationDate":"2025-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9367161","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}