Joshua B Gilbert, Benjamin W Domingue, James S Kim
{"title":"运用项目反应理论估计心理网络的因果效应。","authors":"Joshua B Gilbert, Benjamin W Domingue, James S Kim","doi":"10.1037/met0000764","DOIUrl":null,"url":null,"abstract":"<p><p>Network models in which each variable interacts with the others in a complex system have emerged as an important alternative to latent variable models in psychometric research. However, confirmatory methods for group network comparison can be limited by practical constraints, such as the computational intractability of the Ising model in large networks. In this study, we demonstrate how to estimate causal effects on network state and strength when direct network estimation is not feasible by leveraging the mathematical equivalencies between the Ising model and item response theory (IRT) models. We demonstrate through simulation that a two-parameter logistic explanatory IRT model can simultaneously recover causal effects on network state and strength. We first apply the method to a single empirical example of a vocabulary assessment from a content literacy intervention to demonstrate model building and interpretation strategies. We then replicate our approach with 72 empirical data sets from randomized controlled trials with item-level outcome data in education, economics, health, and related fields. Our results show that causal effects on network strength are both common and uncorrelated with effects on network state, suggesting that causal network models can provide new insight into the impact of interventions in the social and behavioral sciences. (PsycInfo Database Record (c) 2025 APA, all rights reserved).</p>","PeriodicalId":20782,"journal":{"name":"Psychological methods","volume":" ","pages":""},"PeriodicalIF":7.8000,"publicationDate":"2025-06-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Estimating causal effects on psychological networks using item response theory.\",\"authors\":\"Joshua B Gilbert, Benjamin W Domingue, James S Kim\",\"doi\":\"10.1037/met0000764\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>Network models in which each variable interacts with the others in a complex system have emerged as an important alternative to latent variable models in psychometric research. However, confirmatory methods for group network comparison can be limited by practical constraints, such as the computational intractability of the Ising model in large networks. In this study, we demonstrate how to estimate causal effects on network state and strength when direct network estimation is not feasible by leveraging the mathematical equivalencies between the Ising model and item response theory (IRT) models. We demonstrate through simulation that a two-parameter logistic explanatory IRT model can simultaneously recover causal effects on network state and strength. We first apply the method to a single empirical example of a vocabulary assessment from a content literacy intervention to demonstrate model building and interpretation strategies. We then replicate our approach with 72 empirical data sets from randomized controlled trials with item-level outcome data in education, economics, health, and related fields. Our results show that causal effects on network strength are both common and uncorrelated with effects on network state, suggesting that causal network models can provide new insight into the impact of interventions in the social and behavioral sciences. (PsycInfo Database Record (c) 2025 APA, all rights reserved).</p>\",\"PeriodicalId\":20782,\"journal\":{\"name\":\"Psychological methods\",\"volume\":\" \",\"pages\":\"\"},\"PeriodicalIF\":7.8000,\"publicationDate\":\"2025-06-02\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Psychological methods\",\"FirstCategoryId\":\"102\",\"ListUrlMain\":\"https://doi.org/10.1037/met0000764\",\"RegionNum\":1,\"RegionCategory\":\"心理学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"PSYCHOLOGY, MULTIDISCIPLINARY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Psychological methods","FirstCategoryId":"102","ListUrlMain":"https://doi.org/10.1037/met0000764","RegionNum":1,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"PSYCHOLOGY, MULTIDISCIPLINARY","Score":null,"Total":0}
引用次数: 0
摘要
在复杂系统中,每个变量与其他变量相互作用的网络模型已成为心理测量学研究中潜在变量模型的重要替代方案。然而,群体网络比较的验证性方法可能受到实际约束的限制,例如大型网络中Ising模型的计算难度。在这项研究中,我们展示了如何利用Ising模型和项目反应理论(IRT)模型之间的数学等价性,在无法直接估计网络状态和强度的情况下,估计网络状态和强度的因果效应。我们通过仿真证明了一个双参数逻辑解释IRT模型可以同时恢复网络状态和强度的因果效应。我们首先将该方法应用于一个来自内容素养干预的词汇评估的单一实证例子,以展示模型构建和解释策略。然后,我们用来自教育、经济、卫生和相关领域的随机对照试验的72组经验数据重复了我们的方法。我们的研究结果表明,对网络强度的因果效应既普遍又与对网络状态的影响不相关,这表明因果网络模型可以为社会和行为科学中干预的影响提供新的见解。(PsycInfo Database Record (c) 2025 APA,版权所有)。
Estimating causal effects on psychological networks using item response theory.
Network models in which each variable interacts with the others in a complex system have emerged as an important alternative to latent variable models in psychometric research. However, confirmatory methods for group network comparison can be limited by practical constraints, such as the computational intractability of the Ising model in large networks. In this study, we demonstrate how to estimate causal effects on network state and strength when direct network estimation is not feasible by leveraging the mathematical equivalencies between the Ising model and item response theory (IRT) models. We demonstrate through simulation that a two-parameter logistic explanatory IRT model can simultaneously recover causal effects on network state and strength. We first apply the method to a single empirical example of a vocabulary assessment from a content literacy intervention to demonstrate model building and interpretation strategies. We then replicate our approach with 72 empirical data sets from randomized controlled trials with item-level outcome data in education, economics, health, and related fields. Our results show that causal effects on network strength are both common and uncorrelated with effects on network state, suggesting that causal network models can provide new insight into the impact of interventions in the social and behavioral sciences. (PsycInfo Database Record (c) 2025 APA, all rights reserved).
期刊介绍:
Psychological Methods is devoted to the development and dissemination of methods for collecting, analyzing, understanding, and interpreting psychological data. Its purpose is the dissemination of innovations in research design, measurement, methodology, and quantitative and qualitative analysis to the psychological community; its further purpose is to promote effective communication about related substantive and methodological issues. The audience is expected to be diverse and to include those who develop new procedures, those who are responsible for undergraduate and graduate training in design, measurement, and statistics, as well as those who employ those procedures in research.