Educational and Psychological Measurement最新文献_第10页

Power Analysis for Moderator Effects in Longitudinal Cluster Randomized Designs. 纵向聚类随机设计中调节器效应的功率分析》（Power Analysis for Moderator Effects in Longitudinal Cluster Randomized Designs）。

IF 2.7 3区心理学

Educational and Psychological Measurement Pub Date : 2023-02-01 Epub Date: 2022-02-28 DOI: 10.1177/00131644221077359

Wei Li, Spyros Konstantopoulos

引用次数: 0

Performance of Coefficient Alpha and Its Alternatives: Effects of Different Types of Non-Normality. 系数 Alpha 及其替代方法的性能：不同类型非正态性的影响。

IF 2.7 3区心理学

Educational and Psychological Measurement Pub Date : 2023-02-01 Epub Date: 2022-04-11 DOI: 10.1177/00131644221088240

Leifeng Xiao, Kit-Tai Hau

{"title":"Performance of Coefficient Alpha and Its Alternatives: Effects of Different Types of Non-Normality.","authors":"Leifeng Xiao, Kit-Tai Hau","doi":"10.1177/00131644221088240","DOIUrl":"10.1177/00131644221088240","url":null,"abstract":"We examined the performance of coefficient alpha and its potential competitors (ordinal alpha, omega total, Revelle's omega total [omega RT], omega hierarchical [omega h], greatest lower bound [GLB], and coefficient H) with continuous and discrete data having different types of non-normality. Results showed the estimation bias was acceptable for continuous data with varying degrees of non-normality when the scales were strong (high loadings). This bias, however, became quite large with moderate strength scales and increased with increasing non-normality. For Likert-type scales, other than omega h, most indices were acceptable with non-normal data having at least four points, and more points were better. For different exponential distributed data, omega RT and GLB were robust, whereas the bias of other indices for binomial-beta distribution was generally large. An examination of an authentic large-scale international survey suggested that its items were at worst moderately non-normal; hence, non-normality was not a big concern. We recommend (a) the demand for continuous and normally distributed data for alpha may not be necessary for less severely non-normal data; (b) for severely non-normal data, we should have at least four scale points, and more points are better; and (c) there is no single golden standard for all data types, other issues such as scale loading, model structure, or scale length are also important.","PeriodicalId":11502,"journal":{"name":"Educational and Psychological Measurement","volume":"83 1","pages":"5-27"},"PeriodicalIF":2.7,"publicationDate":"2023-02-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9806521/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"10489719","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

On Effect Size Measures for Nested Measurement Models. 嵌套测量模型的效应大小测量。

IF 2.1 3区心理学

Educational and Psychological Measurement Pub Date : 2022-12-01 Epub Date: 2022-01-20 DOI: 10.1177/00131644211066845

Tenko Raykov, Christine DiStefano, Lisa Calvocoressi, Martin Volker

引用次数: 0

Resting-State Functional MRI Adaptation with Attention Graph Convolution Network for Brain Disorder Identification. 利用注意力图卷积网络进行静息态功能磁共振成像适配以识别脑部疾病

IF 2.7 3区心理学

Educational and Psychological Measurement Pub Date : 2022-10-20 DOI: 10.3390/brainsci12101413

Ying Chu, Haonan Ren, Lishan Qiao, Mingxia Liu

{"title":"Resting-State Functional MRI Adaptation with Attention Graph Convolution Network for Brain Disorder Identification.","authors":"Ying Chu, Haonan Ren, Lishan Qiao, Mingxia Liu","doi":"10.3390/brainsci12101413","DOIUrl":"10.3390/brainsci12101413","url":null,"abstract":"Multi-site resting-state functional magnetic resonance imaging (rs-fMRI) data can facilitate learning-based approaches to train reliable models on more data. However, significant data heterogeneity between imaging sites, caused by different scanners or protocols, can negatively impact the generalization ability of learned models. In addition, previous studies have shown that graph convolution neural networks (GCNs) are effective in mining fMRI biomarkers. However, they generally ignore the potentially different contributions of brain regions- of-interest (ROIs) to automated disease diagnosis/prognosis. In this work, we propose a multi-site rs-fMRI adaptation framework with attention GCN (A2GCN) for brain disorder identification. Specifically, the proposed A2GCN consists of three major components: (1) a node representation learning module based on GCN to extract rs-fMRI features from functional connectivity networks, (2) a node attention mechanism module to capture the contributions of ROIs, and (3) a domain adaptation module to alleviate the differences in data distribution between sites through the constraint of mean absolute error and covariance. The A2GCN not only reduces data heterogeneity across sites, but also improves the interpretability of the learning algorithm by exploring important ROIs. Experimental results on the public ABIDE database demonstrate that our method achieves remarkable performance in fMRI-based recognition of autism spectrum disorders.","PeriodicalId":11502,"journal":{"name":"Educational and Psychological Measurement","volume":"23 1","pages":""},"PeriodicalIF":2.7,"publicationDate":"2022-10-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9599902/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"86831644","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Non-iterative Conditional Pairwise Estimation for the Rating Scale Model. 评级量表模型的非迭代条件配对估计。

IF 2.1 3区心理学

Educational and Psychological Measurement Pub Date : 2022-10-01 Epub Date: 2021-09-24 DOI: 10.1177/00131644211046253

Mark Elliott, Paula Buttery

{"title":"Non-iterative Conditional Pairwise Estimation for the Rating Scale Model.","authors":"Mark Elliott, Paula Buttery","doi":"10.1177/00131644211046253","DOIUrl":"10.1177/00131644211046253","url":null,"abstract":"We investigate two non-iterative estimation procedures for Rasch models, the pair-wise estimation procedure (PAIR) and the Eigenvector method (EVM), and identify theoretical issues with EVM for rating scale model (RSM) threshold estimation. We develop a new procedure to resolve these issues-the conditional pairwise adjacent thresholds procedure (CPAT)-and test the methods using a large number of simulated datasets to compare the estimates against known generating parameters. We find support for our hypotheses, in particular that EVM threshold estimates suffer from theoretical issues which lead to biased estimates and that CPAT represents a means of resolving these issues. These findings are both statistically significant (p < .001) and of a large effect size. We conclude that CPAT deserves serious consideration as a conditional, computationally efficient approach to Rasch parameter estimation for the RSM. CPAT has particular potential for use in contexts where computational load may be an issue, such as systems with multiple online algorithms and large test banks with sparse data designs.","PeriodicalId":11502,"journal":{"name":"Educational and Psychological Measurement","volume":"82 5","pages":"989-1019"},"PeriodicalIF":2.1,"publicationDate":"2022-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ftp.ncbi.nlm.nih.gov/pub/pmc/oa_pdf/f6/31/10.1177_00131644211046253.PMC9386884.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"40626320","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Symptom Presence and Symptom Severity as Unique Indicators of Psychopathology: An Application of Multidimensional Zero-Inflated and Hurdle Graded Response Models. 作为精神病理学独特指标的症状存在和症状严重程度：多维零充气和跨栏分级反应模型的应用。

IF 2.7 3区心理学

Educational and Psychological Measurement Pub Date : 2022-10-01 Epub Date: 2021-12-26 DOI: 10.1177/00131644211061820

Brooke E Magnus, Yang Liu

{"title":"Symptom Presence and Symptom Severity as Unique Indicators of Psychopathology: An Application of Multidimensional Zero-Inflated and Hurdle Graded Response Models.","authors":"Brooke E Magnus, Yang Liu","doi":"10.1177/00131644211061820","DOIUrl":"10.1177/00131644211061820","url":null,"abstract":"Questionnaires inquiring about psychopathology symptoms often produce data with excess zeros or the equivalent (e.g., none, never, and not at all). This type of zero inflation is especially common in nonclinical samples in which many people do not exhibit psychopathology, and if unaccounted for, can result in biased parameter estimates when fitting latent variable models. In the present research, we adopt a maximum likelihood approach in fitting multidimensional zero-inflated and hurdle graded response models to data from a psychological distress measure. These models include two latent variables: susceptibility, which relates to the probability of endorsing the symptom at all, and severity, which relates to the frequency of the symptom, given its presence. After estimating model parameters, we compute susceptibility and severity scale scores and include them as explanatory variables in modeling health-related criterion measures (e.g., suicide attempts, diagnosis of major depressive disorder). Results indicate that susceptibility and severity uniquely and differentially predict other health outcomes, which suggests that symptom presence and symptom severity are unique indicators of psychopathology and both may be clinically useful. Psychometric and clinical implications are discussed, including scale score reliability.","PeriodicalId":11502,"journal":{"name":"Educational and Psychological Measurement","volume":"82 5","pages":"938-966"},"PeriodicalIF":2.7,"publicationDate":"2022-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9386878/pdf/10.1177_00131644211061820.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"40626321","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 1

A Multilevel Mixture IRT Framework for Modeling Response Times as Predictors or Indicators of Response Engagement in IRT Models. 一个多层混合IRT框架建模反应时间作为IRT模型中反应参与的预测或指标。

IF 2.7 3区心理学

Educational and Psychological Measurement Pub Date : 2022-10-01 Epub Date: 2021-09-13 DOI: 10.1177/00131644211045351

Gabriel Nagy, Esther Ulitzsch

{"title":"A Multilevel Mixture IRT Framework for Modeling Response Times as Predictors or Indicators of Response Engagement in IRT Models.","authors":"Gabriel Nagy, Esther Ulitzsch","doi":"10.1177/00131644211045351","DOIUrl":"https://doi.org/10.1177/00131644211045351","url":null,"abstract":"Disengaged item responses pose a threat to the validity of the results provided by large-scale assessments. Several procedures for identifying disengaged responses on the basis of observed response times have been suggested, and item response theory (IRT) models for response engagement have been proposed. We outline that response time-based procedures for classifying response engagement and IRT models for response engagement are based on common ideas, and we propose the distinction between independent and dependent latent class IRT models. In all IRT models considered, response engagement is represented by an item-level latent class variable, but the models assume that response times either reflect or predict engagement. We summarize existing IRT models that belong to each group and extend them to increase their flexibility. Furthermore, we propose a flexible multilevel mixture IRT framework in which all IRT models can be estimated by means of marginal maximum likelihood. The framework is based on the widespread Mplus software, thereby making the procedure accessible to a broad audience. The procedures are illustrated on the basis of publicly available large-scale data. Our results show that the different IRT models for response engagement provided slightly different adjustments of item parameters of individuals' proficiency estimates relative to a conventional IRT model.","PeriodicalId":11502,"journal":{"name":"Educational and Psychological Measurement","volume":"82 5","pages":"845-879"},"PeriodicalIF":2.7,"publicationDate":"2022-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ftp.ncbi.nlm.nih.gov/pub/pmc/oa_pdf/c5/49/10.1177_00131644211045351.PMC9386881.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"40628154","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 19

Exploratory Graph Analysis for Factor Retention: Simulation Results for Continuous and Binary Data. 因子保留的探索性图分析:连续和二元数据的模拟结果。

IF 2.7 3区心理学

Educational and Psychological Measurement Pub Date : 2022-10-01 Epub Date: 2021-12-28 DOI: 10.1177/00131644211059089

Tim Cosemans, Yves Rosseel, Sarah Gelper

引用次数: 10

The Effect of Latent and Error Non-Normality on Measures of Fit in Structural Equation Modeling. 潜在和误差非正态性对结构方程建模中拟合测度的影响。

IF 2.7 3区心理学

Educational and Psychological Measurement Pub Date : 2022-10-01 Epub Date: 2021-09-20 DOI: 10.1177/00131644211046201

Lisa J Jobst, Max Auerswald, Morten Moshagen

{"title":"The Effect of Latent and Error Non-Normality on Measures of Fit in Structural Equation Modeling.","authors":"Lisa J Jobst, Max Auerswald, Morten Moshagen","doi":"10.1177/00131644211046201","DOIUrl":"10.1177/00131644211046201","url":null,"abstract":"Prior studies investigating the effects of non-normality in structural equation modeling typically induced non-normality in the indicator variables. This procedure neglects the factor analytic structure of the data, which is defined as the sum of latent variables and errors, so it is unclear whether previous results hold if the source of non-normality is considered. We conducted a Monte Carlo simulation manipulating the underlying multivariate distribution to assess the effect of the source of non-normality (latent, error, and marginal conditions with either multivariate normal or non-normal marginal distributions) on different measures of fit (empirical rejection rates for the likelihood-ratio model test statistic, the root mean square error of approximation, the standardized root mean square residual, and the comparative fit index). We considered different estimation methods (maximum likelihood, generalized least squares, and (un)modified asymptotically distribution-free), sample sizes, and the extent of non-normality in correctly specified and misspecified models to investigate their performance. The results show that all measures of fit were affected by the source of non-normality but with varying patterns for the analyzed estimation methods.","PeriodicalId":11502,"journal":{"name":"Educational and Psychological Measurement","volume":"82 5","pages":"911-937"},"PeriodicalIF":2.7,"publicationDate":"2022-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9386883/pdf/10.1177_00131644211046201.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"40628155","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 4

Application of Change Point Analysis of Response Time Data to Detect Test Speededness. 响应时间数据变化点分析在检测测试速度中的应用。

IF 2.7 3区心理学

Educational and Psychological Measurement Pub Date : 2022-10-01 Epub Date: 2021-09-20 DOI: 10.1177/00131644211046392

Ying Cheng, Can Shao

{"title":"Application of Change Point Analysis of Response Time Data to Detect Test Speededness.","authors":"Ying Cheng, Can Shao","doi":"10.1177/00131644211046392","DOIUrl":"10.1177/00131644211046392","url":null,"abstract":"Computer-based and web-based testing have become increasingly popular in recent years. Their popularity has dramatically expanded the availability of response time data. Compared to the conventional item response data that are often dichotomous or polytomous, response time has the advantage of being continuous and can be collected in an unobstrusive manner. It therefore has great potential to improve many measurement activities. In this paper, we propose a change point analysis (CPA) procedure to detect test speededness using response time data. Specifically, two test statistics based on CPA, the likelihood ratio test and Wald test, are proposed to detect test speededness. A simulation study has been conducted to evaluate the performance of the proposed CPA procedure, as well as the use of asymptotic and empirical critical values. Results indicate that the proposed procedure leads to high power in detecting test speededness, while keeping the false positive rate under control, even when simplistic and liberal critical values are used. Accuracy of the estimation of the actual change point, however, is highly dependent on the true change point. A real data example is also provided to illustrate the utility of the proposed procedure and its contrast to the response-only procedure. Implications of the findings are discussed at the end.","PeriodicalId":11502,"journal":{"name":"Educational and Psychological Measurement","volume":"82 5","pages":"1031-1062"},"PeriodicalIF":2.7,"publicationDate":"2022-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC9386879/pdf/10.1177_00131644211046392.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"40626318","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":3,"RegionCategory":"心理学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 5