Measurement-Interdisciplinary Research and Perspectives最新文献_第8页

Quantitative Data Analysis for Language Assessment Volume II: Advanced Methods 定量数据分析语言评估卷二:先进的方法

IF 1

Measurement-Interdisciplinary Research and Perspectives Pub Date : 2023-01-02 DOI: 10.1080/15366367.2022.2091358

Masoomeh Estaji, Zahra Banitalebi

引用次数: 2

Detecting Rater Centrality Effects in Performance Assessments: A Model-Based Comparison of Centrality Indices 在绩效评估中检测较高的中心性效应:一种基于模型的中心性指数比较

IF 1

Measurement-Interdisciplinary Research and Perspectives Pub Date : 2022-10-02 DOI: 10.1080/15366367.2021.1972654

K. Jin, T. Eckes

{"title":"Detecting Rater Centrality Effects in Performance Assessments: A Model-Based Comparison of Centrality Indices","authors":"K. Jin, T. Eckes","doi":"10.1080/15366367.2021.1972654","DOIUrl":"https://doi.org/10.1080/15366367.2021.1972654","url":null,"abstract":"ABSTRACT Recent research on rater effects in performance assessments has increasingly focused on rater centrality, the tendency to assign scores clustering around the rating scale’s middle categories. In the present paper, we adopted Jin and Wang’s (2018) extended facets modeling approach and constructed a centrality continuum, ranging from raters exhibiting strong central tendencies to raters exhibiting strong tendencies in the opposite direction (extremity). In two simulation studies, we examined three model-based centrality detection indices (rater infit statistics, residual–expected correlations, and rater threshold SDs) as well as the raw-score SD in terms of their efficiency of reconstructing the true rater centrality rank ordering. Findings confirmed the superiority of the residual–expected correlation, rater threshold SD, and raw-score SD statistics, particularly when the examinee sample size was large and the number of scoring criteria was high. By contrast, the infit statistic results were much less consistent and, under conditions of large differences between criterion difficulties, suggested erroneous conclusions about raters’ central tendencies. Analyzing real rating data from a large-scale speaking performance assessment confirmed that infit statistics are unsuitable for identifying raters’ central tendencies. The discussion focuses on detecting centrality effects under different facets models and the indices’ implications for rater monitoring and fair performance assessment.","PeriodicalId":46596,"journal":{"name":"Measurement-Interdisciplinary Research and Perspectives","volume":"55 1","pages":"228 - 247"},"PeriodicalIF":1.0,"publicationDate":"2022-10-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"72658036","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 6

The History of Educational Measurement Key Advancements in Theory, Policy, and Practice 教育测量的历史:理论、政策和实践的关键进步

IF 1

Measurement-Interdisciplinary Research and Perspectives Pub Date : 2022-10-02 DOI: 10.1080/15366367.2021.2024487

D. J. Harris

引用次数: 7

Applications of Bayesian Confirmatory Factor Analysis in Behavioral Measurement: Strong Convergence of a Bayesian Parameter Estimator 贝叶斯验证性因子分析在行为测量中的应用:贝叶斯参数估计的强收敛性

IF 1

Measurement-Interdisciplinary Research and Perspectives Pub Date : 2022-10-02 DOI: 10.1080/15366367.2021.2005959

T. Raykov, Philipp Doebler, G. Marcoulides

引用次数: 0

Conceptual Grounding for Bayesian Inference for Latent Variables in Factor Analysis 因子分析中潜在变量贝叶斯推理的概念基础

IF 1

Measurement-Interdisciplinary Research and Perspectives Pub Date : 2022-10-02 DOI: 10.1080/15366367.2021.1996819

R. Levy

{"title":"Conceptual Grounding for Bayesian Inference for Latent Variables in Factor Analysis","authors":"R. Levy","doi":"10.1080/15366367.2021.1996819","DOIUrl":"https://doi.org/10.1080/15366367.2021.1996819","url":null,"abstract":"ABSTRACT Obtaining values for latent variables in factor analysis models, also referred to as factor scores, has long been of interest to researchers. However, many treatments of factor analysis do not focus on inference about the latent variables, and even fewer do so from a Bayesian perspective. Researchers may therefore be ill-acquainted with Bayesian thinking on this issue, despite the fact that certain existing procedures may be seen as Bayesian to some extent. The focus of this paper is to provide a conceptual grounding for Bayesian inference for latent variables, articulating not only what Bayesian inference has to say about values for latent variables, but why Bayesian inference is suited for this problem. As to why, it is argued that the notion of exchangeability motivates the form of factor analysis, as well as Bayesian inference for latent variables. The argument is supported by documenting the widespread use of Bayesian inference in analogous settings, including latent variables in other measurement models, multilevel models, and missing data. As to what, this work describes a Bayesian analysis when other parameters are known, as well as partially and fully Bayesian analyses when other parameters are unknown. This facilitates a discussion of various choices researchers have when adopting Bayesian approaches to inference about latent variables.","PeriodicalId":46596,"journal":{"name":"Measurement-Interdisciplinary Research and Perspectives","volume":"41 1","pages":"195 - 214"},"PeriodicalIF":1.0,"publicationDate":"2022-10-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"88876916","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 1

Xcalibre Item Parameter Calibration Software for Item Response Theory and Rasch Models Xcalibre项目参数校准软件项目反应理论和Rasch模型

IF 1

Measurement-Interdisciplinary Research and Perspectives Pub Date : 2022-10-02 DOI: 10.1080/15366367.2022.2026736

Gregory M. Hurtz

引用次数: 0

Accounting for Response Styles: Leveraging the Benefits of Combining Response Process Data Collection and Response Process Analysis Methods 考虑反应方式:利用反应过程数据收集和反应过程分析方法相结合的好处

IF 1

Measurement-Interdisciplinary Research and Perspectives Pub Date : 2022-07-03 DOI: 10.1080/15366367.2021.1953315

B. Leventhal, Nikole Gregg, Allison J. Ames

{"title":"Accounting for Response Styles: Leveraging the Benefits of Combining Response Process Data Collection and Response Process Analysis Methods","authors":"B. Leventhal, Nikole Gregg, Allison J. Ames","doi":"10.1080/15366367.2021.1953315","DOIUrl":"https://doi.org/10.1080/15366367.2021.1953315","url":null,"abstract":"ABSTRACT Response styles introduce construct-irrelevant variance as a result of respondents systematically responding to Likert-type items regardless of content. Methods to account for response styles through data analysis as well as approaches to mitigating the effects of response styles during data collection have been well-documented. Recent approaches to modeling Likert responses, such as the IRTree model, rely on the response process individuals take when answering item responses. In this study, we advocate for the use of IRTrees to analyze Likert items in addition to using the hypothesized response process to design new items. Combining these two approaches facilitates answering Likert item design questions that have plagued researchers. These include the interpretation of a middle response option, the optimal number of response options, and how to label the response options. We present 7 research questions that could be answered using this new approach, outline methods of data collection and analysis for each, and present results from an empirical example to address one of these seven questions.","PeriodicalId":46596,"journal":{"name":"Measurement-Interdisciplinary Research and Perspectives","volume":"17 1","pages":"151 - 174"},"PeriodicalIF":1.0,"publicationDate":"2022-07-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"82174021","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 1

Educational and Psychological Measurement 教育与心理测量

IF 1

Measurement-Interdisciplinary Research and Perspectives Pub Date : 2022-07-03 DOI: 10.1080/15366367.2021.2018216

L. Feuerstahler

{"title":"Educational and Psychological Measurement","authors":"L. Feuerstahler","doi":"10.1080/15366367.2021.2018216","DOIUrl":"https://doi.org/10.1080/15366367.2021.2018216","url":null,"abstract":"Educational and Psychological Measurement, written by W. Holmes Finch and Brian French and first published in 2018 by Routledge is a 17-chapter textbook that provides an accessible introduction to classical and modern psychometrics. In this book, the authors provide a broad overview of a wide range of topics and regularly suggest more specialized texts for readers seeking deeper understanding. This book is intended “for students at the graduate school level, and for researchers working in the field of educational and psychological measurement who need a broad resource for understanding test theory” (Finch & French, p. ix). I imagine that this text could also be appropriate for an advanced undergraduate course on educational or psychological measurement. Several aspects of this book were designed particularly for an audience with minimal experience working with statistics or mathematics. Most chapters include “How It Works” sections in which equations are worked out for the reader with example input values. In addition, most chapters include “Psychometrics in the Real World” sections that provide extended worked examples and interpretations. Although the text is accessible to an audience new to statistics, audiences with this background will still learn much from the authors’ clear but nuanced explanations of topics throughout the book. The following review is based on my reading of the e-version of this textbook as accessed through the VitalSource platform. However, errors and typos that I found in the e-version were cross-checked with a print copy of the book, and the vast majority exist in the same way in both versions. Further comments on the e-version are included toward the end of this review. The remainder of this review includes an overview of the book’s 17 chapters and supplemental resources, followed by a discussion of the book’s overall strengths and limitations and some concluding thoughts.","PeriodicalId":46596,"journal":{"name":"Measurement-Interdisciplinary Research and Perspectives","volume":"105 1","pages":"175 - 180"},"PeriodicalIF":1.0,"publicationDate":"2022-07-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"85154818","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Now in JMP® Pro: Structual Equation Modeling 现在在JMP®Pro:结构方程建模

IF 1

Measurement-Interdisciplinary Research and Perspectives Pub Date : 2022-07-03 DOI: 10.1080/15366367.2022.2102722

引用次数: 0

Using Generalizability Theory software suite: GENOVA, urGENOVA, and mGENOVA 使用泛化理论软件套件:GENOVA, urGENOVA和mGENOVA

IF 1

Measurement-Interdisciplinary Research and Perspectives Pub Date : 2022-07-03 DOI: 10.1080/15366367.2022.2025569

S. Y. Kim

引用次数: 0