Educational Measurement-Issues and Practice最新文献_第2页

Robert J. Mislevy and Computational Psychometrics Robert J. Mislevy和计算心理测量学

IF 1.9 4区教育学

Educational Measurement-Issues and Practice Pub Date : 2026-06-03 DOI: 10.1111/emip.70024

Alina A. von Davier, Jiangang Hao

引用次数: 0

Digital Module 40: Introduction to Machine Learning and Generative AI: From AutoGluon to Amazon Bedrock 数字模块40：介绍机器学习和生成人工智能：从AutoGluon到亚马逊基岩

IF 1.9 4区教育学

Educational Measurement-Issues and Practice Pub Date : 2026-05-24 DOI: 10.1111/emip.70029

Ye Ma, Vinita Talreja

引用次数: 0

Grounding Meaning and Warranting Inference in Educational Measurement: Theory, Epistemology, and Practice in Mislevy's Sociocognitive Framework 教育测量的基础意义与保证推理：Mislevy社会认知框架下的理论、认识论与实践

IF 1.9 4区教育学

Educational Measurement-Issues and Practice Pub Date : 2026-05-22 DOI: 10.1111/emip.70023

David Torres Irribarra, Joshua A. McGrane

{"title":"Grounding Meaning and Warranting Inference in Educational Measurement: Theory, Epistemology, and Practice in Mislevy's Sociocognitive Framework","authors":"David Torres Irribarra, Joshua A. McGrane","doi":"10.1111/emip.70023","DOIUrl":"https://doi.org/10.1111/emip.70023","url":null,"abstract":"Educational measurement has long been characterized by a productive tension between technical sophistication and the conceptual frameworks used to interpret what measurement outcomes mean. While the field has produced major methodological advances, comparatively fewer contributions have reshaped how psychometric evidence is connected to theories of cognition, epistemology, and use. This article examines Robert J. Mislevy's Sociocognitive Foundations of Educational Measurement as a landmark effort to address this imbalance. We argue that Mislevy's framework advances the field along three dimensions: reframing constructs through sociocognitive theories of learning and practice; grounding assessment in an epistemology of evidentiary reasoning under uncertainty, aligned with Bayesian inference; and articulating a principled pluralism across methodological traditions. Central to this contribution is a disciplined stance toward inference that treats epistemic restraint as rigor. We discuss the framework's relevance for contemporary challenges, including fairness, socially responsible use, and artificial intelligence in assessment.","PeriodicalId":47345,"journal":{"name":"Educational Measurement-Issues and Practice","volume":"45 2","pages":""},"PeriodicalIF":1.9,"publicationDate":"2026-05-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148090600","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

A Comprehensive Alignment Framework for Building Coherence in an Assessment System 建立评估系统一致性的综合协调框架

IF 1.9 4区教育学

Educational Measurement-Issues and Practice Pub Date : 2026-05-22 DOI: 10.1111/emip.70027

Brooke Nash, Meagan Karvonen, Claudia Flowers, Amy Clark, Russell Swinburne Romine, Sue Bechard

{"title":"A Comprehensive Alignment Framework for Building Coherence in an Assessment System","authors":"Brooke Nash, Meagan Karvonen, Claudia Flowers, Amy Clark, Russell Swinburne Romine, Sue Bechard","doi":"10.1111/emip.70027","DOIUrl":"https://doi.org/10.1111/emip.70027","url":null,"abstract":"Traditional alignment studies that are narrowly focused on content standards and assessment items and are conducted postadministration often lack the timeliness and utility needed to improve assessment systems. This paper introduces a flexible alignment framework centered on assessment-system coherence. Our framework broadens alignment evaluation to include all interconnected elements, from domain definition to score use. We advocate for proactive alignment evaluation by defining expectations in advance and gathering both procedural and empirical evidence throughout the assessment life cycle. By addressing three guiding questions regarding system elements that need to be aligned, the purpose of the alignment evidence, and the types of evidence to use, developers can create customized evaluation plans to enhance alignment during development. The paper provides example alignment questions and an example application of the framework. We discuss the framework's potential to enhance the coherence of assessment systems in the service of meaningful policy and practice.","PeriodicalId":47345,"journal":{"name":"Educational Measurement-Issues and Practice","volume":"45 2","pages":""},"PeriodicalIF":1.9,"publicationDate":"2026-05-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1111/emip.70027","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148090601","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Digital Module 41: Process Data 数字模块41：过程数据

IF 1.9 4区教育学

Educational Measurement-Issues and Practice Pub Date : 2026-05-22 DOI: 10.1111/emip.70030

Susu Zhang, Qiwei He, Sunbeom Kwon

{"title":"Digital Module 41: Process Data","authors":"Susu Zhang, Qiwei He, Sunbeom Kwon","doi":"10.1111/emip.70030","DOIUrl":"https://doi.org/10.1111/emip.70030","url":null,"abstract":"Process data, such as log files from digital assessments, provide detailed records of how examinees interact with assessment tasks. These data offer opportunities to study test-taking behavior, strategy use, and human-machine interaction in ways that final item scores alone cannot capture. This module introduces the structure and characteristics of process data in large-scale digital assessments and presents several approaches for transforming raw action sequences into numerical features that can be used in statistical and psychometric analyses. The module covers both expert-derived and data-driven feature extraction methods, including pattern-based indicators, n-grams, multidimensional scaling, and sequence autoencoders. A hands-on section demonstrates data wrangling and feature extraction in R using the PISA 2012 Climate Control item and the ProcData package. The final section presents case studies showing how process-derived features can be used to study test accommodations, improve measurement precision, and reduce and interpret differential item functioning. By the end of the module, learners should have a practical introduction to process data and a foundation for incorporating process-derived information into educational measurement research.","PeriodicalId":47345,"journal":{"name":"Educational Measurement-Issues and Practice","volume":"45 2","pages":""},"PeriodicalIF":1.9,"publicationDate":"2026-05-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1111/emip.70030","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"148090614","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

ITEMS Corner Update: Reconstructing ITEMS Layout 物品角更新：重建物品布局

IF 1.9 4区教育学

Educational Measurement-Issues and Practice Pub Date : 2026-05-21 DOI: 10.1111/emip.70028

Stella Y. Kim

引用次数: 0

Bob Mislevy's Contributions to Large-Scale Assessments Bob Mislevy对大规模评估的贡献

IF 1.9 4区教育学

Educational Measurement-Issues and Practice Pub Date : 2026-05-19 DOI: 10.1111/emip.70025

John R. Donoghue

引用次数: 0

Knowing What Students Know—An Essay on the Contributions of Robert Mislevy 了解学生所知道的——一篇关于罗伯特·米斯莱维的贡献的文章

IF 1.9 4区教育学

Educational Measurement-Issues and Practice Pub Date : 2026-05-15 DOI: 10.1111/emip.70026

James W. Pellegrino, Mark Wilson, Kadriye Ercikan

引用次数: 0

When Is Classroom Assessment Educational Measurement? 课堂评估何时是教育测量？

IF 1.9 4区教育学

Educational Measurement-Issues and Practice Pub Date : 2026-04-06 DOI: 10.1111/emip.70021

Susan M. Brookhart, Sarah M. Bonner

引用次数: 0

Using Confidence Modeling to Optimize Overall Score Quality in Hybrid Scoring Systems 利用置信度模型优化混合评分系统的总分质量

IF 1.9 4区教育学

Educational Measurement-Issues and Practice Pub Date : 2026-04-05 DOI: 10.1111/emip.70019

Alexander Kwako, Susan Lottridge, Christopher Ormerod

{"title":"Using Confidence Modeling to Optimize Overall Score Quality in Hybrid Scoring Systems","authors":"Alexander Kwako, Susan Lottridge, Christopher Ormerod","doi":"10.1111/emip.70019","DOIUrl":"https://doi.org/10.1111/emip.70019","url":null,"abstract":"In large-scale assessments, constructed response items are often scored using hybrid scoring systems, which combine human and automated scores. In this study, we augment automated scoring with confidence modeling to strategically route difficult-to-score responses for human review. We utilize hybrid performance curves to visualize the impact of routing on performance. Additionally, we propose several hybrid scoring policies for selecting optimal routing thresholds given practical constraints. Our findings reveal that hybrid scoring systems can achieve an overall performance that exceeds that of human- and automated-only systems. Moreover, the superior performance of the hybrid system is less expensive than a human-only system. These findings highlight the complementarity of human raters and automated scoring engines. Although current standards focus on the performance of human raters and automated scoring engines in isolation, we recommend that practitioners also report on the performance of the hybrid scoring system as a whole.","PeriodicalId":47345,"journal":{"name":"Educational Measurement-Issues and Practice","volume":"45 2","pages":""},"PeriodicalIF":1.9,"publicationDate":"2026-04-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1111/emip.70019","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"147714992","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":4,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0