检验K-12测试项目中技术增强项目的使用和构建保真度

IF 2.1 Q1 EDUCATION & EDUCATIONAL RESEARCH
M. Russell, Sebastian Moncaleano
{"title":"检验K-12测试项目中技术增强项目的使用和构建保真度","authors":"M. Russell, Sebastian Moncaleano","doi":"10.1080/10627197.2019.1670055","DOIUrl":null,"url":null,"abstract":"ABSTRACT Over the past decade, large-scale testing programs have employed technology-enhanced items (TEI) to improve the fidelity with which an item measures a targeted construct. This paper presents findings from a review of released TEIs employed by large-scale testing programs worldwide. Analyses examine the prevalence with which different types of TEIs are employed and the content areas and grade levels in which they are employed. The analyses apply the Technology-Enhanced Item Utility Framework to examine the fidelity with which current TEIs represent targeted constructs. The analyses indicate that the most common type of TEI employed by testing programs is a drag-and-drop response interaction. Analyses indicate that approximately 40% of the TEIs examined provide a high-level of construct fidelity, while an approximately equal proportion provide low construct fidelity. Finally, the data indicate that a large portion of drag-and-drop items are of low fidelity while other TEI types provide moderate or high fidelity.","PeriodicalId":46209,"journal":{"name":"Educational Assessment","volume":"24 1","pages":"286 - 304"},"PeriodicalIF":2.1000,"publicationDate":"2019-09-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1080/10627197.2019.1670055","citationCount":"4","resultStr":"{\"title\":\"Examining the Use and Construct Fidelity of Technology-Enhanced Items Employed by K-12 Testing Programs\",\"authors\":\"M. Russell, Sebastian Moncaleano\",\"doi\":\"10.1080/10627197.2019.1670055\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"ABSTRACT Over the past decade, large-scale testing programs have employed technology-enhanced items (TEI) to improve the fidelity with which an item measures a targeted construct. This paper presents findings from a review of released TEIs employed by large-scale testing programs worldwide. Analyses examine the prevalence with which different types of TEIs are employed and the content areas and grade levels in which they are employed. The analyses apply the Technology-Enhanced Item Utility Framework to examine the fidelity with which current TEIs represent targeted constructs. The analyses indicate that the most common type of TEI employed by testing programs is a drag-and-drop response interaction. Analyses indicate that approximately 40% of the TEIs examined provide a high-level of construct fidelity, while an approximately equal proportion provide low construct fidelity. Finally, the data indicate that a large portion of drag-and-drop items are of low fidelity while other TEI types provide moderate or high fidelity.\",\"PeriodicalId\":46209,\"journal\":{\"name\":\"Educational Assessment\",\"volume\":\"24 1\",\"pages\":\"286 - 304\"},\"PeriodicalIF\":2.1000,\"publicationDate\":\"2019-09-27\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://sci-hub-pdf.com/10.1080/10627197.2019.1670055\",\"citationCount\":\"4\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Educational Assessment\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1080/10627197.2019.1670055\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"EDUCATION & EDUCATIONAL RESEARCH\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Educational Assessment","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1080/10627197.2019.1670055","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"EDUCATION & EDUCATIONAL RESEARCH","Score":null,"Total":0}
引用次数: 4

摘要

摘要在过去的十年里,大规模的测试项目采用了技术增强项目(TEI)来提高项目测量目标结构的保真度。本文介绍了对世界范围内大规模测试项目使用的已发布TEI的审查结果。分析考察了不同类型TEI的使用率以及使用它们的内容领域和等级水平。分析应用技术增强型项目实用程序框架来检查当前TEI表示目标结构的保真度。分析表明,测试程序使用的最常见的TEI类型是拖放响应交互。分析表明,大约40%的TEI提供了高水平的结构保真度,而大约相同比例的TEI则提供了低结构保真度。最后,数据表明,大部分拖放项目是低保真度的,而其他TEI类型提供中等或高保真度。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Examining the Use and Construct Fidelity of Technology-Enhanced Items Employed by K-12 Testing Programs
ABSTRACT Over the past decade, large-scale testing programs have employed technology-enhanced items (TEI) to improve the fidelity with which an item measures a targeted construct. This paper presents findings from a review of released TEIs employed by large-scale testing programs worldwide. Analyses examine the prevalence with which different types of TEIs are employed and the content areas and grade levels in which they are employed. The analyses apply the Technology-Enhanced Item Utility Framework to examine the fidelity with which current TEIs represent targeted constructs. The analyses indicate that the most common type of TEI employed by testing programs is a drag-and-drop response interaction. Analyses indicate that approximately 40% of the TEIs examined provide a high-level of construct fidelity, while an approximately equal proportion provide low construct fidelity. Finally, the data indicate that a large portion of drag-and-drop items are of low fidelity while other TEI types provide moderate or high fidelity.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Educational Assessment
Educational Assessment EDUCATION & EDUCATIONAL RESEARCH-
CiteScore
3.20
自引率
6.70%
发文量
24
期刊介绍: Educational Assessment publishes original research and scholarship on the assessment of individuals, groups, and programs in educational settings. It includes theory, methodological approaches and empirical research in the appraisal of the learning and achievement of students and teachers, young children and adults, and novices and experts. The journal reports on current large-scale testing practices, discusses alternative approaches, presents scholarship on classroom assessment practices and includes assessment topics debated at the national level. It welcomes both conceptual and empirical pieces and encourages articles that provide a strong bridge between theory and/or empirical research and the implications for educational policy and/or practice.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信