Marginalized Learners in International and Regional Test Data: The Extent of Floor Effects

IF 2 4区 教育学 Q2 EDUCATION & EDUCATIONAL RESEARCH
M. Gustafsson, B. Barakat
{"title":"Marginalized Learners in International and Regional Test Data: The Extent of Floor Effects","authors":"M. Gustafsson, B. Barakat","doi":"10.1086/725442","DOIUrl":null,"url":null,"abstract":"International assessments inform education policy debates, yet little is known about their floor effects: To what extent do they fail to differentiate between the lowest performers, and what are the implications of this? TIMSS, SACMEQ, and LLECE data are analyzed to answer this question. In TIMSS, floor effects have been reduced through the introduction of a greater number of easy items. SACMEQ and LLECE, despite being specifically designed for developing countries, display substantial floor effects, a problem obscured by their strong reliance on multiple-choice questions. Consequently, some learners are officially classified as proficient who effectively score zero points beyond random guessing. Though floor effects do not substantially alter country rankings, they are large enough to distort trends over time. Designers of assessment programs need to limit floor effects through a greater number of easier multiple-choice items and more constructed-response items. The former solution is easiest to implement.","PeriodicalId":51506,"journal":{"name":"Comparative Education Review","volume":"67 1","pages":"509 - 533"},"PeriodicalIF":2.0000,"publicationDate":"2023-06-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Comparative Education Review","FirstCategoryId":"95","ListUrlMain":"https://doi.org/10.1086/725442","RegionNum":4,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"EDUCATION & EDUCATIONAL RESEARCH","Score":null,"Total":0}
引用次数: 0

Abstract

International assessments inform education policy debates, yet little is known about their floor effects: To what extent do they fail to differentiate between the lowest performers, and what are the implications of this? TIMSS, SACMEQ, and LLECE data are analyzed to answer this question. In TIMSS, floor effects have been reduced through the introduction of a greater number of easy items. SACMEQ and LLECE, despite being specifically designed for developing countries, display substantial floor effects, a problem obscured by their strong reliance on multiple-choice questions. Consequently, some learners are officially classified as proficient who effectively score zero points beyond random guessing. Though floor effects do not substantially alter country rankings, they are large enough to distort trends over time. Designers of assessment programs need to limit floor effects through a greater number of easier multiple-choice items and more constructed-response items. The former solution is easiest to implement.
国际和地区测试数据中的边缘化学习者:地板效应的程度
国际评估为教育政策辩论提供了信息,但对其最低影响知之甚少:它们在多大程度上没有区分表现最差的人,这会产生什么影响?TIMSS、SACMEQ和LLECE数据被分析以回答这个问题。在TIMSS中,通过引入更多简单的项目,地板效果得到了降低。SACMEQ和LLECE尽管是专门为发展中国家设计的,但却显示出实质性的下限效应,这一问题因其对多项选择题的强烈依赖而被掩盖。因此,一些学习者被正式归类为精通者,他们在随机猜测之外实际上得了零分。尽管下限效应不会实质性地改变国家排名,但随着时间的推移,它们已经足够大,足以扭曲趋势。评估程序的设计者需要通过更多更容易的多项选择项和更结构化的响应项来限制地板效果。前一种解决方案最容易实现。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Comparative Education Review
Comparative Education Review EDUCATION & EDUCATIONAL RESEARCH-
CiteScore
3.10
自引率
5.60%
发文量
56
期刊介绍: Comparative Education Review investigates education throughout the world and the social, economic, and political forces that shape it. Founded in 1957 to advance knowledge and teaching in comparative education studies, the Review has since established itself as the most reliable source for the analysis of the place of education in countries other than the United States.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信