{"title":"Marginalized Learners in International and Regional Test Data: The Extent of Floor Effects","authors":"M. Gustafsson, B. Barakat","doi":"10.1086/725442","DOIUrl":null,"url":null,"abstract":"International assessments inform education policy debates, yet little is known about their floor effects: To what extent do they fail to differentiate between the lowest performers, and what are the implications of this? TIMSS, SACMEQ, and LLECE data are analyzed to answer this question. In TIMSS, floor effects have been reduced through the introduction of a greater number of easy items. SACMEQ and LLECE, despite being specifically designed for developing countries, display substantial floor effects, a problem obscured by their strong reliance on multiple-choice questions. Consequently, some learners are officially classified as proficient who effectively score zero points beyond random guessing. Though floor effects do not substantially alter country rankings, they are large enough to distort trends over time. Designers of assessment programs need to limit floor effects through a greater number of easier multiple-choice items and more constructed-response items. The former solution is easiest to implement.","PeriodicalId":51506,"journal":{"name":"Comparative Education Review","volume":"67 1","pages":"509 - 533"},"PeriodicalIF":2.0000,"publicationDate":"2023-06-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Comparative Education Review","FirstCategoryId":"95","ListUrlMain":"https://doi.org/10.1086/725442","RegionNum":4,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"EDUCATION & EDUCATIONAL RESEARCH","Score":null,"Total":0}
引用次数: 0
Abstract
International assessments inform education policy debates, yet little is known about their floor effects: To what extent do they fail to differentiate between the lowest performers, and what are the implications of this? TIMSS, SACMEQ, and LLECE data are analyzed to answer this question. In TIMSS, floor effects have been reduced through the introduction of a greater number of easy items. SACMEQ and LLECE, despite being specifically designed for developing countries, display substantial floor effects, a problem obscured by their strong reliance on multiple-choice questions. Consequently, some learners are officially classified as proficient who effectively score zero points beyond random guessing. Though floor effects do not substantially alter country rankings, they are large enough to distort trends over time. Designers of assessment programs need to limit floor effects through a greater number of easier multiple-choice items and more constructed-response items. The former solution is easiest to implement.
期刊介绍:
Comparative Education Review investigates education throughout the world and the social, economic, and political forces that shape it. Founded in 1957 to advance knowledge and teaching in comparative education studies, the Review has since established itself as the most reliable source for the analysis of the place of education in countries other than the United States.