ANALYZING THE QUALITY OF MEASUREMENT INSTRUMENTS OF MULTIPLE CHOICE QUESTIONS ON CLASS XI ECONOMICS MATERIAL IN PUBLIC HIGH SCHOOL 3 GORONTALO THROUGH CLASSICAL TEST THEORY AND RASCH MODELS

Luthfiah Yulisharyasti, Ansor Nurdin, Nanda Aulia, Fhahnul Aiman H Arfa, Fadjryani
{"title":"ANALYZING THE QUALITY OF MEASUREMENT INSTRUMENTS OF MULTIPLE CHOICE QUESTIONS ON CLASS XI ECONOMICS MATERIAL IN PUBLIC HIGH SCHOOL 3 GORONTALO THROUGH CLASSICAL TEST THEORY AND RASCH MODELS","authors":"Luthfiah Yulisharyasti, Ansor Nurdin, Nanda Aulia, Fhahnul Aiman H Arfa, Fadjryani","doi":"10.22487/27765660.2023.v3.i1.16417","DOIUrl":null,"url":null,"abstract":"One form of evaluation of student learning outcomes is the Final Semester Examination. This exam is designed to measure the extent of achievement of educational objectives. A good evaluation must meet several criteria, including good item validity and reliability, a variety of difficulty levels, and the power of differentiation. This study aims to describe the results of a comparative analysis of the quality of measurement instruments in the form of multiple-choice questions using the classical test theory approach and the Rasch model in terms of validity, reliability, difficulty level, and question differentiation. Data were obtained through a website that presents multiple choice exam results of grade XI students at SMA Negeri 3 Gorontalo, consisting of 26 female students and 10 male students. The results showed that in the instrument validity analysis, the Rasch model showed more valid items with a determination category of 0.4 < pt measure corr < 0.8. This means that the Rasch model provides a better analysis compared to the classical test theory analysis. In the reliability analysis, the reliability value of items in the Rasch model is higher but in almost the same category. In analyzing the difficulty level of the instrument, the classical test theory approach shows that the items are in the easy, medium, and difficult categories, so they are still considered capable of measuring students' abilities. However, in the Rasch model, items are only in the very easy, difficult, and extremely difficult categories. In analyzing the power of differentiation, the classical test theory method and the Rasch model have not provided good enough results to identify respondents in several groups based on their level of understanding","PeriodicalId":337689,"journal":{"name":"Parameter: Journal of Statistics","volume":"73 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-06-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Parameter: Journal of Statistics","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.22487/27765660.2023.v3.i1.16417","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 1

Abstract

One form of evaluation of student learning outcomes is the Final Semester Examination. This exam is designed to measure the extent of achievement of educational objectives. A good evaluation must meet several criteria, including good item validity and reliability, a variety of difficulty levels, and the power of differentiation. This study aims to describe the results of a comparative analysis of the quality of measurement instruments in the form of multiple-choice questions using the classical test theory approach and the Rasch model in terms of validity, reliability, difficulty level, and question differentiation. Data were obtained through a website that presents multiple choice exam results of grade XI students at SMA Negeri 3 Gorontalo, consisting of 26 female students and 10 male students. The results showed that in the instrument validity analysis, the Rasch model showed more valid items with a determination category of 0.4 < pt measure corr < 0.8. This means that the Rasch model provides a better analysis compared to the classical test theory analysis. In the reliability analysis, the reliability value of items in the Rasch model is higher but in almost the same category. In analyzing the difficulty level of the instrument, the classical test theory approach shows that the items are in the easy, medium, and difficult categories, so they are still considered capable of measuring students' abilities. However, in the Rasch model, items are only in the very easy, difficult, and extremely difficult categories. In analyzing the power of differentiation, the classical test theory method and the Rasch model have not provided good enough results to identify respondents in several groups based on their level of understanding
运用经典测试理论和rasch模型分析公办高中部经济学十一课多项选择题测量工具的质量
评估学生学习成果的一种形式是期末考试。这个考试的目的是衡量教育目标实现的程度。一个好的评估必须满足几个标准,包括良好的项目效度和可靠性,各种难度水平,以及差异化的力量。本研究旨在运用经典测验理论方法和Rasch模型,从效度、信度、难易程度和问题分化等方面对多项选择题形式的测量工具质量进行比较分析。数据是通过一个网站获得的,该网站显示了SMA Negeri 3 Gorontalo十一年级学生的多项选择考试成绩,其中包括26名女生和10名男生。结果表明,在仪器效度分析中,Rasch模型显示出更多的有效项目,其测定类别为0.4 < pt测量系数< 0.8。这意味着与经典的测试理论分析相比,Rasch模型提供了更好的分析。在信度分析中,Rasch模型中项目的信度值较高,但在几乎相同的类别中。在分析量表的难度等级时,经典的测试理论方法表明,量表的题目分为易、中、难三类,因此仍然认为它们能够衡量学生的能力。然而,在Rasch模型中,项目只属于非常简单、困难和极其困难的类别。在分析分化能力时,经典的测试理论方法和Rasch模型并没有提供足够好的结果来根据他们的理解水平将被调查者划分为几个群体
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信