The accuracy of the cheating detection methods in large-scale tests: mathematics national examination

Thomas Mbenu Nulangi, D. Mardapi
{"title":"The accuracy of the cheating detection methods in large-scale tests: mathematics national examination","authors":"Thomas Mbenu Nulangi, D. Mardapi","doi":"10.21831/PEP.V22I2.14930","DOIUrl":null,"url":null,"abstract":"This study aimed to describe (1) the characteristics of items based on the Item Response Theory, (2) the cheating level in the implementation of the national examinartion based on Angoffs B-Index method, Pair 1 method, Pair 2 method, Modified Error Similarity Analysis (MESA) method, and G2 method, (3) the most accurate method to detect the cheating in the mathematics national examination at the senior secondary school level in the academic year of 2015/2016 in East Nusa Tenggara Province. The result of the item response theory analysis showed that 17 (42.5%) items of the mathematics national examination fit with the 3-PL model, with the maximum information function of 58.0128 at 1.6, and the measurement error of 0.1313. The number of pairs detected to be cheating by Angoff’s B-Index method was 63 pairs, that by the Pair 1 method was 52 pairs, that by the Pair 2 method was 141 pairs, that by MESA method was 67 pairs, and that by the G2 method was 183 pairs. The methods which could detect most pairs doing cheating were the G2 method, the Pair 2 method, the MESA method, Angoff’s B-Index method, and the Pair 1 method successively. The methods which could accurately detect cheating based on the computation of the standard error were Angoff’s B-Index method, the G2 method, the MESA method, the Pair 1 method, and the Pair 2 method successively.","PeriodicalId":33364,"journal":{"name":"Jurnal Penelitian dan Evaluasi Pendidikan","volume":"21 12","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2018-12-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Jurnal Penelitian dan Evaluasi Pendidikan","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.21831/PEP.V22I2.14930","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

This study aimed to describe (1) the characteristics of items based on the Item Response Theory, (2) the cheating level in the implementation of the national examinartion based on Angoffs B-Index method, Pair 1 method, Pair 2 method, Modified Error Similarity Analysis (MESA) method, and G2 method, (3) the most accurate method to detect the cheating in the mathematics national examination at the senior secondary school level in the academic year of 2015/2016 in East Nusa Tenggara Province. The result of the item response theory analysis showed that 17 (42.5%) items of the mathematics national examination fit with the 3-PL model, with the maximum information function of 58.0128 at 1.6, and the measurement error of 0.1313. The number of pairs detected to be cheating by Angoff’s B-Index method was 63 pairs, that by the Pair 1 method was 52 pairs, that by the Pair 2 method was 141 pairs, that by MESA method was 67 pairs, and that by the G2 method was 183 pairs. The methods which could detect most pairs doing cheating were the G2 method, the Pair 2 method, the MESA method, Angoff’s B-Index method, and the Pair 1 method successively. The methods which could accurately detect cheating based on the computation of the standard error were Angoff’s B-Index method, the G2 method, the MESA method, the Pair 1 method, and the Pair 2 method successively.
大规模考试作弊检测方法的准确性:数学国家考试
本研究旨在描述(1)项基于项目反应理论的特征,(2)作弊水平国家的实现基于Angoffs examinartion B-Index方法,对1的方法,对2的方法,修改错误相似性分析(台面)方法,和G2方法,(3)最精确的方法来检测数学国家考试作弊高级中学水平的2015/2016学年东努沙登卡拉省相接。项目反应理论分析结果表明,数学国家考试有17个(42.5%)项目符合3-PL模型,在1.6处信息函数最大值为58.0128,测量误差为0.1313。Angoff’s B-Index法检测到作弊的对数为63对,Pair 1法检测到作弊的对数为52对,Pair 2法检测到作弊的对数为141对,MESA法检测到作弊的对数为67对,G2法检测到作弊的对数为183对。对作弊行为检测最多的方法依次为G2法、Pair 2法、MESA法、Angoff’s B-Index法和Pair 1法。基于标准误差计算能够准确检测作弊的方法依次是Angoff的B-Index法、G2法、MESA法、Pair 1法、Pair 2法。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
审稿时长
14 weeks
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信