求解概率中等的自适应试验所需试验长度的封闭公式

IF 1.5 Q2 EDUCATION & EDUCATIONAL RESEARCH
Judit T. Kárász, K. Széll, Szabolcs Takács
{"title":"求解概率中等的自适应试验所需试验长度的封闭公式","authors":"Judit T. Kárász, K. Széll, Szabolcs Takács","doi":"10.1108/qae-03-2023-0042","DOIUrl":null,"url":null,"abstract":"\nPurpose\nBased on the general formula, which depends on the length and difficulty of the test, the number of respondents and the number of ability levels, this study aims to provide a closed formula for the adaptive tests with medium difficulty (probability of solution is p = 1/2) to determine the accuracy of the parameters for each item and in the case of calibrated items, determine the required test length given number of respondents.\n\n\nDesign/methodology/approach\nEmpirical results have been obtained on computerized or multistage adaptive implementation. Simulation studies and classroom/experimental results show that adaptive tests can measure test subjects’ ability to the same quality over half the test length compared to linear versions. Due to the complexity of the problem, the authors discuss a closed mathematical formula: the relationship between the length of the tests, the difficulty of solving the items, the number of respondents and the levels of ability.\n\n\nFindings\nThe authors present a closed formula that provides a lower bound for the minimum test length in the case of adaptive tests. The authors also present example calculations using the formula, based on the assessment framework of some student assessments to show the similarity between the theoretical calculations and the empirical results.\n\n\nOriginality/value\nWith this formula, we can form a connection between theoretical and simulation results.\n","PeriodicalId":46734,"journal":{"name":"QUALITY ASSURANCE IN EDUCATION","volume":null,"pages":null},"PeriodicalIF":1.5000,"publicationDate":"2023-07-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Closed formula of test length required for adaptive testing with medium probability of solution\",\"authors\":\"Judit T. Kárász, K. Széll, Szabolcs Takács\",\"doi\":\"10.1108/qae-03-2023-0042\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"\\nPurpose\\nBased on the general formula, which depends on the length and difficulty of the test, the number of respondents and the number of ability levels, this study aims to provide a closed formula for the adaptive tests with medium difficulty (probability of solution is p = 1/2) to determine the accuracy of the parameters for each item and in the case of calibrated items, determine the required test length given number of respondents.\\n\\n\\nDesign/methodology/approach\\nEmpirical results have been obtained on computerized or multistage adaptive implementation. Simulation studies and classroom/experimental results show that adaptive tests can measure test subjects’ ability to the same quality over half the test length compared to linear versions. Due to the complexity of the problem, the authors discuss a closed mathematical formula: the relationship between the length of the tests, the difficulty of solving the items, the number of respondents and the levels of ability.\\n\\n\\nFindings\\nThe authors present a closed formula that provides a lower bound for the minimum test length in the case of adaptive tests. The authors also present example calculations using the formula, based on the assessment framework of some student assessments to show the similarity between the theoretical calculations and the empirical results.\\n\\n\\nOriginality/value\\nWith this formula, we can form a connection between theoretical and simulation results.\\n\",\"PeriodicalId\":46734,\"journal\":{\"name\":\"QUALITY ASSURANCE IN EDUCATION\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":1.5000,\"publicationDate\":\"2023-07-13\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"QUALITY ASSURANCE IN EDUCATION\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1108/qae-03-2023-0042\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"EDUCATION & EDUCATIONAL RESEARCH\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"QUALITY ASSURANCE IN EDUCATION","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1108/qae-03-2023-0042","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"EDUCATION & EDUCATIONAL RESEARCH","Score":null,"Total":0}
引用次数: 0

摘要

目的在一般公式的基础上,根据测试的长度和难度、被调查者的数量和能力水平的数量,本研究旨在为中等难度的自适应测试(解决的概率为p = 1/2)提供一个封闭的公式,以确定每个项目参数的准确性,并在校准项目的情况下,确定给定被调查者数量所需的测试长度。设计/方法/方法在计算机化或多阶段自适应实施中获得了经验结果。模拟研究和课堂/实验结果表明,与线性测试相比,适应性测试可以在测试长度的一半时间内测量测试对象的相同质量的能力。由于问题的复杂性,作者讨论了一个封闭的数学公式:测试的长度,解决项目的难度,被调查者的数量和能力水平之间的关系。作者提出了一个封闭的公式,提供了最小测试长度的下界,在适应性测试的情况下。作者还根据一些学生评估的评估框架,给出了使用该公式的计算实例,以表明理论计算与实证结果之间的相似性。独创性/价值通过这个公式,我们可以将理论和仿真结果联系起来。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Closed formula of test length required for adaptive testing with medium probability of solution
Purpose Based on the general formula, which depends on the length and difficulty of the test, the number of respondents and the number of ability levels, this study aims to provide a closed formula for the adaptive tests with medium difficulty (probability of solution is p = 1/2) to determine the accuracy of the parameters for each item and in the case of calibrated items, determine the required test length given number of respondents. Design/methodology/approach Empirical results have been obtained on computerized or multistage adaptive implementation. Simulation studies and classroom/experimental results show that adaptive tests can measure test subjects’ ability to the same quality over half the test length compared to linear versions. Due to the complexity of the problem, the authors discuss a closed mathematical formula: the relationship between the length of the tests, the difficulty of solving the items, the number of respondents and the levels of ability. Findings The authors present a closed formula that provides a lower bound for the minimum test length in the case of adaptive tests. The authors also present example calculations using the formula, based on the assessment framework of some student assessments to show the similarity between the theoretical calculations and the empirical results. Originality/value With this formula, we can form a connection between theoretical and simulation results.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
QUALITY ASSURANCE IN EDUCATION
QUALITY ASSURANCE IN EDUCATION EDUCATION & EDUCATIONAL RESEARCH-
CiteScore
3.10
自引率
20.00%
发文量
47
期刊介绍: QAE publishes original empirical or theoretical articles on Quality Assurance issues, including dimensions and indicators of Quality and Quality Improvement, as applicable to education at all levels, including pre-primary, primary, secondary, higher and professional education. Periodically, QAE also publishes systematic reviews, research syntheses and assessment policy articles on topics of current significance. As an international journal, QAE seeks submissions on topics that have global relevance. Article submissions could pertain to the following areas integral to QAE''s mission: -organizational or program development, change and improvement -educational testing or assessment programs -evaluation of educational innovations, programs and projects -school efficiency assessments -standards, reforms, accountability, accreditation, and audits in education -tools, criteria and methods for examining or assuring quality
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信