Approximate Bayesian Inference for Educational Attainment Models

Shuhrah ALghamdi, Nema Dean, L. Evers
{"title":"Approximate Bayesian Inference for Educational Attainment Models","authors":"Shuhrah ALghamdi, Nema Dean, L. Evers","doi":"10.11159/icsta22.140","DOIUrl":null,"url":null,"abstract":"- The rapidly expanding volume of educational testing data from online assessments has posed a problem for researchers in modern education. Their main goal is to utilise this information in a timely and adaptive manner to infer skills mastery, improving learning facilities and adapting them to individual learners. Over the past few years, a number of static statistical models have been proposed for extracting knowledge about skills mastery from item response data. However, realistic models typically lead to complex, computationally expensive fitting methods such as MCMC. So these methods will not tend to scale well for streaming data and large-scale real-time systems. The main objective of this paper is to develop approximate Bayesian inference based on the Laplace approximation method (LA), which allows faster inference. The LA estimation method's performance for the one-parameter logistic item response theory (IRT) model has been compared with the MCMC method in a simulation study. Based on the results of several comparison criterion methods such as bias, RMSE and Kendell's measurement distance, the performance of the LA is very good in small, moderate, and relatively large sample size settings. The LA approximately estimated abilities results are very close to the actual values and sometimes even better than the estimated abilities resulting from MCMC. In addition, LA resulted in between a 120 to 900 times speedup over MCMC, making it a more practical alternative for large educational testing datasets. test","PeriodicalId":325859,"journal":{"name":"Proceedings of the 4th International Conference on Statistics: Theory and Applications","volume":"1 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings of the 4th International Conference on Statistics: Theory and Applications","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.11159/icsta22.140","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

- The rapidly expanding volume of educational testing data from online assessments has posed a problem for researchers in modern education. Their main goal is to utilise this information in a timely and adaptive manner to infer skills mastery, improving learning facilities and adapting them to individual learners. Over the past few years, a number of static statistical models have been proposed for extracting knowledge about skills mastery from item response data. However, realistic models typically lead to complex, computationally expensive fitting methods such as MCMC. So these methods will not tend to scale well for streaming data and large-scale real-time systems. The main objective of this paper is to develop approximate Bayesian inference based on the Laplace approximation method (LA), which allows faster inference. The LA estimation method's performance for the one-parameter logistic item response theory (IRT) model has been compared with the MCMC method in a simulation study. Based on the results of several comparison criterion methods such as bias, RMSE and Kendell's measurement distance, the performance of the LA is very good in small, moderate, and relatively large sample size settings. The LA approximately estimated abilities results are very close to the actual values and sometimes even better than the estimated abilities resulting from MCMC. In addition, LA resulted in between a 120 to 900 times speedup over MCMC, making it a more practical alternative for large educational testing datasets. test
教育程度模型的近似贝叶斯推断
-在线评估的教育测试数据量迅速增加,这给现代教育研究人员带来了一个问题。他们的主要目标是及时和适应性地利用这些信息来推断技能掌握情况,改善学习设施并使其适应个别学习者。在过去的几年里,人们提出了一些静态统计模型来从项目反应数据中提取技能掌握的知识。然而,现实模型通常导致复杂的,计算昂贵的拟合方法,如MCMC。因此,这些方法往往不能很好地扩展流数据和大规模实时系统。本文的主要目的是在拉普拉斯近似方法(LA)的基础上发展近似贝叶斯推理,使推理速度更快。通过仿真研究,比较了单参数logistic项目响应理论(IRT)模型的LA估计方法与MCMC方法的性能。根据偏差、均方根误差和肯德尔测量距离等几种比较标准方法的结果,LA在小样本量、中等样本量和相对较大样本量设置下的性能都非常好。LA近似估计的能力结果非常接近实际值,有时甚至比MCMC估计的能力结果更好。此外,LA比MCMC的速度提高了120到900倍,使其成为大型教育测试数据集的更实用的替代方案。测试
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信