Research on Question Severity Detection for Automatic Essay Scoring

Ken Cheng, Shixian Wang, Yu Zhu
{"title":"Research on Question Severity Detection for Automatic Essay Scoring","authors":"Ken Cheng, Shixian Wang, Yu Zhu","doi":"10.1109/icise-ie58127.2022.00018","DOIUrl":null,"url":null,"abstract":"In the process of essay scoring, the item-specific index is an important factor affecting the final score. In previous studies, the item-specific index was not included in the characteristic system of objective essay scoring. Therefore, it is easy to produce the phenomenon that the deviation from the topic with high language standardization, rich vocabulary and correct grammar is judged high, resulting in the decrease of the accuracy of the score prediction model, which is quite different from the results of manual evaluation. In this paper, the LDA topic model is used to model the article, and the topic probability distribution distance and word vector are used to calculate the topic degree index of the article. The index is added to the composition automatic scoring system to improve the accuracy of the machine scoring.","PeriodicalId":376815,"journal":{"name":"2022 3rd International Conference on Information Science and Education (ICISE-IE)","volume":"15 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-11-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"2022 3rd International Conference on Information Science and Education (ICISE-IE)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/icise-ie58127.2022.00018","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

In the process of essay scoring, the item-specific index is an important factor affecting the final score. In previous studies, the item-specific index was not included in the characteristic system of objective essay scoring. Therefore, it is easy to produce the phenomenon that the deviation from the topic with high language standardization, rich vocabulary and correct grammar is judged high, resulting in the decrease of the accuracy of the score prediction model, which is quite different from the results of manual evaluation. In this paper, the LDA topic model is used to model the article, and the topic probability distribution distance and word vector are used to calculate the topic degree index of the article. The index is added to the composition automatic scoring system to improve the accuracy of the machine scoring.
自动作文评分中问题严重性检测的研究
在作文评分过程中,单项指标是影响最终分数的重要因素。在以往的研究中,客观作文评分的特征体系中并没有纳入具体项目指标。因此,很容易产生对语言标准化程度高、词汇量丰富、语法正确的话题偏差判断高的现象,导致分数预测模型的准确率下降,与人工评价结果相差较大。本文采用LDA主题模型对文章进行建模,利用主题概率分布距离和词向量计算文章的主题度指标。该指标加入到作文自动打分系统中,提高了机器打分的准确性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信