基于学习向量量化和词相似度增强的潜在语义分析的论文自动评分系统

A. A. P. Ratna, Adam Arsy Arbani, Ihsan Ibrahim, F. A. Ekadiyanto, Kristofer Jehezkiel Bangun, Prima Dewi Purnamasari
{"title":"基于学习向量量化和词相似度增强的潜在语义分析的论文自动评分系统","authors":"A. A. P. Ratna, Adam Arsy Arbani, Ihsan Ibrahim, F. A. Ekadiyanto, Kristofer Jehezkiel Bangun, Prima Dewi Purnamasari","doi":"10.1145/3293663.3293684","DOIUrl":null,"url":null,"abstract":"Department of Electrical Engineering Universitas Indonesia has developed an automatic essay grading system called Simple-O since 2007. Simple-O uses the Latent Semantic Analysis (LSA) method to compare two essays by extracting the essay into matrix. The previous development of Simple-O is the addition of Learning Vector Quantization (LVQ) which is a method of artificial neural network. This research will discuss and provide analysis related to the effect of adding word similarity function to the automatic essay grading system (Simple-O) to the accuracy of the system itself. The experiment will be conducted with five different scenarios by varying the number of keywords in the student's answer essay to 100%, 80%, 60%, 40%, and 20% of the reference essay keywords. According to the result, there are scenarios that has decreased and increased in accuracy. The average accuracy of the Simple-O system after the addition of word similarity function has increased, though not significant. The average increase in accuracy after the addition of word similarity function is 5.4% from 90.9% to 96.3%.","PeriodicalId":420290,"journal":{"name":"International Conference on Artificial Intelligence and Virtual Reality","volume":"24 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2018-11-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"4","resultStr":"{\"title\":\"Automatic Essay Grading System Based on Latent Semantic Analysis with Learning Vector Quantization and Word Similarity Enhancement\",\"authors\":\"A. A. P. Ratna, Adam Arsy Arbani, Ihsan Ibrahim, F. A. Ekadiyanto, Kristofer Jehezkiel Bangun, Prima Dewi Purnamasari\",\"doi\":\"10.1145/3293663.3293684\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Department of Electrical Engineering Universitas Indonesia has developed an automatic essay grading system called Simple-O since 2007. Simple-O uses the Latent Semantic Analysis (LSA) method to compare two essays by extracting the essay into matrix. The previous development of Simple-O is the addition of Learning Vector Quantization (LVQ) which is a method of artificial neural network. This research will discuss and provide analysis related to the effect of adding word similarity function to the automatic essay grading system (Simple-O) to the accuracy of the system itself. The experiment will be conducted with five different scenarios by varying the number of keywords in the student's answer essay to 100%, 80%, 60%, 40%, and 20% of the reference essay keywords. According to the result, there are scenarios that has decreased and increased in accuracy. The average accuracy of the Simple-O system after the addition of word similarity function has increased, though not significant. The average increase in accuracy after the addition of word similarity function is 5.4% from 90.9% to 96.3%.\",\"PeriodicalId\":420290,\"journal\":{\"name\":\"International Conference on Artificial Intelligence and Virtual Reality\",\"volume\":\"24 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2018-11-23\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"4\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"International Conference on Artificial Intelligence and Virtual Reality\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1145/3293663.3293684\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Conference on Artificial Intelligence and Virtual Reality","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1145/3293663.3293684","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 4

摘要

自2007年以来,印尼电子工程系开发了一套名为Simple-O的论文自动评分系统。Simple-O使用潜在语义分析(LSA)方法将两篇文章提取到矩阵中进行比较。Simple-O之前的发展是加入了学习向量量化(LVQ),这是一种人工神经网络的方法。本研究将讨论并分析在自动作文评分系统(Simple-O)中加入单词相似度功能对系统本身准确性的影响。实验将在五种不同的场景下进行,通过将学生的答题文章中的关键词数量改变为参考文章关键词的100%,80%,60%,40%和20%。根据结果,有降低和提高准确性的场景。加入单词相似度函数后,Simple-O系统的平均准确率有所提高,但并不显著。加入单词相似度函数后,准确率平均从90.9%提高到96.3%,提高了5.4%。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Automatic Essay Grading System Based on Latent Semantic Analysis with Learning Vector Quantization and Word Similarity Enhancement
Department of Electrical Engineering Universitas Indonesia has developed an automatic essay grading system called Simple-O since 2007. Simple-O uses the Latent Semantic Analysis (LSA) method to compare two essays by extracting the essay into matrix. The previous development of Simple-O is the addition of Learning Vector Quantization (LVQ) which is a method of artificial neural network. This research will discuss and provide analysis related to the effect of adding word similarity function to the automatic essay grading system (Simple-O) to the accuracy of the system itself. The experiment will be conducted with five different scenarios by varying the number of keywords in the student's answer essay to 100%, 80%, 60%, 40%, and 20% of the reference essay keywords. According to the result, there are scenarios that has decreased and increased in accuracy. The average accuracy of the Simple-O system after the addition of word similarity function has increased, though not significant. The average increase in accuracy after the addition of word similarity function is 5.4% from 90.9% to 96.3%.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信