基于LSTM(长短期记忆)算法的情感总结学习评价

Achmad Yogie Setiawan, I. G. M. Darmawiguna, G. Pradnyana
{"title":"基于LSTM(长短期记忆)算法的情感总结学习评价","authors":"Achmad Yogie Setiawan, I. G. M. Darmawiguna, G. Pradnyana","doi":"10.4108/eai.27-11-2021.2315533","DOIUrl":null,"url":null,"abstract":"Lecturer learning evaluation is a text that contains student reviews related to lecturer learning performance. Learning evaluation is used as a lecturer's self-reflection material to improve the learning services provided in the next lesson. The evaluations are many in number, making it difficult for lecturers to analyze. Sentiment analysis techniques are needed to classify student evaluations. The evaluation that has been classified still leaves a long and convoluted text. Text summarization is one solution to summarize a long text into a dense and informative text. Text summarization is helpful to save time searching for the text's gist. There are two methods in text summarization, extractive and abstractive methods. This study applied an abstract method because the data used was an evaluation of lecturer learning whose reviews were written by students. The algorithm used for sentiment classification and text summarization used the Long Short Term Memory (LSTM) algorithm. The sentiment classification results were evaluated using a confusion matrix, namely testing the model with evaluation data. While the summary results were evaluated using ROUGE, which compared the summary results from the system with a manual summary by experts. In testing the confusion matrix system, the accuracy value was 0.902, and the f-measure value was 0.921. In the Recall-Oriented Understudy for Gisting Evaluation (ROGUE) test, the positive evaluation scored 0.16, and the negative evaluation scored 0.2. The developed tokenizer has not stored the tokens resulting from the training process. As a result, the prediction results when loading the model were not as good as when training was finished.","PeriodicalId":246168,"journal":{"name":"Proceedings of the 4th International Conference on Vocational Education and Technology, IConVET 2021, 27 November 2021, Singaraja, Bali, Indonesia","volume":"1 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"1900-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Sentiment Summarization Learning Evaluation Using LSTM (Long Short Term Memory) Algorithm\",\"authors\":\"Achmad Yogie Setiawan, I. G. M. Darmawiguna, G. Pradnyana\",\"doi\":\"10.4108/eai.27-11-2021.2315533\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Lecturer learning evaluation is a text that contains student reviews related to lecturer learning performance. Learning evaluation is used as a lecturer's self-reflection material to improve the learning services provided in the next lesson. The evaluations are many in number, making it difficult for lecturers to analyze. Sentiment analysis techniques are needed to classify student evaluations. The evaluation that has been classified still leaves a long and convoluted text. Text summarization is one solution to summarize a long text into a dense and informative text. Text summarization is helpful to save time searching for the text's gist. There are two methods in text summarization, extractive and abstractive methods. This study applied an abstract method because the data used was an evaluation of lecturer learning whose reviews were written by students. The algorithm used for sentiment classification and text summarization used the Long Short Term Memory (LSTM) algorithm. The sentiment classification results were evaluated using a confusion matrix, namely testing the model with evaluation data. While the summary results were evaluated using ROUGE, which compared the summary results from the system with a manual summary by experts. In testing the confusion matrix system, the accuracy value was 0.902, and the f-measure value was 0.921. In the Recall-Oriented Understudy for Gisting Evaluation (ROGUE) test, the positive evaluation scored 0.16, and the negative evaluation scored 0.2. The developed tokenizer has not stored the tokens resulting from the training process. As a result, the prediction results when loading the model were not as good as when training was finished.\",\"PeriodicalId\":246168,\"journal\":{\"name\":\"Proceedings of the 4th International Conference on Vocational Education and Technology, IConVET 2021, 27 November 2021, Singaraja, Bali, Indonesia\",\"volume\":\"1 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"1900-01-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Proceedings of the 4th International Conference on Vocational Education and Technology, IConVET 2021, 27 November 2021, Singaraja, Bali, Indonesia\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.4108/eai.27-11-2021.2315533\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings of the 4th International Conference on Vocational Education and Technology, IConVET 2021, 27 November 2021, Singaraja, Bali, Indonesia","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.4108/eai.27-11-2021.2315533","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

摘要

讲师学习评价是包含与讲师学习表现相关的学生评论的文本。学习评价是讲师自我反思的材料,以改善下一课提供的学习服务。评价的数量很多,讲师很难进行分析。需要情感分析技术对学生评价进行分类。已经分类的评估仍然留下了冗长而复杂的文本。文本摘要是一种将长文本总结为密集和信息丰富的文本的解决方案。文本摘要有助于节省查找文本主旨的时间。文本摘要有两种方法:抽取法和抽象法。本研究采用了一种抽象的方法,因为使用的数据是讲师学习的评价,其评论是由学生写的。用于情感分类和文本摘要的算法采用长短期记忆(LSTM)算法。使用混淆矩阵对情感分类结果进行评估,即用评估数据对模型进行测试。同时使用ROUGE对总结结果进行评估,它将来自系统的总结结果与专家的手动总结进行比较。在测试混淆矩阵系统时,准确度值为0.902,f测量值为0.921。在ROGUE测试中,正面评价得分为0.16分,负面评价得分为0.2分。开发的标记器没有存储训练过程产生的标记。因此,加载模型时的预测结果不如训练结束时的预测结果好。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Sentiment Summarization Learning Evaluation Using LSTM (Long Short Term Memory) Algorithm
Lecturer learning evaluation is a text that contains student reviews related to lecturer learning performance. Learning evaluation is used as a lecturer's self-reflection material to improve the learning services provided in the next lesson. The evaluations are many in number, making it difficult for lecturers to analyze. Sentiment analysis techniques are needed to classify student evaluations. The evaluation that has been classified still leaves a long and convoluted text. Text summarization is one solution to summarize a long text into a dense and informative text. Text summarization is helpful to save time searching for the text's gist. There are two methods in text summarization, extractive and abstractive methods. This study applied an abstract method because the data used was an evaluation of lecturer learning whose reviews were written by students. The algorithm used for sentiment classification and text summarization used the Long Short Term Memory (LSTM) algorithm. The sentiment classification results were evaluated using a confusion matrix, namely testing the model with evaluation data. While the summary results were evaluated using ROUGE, which compared the summary results from the system with a manual summary by experts. In testing the confusion matrix system, the accuracy value was 0.902, and the f-measure value was 0.921. In the Recall-Oriented Understudy for Gisting Evaluation (ROGUE) test, the positive evaluation scored 0.16, and the negative evaluation scored 0.2. The developed tokenizer has not stored the tokens resulting from the training process. As a result, the prediction results when loading the model were not as good as when training was finished.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信