{"title":"基于语义的在线讨论质量自动评价研究","authors":"Wen Qin, Shuang Qi, Shu Zhou, Chao-Jun Xu","doi":"10.18178/ijlt.8.2.80-85","DOIUrl":null,"url":null,"abstract":"High-quality discussions are of great significance to promote learning and achieve teaching goals. In this study, content analysis is used to perform semantic analysis on the content of the discussion posted by learners on online learning platform from the perspective of semantic similarity. The semantic similarity of different topics under the course is weighted to obtain the online discussion quality score of the learner. Then the evaluation results from experts discussed with the learner are divided into four levels. The Kappa consistency test and the McNemar paired chi-square test are performed. The experimental results show that there is consistency between the two evaluation methods, and the accuracy rates of the two ranked lower rankings are better. Therefore, the automated evaluation of the online discussion quality of learners based on semantics will play an indispensable role in the selection and sticking of comments on online learning platforms.","PeriodicalId":93451,"journal":{"name":"International journal of learning and teaching","volume":"353 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2022-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"The Study on Automated Evaluation of Online Discussion Quality Based on Semantics\",\"authors\":\"Wen Qin, Shuang Qi, Shu Zhou, Chao-Jun Xu\",\"doi\":\"10.18178/ijlt.8.2.80-85\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"High-quality discussions are of great significance to promote learning and achieve teaching goals. In this study, content analysis is used to perform semantic analysis on the content of the discussion posted by learners on online learning platform from the perspective of semantic similarity. The semantic similarity of different topics under the course is weighted to obtain the online discussion quality score of the learner. Then the evaluation results from experts discussed with the learner are divided into four levels. The Kappa consistency test and the McNemar paired chi-square test are performed. The experimental results show that there is consistency between the two evaluation methods, and the accuracy rates of the two ranked lower rankings are better. Therefore, the automated evaluation of the online discussion quality of learners based on semantics will play an indispensable role in the selection and sticking of comments on online learning platforms.\",\"PeriodicalId\":93451,\"journal\":{\"name\":\"International journal of learning and teaching\",\"volume\":\"353 1\",\"pages\":\"\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2022-01-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"International journal of learning and teaching\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.18178/ijlt.8.2.80-85\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"International journal of learning and teaching","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.18178/ijlt.8.2.80-85","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
The Study on Automated Evaluation of Online Discussion Quality Based on Semantics
High-quality discussions are of great significance to promote learning and achieve teaching goals. In this study, content analysis is used to perform semantic analysis on the content of the discussion posted by learners on online learning platform from the perspective of semantic similarity. The semantic similarity of different topics under the course is weighted to obtain the online discussion quality score of the learner. Then the evaluation results from experts discussed with the learner are divided into four levels. The Kappa consistency test and the McNemar paired chi-square test are performed. The experimental results show that there is consistency between the two evaluation methods, and the accuracy rates of the two ranked lower rankings are better. Therefore, the automated evaluation of the online discussion quality of learners based on semantics will play an indispensable role in the selection and sticking of comments on online learning platforms.