错误中的错误

IF 0.7 Q3 EDUCATION & EDUCATIONAL RESEARCH

International Journal of Computer-Assisted Language Learning and Teaching Pub Date : 2023-07-11 DOI:10.4018/ijcallt.325792

Joshua Kloppers

{"title":"错误中的错误","authors":"Joshua Kloppers","doi":"10.4018/ijcallt.325792","DOIUrl":null,"url":null,"abstract":"Automated writing evaluation (AWE) software is an increasingly popular tool for English second language learners. However, research on the accuracy of such software has been both scarce and largely limited in its scope. As such, this article broadens the field of research on AWE accuracy by using a mixed design to holistically evaluate the accuracy of the corrective feedback of the leading AWE program Grammarly. 1136 Grammarly-identified errors related to style, lexis, and form were graded and discussed by two native English speakers. An overall accuracy rate of 78.86% and an accuracy rate of 91.60% when excluding style-related errors were found. However, several issues relating to the promotion of a set writing style, variance in feedback quality, and accuracy of style-related corrective feedback were also identified.","PeriodicalId":43610,"journal":{"name":"International Journal of Computer-Assisted Language Learning and Teaching","volume":null,"pages":null},"PeriodicalIF":0.7000,"publicationDate":"2023-07-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Errors in Errors\",\"authors\":\"Joshua Kloppers\",\"doi\":\"10.4018/ijcallt.325792\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Automated writing evaluation (AWE) software is an increasingly popular tool for English second language learners. However, research on the accuracy of such software has been both scarce and largely limited in its scope. As such, this article broadens the field of research on AWE accuracy by using a mixed design to holistically evaluate the accuracy of the corrective feedback of the leading AWE program Grammarly. 1136 Grammarly-identified errors related to style, lexis, and form were graded and discussed by two native English speakers. An overall accuracy rate of 78.86% and an accuracy rate of 91.60% when excluding style-related errors were found. However, several issues relating to the promotion of a set writing style, variance in feedback quality, and accuracy of style-related corrective feedback were also identified.\",\"PeriodicalId\":43610,\"journal\":{\"name\":\"International Journal of Computer-Assisted Language Learning and Teaching\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":0.7000,\"publicationDate\":\"2023-07-11\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"International Journal of Computer-Assisted Language Learning and Teaching\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.4018/ijcallt.325792\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"EDUCATION & EDUCATIONAL RESEARCH\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Journal of Computer-Assisted Language Learning and Teaching","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.4018/ijcallt.325792","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"EDUCATION & EDUCATIONAL RESEARCH","Score":null,"Total":0}

引用次数: 0

摘要

自动写作评估(AWE)软件是英语第二语言学习者日益流行的工具。然而，对这种软件的准确性的研究很少，而且在很大程度上限制了它的范围。因此，本文通过使用混合设计来全面评估领先的AWE程序Grammarly的纠正反馈的准确性，从而拓宽了AWE准确性的研究领域。1136两位母语为英语的人对与风格、词汇和形式相关的语法识别错误进行了评分和讨论。总体准确率为78.86%，排除文体错误后的准确率为91.60%。但是，也确定了与促进一套写作风格、反馈质量的差异以及与风格有关的纠正反馈的准确性有关的几个问题。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

查看原文本刊更多论文

Errors in Errors

Automated writing evaluation (AWE) software is an increasingly popular tool for English second language learners. However, research on the accuracy of such software has been both scarce and largely limited in its scope. As such, this article broadens the field of research on AWE accuracy by using a mixed design to holistically evaluate the accuracy of the corrective feedback of the leading AWE program Grammarly. 1136 Grammarly-identified errors related to style, lexis, and form were graded and discussed by two native English speakers. An overall accuracy rate of 78.86% and an accuracy rate of 91.60% when excluding style-related errors were found. However, several issues relating to the promotion of a set writing style, variance in feedback quality, and accuracy of style-related corrective feedback were also identified.

求助全文

通过发布文献求助，成功后即可免费获取论文全文。去求助

来源期刊

International Journal of Computer-Assisted Language Learning and Teaching EDUCATION & EDUCATIONAL RESEARCH-

CiteScore

3.00

自引率

14.30%

发文量

期刊介绍： The mission of the International Journal of Computer-Assisted Language Learning and Teaching (IJCALLT) is to publish research, theory, and conceptually-based papers that address the use and impact of and innovations in education technologies in advancing foreign/second language learning and teaching. This journal expands on the principles, theories, designs, discussion, and implementations of computer-assisted language learning. In addition to original research papers and submissions on theory and concept development and systematic reports of practice, this journal welcomes theory-based CALL-related book and software/application reviews.