Feedback precision and learners’ responses: A study into ETS Criterion automated corrective feedback in EFL writing classrooms

Q1 Arts and Humanities
G. Hoang
{"title":"Feedback precision and learners’ responses: A study into ETS Criterion automated corrective feedback in EFL writing classrooms","authors":"G. Hoang","doi":"10.29140/jaltcall.v18n3.775","DOIUrl":null,"url":null,"abstract":"This study examines the implementation of Criterion , an automated writing evaluation system developed by ETS, as a source of diagnostic feedback on learners’ linguistic performance in a Vietnamese EFL writing classroom. Thirty-eight second-year English majors had access to Criterion for a five-month period. Data include Criterion error tags on students’ essays from multiple practice sessions, recorded think-aloud protocols as students engaged with the feedback for revisions, and first and revised drafts students submitted to Criterion . The main findings indicate Criterion ’s satisfactory precision and capacity to trigger vari-ous engagement strategies among learners, but reservations remain due to students’ modest response accuracy and lack of substantive revisions to their texts. Important implications for formative feedback practices in EFL writing classrooms and the adaptation of Criterion ’s technical capacities are accordingly presented.","PeriodicalId":37946,"journal":{"name":"JALT CALL Journal","volume":" ","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2022-12-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"JALT CALL Journal","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.29140/jaltcall.v18n3.775","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"Arts and Humanities","Score":null,"Total":0}
引用次数: 0

Abstract

This study examines the implementation of Criterion , an automated writing evaluation system developed by ETS, as a source of diagnostic feedback on learners’ linguistic performance in a Vietnamese EFL writing classroom. Thirty-eight second-year English majors had access to Criterion for a five-month period. Data include Criterion error tags on students’ essays from multiple practice sessions, recorded think-aloud protocols as students engaged with the feedback for revisions, and first and revised drafts students submitted to Criterion . The main findings indicate Criterion ’s satisfactory precision and capacity to trigger vari-ous engagement strategies among learners, but reservations remain due to students’ modest response accuracy and lack of substantive revisions to their texts. Important implications for formative feedback practices in EFL writing classrooms and the adaptation of Criterion ’s technical capacities are accordingly presented.
反馈精度与学习者的反应:英语写作课堂中ETS标准自动纠正反馈的研究
本研究考察了由ETS开发的自动化写作评估系统Criteria的实施情况,该系统是对越南EFL写作课堂上学习者语言表现的诊断反馈来源。38名英语专业二年级学生在五个月的时间里可以进入Criterion。数据包括学生在多个练习环节的文章上的Criterion错误标签,记录学生参与修改反馈时的大声思考协议,以及学生提交给Criterion的初稿和修改稿。主要研究结果表明,Criterion在学习者中具有令人满意的准确性和触发各种参与策略的能力,但由于学生的反应准确性不高,并且缺乏对其文本的实质性修改,因此仍有保留意见。对英语写作课堂中的形成性反馈实践和标准技术能力的适应提出了重要的启示。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
JALT CALL Journal
JALT CALL Journal Arts and Humanities-Language and Linguistics
CiteScore
2.40
自引率
0.00%
发文量
14
期刊介绍: The JALT CALL Journal is an international refereed journal committed to excellence in research in all areas within the field of Computer Assisted Language Learning.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信