草并不总是更绿:教师与 GPT 辅助书面纠正反馈的对比

IF 5.4 3区 材料科学 Q2 CHEMISTRY, PHYSICAL
Shiming Lin, Peter Crosthwaite
{"title":"草并不总是更绿:教师与 GPT 辅助书面纠正反馈的对比","authors":"Shiming Lin,&nbsp;Peter Crosthwaite","doi":"10.1016/j.system.2024.103529","DOIUrl":null,"url":null,"abstract":"<div><div>Written Corrective Feedback (WCF) is a crucial pedagogical practice where teachers annotate student writing to correct errors and improve language skills, albeit one that is time-consuming and laborious for large classes or under time constraints. However, the advent of advanced generative artificial intelligence and large language models, specifically ChatGPT, has introduced new possibilities for automating such educational tasks. GPT models with their transformer architecture and self-attention mechanism can perform complex natural language tasks including assisting teachers in providing WCF. This study compares the WCF produced by teachers and ChatGPT, examining their respective capabilities while identifying differences in their feedback practice. Findings reveal teacher provided WCF typically involves a consistent combination of direct correction and indirect feedback forms addressing both local and global issues, albeit with a degree of inaccuracy. ChatGPT-assisted WCF tends to be in the form of metalinguistic feedback and/or reformulation of the original text. However, GPT also frequently varies in its entire approach to WCF provision even when using the same prompt on the same text, while also providing grammatically accurate yet redundant WCF in certain cases. We discuss the implications of these findings for L2 writing practice.</div></div>","PeriodicalId":4,"journal":{"name":"ACS Applied Energy Materials","volume":null,"pages":null},"PeriodicalIF":5.4000,"publicationDate":"2024-10-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"The grass is not always greener: Teacher vs. GPT-assisted written corrective feedback\",\"authors\":\"Shiming Lin,&nbsp;Peter Crosthwaite\",\"doi\":\"10.1016/j.system.2024.103529\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Written Corrective Feedback (WCF) is a crucial pedagogical practice where teachers annotate student writing to correct errors and improve language skills, albeit one that is time-consuming and laborious for large classes or under time constraints. However, the advent of advanced generative artificial intelligence and large language models, specifically ChatGPT, has introduced new possibilities for automating such educational tasks. GPT models with their transformer architecture and self-attention mechanism can perform complex natural language tasks including assisting teachers in providing WCF. This study compares the WCF produced by teachers and ChatGPT, examining their respective capabilities while identifying differences in their feedback practice. Findings reveal teacher provided WCF typically involves a consistent combination of direct correction and indirect feedback forms addressing both local and global issues, albeit with a degree of inaccuracy. ChatGPT-assisted WCF tends to be in the form of metalinguistic feedback and/or reformulation of the original text. However, GPT also frequently varies in its entire approach to WCF provision even when using the same prompt on the same text, while also providing grammatically accurate yet redundant WCF in certain cases. We discuss the implications of these findings for L2 writing practice.</div></div>\",\"PeriodicalId\":4,\"journal\":{\"name\":\"ACS Applied Energy Materials\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":5.4000,\"publicationDate\":\"2024-10-29\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"ACS Applied Energy Materials\",\"FirstCategoryId\":\"98\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0346251X24003117\",\"RegionNum\":3,\"RegionCategory\":\"材料科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"CHEMISTRY, PHYSICAL\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"ACS Applied Energy Materials","FirstCategoryId":"98","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0346251X24003117","RegionNum":3,"RegionCategory":"材料科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"CHEMISTRY, PHYSICAL","Score":null,"Total":0}
引用次数: 0

摘要

书面批改反馈(WCF)是一种重要的教学实践,教师通过批改学生的作文来纠正错误和提高语言技能。然而,先进的生成人工智能和大型语言模型(特别是 ChatGPT)的出现,为此类教育任务的自动化带来了新的可能性。GPT 模型具有转换器架构和自我关注机制,可以执行复杂的自然语言任务,包括协助教师提供 WCF。本研究对教师和 ChatGPT 制作的 WCF 进行了比较,考察了它们各自的能力,同时发现了它们在反馈实践中的差异。研究结果表明,教师提供的 WCF 通常包括直接纠正和间接反馈形式的一致组合,以解决局部和全局问题,尽管存在一定程度的不准确性。ChatGPT 辅助的 WCF 往往采用金属语言反馈和/或重新表述原文的形式。然而,即使在同一文本上使用相同的提示,GPT 在提供 WCF 的整个方法上也经常出现差异,在某些情况下还会提供语法准确但多余的 WCF。我们将讨论这些发现对 L2 写作实践的影响。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
The grass is not always greener: Teacher vs. GPT-assisted written corrective feedback
Written Corrective Feedback (WCF) is a crucial pedagogical practice where teachers annotate student writing to correct errors and improve language skills, albeit one that is time-consuming and laborious for large classes or under time constraints. However, the advent of advanced generative artificial intelligence and large language models, specifically ChatGPT, has introduced new possibilities for automating such educational tasks. GPT models with their transformer architecture and self-attention mechanism can perform complex natural language tasks including assisting teachers in providing WCF. This study compares the WCF produced by teachers and ChatGPT, examining their respective capabilities while identifying differences in their feedback practice. Findings reveal teacher provided WCF typically involves a consistent combination of direct correction and indirect feedback forms addressing both local and global issues, albeit with a degree of inaccuracy. ChatGPT-assisted WCF tends to be in the form of metalinguistic feedback and/or reformulation of the original text. However, GPT also frequently varies in its entire approach to WCF provision even when using the same prompt on the same text, while also providing grammatically accurate yet redundant WCF in certain cases. We discuss the implications of these findings for L2 writing practice.
求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
ACS Applied Energy Materials
ACS Applied Energy Materials Materials Science-Materials Chemistry
CiteScore
10.30
自引率
6.20%
发文量
1368
期刊介绍: ACS Applied Energy Materials is an interdisciplinary journal publishing original research covering all aspects of materials, engineering, chemistry, physics and biology relevant to energy conversion and storage. The journal is devoted to reports of new and original experimental and theoretical research of an applied nature that integrate knowledge in the areas of materials, engineering, physics, bioscience, and chemistry into important energy applications.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信