Effects of three levels of AI integration on second language academic writing: Evaluating restricted, guided, and free use of ChatGPT

IF 5.6 1区文学 Q1 EDUCATION & EDUCATIONAL RESEARCH

System Pub Date : 2025-09-08 DOI:10.1016/j.system.2025.103820

Seungjin Hong , Yu Kyoung Shin

{"title":"Effects of three levels of AI integration on second language academic writing: Evaluating restricted, guided, and free use of ChatGPT","authors":"Seungjin Hong , Yu Kyoung Shin","doi":"10.1016/j.system.2025.103820","DOIUrl":null,"url":null,"abstract":"<div><div>This study evaluates the impact of different ChatGPT usage protocols as instructional tools for academic writing among L2-English learners by exploring how three levels of AI integration affect learning outcomes. Three groups of Korean college students (<em>n</em> = 103) were taught by the same instructor in English essay writing courses: The Restricted group did not use ChatGPT, the Guided group accessed it only during supervised in-class activities, and the Free group had unrestricted access to ChatGPT throughout the semester. The results indicate that both the Guided and Free groups consistently outperformed the Restricted group, demonstrating the educational benefits of AI engagement as an innovative approach to language learning. A close examination of essay scores finds that the Guided group excelled in content quality, although there were no significant differences in organization and language use between the Guided and Free groups. This suggests that while structured guidance is crucial for content development, more autonomy may be advantageous in other areas of writing. An interview with the instructor provides further insights into how different levels of autonomy in engagement with AI affected student engagement, and suggests the benefits of strategically integrating AI to improve L2 academic writing skills.</div></div>","PeriodicalId":48185,"journal":{"name":"System","volume":"134 ","pages":"Article 103820"},"PeriodicalIF":5.6000,"publicationDate":"2025-09-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"System","FirstCategoryId":"98","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0346251X25002301","RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"EDUCATION & EDUCATIONAL RESEARCH","Score":null,"Total":0}

引用次数: 0

Abstract

This study evaluates the impact of different ChatGPT usage protocols as instructional tools for academic writing among L2-English learners by exploring how three levels of AI integration affect learning outcomes. Three groups of Korean college students (n = 103) were taught by the same instructor in English essay writing courses: The Restricted group did not use ChatGPT, the Guided group accessed it only during supervised in-class activities, and the Free group had unrestricted access to ChatGPT throughout the semester. The results indicate that both the Guided and Free groups consistently outperformed the Restricted group, demonstrating the educational benefits of AI engagement as an innovative approach to language learning. A close examination of essay scores finds that the Guided group excelled in content quality, although there were no significant differences in organization and language use between the Guided and Free groups. This suggests that while structured guidance is crucial for content development, more autonomy may be advantageous in other areas of writing. An interview with the instructor provides further insights into how different levels of autonomy in engagement with AI affected student engagement, and suggests the benefits of strategically integrating AI to improve L2 academic writing skills.

查看原文本刊更多论文

三个层次的AI整合对第二语言学术写作的影响：评估限制、引导和自由使用ChatGPT

本研究通过探索三个层次的人工智能整合如何影响学习成果，评估了不同的ChatGPT使用协议作为l2 -英语学习者学术写作教学工具的影响。三组韩国大学生（n = 103）由同一位老师教授英语论文写作课程：限制组不使用ChatGPT，引导组只在有监督的课堂活动中使用ChatGPT，自由组在整个学期都不受限制地使用ChatGPT。结果表明，指导组和自由组的表现都优于限制组，这表明人工智能参与作为一种创新的语言学习方法的教育效益。对作文分数的仔细检查发现，尽管在组织和语言使用方面，指导组和自由组之间没有显着差异，但指导组在内容质量方面表现出色。这表明，虽然结构化的指导对内容开发至关重要，但在其他写作领域，更多的自主权可能是有利的。通过对讲师的采访，我们进一步了解了不同程度的人工智能自主性如何影响学生的参与度，并提出了战略性地整合人工智能以提高第二语言学术写作技能的好处。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

System Multiple-

CiteScore

8.80

自引率

8.30%

发文量

202

审稿时长

64 days

期刊介绍： This international journal is devoted to the applications of educational technology and applied linguistics to problems of foreign language teaching and learning. Attention is paid to all languages and to problems associated with the study and teaching of English as a second or foreign language. The journal serves as a vehicle of expression for colleagues in developing countries. System prefers its contributors to provide articles which have a sound theoretical base with a visible practical application which can be generalized. The review section may take up works of a more theoretical nature to broaden the background.