Evaluating ChatGPT’s effectiveness in enhancing argumentative writing: A quasi-experimental study of EFL learners in Pakistan

IF 4.9 2区社会学 Q2 ENVIRONMENTAL SCIENCES

Sustainable Futures Pub Date : 2025-06-08 DOI:10.1016/j.sftr.2025.100809

Musarat Yasmin, Walees Fatima, Isra Irshad

{"title":"Evaluating ChatGPT’s effectiveness in enhancing argumentative writing: A quasi-experimental study of EFL learners in Pakistan","authors":"Musarat Yasmin, Walees Fatima, Isra Irshad","doi":"10.1016/j.sftr.2025.100809","DOIUrl":null,"url":null,"abstract":"<div><div>A crucial area of ongoing research is the potential of artificial intelligence to improve learning outcomes in diverse educational settings, given its increasing global integration into education. This study assesses the effectiveness of ChatGPT, an artificial intelligence tool, in improving the argumentative writing skills of Pakistani students pursuing the Secondary School Certificate (SSC) in English as a Foreign Language (EFL) environment. The focus of this study is to assess the impact of ChatGPT on the skills of argumentative writing of SSC students to evaluate to what extent they improve the key components of argumentative writing through pre-test and post-test, and to identify the specific types of errors committed by the learners in Pakistani context. This study adopted a quasi-experimental approach, using pre- and post-tests to measure changes in students' argumentative writing abilities after three months of ChatGPT interaction. The data from the pre-test and post-test is analyzed by using key components of argumentative writing by Tolumin (1958) and the framework of error analysis by Ellis (2002). The findings demonstrate significant progress in students' argumentative writing, with a corresponding decrease in error types after implementing the ChatGPT intervention. The study's results indicate a significant improvement in the argumentative writing abilities of secondary school students using ChatGPT, suggesting its usefulness in supporting error correction and enhancing writing skills in English as a Foreign Language education.</div></div>","PeriodicalId":34478,"journal":{"name":"Sustainable Futures","volume":"10 ","pages":"Article 100809"},"PeriodicalIF":4.9000,"publicationDate":"2025-06-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Sustainable Futures","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2666188825003740","RegionNum":2,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENVIRONMENTAL SCIENCES","Score":null,"Total":0}

引用次数: 0

Abstract

A crucial area of ongoing research is the potential of artificial intelligence to improve learning outcomes in diverse educational settings, given its increasing global integration into education. This study assesses the effectiveness of ChatGPT, an artificial intelligence tool, in improving the argumentative writing skills of Pakistani students pursuing the Secondary School Certificate (SSC) in English as a Foreign Language (EFL) environment. The focus of this study is to assess the impact of ChatGPT on the skills of argumentative writing of SSC students to evaluate to what extent they improve the key components of argumentative writing through pre-test and post-test, and to identify the specific types of errors committed by the learners in Pakistani context. This study adopted a quasi-experimental approach, using pre- and post-tests to measure changes in students' argumentative writing abilities after three months of ChatGPT interaction. The data from the pre-test and post-test is analyzed by using key components of argumentative writing by Tolumin (1958) and the framework of error analysis by Ellis (2002). The findings demonstrate significant progress in students' argumentative writing, with a corresponding decrease in error types after implementing the ChatGPT intervention. The study's results indicate a significant improvement in the argumentative writing abilities of secondary school students using ChatGPT, suggesting its usefulness in supporting error correction and enhancing writing skills in English as a Foreign Language education.

查看原文本刊更多论文

评价ChatGPT在提高议论文写作方面的有效性：对巴基斯坦英语学习者的准实验研究

正在进行的一个关键研究领域是人工智能在不同教育环境中改善学习成果的潜力，因为人工智能日益融入全球教育。本研究评估了ChatGPT（一种人工智能工具）在提高巴基斯坦学生在英语作为外语（EFL）环境中获得中学证书（SSC）的议论文写作技巧方面的有效性。本研究的重点是评估ChatGPT对SSC学生议论文写作技能的影响，通过前测和后测来评估他们在多大程度上提高了议论文写作的关键组成部分，并确定学习者在巴基斯坦语境中所犯的具体错误类型。本研究采用准实验方法，通过前后测试来衡量学生在三个月的ChatGPT互动后议论文写作能力的变化。通过使用Tolumin（1958）的议论文写作的关键成分和Ellis（2002）的错误分析框架，对前测和后测的数据进行分析。研究结果表明，在实施ChatGPT干预后，学生的议论文写作有了显著的进步，错误类型也相应减少。研究结果表明，使用ChatGPT的中学生的议论文写作能力有了显著的提高，这表明它在英语作为外语教育中支持纠错和提高写作技能方面是有用的。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

Sustainable Futures Social Sciences-Sociology and Political Science

CiteScore

9.30

自引率

1.80%

发文量

审稿时长

71 days

期刊介绍： Sustainable Futures: is a journal focused on the intersection of sustainability, environment and technology from various disciplines in social sciences, and their larger implications for corporation, government, education institutions, regions and society both at present and in the future. It provides an advanced platform for studies related to sustainability and sustainable development in society, economics, environment, and culture. The scope of the journal is broad and encourages interdisciplinary research, as well as welcoming theoretical and practical research from all methodological approaches.