Challenges and Benefits of Developing CEFR for Languages-Aligned Writing Assessments for Thai EFL Learners: A Case Study on Yala Rajabhat University Test of English Proficiency

Koleeyoh Jeh-do, Varavejbhisis Yossiri, Muhammadsukree Hayeesani, Smith Vongsvivut, N. Paramal
{"title":"Challenges and Benefits of Developing CEFR for Languages-Aligned Writing Assessments for Thai EFL Learners: A Case Study on Yala Rajabhat University Test of English Proficiency","authors":"Koleeyoh Jeh-do, Varavejbhisis Yossiri, Muhammadsukree Hayeesani, Smith Vongsvivut, N. Paramal","doi":"10.24093/awej/vol15no1.22","DOIUrl":null,"url":null,"abstract":"This research aims to explore the development of the local standardized tests, Yala Rajabhat University Test of English Proficiency or YRU-TEP, tailored to specific regions, and explore the test aligning with the Common European Framework of Reference for Languages compared to another standardized test, English Discoveries. This study focuses on the context of Thai English as a foreign language learners’ context. To write the test items, Can-Do statements were employed as the expert panel discussed and agreed on the objectives of each skill assessed in each item. In contrast, each item was evaluated through the Index of Item Objective Congruence by the experts. Three hundred experimental groups of test takers have been involved through purposive random sampling. To explore if the YRU-TEP aligns with the CEFR proficiency levels, another standardized test, English Discoveries developed by the ETS has been employed. The experimental test takers took both tests, and the scores were calculated following the cutoff scores to see if they were equivalent. The results showed that 98.67% of the scores had equally the same CEFR levels. However, challenges exist in implementing CEFR-aligned writing assessments in this context. Addressing these challenges involves adapting CEFR to the Thai context, ensuring cultural relevance, refining assessment criteria, and effective resource management. This endeavor contributes to standardizing language proficiency assessment practices and enhancing the quality of EFL education, especially in the case of local tests like the YRU-TEP.","PeriodicalId":505235,"journal":{"name":"Arab World English Journal","volume":"19 15","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-03-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Arab World English Journal","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.24093/awej/vol15no1.22","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

This research aims to explore the development of the local standardized tests, Yala Rajabhat University Test of English Proficiency or YRU-TEP, tailored to specific regions, and explore the test aligning with the Common European Framework of Reference for Languages compared to another standardized test, English Discoveries. This study focuses on the context of Thai English as a foreign language learners’ context. To write the test items, Can-Do statements were employed as the expert panel discussed and agreed on the objectives of each skill assessed in each item. In contrast, each item was evaluated through the Index of Item Objective Congruence by the experts. Three hundred experimental groups of test takers have been involved through purposive random sampling. To explore if the YRU-TEP aligns with the CEFR proficiency levels, another standardized test, English Discoveries developed by the ETS has been employed. The experimental test takers took both tests, and the scores were calculated following the cutoff scores to see if they were equivalent. The results showed that 98.67% of the scores had equally the same CEFR levels. However, challenges exist in implementing CEFR-aligned writing assessments in this context. Addressing these challenges involves adapting CEFR to the Thai context, ensuring cultural relevance, refining assessment criteria, and effective resource management. This endeavor contributes to standardizing language proficiency assessment practices and enhancing the quality of EFL education, especially in the case of local tests like the YRU-TEP.
为泰国 EFL 学习者开发与语言 CEFR 一致的写作评估的挑战和益处:Yala Rajabhat 大学英语水平测试案例研究
本研究旨在探讨本地标准化测试--亚拉拉贾巴特大学英语水平测试(YRU-TEP)--针对特定地区的发展情况,并与另一个标准化测试--英语发现--相比,探讨该测试与《欧洲语言共同参考框架》的一致性。本研究侧重于泰国英语作为外语学习者的语境。在编写测试项目时,专家小组对每个项目所评估的每项技能的目标进行了讨论,并达成了一致意见,因此采用了 "能做到"(Can-Do)陈述。同时,专家们还通过 "项目目标一致性指数 "对每个项目进行了评估。通过有目的的随机抽样,共有三百个实验组的应试者参与其中。为了探究 YRU-TEP 是否与 CEFR 能力水平相一致,我们还采用了另一个标准化测试,即由 ETS 开发的 "英语发现"。实验测试者参加了这两项测试,并按照分数线计算分数,以确定两者是否相当。结果显示,98.67% 的分数具有相同的 CEFR 水平。然而,在这种情况下实施与 CEFR 接轨的写作评估存在挑战。要应对这些挑战,就必须根据泰国的国情调整 CEFR,确保文化相关性,完善评估标准,并有效管理资源。这项工作有助于规范语言能力评估实践,提高英语语言教育的质量,尤其是像 YRU-TEP 这样的本地测试。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信