The impact of collocational proficiency features on expert ratings of L2 English learners’ writing

IF 4.2 1区文学 Q1 LINGUISTICS

Studies in Second Language Acquisition Pub Date : 2025-02-05 DOI:10.1017/s0272263125000075

Ben Naismith, Alan Juffs

{"title":"The impact of collocational proficiency features on expert ratings of L2 English learners’ writing","authors":"Ben Naismith, Alan Juffs","doi":"10.1017/s0272263125000075","DOIUrl":null,"url":null,"abstract":"<p>Lexical proficiency is a multifaceted phenomenon that greatly impacts human judgments of writing quality. However, the importance of collocations’ contribution to proficiency assessment has received less attention than that of single words, despite collocations’ essential role in language production. This study, therefore, investigated how aspects of collocational proficiency affect the ratings that examiners give to English learner essays. To do so, collocational features related to sophistication and accuracy were manipulated in a set of argumentative essays. Examiners then rated the texts and provided rationales for their choices. The findings revealed that the use of lower-frequency words significantly and positively impacted the experts’ ratings. When used as part of collocations, such words then provided a small yet significant additional boost to ratings. Notably, there was no significant effect for increased collocational accuracy. These findings suggest that low-frequency words within collocations are particularly salient to examiners and deserving of pedagogic focus.</p>","PeriodicalId":22008,"journal":{"name":"Studies in Second Language Acquisition","volume":"83 1","pages":""},"PeriodicalIF":4.2000,"publicationDate":"2025-02-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Studies in Second Language Acquisition","FirstCategoryId":"98","ListUrlMain":"https://doi.org/10.1017/s0272263125000075","RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"LINGUISTICS","Score":null,"Total":0}

引用次数: 0

Abstract

Lexical proficiency is a multifaceted phenomenon that greatly impacts human judgments of writing quality. However, the importance of collocations’ contribution to proficiency assessment has received less attention than that of single words, despite collocations’ essential role in language production. This study, therefore, investigated how aspects of collocational proficiency affect the ratings that examiners give to English learner essays. To do so, collocational features related to sophistication and accuracy were manipulated in a set of argumentative essays. Examiners then rated the texts and provided rationales for their choices. The findings revealed that the use of lower-frequency words significantly and positively impacted the experts’ ratings. When used as part of collocations, such words then provided a small yet significant additional boost to ratings. Notably, there was no significant effect for increased collocational accuracy. These findings suggest that low-frequency words within collocations are particularly salient to examiners and deserving of pedagogic focus.

查看原文本刊更多论文

搭配熟练度特征对二语学习者写作专家评分的影响

词汇熟练程度是一个多方面的现象，它极大地影响着人们对写作质量的判断。然而，尽管搭配在语言生成中起着至关重要的作用，但搭配对熟练程度评估的重要性却没有受到单个单词的重视。因此，本研究调查了搭配能力的各个方面如何影响考官对英语学习者作文的评分。为了做到这一点，在一组议论文中，与复杂性和准确性相关的搭配特征被操纵。然后考官给这些文章打分，并给出他们选择的理由。研究结果显示，使用频率较低的单词对专家的评分有显著的积极影响。当作为搭配的一部分使用时，这些词会对评分产生小而显著的额外提升。值得注意的是，对增加搭配准确性没有显著影响。这些发现表明，搭配中的低频词对考官来说特别突出，值得教学关注。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

Studies in Second Language Acquisition LINGUISTICS-

CiteScore

8.00

自引率

9.80%

发文量

期刊介绍： Studies in Second Language Acquisition is a refereed journal of international scope devoted to the scientific discussion of acquisition or use of non-native and heritage languages. Each volume (five issues) contains research articles of either a quantitative, qualitative, or mixed-methods nature in addition to essays on current theoretical matters. Other rubrics include shorter articles such as Replication Studies, Critical Commentaries, and Research Reports.