Introducing fluency measures to the elicited imitation task

Hui Sun , Dagmar Divjak , Petar Milin
{"title":"Introducing fluency measures to the elicited imitation task","authors":"Hui Sun ,&nbsp;Dagmar Divjak ,&nbsp;Petar Milin","doi":"10.1016/j.rmal.2024.100176","DOIUrl":null,"url":null,"abstract":"<div><div>The elicited imitation (EI) task has been widely used as a measure of automatized L2 knowledge. However, the scoring of the task has relied exclusively on product-based measures (i.e., accuracy of L2 production), without considering any process-based indices of automatization, such as fluency. To fill this gap, our study develops a written version of the EI task and innovatively draws on keystroke logging techniques to introduce new measures of fluency in EI production. To test whether the addition of fluency measures improves task sensitivity, we examined the degree to which fluency and accuracy predicted L2 proficiency among 40 L1 Polish speakers of English, living in the UK (Mage = 31, 20–60). The participants were late learners of English at intermediate-to-advanced level (CEFR B1–C2) with varying lengths of residence (0.5–18 years). Their L2 proficiency was measured through self-evaluation according to CEFR scales and through test-evaluation by DIALANG English grammar and vocabulary tests. Their written production of English article and tense-aspect target structures was coded for grammatical accuracy, speed and pausing fluency, and consistency in fluency. Generalized Additive Modelling revealed a nonlinear interaction between speed and pausing fluency and grammatical accuracy as predictors of selfevaluated (but not test-evaluated) proficiency, which suggests that participants tended to be more accurate and fluent from low to average proficiency, after which their accuracy plateaued while fluency continued to improve. The results support the importance of assessing fluency to maintain the sensitivity of the EI task especially among advanced learners.</div></div>","PeriodicalId":101075,"journal":{"name":"Research Methods in Applied Linguistics","volume":"4 1","pages":"Article 100176"},"PeriodicalIF":0.0000,"publicationDate":"2024-12-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Research Methods in Applied Linguistics","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S277276612400082X","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

The elicited imitation (EI) task has been widely used as a measure of automatized L2 knowledge. However, the scoring of the task has relied exclusively on product-based measures (i.e., accuracy of L2 production), without considering any process-based indices of automatization, such as fluency. To fill this gap, our study develops a written version of the EI task and innovatively draws on keystroke logging techniques to introduce new measures of fluency in EI production. To test whether the addition of fluency measures improves task sensitivity, we examined the degree to which fluency and accuracy predicted L2 proficiency among 40 L1 Polish speakers of English, living in the UK (Mage = 31, 20–60). The participants were late learners of English at intermediate-to-advanced level (CEFR B1–C2) with varying lengths of residence (0.5–18 years). Their L2 proficiency was measured through self-evaluation according to CEFR scales and through test-evaluation by DIALANG English grammar and vocabulary tests. Their written production of English article and tense-aspect target structures was coded for grammatical accuracy, speed and pausing fluency, and consistency in fluency. Generalized Additive Modelling revealed a nonlinear interaction between speed and pausing fluency and grammatical accuracy as predictors of selfevaluated (but not test-evaluated) proficiency, which suggests that participants tended to be more accurate and fluent from low to average proficiency, after which their accuracy plateaued while fluency continued to improve. The results support the importance of assessing fluency to maintain the sensitivity of the EI task especially among advanced learners.
引入引出模仿任务的流畅性测量
被激发的模仿(EI)任务被广泛用于衡量二语知识的自动化程度。然而,该任务的评分完全依赖于基于产品的衡量标准(即L2生产的准确性),而没有考虑任何基于过程的自动化指标,如流利性。为了填补这一空白,我们的研究开发了一个EI任务的书面版本,并创新地利用击键记录技术来引入新的EI生产流畅性指标。为了测试增加流利度测量是否能提高任务敏感性,我们研究了40名居住在英国的波兰语母语者(Mage = 31, 20-60)对流利度和准确性预测第二语言熟练程度的程度。参与者为中高级水平的英语晚期学习者(CEFR B1-C2),居住时间不同(0.5-18年)。通过CEFR量表的自我评价和DIALANG英语语法和词汇测试的测试评价来衡量他们的二语水平。他们写的英语冠词和时态方面的目标结构被编码为语法准确性,速度和停顿流畅性,以及流畅性的一致性。广义加性模型揭示了语速、停顿流利度和语法准确性之间的非线性相互作用,作为自我评估(而不是测试评估)熟练程度的预测因素,这表明参与者从低水平到平均水平往往更准确和流利,之后他们的准确性趋于平稳,而流利度继续提高。研究结果支持了评估流利度对于保持EI任务的敏感性的重要性,特别是在高级学习者中。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
CiteScore
4.10
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信