Research Methods in Applied Linguistics最新文献_第5页

Fuzzy logic theory: A unifying pathway to intelligent accountability in addressing methodological challenges of applied linguistics 模糊逻辑理论：解决应用语言学方法论挑战的智能问责统一途径

Research Methods in Applied Linguistics Pub Date : 2025-12-01 Epub Date: 2025-10-30 DOI: 10.1016/j.rmal.2025.100278

Hadi Masjedy, Seyyed Mohammad Reza Adel

引用次数: 0

Rethinking fluency in task-based L2 writing: A critical examination of product- and process-based measures 重新思考基于任务的第二语言写作的流畅性：对基于产品和过程的衡量标准的批判性检查

Research Methods in Applied Linguistics Pub Date : 2025-12-01 Epub Date: 2025-06-14 DOI: 10.1016/j.rmal.2025.100225

Mahmoud Abdi Tabari , Mark D. Johnson

引用次数: 0

Stop splitting hairs: The problems with dichotomizing continuous data in language research 停止吹毛求疵：语言研究中连续数据二分类的问题

Research Methods in Applied Linguistics Pub Date : 2025-12-01 Epub Date: 2025-10-14 DOI: 10.1016/j.rmal.2025.100272

Shawn Hemelstrand , Tomohiro Inoue

引用次数: 0

Sampling through the lens of QRPs 通过qrp的镜头进行采样

Research Methods in Applied Linguistics Pub Date : 2025-12-01 Epub Date: 2025-11-07 DOI: 10.1016/j.rmal.2025.100280

Scott Sterling , Merja Kytö , Luke Plonsky , Kate Yaw , Tove Larsson

引用次数: 0

Revisiting the impact of errors in L2/FL writing: A methodological review of five decades of research 重新审视二语/外语写作中错误的影响：五十年研究的方法论回顾

Research Methods in Applied Linguistics Pub Date : 2025-12-01 Epub Date: 2025-10-09 DOI: 10.1016/j.rmal.2025.100269

Wilson Cheong Hin Hong

{"title":"Revisiting the impact of errors in L2/FL writing: A methodological review of five decades of research","authors":"Wilson Cheong Hin Hong","doi":"10.1016/j.rmal.2025.100269","DOIUrl":"10.1016/j.rmal.2025.100269","url":null,"abstract":"<div><div>Despite five decades of research into error gravity (EG) in writing, the field remains characterized by contradictory findings and limited practical applications. This methodology review critically examines the methods and their impact on findings across this fragmented research landscape. Through a two-phase approach—a selective review of studies from 1970–2015 (<em>n</em> = 21) and a PRISMA review of 2016–2025 research (<em>n</em> = 16)—four key constructs that have shaped the field are identified: reader perceptions, comprehension, awareness/sensitivity, and processing effort. Analyses reveal significant methodological limitations that have hindered progress, including over-reliance on subjective assessments, inconsistent error categorization, limited participant representativeness, and lack of theoretical grounding. The research trajectory shows a shifting focus from comprehension in early studies to reader preferences in the 2000s, followed by renewed interest in communication effectiveness and the emergence of processing effort as a novel yet critical construct, despite the persistent dominance of subjective ratings. Recommendations for future research are proposed, including the potential theories to frame studies, adoption of direct and validated methods and shifting focus to non-teacher participant populations. Only with genuine methodological advancements can this strand of study meaningfully inform L2/FL pedagogy and curriculum, providing evidence-based guidance for prioritizing certain L2 issues in instructions.</div></div>","PeriodicalId":101075,"journal":{"name":"Research Methods in Applied Linguistics","volume":"4 3","pages":"Article 100269"},"PeriodicalIF":0.0,"publicationDate":"2025-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145264724","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Evaluating LLMs as proxies for humans in psycholinguistic ratings: A comparison of statistical knowledge 评估法学硕士作为人类心理语言学评级的代理：统计知识的比较

Research Methods in Applied Linguistics Pub Date : 2025-12-01 Epub Date: 2025-10-08 DOI: 10.1016/j.rmal.2025.100274

Yanlu Zhong, Simon Todd, Nicole Xu, Laurel Brehm

{"title":"Evaluating LLMs as proxies for humans in psycholinguistic ratings: A comparison of statistical knowledge","authors":"Yanlu Zhong, Simon Todd, Nicole Xu, Laurel Brehm","doi":"10.1016/j.rmal.2025.100274","DOIUrl":"10.1016/j.rmal.2025.100274","url":null,"abstract":"<div><div>Psycholinguistic research has traditionally relied on human ratings for stimulus norming, but whether large language models (LLMs) can reliably replace human ratings remains uncertain. This study compares human participants and three LLMs—one proprietary model (ChatGPT-4o) and two open-source models (LLaMA-3.3–70B and DeepSeek-V3)—with respect to their statistical knowledge of English binomials. For each binomial, we obtained ratings of frequency, dispersion, forward association strength, and backward association strength from 34 human participants and from 30 output samples per LLM. We examined rating-to-corpus consistency (consistency<sub>rating2corpus</sub>), the sensitivity of statistical ratings to corpus data, and the influence of other psycholinguistic factors on ratings. All LLMs’ statistical knowledge broadly mirrored that of humans. Ratings from both groups were sensitive to corpus data but not fully consistent with it. Frequency showed the highest consistency<sub>rating2corpus</sub>, whereas dispersion showed the lowest consistency<sub>rating2corpus</sub> and the weakest sensitivity. LLM ratings were also influenced by word-level cues. Nonetheless, LLM ratings showed greater consistency<sub>rating2corpus</sub>, heightened sensitivity, and stronger reliance on other psycholinguistic cues than human ratings. Overall, while LLMs’ performance generally aligned with that of humans, their internal statistical representations differed significantly from human cognition. The three LLMs also showed variation in their rating behavior. Thus, although multi-LLM ratings can aid pilot studies in psycholinguistics, they should not replace human ratings in formal experiments.</div></div>","PeriodicalId":101075,"journal":{"name":"Research Methods in Applied Linguistics","volume":"4 3","pages":"Article 100274"},"PeriodicalIF":0.0,"publicationDate":"2025-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145264725","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

A Bayesian approach to small samples: Mixed-effects modeling in L2 interventional research 小样本贝叶斯方法：L2介入性研究中的混合效应建模

Research Methods in Applied Linguistics Pub Date : 2025-12-01 Epub Date: 2025-06-27 DOI: 10.1016/j.rmal.2025.100231

Man Ho Ivy Wong

{"title":"A Bayesian approach to small samples: Mixed-effects modeling in L2 interventional research","authors":"Man Ho Ivy Wong","doi":"10.1016/j.rmal.2025.100231","DOIUrl":"10.1016/j.rmal.2025.100231","url":null,"abstract":"<div><div>Small sample sizes are a common challenge in second language (L2) research, particularly in classroom-based studies or exploratory intervention work. Traditional frequentist approaches often lack the flexibility needed to analyse such data meaningfully. This paper presents a two-study Bayesian tutorial designed to address the small-N problem using logistic mixed-effects models. In Study 1<strong>,</strong> we analyse pilot data from 27 final-year or postgraduate students across three instructional conditions, using Bayesian mixed-effects modelling with non-informative (uniform) priors to explore effects of instruction, time, conditional type, and proficiency on participants’ binary responses in two language assessment tasks (a processing test and a production test). In Study 2, we build on the pilot by modelling follow-up data from a refined version of the study, focusing on the one treatment group only. Here, we incorporate highly informed priors derived from the posterior estimates of Study 1, demonstrating how prior information can improve estimation and interpretability, even with small datasets. This paper offers practical guidance on specifying priors, modelling binary outcomes, and applying Bayesian reasoning across iterative L2 research designs.</div></div>","PeriodicalId":101075,"journal":{"name":"Research Methods in Applied Linguistics","volume":"4 3","pages":"Article 100231"},"PeriodicalIF":0.0,"publicationDate":"2025-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144490695","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

The L-maze task and web-based data collection in second language sentence processing research 第二语言句子加工研究中的l -迷宫任务和基于网络的数据收集

Research Methods in Applied Linguistics Pub Date : 2025-12-01 Epub Date: 2025-08-19 DOI: 10.1016/j.rmal.2025.100251

Hiroki Fujita

{"title":"The L-maze task and web-based data collection in second language sentence processing research","authors":"Hiroki Fujita","doi":"10.1016/j.rmal.2025.100251","DOIUrl":"10.1016/j.rmal.2025.100251","url":null,"abstract":"<div><div>In recent years, an increasing number of studies on sentence processing have used web-based data collection and the L-maze task. Web-based data collection has become particularly popular since the coronavirus pandemic, when access to laboratory-based experiments was severely restricted. In the L-maze task, participants read sentences word by word, with each word presented alongside a pseudoword that does not continue the sentence. During the task, participants need to select a word that continues the sentence. Previous research has shown that both web-based data collection and the L-maze task are useful for investigating first language sentence processing. However, little is known about their usefulness for second language sentence processing research. To address this gap in the literature, I conducted replication experiments using the web-based L-maze and self-paced reading (SPR) tasks, and investigated whether these tasks could detect garden path and gender mismatch effects during the processing of locally ambiguous sentences. The results showed these effects in both tasks, with the effects being more localised in the L-maze task. A prospective power analysis suggested that these tasks would be effective for detecting these effects, and that the L-maze task would be more reliable than the SPR task for detecting gender mismatch effects. These findings suggest that web-based data collection and the L-maze task are potentially useful tools for investigating second language sentence processing.</div></div>","PeriodicalId":101075,"journal":{"name":"Research Methods in Applied Linguistics","volume":"4 3","pages":"Article 100251"},"PeriodicalIF":0.0,"publicationDate":"2025-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144863502","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Semantic prosody, categorisation and inter-rater reliability 语义韵律、分类和信度

Research Methods in Applied Linguistics Pub Date : 2025-12-01 Epub Date: 2025-09-29 DOI: 10.1016/j.rmal.2025.100264

Mathias Russnes

{"title":"Semantic prosody, categorisation and inter-rater reliability","authors":"Mathias Russnes","doi":"10.1016/j.rmal.2025.100264","DOIUrl":"10.1016/j.rmal.2025.100264","url":null,"abstract":"<div><div>This article investigates the inter-rater reliability of established methods of categorising semantic prosody. Semantic prosody is a concept associated with corpus linguistics, which describes the tendency of seemingly neutral items to occur in particular evaluative contexts. In previous research on semantic prosody, there has been a heavy reliance on manual analysis of smaller samples, and because of this, questions have been raised about the stability of the established methods for categorisation. Furthermore, there is also a lack of consensus regarding how such categorisations should be operationalised. Traditionally, it has often been viewed in binary terms, distinguishing between <em>positive</em> and <em>negative</em> prosodies. However, this restricted system has also received criticism, and certain researchers have adopted a more comprehensive (or fine-grained) categorisation, more connected to a unit’s semantic preference. This paper aims to evaluate the inter-analyst consistency of these systems through two experimental studies, in which four researchers independently analyse the same set of random concordance lines of the items <em>habit</em> and <em>views</em> from BNC2014, applying both methods of categorisation. The results indicate that a binary distinction between <em>positive</em> and <em>negative</em> offers a higher inter-analyst consistency than a more fine-grained categorisation. Additionally, this more comprehensive system was also found to obscure the borders between semantic preference and semantic prosody. However, because neither system achieved satisfactory inter-rater agreement, both studies highlight the need for more objective methods of analysing and categorising semantic prosody.</div></div>","PeriodicalId":101075,"journal":{"name":"Research Methods in Applied Linguistics","volume":"4 3","pages":"Article 100264"},"PeriodicalIF":0.0,"publicationDate":"2025-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145219401","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Bibliographic analysis in solving pitch doubling issues 书目分析解决音高加倍问题

Research Methods in Applied Linguistics Pub Date : 2025-12-01 Epub Date: 2025-09-30 DOI: 10.1016/j.rmal.2025.100271

Xiuming Wang , Shan Chen , Yuanzhao Ding

引用次数: 0