Research Methods in Applied Linguistics最新文献_第6页

Eight reasons not to test for baseline group equivalence in a parallel groups pretest-posttest study 在平行组的前测后测研究中不测试基线组等效性的八个理由

Research Methods in Applied Linguistics Pub Date : 2025-12-01 Epub Date: 2025-08-25 DOI: 10.1016/j.rmal.2025.100254

Seth Lindstromberg

引用次数: 0

Towards a preschooler corpus of Italian: an experimental journey 迈向学前意大利语语料库：实验之旅

Research Methods in Applied Linguistics Pub Date : 2025-12-01 Epub Date: 2025-08-25 DOI: 10.1016/j.rmal.2025.100252

Chiara Bolognesi, Alessandra Cinini, Paola Cutugno, Melissa Ferretti, Davide Chiarella

{"title":"Towards a preschooler corpus of Italian: an experimental journey","authors":"Chiara Bolognesi, Alessandra Cinini, Paola Cutugno, Melissa Ferretti, Davide Chiarella","doi":"10.1016/j.rmal.2025.100252","DOIUrl":"10.1016/j.rmal.2025.100252","url":null,"abstract":"<div><div>The paper surveys the process and reasonings behind the written sources section of the Corpus of Italian for Preschoolers (CIP), a corpus collecting child-directed speech targeted at Italian children aged 3–6. Beginning from an overview of the available child-speech and child-directed speech corpora, the article underlines the need for an Italian Corpus focusing on children’s passive vocabulary and how such a tool would be useful for future comparative studies on children’s own production and as a tool for professionals in children’s needs. The CIP aims at collecting 250,000 linguistic tokens across a selection of different sources (Written, Spoken, Signed) gathered with the help of schools and families. This paper focuses specifically on the selection criteria for the written sources and the first steps of their linguistic processing, explaining through a set of three experiments how three different linguistic annotation tools performed on the tasks of tokenizing, lemmatizing and POS-tagging three different children’s literature texts. The last part presents the results of the experiments with insight on the NLP tools’ performances, as well as the reasons for our choice of tool for the large-scale annotation process and the still-ongoing challenges for the finalization of our corpus.</div></div>","PeriodicalId":101075,"journal":{"name":"Research Methods in Applied Linguistics","volume":"4 3","pages":"Article 100252"},"PeriodicalIF":0.0,"publicationDate":"2025-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144893405","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Can you trust your participants? How not to get scammed when recruiting online 你能信任你的参与者吗？如何在网上招聘时不被骗

Research Methods in Applied Linguistics Pub Date : 2025-12-01 Epub Date: 2025-11-20 DOI: 10.1016/j.rmal.2025.100285

Ekaterina Sudina , Ruirui Jia , Eunsoo Kang , Luke Plonsky , Katherine Yaw

引用次数: 0

Evaluating the scoring system of an AI-integrated app to assess foreign language phonological decoding 评估ai集成应用程序的评分系统，以评估外语语音解码

Research Methods in Applied Linguistics Pub Date : 2025-12-01 Epub Date: 2025-09-01 DOI: 10.1016/j.rmal.2025.100257

James Turner , Alison Porter , Suzanne Graham , Travis Ralph-Donaldson , Heike Krüsemann , Pengchong Zhang , Kate Borthwick

{"title":"Evaluating the scoring system of an AI-integrated app to assess foreign language phonological decoding","authors":"James Turner , Alison Porter , Suzanne Graham , Travis Ralph-Donaldson , Heike Krüsemann , Pengchong Zhang , Kate Borthwick","doi":"10.1016/j.rmal.2025.100257","DOIUrl":"10.1016/j.rmal.2025.100257","url":null,"abstract":"<div><div>Phonological decoding in a foreign language (FL)—a two-part process involving first the ability to map written symbols to their corresponding sounds and second to pronounce them intelligibly—is foundational for reading and vocabulary acquisition. Yet assessing this skill efficiently and at scale in young learners remains a persistent challenge. Here, we introduce and evaluate the accuracy and effectiveness of a novel method for assessing FL phonological decoding using an AI-driven app that automatically scores children's pronunciation of symbol-sound correspondences. In a study involving 254 learners of French and Spanish (aged 10–11) across five UK primary schools, pupils completed a read-aloud task (14 symbol-sound correspondences) that was scored by the app’s automatic speech recognition (ASR) technology. The validity of these automated scores was tested by fitting them as independent variables in regression models predicting human auditory coding. The multiple significant relationships between automated and human scores that were established indicate that there is great potential for ASR-based tools to reliably assess phonological decoding in this population. These findings provide the first large-scale empirical validation of an AI-based assessment of FL decoding in children, opening new possibilities, applicable to a range of languages being learnt, for scalable and efficient assessment.</div></div>","PeriodicalId":101075,"journal":{"name":"Research Methods in Applied Linguistics","volume":"4 3","pages":"Article 100257"},"PeriodicalIF":0.0,"publicationDate":"2025-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144925646","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Challenging lexical coverage conventions: Evaluating the vocabulary demands of family-genre film and television 挑战词汇覆盖惯例：评估家庭类型电影和电视的词汇需求

Research Methods in Applied Linguistics Pub Date : 2025-12-01 Epub Date: 2025-06-19 DOI: 10.1016/j.rmal.2025.100230

Brett Milliner , Geoffrey Pinchbeck

{"title":"Challenging lexical coverage conventions: Evaluating the vocabulary demands of family-genre film and television","authors":"Brett Milliner , Geoffrey Pinchbeck","doi":"10.1016/j.rmal.2025.100230","DOIUrl":"10.1016/j.rmal.2025.100230","url":null,"abstract":"<div><div>The contribution of studies investigating lexical coverage to the field of applied linguistics cannot be understated. Lexical coverage research has helped establish the vocabulary knowledge most essential for second language (L2) comprehension and elevate the importance of high-frequency vocabulary knowledge acquisition. Approaches to lexical coverage research have, however, begun to come under closer scrutiny in recent studies, with some experts questioning the accuracy of coverage estimates. Understanding these limitations, the current study applies an alternative approach to evaluating the lexical knowledge required to comprehend the OPUS-family-genre corpus, a collection of closed captions from 1597 family-genre films and television programs (10,744,767 tokens). In contrast to previous conventions that used band-based (1000-word) predictions of lexical coverage, in this study, coverage is evaluated at the individual word-unit level. It compares the coverage provided by four word lists: (1) a lemma list derived from tagging the OPUS-family-genre corpus, (2) a flemma list, and two word-family lists, (3) the BNC, and (4) the BNC/COCA. The study also models how a part-of-speech lexical tagger (TagAnt) can be used to evaluate lemma-based lexical coverage. The analysis revealed that English language learners will know 90, 95, and 98% of the running words appearing in family-genre films and television if they know the first 855, 2005, and 4393 flemmas, from the attached word lists. More simply, knowing the first 900 words from our supplementary word frequency lists would enable English language learners to start viewing family-genre films and television.</div></div>","PeriodicalId":101075,"journal":{"name":"Research Methods in Applied Linguistics","volume":"4 3","pages":"Article 100230"},"PeriodicalIF":0.0,"publicationDate":"2025-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144322640","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Research methods in L2 pragmatics research: Introduction to the special issue 二语用学研究中的研究方法：专题导论

Research Methods in Applied Linguistics Pub Date : 2025-12-01 Epub Date: 2025-07-25 DOI: 10.1016/j.rmal.2025.100241

Kathleen Bardovi-Harlig

引用次数: 0

From monologic to dialogic: Conceptual and methodological issues in metadiscourse studies 从一元到对话：元话语研究中的概念与方法问题

Research Methods in Applied Linguistics Pub Date : 2025-12-01 Epub Date: 2025-09-26 DOI: 10.1016/j.rmal.2025.100268

Wen Xin, Lei Jiang

引用次数: 0

Validity of Task Choice on Global and Specific Pronunciation 任务选择对整体发音和特定发音的效度

Research Methods in Applied Linguistics Pub Date : 2025-12-01 Epub Date: 2025-10-29 DOI: 10.1016/j.rmal.2025.100277

Alyssa Kermad

{"title":"Validity of Task Choice on Global and Specific Pronunciation","authors":"Alyssa Kermad","doi":"10.1016/j.rmal.2025.100277","DOIUrl":"10.1016/j.rmal.2025.100277","url":null,"abstract":"<div><div>Second language pronunciation tasks are the means to eliciting speech performance; however, sparse research has considered task choice from a validity and methodological perspective. Drawing on validity (Harding, 2018) and task theoretical frameworks (Saito & Plonsky, 2019), this study investigates the most common tasks (i.e., read-aloud, spontaneous speech, elicited imitation, and picture description) in second language pronunciation research (see Thomson & Derwing, 2015) and triangulates their effect on specific pronunciation (i.e., segmental and suprasegmental properties) and global pronunciation (i.e., listeners’ judgments of comprehensibility, accentedness, and proficiency). Fifteen speakers participated, and fifty-six untrained listeners rated speech across four tasks (two controlled and two spontaneous). One-way repeated measures ANOVAs and regression analyses were conducted. Speakers had more vowel and consonant deviations and a faster speech rate on the read-aloud task and more sentence prominence on both of the controlled tasks. Overall, speakers were rated to be more comprehensible and proficient and have less of an accent on controlled tasks as opposed to spontaneous task types, where they were rated more severely. Task-associated pronunciation properties differentially predicted listeners’ ratings, especially pitch range. Recommendations are made to strengthen validity claims by aligning interpretations of pronunciation ability with task types.</div></div>","PeriodicalId":101075,"journal":{"name":"Research Methods in Applied Linguistics","volume":"4 3","pages":"Article 100277"},"PeriodicalIF":0.0,"publicationDate":"2025-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145415158","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Methodological rigor in quantitative L2 research: A focus on interventionist experimental studies 定量第二语言研究方法的严谨性：干预实验研究的焦点

Research Methods in Applied Linguistics Pub Date : 2025-12-01 Epub Date: 2025-10-08 DOI: 10.1016/j.rmal.2025.100273

Akbar A. Jahanbakhsh , Zahra Banitalebi , Jenifer Larson-Hall , Aya Shiiba

{"title":"Methodological rigor in quantitative L2 research: A focus on interventionist experimental studies","authors":"Akbar A. Jahanbakhsh , Zahra Banitalebi , Jenifer Larson-Hall , Aya Shiiba","doi":"10.1016/j.rmal.2025.100273","DOIUrl":"10.1016/j.rmal.2025.100273","url":null,"abstract":"<div><div>An increasing bulk of research highlights the importance of robust methodologies in ensuring the validity and reliability of research findings; yet, concerns remain regarding the quality of quantitative studies within second language (L2) research. To address the gap, this study aimed to systematically analyze a corpus of quantitative articles to assess the extent to which they adhere to established methodological best practices. The corpus comprises 791 interventionist quantitative articles published over 12 years in 8 journals selected based on their high impact factor and relevance to key areas within applied linguistics. A detailed coding scheme was developed to evaluate the articles across several crucial methodological dimensions, including sampling and design issues, types of statistical analyses, the necessary statistical assumptions to be checked, reporting practices, and visual presentation of data. The findings revealed that while improvements were evident in some areas, such as design-related issues and reporting practices, there is still a lack/shortage of attention to sampling issues like power analysis, practicing data sharing, and using data-rich/accountable visuals, with no significant improvement over time. These results highlighted areas where improvements in methodological rigor are needed to enhance the credibility and generalizability of quantitative research in applied linguistics. The study promotes best practices in research design and reporting, informs the development of guidelines for future research, and fosters a more critical and reflective approach to interpreting quantitative findings in the field.</div></div>","PeriodicalId":101075,"journal":{"name":"Research Methods in Applied Linguistics","volume":"4 3","pages":"Article 100273"},"PeriodicalIF":0.0,"publicationDate":"2025-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145264686","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Automate the ‘boring bits’: An assessment of AI-assisted systematic review (AIASR) 自动化“无聊的部分”：人工智能辅助系统审查（AIASR）的评估

Research Methods in Applied Linguistics Pub Date : 2025-12-01 Epub Date: 2025-09-01 DOI: 10.1016/j.rmal.2025.100258

Timothy Hampson , Kelly Cargos , Jim McKinley

{"title":"Automate the ‘boring bits’: An assessment of AI-assisted systematic review (AIASR)","authors":"Timothy Hampson , Kelly Cargos , Jim McKinley","doi":"10.1016/j.rmal.2025.100258","DOIUrl":"10.1016/j.rmal.2025.100258","url":null,"abstract":"<div><div>Systematic review is a powerful tool for disseminating the findings of research, particularly in applied linguistics where we hope to provide insights for practising language teachers. Yet, systematic review is also often prohibitively time-consuming, particularly for small, underfunded teams or solo researchers. In this study, we explore the use of generative artificial intelligence to ease the burden of screening and organising papers. Our findings suggest that AI excels in some tasks, particularly when those tasks involve explicitly stated information, and struggles in others, particularly when information is more implicit. A comparison of generative artificial intelligence for filtering papers with ASReview, a popular non-generative tool, reveals trade-offs, with Generative AI being replicable and more efficient, but with concerns about accuracy. We conclude that generative artificial intelligence can be a useful tool for systematic review but requires rigorous validation before use. We conclude by emphasising the importance of testing AI for systematic review tasks and exploring how this can practically be achieved.</div></div>","PeriodicalId":101075,"journal":{"name":"Research Methods in Applied Linguistics","volume":"4 3","pages":"Article 100258"},"PeriodicalIF":0.0,"publicationDate":"2025-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144922554","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0