Research Methods in Applied Linguistics最新文献_第9页

Developing a cross-case, time-ordered analysis of informal language learning from ethnographic narratives 从民族志叙事中发展非正式语言学习的跨案例、时间顺序分析

Research Methods in Applied Linguistics Pub Date : 2025-02-22 DOI: 10.1016/j.rmal.2025.100190

Mark Dressman , Denyze Toffoli , Ju Seong Lee

引用次数: 0

Engaging young language learners in participatory research: Visual arts-based approach 让年轻的语言学习者参与研究：基于视觉艺术的方法

Research Methods in Applied Linguistics Pub Date : 2025-02-18 DOI: 10.1016/j.rmal.2025.100187

Junjie Li, Weizhao Gong

{"title":"Engaging young language learners in participatory research: Visual arts-based approach","authors":"Junjie Li, Weizhao Gong","doi":"10.1016/j.rmal.2025.100187","DOIUrl":"10.1016/j.rmal.2025.100187","url":null,"abstract":"<div><div>This paper explores the visual arts-based approach to participatory research with children, aged 9 to 11, by analysing the micro-processes of children agentively making meanings in individual and group interviews. Specifically, drawing and graphing are utilised to facilitate participants’ thinking, verbalisation, and nonverbal expressions during data elicitation. We draw on two example qualitative studies to discuss the innovative methods. By interpreting critical episodes emerging from visual arts-crafting activities, we find a mixed set of visual tools empowering in listening to children's voices in hierarchical bilingual educational contexts, including two schools and a private language institution.</div><div>The methodological insights are examined in line with two overarching themes: a) the mediational and scaffolding role of visual artefacts in children's embodied meaning-making processes, and b) children's strategic appropriation of activities to address their own personal and social goals. Findings indicate that, as local actors, young participants agentively claim expertise resorting to ‘insider knowledge’ of childhood, subvert the prescribed power status in relation to adult researchers, and strategically appropriate research instruments for reinterpreting the research agenda. We argue a glimpse of children's multi-faceted lifeworlds and peer culture is temporarily made possible by means of visual arts-based approach, generating data that is otherwise hard to elicit or interpret.</div></div>","PeriodicalId":101075,"journal":{"name":"Research Methods in Applied Linguistics","volume":"4 1","pages":"Article 100187"},"PeriodicalIF":0.0,"publicationDate":"2025-02-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143429106","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Mobile-assisted language learning with commercial apps: A focused methodological review of quantitative/mixed methods research and ethics 商业应用的移动辅助语言学习：定量/混合方法研究和伦理的重点方法论回顾

Research Methods in Applied Linguistics Pub Date : 2025-01-31 DOI: 10.1016/j.rmal.2025.100186

Matt Kessler, Tania Ferronato, María José Torres Centurion, Melike Akay, Jihye Kim

{"title":"Mobile-assisted language learning with commercial apps: A focused methodological review of quantitative/mixed methods research and ethics","authors":"Matt Kessler, Tania Ferronato, María José Torres Centurion, Melike Akay, Jihye Kim","doi":"10.1016/j.rmal.2025.100186","DOIUrl":"10.1016/j.rmal.2025.100186","url":null,"abstract":"<div><div>Researchers have increasingly investigated the effectiveness of commercial mobile-assisted language learning (MALL) applications (apps) such as Duolingo, Babbel, Busuu, Memrise, and Rosetta Stone, with several methodological reviews that have been published to date. However, prior reviews have often lumped together MALL studies involving commercial apps with those that investigate teacher-generated MALL activities. Such reviews also provide limited discussions of important issues involving research ethics. This study aims to fill these gaps by conducting a focused review of studies from the past 10 years (2014–2023) that have appeared in six key CALL journals. Investigated are 1) the research methods used in commercial MALL app studies using quantitative or mixed methods (e.g., samples, target languages, instruments), and 2) the extent to which researchers have discussed issues of research ethics (e.g., disclosing funding, conflicts of interest). The findings illustrate trends in the popularity of certain target languages, topics, and instruments, along with issues involving the reporting of key statistical information. Some authors also provide wide-ranging discussions of ethics; however, many studies lack transparency concerning potential conflicts of interest. Based on these findings, recommendations are provided for conducting future research with commercial MALL apps.</div></div>","PeriodicalId":101075,"journal":{"name":"Research Methods in Applied Linguistics","volume":"4 1","pages":"Article 100186"},"PeriodicalIF":0.0,"publicationDate":"2025-01-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143101669","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Beyond BLEU: Repurposing neural-based metrics to assess interlingual interpreting in tertiary-level language learning settings 超越BLEU：重新利用基于神经的指标来评估三级语言学习环境中的语际口译

Research Methods in Applied Linguistics Pub Date : 2025-01-16 DOI: 10.1016/j.rmal.2025.100184

Chao Han , Xiaolei Lu

{"title":"Beyond BLEU: Repurposing neural-based metrics to assess interlingual interpreting in tertiary-level language learning settings","authors":"Chao Han , Xiaolei Lu","doi":"10.1016/j.rmal.2025.100184","DOIUrl":"10.1016/j.rmal.2025.100184","url":null,"abstract":"<div><div>Recent years have seen a revival of using translation and interpreting (T&I) as a pedagogical and assessment tool to enhance language learning. This growing usage contributes to an increasing amount of learner-generated T&I data, creating a strong demand for assessment. To alleviate this issue, researchers have proposed repurposing machine translation (MT) evaluation metrics to automatically assess human-generated T&I. In this article, we report on the first large-scale study in which we leveraged sophisticated neural-based MT evaluation metrics for automatically assessing English-Chinese interpreting, using a database called <em>Interpreting Quality Evaluation Corpus</em>. To evaluate the efficacy of neural-based metrics, we correlated them with human benchmark scores. Because of the unique data structure, we conducted an internal meta-analysis of correlation coefficients to examine the overall machine-human correlation, and further performed meta-regression to identify potential significant moderators. We find that: a) the overall meta-synthesized correlations were fairly strong: <em>r</em> = .652 and <em>r<sub>s</sub></em> = .631; b) the type of neural-based metrics was a significant moderator, with BLEURT-20 registering the highest correlations (<em>r</em> = .738, <em>r<sub>s</sub></em> = .700); and c) the level of human rater reliability was also a significant moderator. We discussed these findings and their implications for T&I assessment in higher education.</div></div>","PeriodicalId":101075,"journal":{"name":"Research Methods in Applied Linguistics","volume":"4 1","pages":"Article 100184"},"PeriodicalIF":0.0,"publicationDate":"2025-01-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143101668","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Towards more appropriate modelling of linguistic complexity measures: Beyond traditional regression models 走向更合适的语言复杂性度量建模：超越传统的回归模型

Research Methods in Applied Linguistics Pub Date : 2025-01-16 DOI: 10.1016/j.rmal.2025.100182

Akira Murakami

{"title":"Towards more appropriate modelling of linguistic complexity measures: Beyond traditional regression models","authors":"Akira Murakami","doi":"10.1016/j.rmal.2025.100182","DOIUrl":"10.1016/j.rmal.2025.100182","url":null,"abstract":"<div><div>Despite a recent emphasis on appropriate quantitative data analysis as part of the methodological reform, applied linguists often overlook scrutinising the adequacy of their analytical methods, risking model misspecification. This article critiques the use of regression models assuming normal error distributions for modelling linguistic complexity measures. It examines two alternative approaches: weighted linear regression with a log-transformed outcome variable and negative binomial regression, demonstrating how they mitigate associated limitations. Normal error regression models are inadequate for modelling count-based ratio variables due to two main issues: (i) count variables are theoretically lower-bounded, a constraint not addressed by normal error regression models, and (ii) variations in count quantities lead to differences in sampling variability, violating the homoscedasticity assumption and potentially inflating the Type I error rate. Analysis of 14 syntactic complexity measures and an artificial-data simulation show that the lower bound of the prediction intervals for normal error regression models often falls below the theoretical minimum in realistic scenarios. Moreover, the denominator count of syntactic complexity measures negatively correlates with variability, causing heteroscedasticity, a higher false-positive rate, and reduced true value coverage by 80% confidence intervals. Both alternative approaches outperform normal error regression models in these criteria. These findings challenge the suitability of normal error regressions for modelling syntactic complexity measures and caution against their use for other count-based measures in second language research and corpus linguistics. This necessitates reevaluating the widespread use of normal error regression in applied linguistics, urging methodologists to develop and validate more structurally faithful modelling approaches.</div></div>","PeriodicalId":101075,"journal":{"name":"Research Methods in Applied Linguistics","volume":"4 1","pages":"Article 100182"},"PeriodicalIF":0.0,"publicationDate":"2025-01-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143101667","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

CA and MCA to advance diversity, equity, and inclusion (DEI): A case for motivated looking CA和MCA促进多样性、公平和包容（DEI）：一个积极寻找的案例

Research Methods in Applied Linguistics Pub Date : 2025-01-16 DOI: 10.1016/j.rmal.2025.100185

Steven Talmy

引用次数: 0

Embracing temporality: Reflexive insights into positionality and relational dynamics in intercultural research 拥抱时间性：跨文化研究中对位置性和关系动态的反思性见解

Research Methods in Applied Linguistics Pub Date : 2025-01-13 DOI: 10.1016/j.rmal.2025.100183

Angie Baily

{"title":"Embracing temporality: Reflexive insights into positionality and relational dynamics in intercultural research","authors":"Angie Baily","doi":"10.1016/j.rmal.2025.100183","DOIUrl":"10.1016/j.rmal.2025.100183","url":null,"abstract":"<div><div>Reflexivity has increasingly become a focal point in qualitative research as researchers embrace their evolving roles and presence in the research process. In this article, I explore the complexities of reflexive practice, highlighting notions of relationality, intercultural research and hierarchical structures. Through personal reflexive diaries, I investigate how nuanced shifts and transformations in my identity and positionality were negotiated over time. Specifically, I reflect on my transition from researcher to <em>Dasao</em> (sister-in-law) during my Ph.D. fieldwork, where cultural and linguistic immersion simultaneously guided and challenged my inquiry. This journey confronted me with unforeseen complexities, prompting deeper engagement with reflexivity and positionality. I discuss the fear of becoming too involved in the research and with the participants, potentially (mis)leading the data. I describe my struggles moving in and out of fluid researcher roles, alternating between researcher/participant, insider/outsider, learned/learner - positions interwoven with, and inseparable from my own life experience. While time was central to gaining, understanding and developing positionality, it also highlighted my own research insecurities, which became further exposed by unplanned timescales, leading to unexpected friendships, fluid relational boundaries and an all-consuming reflexivity which thrived on time. By focussing on temporal dimensions, this study offers an innovative perspective on the challenges of reflexivity, the negotiation of roles and blurring of boundaries, researcher vulnerability and the dilemmas around accepting one's presence in the data.</div></div>","PeriodicalId":101075,"journal":{"name":"Research Methods in Applied Linguistics","volume":"4 1","pages":"Article 100183"},"PeriodicalIF":0.0,"publicationDate":"2025-01-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143101665","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Vocabulary list generator: A digital tool to generate frequency-based word lists adjusted for dispersion 词汇表生成器：一个数字工具，用于生成基于频率的单词表，并根据分散情况进行调整

Research Methods in Applied Linguistics Pub Date : 2025-01-09 DOI: 10.1016/j.rmal.2025.100180

Ashleigh Cox , Daniel Dixon , Tülay Dixon

{"title":"Vocabulary list generator: A digital tool to generate frequency-based word lists adjusted for dispersion","authors":"Ashleigh Cox , Daniel Dixon , Tülay Dixon","doi":"10.1016/j.rmal.2025.100180","DOIUrl":"10.1016/j.rmal.2025.100180","url":null,"abstract":"<div><div>In second and foreign language teaching, helping students learn new vocabulary is an important goal, and many researchers aim to help teachers determine which vocabulary items should be prioritized by making predictions about the words that specific learner populations are likely to need. Such predictions can be made by examining the words that frequently appear in corpora that are representative of the learners’ target language use domains. While early vocabulary lists tended to consider only frequency and range when ranking important words in a domain, more recently, researchers have argued for more robust measures of dispersion, including <em>evenness</em> (i.e., how evenly spread a word is across texts) and <em>pervasiveness</em> (i.e., the proportion of texts using a word, which is similar to range) (Egbert & Burch, 2023). However, the current tools and methods that are commonly used to form corpus-based vocabulary lists often do not include these dispersion measures, especially the measure of <em>evenness</em>. To make it easier for researchers and teachers to inform language learning goals with vocabulary lists that consider both frequency and recommended dispersion measures, this report describes and demonstrates a new digital tool, the <em>Vocabulary List Generator</em>. The tool was piloted with a corpus of psychology journal articles, and the vocabulary list generated from the corpus demonstrates its use and output.</div></div>","PeriodicalId":101075,"journal":{"name":"Research Methods in Applied Linguistics","volume":"4 1","pages":"Article 100180"},"PeriodicalIF":0.0,"publicationDate":"2025-01-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143101664","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Making sense of non-comprehension issues while listening: A data-based coding scheme 在收听时理解不理解的问题：基于数据的编码方案

Research Methods in Applied Linguistics Pub Date : 2025-01-09 DOI: 10.1016/j.rmal.2025.100181

Joseph Siegel, Maria Kuteeva, Aki Siegel

引用次数: 0

Challenges and opportunities of design-based research in applied linguistics: Insights from a scoping review 应用语言学中基于设计的研究的挑战和机遇：来自范围审查的见解

Research Methods in Applied Linguistics Pub Date : 2025-01-08 DOI: 10.1016/j.rmal.2024.100178

Zehui Yang, Yan-Yi Lee

引用次数: 0