Research Methods in Applied Linguistics最新文献

Theorizing and practicing the discourse-based interview in research on multilingual writers 语篇访谈在多语作家研究中的理论与实践

Research Methods in Applied Linguistics Pub Date : 2025-05-17 DOI: 10.1016/j.rmal.2025.100214

Debra A. Friedman

{"title":"Theorizing and practicing the discourse-based interview in research on multilingual writers","authors":"Debra A. Friedman","doi":"10.1016/j.rmal.2025.100214","DOIUrl":"10.1016/j.rmal.2025.100214","url":null,"abstract":"<div><div>Discourse-based interviews are a method developed by composition researchers Lee Odell, Dixie Goswami, and Anne Herrington (Odell et al., 1983) in which research participants are shown a text and asked to comment on certain features. They have since been adopted by applied linguistics writing researchers to explore multilingual writers’ perspectives as both writers and readers of texts; however, they have received little attention in the applied linguistics methodological literature. This article explores how discourse-based interviews have been conceptualized and used in research on multilingual writers though a review of 45 articles and book chapters that cited Odell et al. (1983) as the source of the interview method. These studies were reviewed to identify (a) the topic or focus of the research, (b) researchers’ stated purpose for using this method, (c) how and by whom texts and focal features were selected, (d) how interviews were conducted, and (e) how researchers dealt with subjectivity. Findings indicate that studies of multilingual writers have used the term <em>discourse-based interview</em> to refer to a wide range of interview purposes and procedures that often deviate considerably from those of Odell et al. The article concludes with a reflection on areas requiring further attention if applied linguistics writing researchers are to best exploit the potential of discourse-based interviews as a research method.</div></div>","PeriodicalId":101075,"journal":{"name":"Research Methods in Applied Linguistics","volume":"4 2","pages":"Article 100214"},"PeriodicalIF":0.0,"publicationDate":"2025-05-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144071879","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Generating better understandings of linguistic dissociation using multiscalar temporal accounts 使用多标量时间账户更好地理解语言分离

Research Methods in Applied Linguistics Pub Date : 2025-05-16 DOI: 10.1016/j.rmal.2025.100212

Ashley R. Moore

{"title":"Generating better understandings of linguistic dissociation using multiscalar temporal accounts","authors":"Ashley R. Moore","doi":"10.1016/j.rmal.2025.100212","DOIUrl":"10.1016/j.rmal.2025.100212","url":null,"abstract":"<div><div><em>Linguistic dissociation</em> is “a relatively enduring psychosocial process in which an individual or group distances themselves from a set of linguistic practices already within their repertoire because those practices have come to connote a state of significant intersubjective disharmony, or <em>contrasubjectivity</em>” (Moore, 2023, p. 1152). Generating data to theorise the nature and causes of linguistic dissociation among particular kinds of language users represents a methodological challenge; as intersubjective phenomena, linguistic dissociation and contrasubjectivity emerge across multiple converging, connected temporal scales.</div><div>With reference to data generated with two participants from a larger critical realist grounded theory method investigation into the nature and causes of L1 dissociation among some Japanese-English late plurilinguals, I show how I combined two data generation activities with distinct temporal scales—a multimodal timeline through which participants constructed an account of their affective relationship to Japanese over their lifespan and a two-day language use journal—with follow-up interviews to produce different types of data about linguistic dissociation, which in turn made it possible for the participants and me to construct different forms of knowledge about the phenomenon. Further, I contend that we used those knowledges to arrive at better (i.e., more verisimilitudinous) understandings of the nature and causes of the L1 dissociation they had experienced. I finish by sharing methodological implications for applied linguists investing various intersubjective phenomena that shape the linguistic repertoire and reflecting on the limits of my own knowledge of linguistic dissociation.</div></div>","PeriodicalId":101075,"journal":{"name":"Research Methods in Applied Linguistics","volume":"4 2","pages":"Article 100212"},"PeriodicalIF":0.0,"publicationDate":"2025-05-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144070908","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Timelines: Visualizing time in narrative research 时间线：叙事研究中的时间可视化

Research Methods in Applied Linguistics Pub Date : 2025-05-15 DOI: 10.1016/j.rmal.2025.100215

Eric K. Ku

{"title":"Timelines: Visualizing time in narrative research","authors":"Eric K. Ku","doi":"10.1016/j.rmal.2025.100215","DOIUrl":"10.1016/j.rmal.2025.100215","url":null,"abstract":"<div><div>Timelines have been increasingly recognized as valuable tools in narrative research for visualizing the temporal dimension of participants' lived experiences. This paper offers a comprehensive overview of the application of timelines in qualitative narrative research, particularly within applied linguistics. Narrative research methods inherently focus on time, with timelines serving to highlight the temporal aspects of critical life events, transitions, and personal transformations. By organizing and representing time visually, timelines facilitate deeper reflexivity among participants, offering insights that may not emerge through verbal interviews alone. This study synthesizes existing research on timelines, exploring their flexible application and impact on the quality of narrative data. In applied linguistics, timelines have been employed to investigate various aspects of language teaching and learning, from tracking long-term language learning trajectories to supporting teacher professional development. The paper also discusses methodological considerations, such as who constructs the timeline, when timelines should be constructed, and the medium used. Additionally, it addresses the limitations of timelines, including their tendency to present time linearly, which may not capture the complex, cyclical nature of human experiences. Drawing on examples from within and beyond applied linguistics as well as research with teachers of multiple langauges, this paper underscores the potential of timelines to enhance the rigor and depth of qualitative narrative research while also acknowledging the challenges and limitations inherent in their use.</div></div>","PeriodicalId":101075,"journal":{"name":"Research Methods in Applied Linguistics","volume":"4 2","pages":"Article 100215"},"PeriodicalIF":0.0,"publicationDate":"2025-05-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144069308","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Research methods in L2 writing: Interdisciplinary approaches, cutting-edge methods, and practical applications 二语写作的研究方法：跨学科的方法、前沿的方法和实际应用

Research Methods in Applied Linguistics Pub Date : 2025-05-01 DOI: 10.1016/j.rmal.2025.100211

Peter Crosthwaite

引用次数: 0

Large language models fall short in classifying learners’ open-ended responses 大型语言模型无法对学习者的开放式回答进行分类

Research Methods in Applied Linguistics Pub Date : 2025-04-21 DOI: 10.1016/j.rmal.2025.100210

Atsushi Mizumoto , Mark Feng Teng

{"title":"Large language models fall short in classifying learners’ open-ended responses","authors":"Atsushi Mizumoto , Mark Feng Teng","doi":"10.1016/j.rmal.2025.100210","DOIUrl":"10.1016/j.rmal.2025.100210","url":null,"abstract":"<div><div>Generative Artificial Intelligence (GenAI), based on large language models (LLMs), excels in various language comprehension tasks and is increasingly utilized in applied linguistics research. This study examines the accuracy and methodological implications of using LLMs to classify open-ended responses from learners. We surveyed 143 Japanese university students studying English as a foreign language (EFL) about their essay-writing process. Two human evaluators independently classified the students’ responses based on self-regulated learning processes: planning, monitoring, and evaluation. At the same time, several LLMs performed the same classification task, and their results were compared with those of the human evaluators using Cohen’s kappa coefficient. We established κ ≥ 0.8 as the threshold for strong agreement based on rigorous methodological standards. Our findings revealed that even the best-performing model (DeepSeek-V3) achieved only moderate agreement (κ = 0.68), while other models demonstrated fair-to-moderate agreement (κ = 0.37–0.61). Surprisingly, open-source models outperformed several commercial counterparts. These results highlight the necessity of expert oversight when integrating GenAI as a support tool in qualitative data analysis. The paper concludes by discussing the methodological implications for using LLMs in qualitative research and proposing specific prompt engineering strategies to enhance their reliability in applied linguistics.</div></div>","PeriodicalId":101075,"journal":{"name":"Research Methods in Applied Linguistics","volume":"4 2","pages":"Article 100210"},"PeriodicalIF":0.0,"publicationDate":"2025-04-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143852020","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

LexJP: A test to efficiently assess vocabulary knowledge of Japanese 一个有效评估日语词汇知识的测试

Research Methods in Applied Linguistics Pub Date : 2025-04-14 DOI: 10.1016/j.rmal.2025.100208

Yui Suzukida , Kazuya Saito

引用次数: 0

Network Analysis for the investigation of rater effects in language assessment: A comparison of ChatGPT vs human raters 语言评估中评价者效应调查的网络分析：ChatGPT与人类评价者的比较

Research Methods in Applied Linguistics Pub Date : 2025-04-11 DOI: 10.1016/j.rmal.2025.100205

Iasonas Lamprianou

{"title":"Network Analysis for the investigation of rater effects in language assessment: A comparison of ChatGPT vs human raters","authors":"Iasonas Lamprianou","doi":"10.1016/j.rmal.2025.100205","DOIUrl":"10.1016/j.rmal.2025.100205","url":null,"abstract":"<div><div>A recent study by Yamashita (2024) showcases the usefulness of Many-Facet Rasch Model (MFRM) for the analysis of rater effects within the context of Automated Essay Scoring (AES). Building upon Yamashita's work, we break new ground by using Network Analysis (NA) to interrogate the same dataset comparing ChatGPT and human raters for the evaluation of 136 essays. We replicate the analysis of the original study and show a near-perfect agreement between the results of NA and MFRM. We extend the original study by providing strong evidence of halo effect in the data (including the ChatGPT ratings) and propose two new statistics to assess the consistency of raters. We also present simulation studies to show that the NA estimation algorithm is robust, even with small and sparse datasets. Finally, we provide practical guidelines for researchers seeking to use NA with their own datasets. We argue that NA can complement established methodologies, such as the MFRM, but can also be used independently, leveraging its strong visual representations. Relevant algorithms and R code are provided in the Online Appendix to support researchers and practitioners in replicating our findings.</div></div>","PeriodicalId":101075,"journal":{"name":"Research Methods in Applied Linguistics","volume":"4 2","pages":"Article 100205"},"PeriodicalIF":0.0,"publicationDate":"2025-04-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143816307","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

The development of tasks for measuring morphological awareness and word-meaning inference in L2 Russian 二语俄语词形意识和词义推理测试任务的发展

Research Methods in Applied Linguistics Pub Date : 2025-04-09 DOI: 10.1016/j.rmal.2025.100209

Rossina Soyan

引用次数: 0

Making time count: Kairos as temporal, methodological, and ethical innovation in qualitative applied linguistics research 让时间有价值：Kairos在定性应用语言学研究中的时间、方法和伦理创新

Research Methods in Applied Linguistics Pub Date : 2025-04-08 DOI: 10.1016/j.rmal.2025.100207

Jacob Rieker, Meredith Doran

{"title":"Making time count: Kairos as temporal, methodological, and ethical innovation in qualitative applied linguistics research","authors":"Jacob Rieker, Meredith Doran","doi":"10.1016/j.rmal.2025.100207","DOIUrl":"10.1016/j.rmal.2025.100207","url":null,"abstract":"<div><div>Responding to calls to interrogate the role of temporality in applied linguistics research methods, this paper explores the utility and value of <em>kairos</em> as a temporal and methodological logic in qualitative inquiry. In contrast to the predominant understanding of time as <em>chronos</em>, the objective passage of clock time, <em>kairos</em> represents the qualitative experience of time by the individual as personally significant moments that constitute turning points and major transitions in development. To illustrate how <em>kairos</em> can be productively integrated in qualitative research, we present a case study of a research project on faculty development in the context of English as a Medium of Instruction that was designed to create change in participants’ instructional decision making and practices. The analysis illustrates how the cultivation of <em>kairos</em>, defined as opportune, relevant, and meaningful experiences for participants, guided the study design and implementation, and enabled faculty-participants to implement new teaching practices to the benefit of their students’ engagement and learning. We conclude by considering the temporal, methodological, and ethical implications of attending to time as <em>kairos</em>, and by advocating for the potential benefits of a kairic orientation to qualitative inquiry in applied linguistics.</div></div>","PeriodicalId":101075,"journal":{"name":"Research Methods in Applied Linguistics","volume":"4 2","pages":"Article 100207"},"PeriodicalIF":0.0,"publicationDate":"2025-04-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143791359","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

The volunteer participation paradox: Ethical tensions between self-selection and targeted sampling 志愿者参与悖论：自我选择与目标抽样之间的伦理矛盾

Research Methods in Applied Linguistics Pub Date : 2025-04-08 DOI: 10.1016/j.rmal.2025.100206

Takaaki Hiratsuka

{"title":"The volunteer participation paradox: Ethical tensions between self-selection and targeted sampling","authors":"Takaaki Hiratsuka","doi":"10.1016/j.rmal.2025.100206","DOIUrl":"10.1016/j.rmal.2025.100206","url":null,"abstract":"<div><div>The voluntary nature of research participation is a cornerstone of ethical practices in studies involving human participants. However, when individuals voluntarily respond to participant calls or are selected through convenient methods, they often share traits like proximity or willingness—possibly leading to data skewed by similar attitudes. Conversely, methods aimed at diversity and inclusion, such as snowballing or maximum variation sampling, might inadvertently compromise the voluntary nature of participation. This tension, which I term the <em>volunteer participation paradox</em>, presents researchers with a methodological dilemma. That is, when participation is entirely voluntary, research may face limitations due to potentially unbalanced data. In contrast, when researchers employ targeted sampling strategies to gather broad-ranging data, the authenticity of voluntary participation may be influenced by factors such as social obligation or researcher relationships. This article explores manifestations of this methodological tension and puts forward guidance for navigating the complex ethical terrain in research methodology.</div></div>","PeriodicalId":101075,"journal":{"name":"Research Methods in Applied Linguistics","volume":"4 2","pages":"Article 100206"},"PeriodicalIF":0.0,"publicationDate":"2025-04-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143791360","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0