Research Methods in Applied Linguistics最新文献_第8页

A systematic examination of generative artificial intelligence (GenAI) use guidelines in applied linguistics journals 应用语言学期刊中生成式人工智能（GenAI）使用指南的系统研究

Research Methods in Applied Linguistics Pub Date : 2025-12-01 Epub Date: 2025-06-20 DOI: 10.1016/j.rmal.2025.100227

Shuhui Yin, Carol A. Chapelle

{"title":"A systematic examination of generative artificial intelligence (GenAI) use guidelines in applied linguistics journals","authors":"Shuhui Yin, Carol A. Chapelle","doi":"10.1016/j.rmal.2025.100227","DOIUrl":"10.1016/j.rmal.2025.100227","url":null,"abstract":"<div><div>The unannounced appearance of GenAI in 2022 and the speed of its adoption by researchers have left many questions unanswered about its accepted ethical use, with no apparent consensus among applied linguists. In this context, it’s essential for researchers to develop their GenAI literacy for research to engage with GenAI effectively and responsibly. This study contributes to identifying key components of this literacy through examining accepted GenAI uses in research practices. Based on a systematically sampled collection of 170 high-impact journals in applied linguistics, we investigated the scope and nature of GenAI use guidelines provided by 76 journals intended to guide authors. A checklist including four items regarding general statements and 17 items regarding three categories of specific aspects that GenAI guidelines target (authorship, uses, and human responsibility) was identified. Our findings reveal that (1) less than half of the journals provided GenAI use guidelines to guide authors, (2) the number of specific aspects varied across journals, with most falling short of comprehensive coverage, and (3) disagreements were observed about whether AI can be cited and used for manuscript drafting, idea generating, image generating, data generation, data collection, and data analysis and interpretation. Additionally, journals varied in their guidance on how to disclose GenAI uses. We propose recommendations for journals in improving their AI guidelines. Importantly, we introduce and conceptualize the new construct GenAI literacy for research article writing (GenAI-LR) that is important for authors to develop. We provide actionable recommendations accordingly based on our findings.</div></div>","PeriodicalId":101075,"journal":{"name":"Research Methods in Applied Linguistics","volume":"4 3","pages":"Article 100227"},"PeriodicalIF":0.0,"publicationDate":"2025-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144322641","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Evaluating the linguistic complexity of machine translation and LLMs for EFL/ESL applications: An entropy weight method 评估机器翻译和llm在EFL/ESL应用中的语言复杂性：一种熵权法

Research Methods in Applied Linguistics Pub Date : 2025-12-01 Epub Date: 2025-06-30 DOI: 10.1016/j.rmal.2025.100229

Yingqi Huang, Dechao Li, Andrew K.F. Cheung

{"title":"Evaluating the linguistic complexity of machine translation and LLMs for EFL/ESL applications: An entropy weight method","authors":"Yingqi Huang, Dechao Li, Andrew K.F. Cheung","doi":"10.1016/j.rmal.2025.100229","DOIUrl":"10.1016/j.rmal.2025.100229","url":null,"abstract":"<div><div>English as a Foreign and Second Language (EFL/ESL) learners are increasingly using machine translation (MT) tools such as neural machine translations (NMTs) and large language models (LLMs) to enhance their language learning and translation processes due to their accuracy and efficiency in both cost and time compared with human translation. Given the distinct linguistic features exhibited by NMTs and LLMs, it is crucial to assess the linguistic complexity of texts produced by these tools to optimize their use in EFL/ESL teaching and learning. This study examines two forms of absolute linguistic complexity, namely lexical complexity and syntactic complexity, that influence EFL/ESL activities. Lexical complexity affects vocabulary recognition and semantic processing, while syntactic complexity influences sentence parsing and the internalization of grammatical rules. As both dimensions are multi-faceted and involve numerous indices that may vary in different directions (e.g., high values in certain measures and lower in others), an entropy weight method (EWM) is employed to assign data-driven weights and derive a balanced holistic complexity score. This approach enables a systematic comparison of translation outputs from NMTs (Google Translate, DeepL) and LLMs (ChatGPT-4o, OpenAI-o1). The findings reveal that LLMs generally exhibit higher holistic linguistic complexity, whereas NMTs tend to produce simpler translations. Pedagogically, LLM-translated texts may serve as more effective input for advanced language learners in EFL/ESL contexts, while NMT outputs may be more suitable for those with less linguistic proficiency.</div></div>","PeriodicalId":101075,"journal":{"name":"Research Methods in Applied Linguistics","volume":"4 3","pages":"Article 100229"},"PeriodicalIF":0.0,"publicationDate":"2025-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144513924","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Reframing subjectivity and construct elicitation: Applying the repertory grid technique in applied linguistics research 重构主体性与构式启发：库网格技术在应用语言学研究中的应用

Research Methods in Applied Linguistics Pub Date : 2025-12-01 Epub Date: 2025-09-18 DOI: 10.1016/j.rmal.2025.100261

Pariwat Imsa-ard

{"title":"Reframing subjectivity and construct elicitation: Applying the repertory grid technique in applied linguistics research","authors":"Pariwat Imsa-ard","doi":"10.1016/j.rmal.2025.100261","DOIUrl":"10.1016/j.rmal.2025.100261","url":null,"abstract":"<div><div>As applied linguistics turns increasingly towards subjectivity and individualized meaning-making, there is a pressing need for research methods that can systematically access tacit beliefs while preserving analytic transparency. This article introduces and advocates for the Repertory Grid Technique (RGT), grounded in Personal Construct Theory, as a flexible and rigorous tool for qualitative and mixed-methods inquiry. Rather than testing hypotheses, the article offers a methodologically driven illustration of RGT’s application in applied linguistics. Through a structured workflow–construct elicitation via triadic comparison, matrix rating, visual modeling, and post-grid reflection–the technique reveals participants’ personal constructs in their own views and supports both within-case and cross-case analysis. An illustrative study with three Thai EFL teachers shows how RGT captures complex, sometimes contradictory, conceptualizations of teacher roles and agency. The article provides step-by-step guidance, analytic demonstrations, and reflections on ethical, cognitive, and design challenges. RGT emerges not only as a methodological option but as a conceptual lens through which subjectivity can be explored systematically. Its capacity to generate participant-centered data, support visual and statistical analysis, and foster reflective engagement makes it a valuable addition to the applied linguistics methodological repertoire.</div></div>","PeriodicalId":101075,"journal":{"name":"Research Methods in Applied Linguistics","volume":"4 3","pages":"Article 100261"},"PeriodicalIF":0.0,"publicationDate":"2025-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145099538","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Authorial voices and scholarliness in participatory sociolinguistic research:An invitation to rethink the concept of academic language 参与式社会语言学研究中的作者声音与学术：重新思考学术语言概念的邀请

Research Methods in Applied Linguistics Pub Date : 2025-12-01 Epub Date: 2025-11-03 DOI: 10.1016/j.rmal.2025.100281

János Imre Heltai , Eszter Tarsoly , Petteri Laihonen , Bernadett Jani-Demetriou , Ildikó Schmidt , Csanád Bodó

{"title":"Authorial voices and scholarliness in participatory sociolinguistic research:An invitation to rethink the concept of academic language","authors":"János Imre Heltai , Eszter Tarsoly , Petteri Laihonen , Bernadett Jani-Demetriou , Ildikó Schmidt , Csanád Bodó","doi":"10.1016/j.rmal.2025.100281","DOIUrl":"10.1016/j.rmal.2025.100281","url":null,"abstract":"<div><div>Participatory research redefines the concept of researcher, extending it to people who were previously not considered researchers. In this way, it also challenges the enregisterment of academic voice. This paper employs the concept of enregisterment to offer new insights into the relationship between participatory research, academic language and ultimately scholarly publishing. We argue that scholarliness of participatory sociolinguistic work rests on four pillars: i) reflexivity, ii) systematicity, iii) dialogicity, and iv) social responsibility, rather than on features conventionally associated with scholarly voice, such as objectivity, neutrality, factuality, theoretical grounding, evidence-based argumentation, and formal style. Currently, professional researchers committed to participatory sociolinguistics follow two tracks in their careers: they either write articles <em>about</em> their collaboration with non-professionals, or they present the research outcomes of such research. The project presented here differs from both of these approaches insofar as trained researchers undertake writing <em>with</em>, and not <em>about</em>, non-academic research collaborators. A group of academics invited local civic participants from a marginalised post-industrial small-town setting in Hungary, some of whom were racialised bilinguals, to collaboratively edit and write a linguistic-ethnographic journal. In our collaborative activities, it is the activity itself that is guided by the above four epistemological principles, without the obligatory enregisterment of scholarliness in the writing. Based on this work, we formulate our vision for a journal in participatory sociolinguistics with a global reach, thus exploring opportunities for scholarly voices of non-professional researchers to flourish internationally as well.</div></div>","PeriodicalId":101075,"journal":{"name":"Research Methods in Applied Linguistics","volume":"4 3","pages":"Article 100281"},"PeriodicalIF":0.0,"publicationDate":"2025-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145465633","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Validation of online L2 vocabulary tests: Test performance across laboratory, virtual meeting, and crowdsourcing contexts 在线第二语言词汇测试的验证：跨实验室、虚拟会议和众包环境的测试性能

Research Methods in Applied Linguistics Pub Date : 2025-12-01 Epub Date: 2025-07-24 DOI: 10.1016/j.rmal.2025.100246

Ayako Aizawa

{"title":"Validation of online L2 vocabulary tests: Test performance across laboratory, virtual meeting, and crowdsourcing contexts","authors":"Ayako Aizawa","doi":"10.1016/j.rmal.2025.100246","DOIUrl":"10.1016/j.rmal.2025.100246","url":null,"abstract":"<div><div>Online data collection has become increasingly common in diverse fields, including marketing and psychology, and is gaining ground in applied linguistics. Although concerns have been raised about the validity and reliability of online assessments, previous research on online data collection suggests that, with appropriate precautions, data quality can be comparable to that obtained using in-person methods. However, the validity and reliability of online vocabulary tests have not been thoroughly investigated. To fill this gap, the present study compared the results of online vocabulary tests with those of face-to-face administration. In this study, 159 Japanese university students took the Vocabulary Size Test and Phrasal Vocabulary Size Test in three environments: (a) in-person (laboratory), (b) online with supervision (virtual meeting), and (c) online without supervision (crowdsourcing). Reliability and validity were analysed, and results showed that test performance was largely comparable: test environment and presence or absence of supervision had minimal effects on three out of the four tests, with only the meaning recall format of the Vocabulary Size Test showing significantly inflated scores in the crowdsourcing condition. While the findings suggest that pooling data online and aggregating data from different environments are feasible for vocabulary testing research, they also highlight the need for careful planning in research design to achieve a desirable environment for the participants to take the tests.</div></div>","PeriodicalId":101075,"journal":{"name":"Research Methods in Applied Linguistics","volume":"4 3","pages":"Article 100246"},"PeriodicalIF":0.0,"publicationDate":"2025-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144696442","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Automated vs. manual linguistic annotation for assessing pragmatic competence in English classes 评估英语课堂语用能力的自动与手动语言注释

Research Methods in Applied Linguistics Pub Date : 2025-12-01 Epub Date: 2025-08-20 DOI: 10.1016/j.rmal.2025.100253

Mohsen Mahmoudi-Dehaki , Nasim Nasr-Esfahani

{"title":"Automated vs. manual linguistic annotation for assessing pragmatic competence in English classes","authors":"Mohsen Mahmoudi-Dehaki , Nasim Nasr-Esfahani","doi":"10.1016/j.rmal.2025.100253","DOIUrl":"10.1016/j.rmal.2025.100253","url":null,"abstract":"<div><div>Evaluating pragmatic competence remains a complex and critical challenge in applied linguistics, particularly in English as a Foreign Language (EFL) contexts. This study aims to address this gap by examining the potential of automating pragmatic competence assessment using AI-powered text analytics. Employing an explanatory sequential mixed-methods design, the quantitative phase compares the accuracy of automated versus manual linguistic annotation in evaluating the pragmatic skills of EFL learners. In the qualitative phase, factors influencing the accuracy of manual annotation are explored. For automated annotation, ChatGPT-4 Omni (ChatGPT-4o) processed 116 transcriptions representing participants' performances across six verbal discourse completion tasks (DCTs), encompassing prosodic features and pragmatic functions such as requesting favors, apologizing, suggesting, complaining, inviting, and refusing invitations. The AI model was fine-tuned using a human-in-the-loop approach, incorporating ensemble techniques such as few-shot learning and instructional prompts. Manual annotation employed trained EFL teachers using standardized assessment cards. Results indicate that automated annotation surpasses manual accuracy in evaluating most pragmatic components, except cultural norms, where both methods exhibit limitations. Focus group findings reveal that annotator bias, fatigue, technological influences, linguistic background differences, and subjectivity impact manual annotation accuracy. This interdisciplinary investigation expands the methodological toolkit for pragmatic competence evaluation and holds significant implications for fields such as digital humanities, computational pragmatics, language education, machine learning, and natural language processing.</div></div>","PeriodicalId":101075,"journal":{"name":"Research Methods in Applied Linguistics","volume":"4 3","pages":"Article 100253"},"PeriodicalIF":0.0,"publicationDate":"2025-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"144863503","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Validating the Japanese version of the short-form foreign language enjoyment scale 日语简体外语享受量表的验证

Research Methods in Applied Linguistics Pub Date : 2025-12-01 Epub Date: 2025-09-30 DOI: 10.1016/j.rmal.2025.100270

Larry Xethakis , Michael Rupp , Oliver Edwards , Mark Howarth , Toshikazu Kawagoe

{"title":"Validating the Japanese version of the short-form foreign language enjoyment scale","authors":"Larry Xethakis , Michael Rupp , Oliver Edwards , Mark Howarth , Toshikazu Kawagoe","doi":"10.1016/j.rmal.2025.100270","DOIUrl":"10.1016/j.rmal.2025.100270","url":null,"abstract":"<div><div>The study of positive emotions and their influence on language learning has gained considerable attention recently, with foreign language enjoyment being one of the most-studied emotions. The Short-form Foreign Language Enjoyment Scale (S-FLES) is a popular measure of enjoyment, however, this measure has yet to be validated for use in the Japanese context. This study aimed to address this gap by comparing hierarchical and bifactor confirmatory factor analysis (CFA) models, with analogous models employing the innovative technique of exploratory structural equation modeling (ESEM). Responses from 536 undergraduate EFL learners were used in the analysis of the models, with results indicating that the fit of the ESEM models were superior to that of the CFA models. The bifactor ESEM was chosen as the most suitable model of the S-FLES on the basis of its better convergent validity, divergent validity, and reliability, as well as its measurement quality. Invariance testing supported the bifactor model’s configural invariance, as well as its partial metric and scalar invariance across gender. The relationship between the bifactor model and social-behavioral engagement was evaluated as a measure of the S-FLES’s concurrent validity. The model exhibited a very strong degree of predictive power, with the general factor accounting for the greatest degree of variance in social-behavioral engagement. The bifactor model of the S-FLES was shown to be a valid and reliable measure of FLE among Japanese undergraduate EFL learners, providing further support to the use of ESEM in evaluating positive psychological instruments.</div></div>","PeriodicalId":101075,"journal":{"name":"Research Methods in Applied Linguistics","volume":"4 3","pages":"Article 100270"},"PeriodicalIF":0.0,"publicationDate":"2025-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145219402","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Evaluating methodological features of research on translanguaging pedagogy in English Medium Instruction (EMI) 英语媒介教学中译语教学法研究的方法论特征评价

Research Methods in Applied Linguistics Pub Date : 2025-12-01 Epub Date: 2025-09-17 DOI: 10.1016/j.rmal.2025.100263

Junwei Sam Liao , Fan Fang , Lawrence Jun Zhang

{"title":"Evaluating methodological features of research on translanguaging pedagogy in English Medium Instruction (EMI)","authors":"Junwei Sam Liao , Fan Fang , Lawrence Jun Zhang","doi":"10.1016/j.rmal.2025.100263","DOIUrl":"10.1016/j.rmal.2025.100263","url":null,"abstract":"<div><div>Research on translanguaging has gained momentum in recent years. However, there is little literature systematically documenting the research methodologies of translangaging pedagogy employed for carrying out this line of research in English Medium Instruction (EMI) contexts. Thus, we made an attempt to examine studies on translanguaging pedagogy in EMI from 2014 to 2024. Utilising a qualitative meta-synthesis approach, we analysed 10 empirical studies through systematic searches in the Web of Science Core Collection and the Scopus database. Findings revealed a predominance of qualitative methodologies, such as case studies and thematic analysis, with data collected via semi-structured interviews, classroom observations, surveys, and student artifacts. These studies largely concentrated on Asian contexts and at the tertiary level, exploring teachers’ and students’ translanguaging perceptions and strategies in EMI classrooms. Despite the depth provided by qualitative approaches, the review identified a lack of quantitative and mixed-methods research in this field. The absence of research frameworks and contextual diversity highlights gaps in the field. The paper, therefore, concludes with recommendations for more research using multiple methodologies to explore translanguaging pedagogies in different EMI contexts and specific EMI subjects, as well as potential research objectives and research fields.</div></div>","PeriodicalId":101075,"journal":{"name":"Research Methods in Applied Linguistics","volume":"4 3","pages":"Article 100263"},"PeriodicalIF":0.0,"publicationDate":"2025-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145099537","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Toward research inclusivity in applied linguistics: Methodological considerations for inclusive online experimentation 迈向应用语言学研究的包容性：对包容性在线实验的方法论思考

Research Methods in Applied Linguistics Pub Date : 2025-12-01 Epub Date: 2025-09-03 DOI: 10.1016/j.rmal.2025.100255

Kathy Kim, Erning Henry Chen

引用次数: 0

Negotiating stance expressions in research writing with GenAI: A three-step prompt approach for ChatGPT 用GenAI进行研究写作中的谈判立场表达：ChatGPT的三步提示方法

Research Methods in Applied Linguistics Pub Date : 2025-12-01 Epub Date: 2025-10-30 DOI: 10.1016/j.rmal.2025.100267

Maria Kuteeva , Marta Andersson

{"title":"Negotiating stance expressions in research writing with GenAI: A three-step prompt approach for ChatGPT","authors":"Maria Kuteeva , Marta Andersson","doi":"10.1016/j.rmal.2025.100267","DOIUrl":"10.1016/j.rmal.2025.100267","url":null,"abstract":"<div><div>Recent studies have started to examine differences in the use of stance expressions between human and GenAI writing, e.g. comparing student essays to those generated by LLMs. In professional research writing, stance expressions not only reflect authors’ attitudes and assessments but also function as manifestations of researcher’s positionality. However, to our knowledge, the impact of GenAI on the linguistic expression of researcher positionality, and stance in particular, has not received attention in the literature. To address this gap, our study zooms in on how ChatGPT-4 adopts and adapts stance with regard to knowledge claims in applied linguistics and pragmatics. We have systematically tested three kinds of prompting techniques in order to assess the model’s flexibility in generating stance expressions: a) zero-shot prompting with minimal input; b) few-shot prompting technique; c) role enactment prompting. Our analysis of ChatGPT-4 output in response to our prompts suggests that, overall, the model displays a rather rigid understanding of stance. The outputs are more acceptable for epistemic rather than attitudinal stance. Our results suggest that interactional prompting is the most effective strategy, as the model is guided to treat texts holistically and consider a range of nuanced elements, producing an output that better mimics genuine engagement with the text.</div></div>","PeriodicalId":101075,"journal":{"name":"Research Methods in Applied Linguistics","volume":"4 3","pages":"Article 100267"},"PeriodicalIF":0.0,"publicationDate":"2025-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"145415160","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0