{"title":"Elicited imitation in second language acquisition research: New insights to advance methodological rigor (Introduction to the special issue)","authors":"Megan Solon , Hae In Park","doi":"10.1016/j.rmal.2024.100112","DOIUrl":"https://doi.org/10.1016/j.rmal.2024.100112","url":null,"abstract":"<div><p>This introduction provides an overview of the state of research on and knowledge about the use of elicited imitation in applied linguistics research, highlighting gaps in our current understanding of this tool. It then introduces the eight articles that comprise the special issue.</p></div>","PeriodicalId":101075,"journal":{"name":"Research Methods in Applied Linguistics","volume":"3 2","pages":"Article 100112"},"PeriodicalIF":0.0,"publicationDate":"2024-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140818458","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Adding discourse to sentence repetition tasks: Under which conditions does bilingual children's performance improve?","authors":"Jacopo Torregrossa , Andrea Listanti , Christiane Bongartz , Theodoros Marinis","doi":"10.1016/j.rmal.2024.100107","DOIUrl":"https://doi.org/10.1016/j.rmal.2024.100107","url":null,"abstract":"<div><p>Sentence repetition tasks (SRTs) have been extensively used as measures of bilinguals’ language abilities. Most studies relied on SRTs in which the target sentences were not connected to each other. However, participants’ performance may differ if these sentences are embedded in discourse, since discourse provides participants with additional cues for sentence comprehension and interpretation. For the present study, we designed a discourse-based SRT, whereby the target sentences were connected to each other in a story. We examined the effect of discourse on bilinguals’ performance in the SRT and investigated whether this effect varied based on the language of administration, bilinguals’ dominance score and type of target structure. We tested 32 Italian-German bilingual children (7–12 years) living in Germany with two SRTs in each language, one with discourse and one without discourse. Participants showed a better performance in the SRTs with discourse, especially in the heritage language (Italian). The effect of discourse was visible across the board with all target structures. On the whole, SRTs with discourse seem to reduce the processing costs associated with lexical retrieval and shifts in scenarios, thus tapping more directly into children's processing abilities, compared to more traditional SRTs. The results are discussed in terms of ecological validity of different assessment instruments.</p></div>","PeriodicalId":101075,"journal":{"name":"Research Methods in Applied Linguistics","volume":"3 2","pages":"Article 100107"},"PeriodicalIF":0.0,"publicationDate":"2024-04-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2772766124000132/pdfft?md5=d9045c613b1729ee3faa3a30a78cb023&pid=1-s2.0-S2772766124000132-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140649973","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Tim Stoeckel , Hung Tan Ha , Duyen Thi Bich Nguyen , Christopher Nicklin
{"title":"Can an extended-matching second-language vocabulary test format bridge the gap between meaning-recognition and meaning-recall?","authors":"Tim Stoeckel , Hung Tan Ha , Duyen Thi Bich Nguyen , Christopher Nicklin","doi":"10.1016/j.rmal.2024.100109","DOIUrl":"https://doi.org/10.1016/j.rmal.2024.100109","url":null,"abstract":"<div><p>Meaning-recognition and meaning-recall vocabulary tests are commonly used to assess knowledge of the form-meaning link as it relates to the receptive skills. Although meaning-recognition is generally more convenient, think-aloud protocols have revealed that in comparison to meaning-recall, meaning-recognition is more susceptible to blind guessing and the use of construct-irrelevant test strategies. Perhaps because of this, meaning-recall tends to be a stronger predictor of reading ability. Following Budescu (1988), this article reports on three studies that investigated an extended-matching test (EMT) format that was designed to address these limitations of meaning-recognition while retaining its convenience. An EMT with 90 target words was developed. It contained three clusters, each with a 30:130 ratio of target words to Vietnamese L2 response options. In comparison to meaning-recall criterion measures, the EMT did not meaningfully differ in terms of internal reliability, mean scores, and, importantly, the strength of the correlation with reading comprehension scores. The consistency of correct/incorrect response classifications ranged from 83 % to 86 %. These initial findings suggest that the EMT format may be used interchangeably with meaning-recall for many research purposes.</p></div>","PeriodicalId":101075,"journal":{"name":"Research Methods in Applied Linguistics","volume":"3 2","pages":"Article 100109"},"PeriodicalIF":0.0,"publicationDate":"2024-04-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140644127","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Examining the criterion validity of curriculum-based measurement of writing (CBM-W) with young EFL learners","authors":"Keith M. Graham","doi":"10.1016/j.rmal.2024.100108","DOIUrl":"https://doi.org/10.1016/j.rmal.2024.100108","url":null,"abstract":"<div><p>This study examines the criterion validity of curriculum-based measurement of writing (CBM-W) for assessing the writing of young language learners in an EFL context. CBM-W has been found to have criterion validity with a variety of tests and student populations, including learners in ESL settings taking standardized tests. However, evidence of CBM-W's validity for use with young learners in EFL settings is limited. This study seeks to address this gap by investigating the criterion validity argument for the following CBM-W scoring procedures: words written (WW), words spelled correctly (WSC), correct word sequences (CWS), and correct minus incorrect word sequences (CIWS). The data set included classroom-administered narrative prompt writing samples and official test scores from the Cambridge Assessment English Young Learners exam reading and writing test collected from 51 Taiwanese English learners aged seven to eight. A Bayesian correlation data analysis found a greater probability favoring the criterion validity argument for CWS and WSC, with strong evidence for CWS and moderate evidence for WSC. This study sets the foundation for future research examining the validity argument of CBM-W for evaluating young EFL learners’ writing in research and classroom settings.</p></div>","PeriodicalId":101075,"journal":{"name":"Research Methods in Applied Linguistics","volume":"3 2","pages":"Article 100108"},"PeriodicalIF":0.0,"publicationDate":"2024-04-23","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140633499","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Postdigital ethnography in applied linguistics: Beyond the online and offline in language learning","authors":"Chaoran Wang , Suresh Canagarajah","doi":"10.1016/j.rmal.2024.100111","DOIUrl":"https://doi.org/10.1016/j.rmal.2024.100111","url":null,"abstract":"<div><p>We live in a postdigital world where traversing digital and in-person domains for teaching and learning is normalized, raising important methodological and ethical considerations for ethnographic approaches in language education. We define postdigital as a condition where the virtual and physical mediate each other to form hybrid spaces that transcend the online/offline distinction. We begin the article with theoretical discussions on the epistemological orientations that inform postdigital inquiry. Then we situate our language education research, discussing the value of ethnography for understanding hybrid spaces and identifying the challenges and limitations of existing ethnographic methodologies in addressing postdigital conditions. Following this, we illustrate ways to follow the chosen unit of analysis in postidigital ethnography through three case studies, specifically focusing on pedagogical activities. We also reflect on pedagogical insights from postdigital ethnography, sensitive ethical concerns involved in postdigital research, as well as considerations for addressing those ethical issues. We conclude the paper with practical suggestions for researchers on conducting postdigital ethnographies.</p></div>","PeriodicalId":101075,"journal":{"name":"Research Methods in Applied Linguistics","volume":"3 2","pages":"Article 100111"},"PeriodicalIF":0.0,"publicationDate":"2024-04-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S277276612400017X/pdfft?md5=8a0ea21e46aeaab3bd27e8607aad0254&pid=1-s2.0-S277276612400017X-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140620771","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Text and reading task variables in incidental L2 vocabulary learning from reading: A methodological synthesis","authors":"Yuya Arai, Kotaro Takizawa","doi":"10.1016/j.rmal.2024.100110","DOIUrl":"https://doi.org/10.1016/j.rmal.2024.100110","url":null,"abstract":"<div><p>Although a number of studies have been conducted on incidental second language (L2) vocabulary learning from reading, there is little discussion on the importance of reading text and task variables in research design and learning outcomes. This methodological synthesis aims to systematically review and critically appraise the methodological choices related to text variables (text audience, quality, genre, topic and content, length, and amount) and reading task variables (reading task instruction, reading comprehension assessment, and time allocation for reading) in previous studies. A total of 33 primary studies were retrieved and reviewed. The results indicated that the current practice of the use of texts and reading tasks should be reconsidered, and that researchers should provide more information on these variables. The findings contribute to the methodological rigor of the research on incidental L2 vocabulary learning from reading.</p></div>","PeriodicalId":101075,"journal":{"name":"Research Methods in Applied Linguistics","volume":"3 2","pages":"Article 100110"},"PeriodicalIF":0.0,"publicationDate":"2024-04-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140619097","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Ethics in applied linguistics research: Evidence and action","authors":"Daniel R. Isbell , Peter I. De Costa","doi":"10.1016/j.rmal.2024.100104","DOIUrl":"https://doi.org/10.1016/j.rmal.2024.100104","url":null,"abstract":"","PeriodicalId":101075,"journal":{"name":"Research Methods in Applied Linguistics","volume":"3 1","pages":"Article 100104"},"PeriodicalIF":0.0,"publicationDate":"2024-03-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2772766124000107/pdfft?md5=a8281d6218153d6ef52d6f45b5cfb54c&pid=1-s2.0-S2772766124000107-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140141489","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Utilizing ASReview in screening primary studies for meta-research in SLA: A step-by-step tutorial","authors":"Yazhuo Quan, Tetiana Tytko, Bronson Hui","doi":"10.1016/j.rmal.2024.100101","DOIUrl":"https://doi.org/10.1016/j.rmal.2024.100101","url":null,"abstract":"<div><p>Meta-research, including meta-analyses and systematic methodological reviews, has proven to be a useful tool for obtaining a comprehensive understanding of research questions by numerically summarizing data and methodological features in a given literature. As part of the review procedure, researchers select primary studies to be included in their analysis. However, this process is resource-intensive and prone to human error. In this tutorial, we introduce a practical application of artificial intelligence (AI), known as ASReview, that can facilitate the screening process. Using a simulated data set derived from a published meta-analysis, we offer step-by-step guidance on how to incorporate the tool into the screening process. We cover the essential steps, including the preparation of the data set, the import of the data set, the labeling of the study as relevant or irrelevant (for inclusion or not), as well as the saving of the results for the researcher's record and sharing for transparency in the spirit of open science. In addition, the tutorial addresses essential factors to consider in the AI-aided screening process, such as stopping rules. We acknowledge potential limitations of the tool and provide a couple of alternatives for interested readers. Our overall goal is to contribute to advancing and promoting meta-research in SLA by facilitating the screening process in the era of AI.</p></div>","PeriodicalId":101075,"journal":{"name":"Research Methods in Applied Linguistics","volume":"3 1","pages":"Article 100101"},"PeriodicalIF":0.0,"publicationDate":"2024-03-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2772766124000077/pdfft?md5=10b4a462e814e7f0d6755eb96d829327&pid=1-s2.0-S2772766124000077-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140062386","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"What's ethics got to do with applied linguistics? Revisiting the past, considering the present, and being optimistic about the future of our field","authors":"Peter I. De Costa","doi":"10.1016/j.rmal.2024.100103","DOIUrl":"https://doi.org/10.1016/j.rmal.2024.100103","url":null,"abstract":"<div><p>No abstract for this editorial commentary</p></div>","PeriodicalId":101075,"journal":{"name":"Research Methods in Applied Linguistics","volume":"3 1","pages":"Article 100103"},"PeriodicalIF":0.0,"publicationDate":"2024-03-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2772766124000090/pdfft?md5=6773b65fc862b721d6f7964d03b51c21&pid=1-s2.0-S2772766124000090-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140051531","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Keeping in time: The design of qualitative longitudinal research in SLA","authors":"Alastair Henry , Peter D. MacIntyre","doi":"10.1016/j.rmal.2024.100102","DOIUrl":"https://doi.org/10.1016/j.rmal.2024.100102","url":null,"abstract":"<div><p>Language development is a long-term process. Individual-level longitudinal case studies have been foundational to SLA. However, methodologies that can support person-focused and process-oriented research lack consolidation. Qualitative longitudinal (QL) research (Neale, 2021a, 2021b) is a methodology that facilitates exploration of the influences <em>of</em> time <em>over</em> time. It provides a temporal architecture within which the ever-changing influence of time can be explored. In QL research, development is studied during a period of transition. With focus trained on a defined time window, data generation is guided by temporally configured strategies. This article introduces QL methodology and demonstrates its application in the investigation of willingness to communicate (WTC) among immigrant women in Sweden. We present the key principles of QL research, and the application of data collection strategies that are (1) sequential, (2) participatory, (3) cartographic, and (4) recursive. In QL research, exploration of the episodic and incremental nature of change will be facilitated when narratives reflecting a participant's experiences are compiled and shared with an engaged researcher in sequentially ordered interviews. In a QL study, time provides an axis of comparison. With participatory data providing pivots around which an interview is conducted, interviews are designed to map out temporal shifts. In mapping a developmental journey, events currently in focus are examined in relation to similar events discussed in preceding interviews and, within broader developmental timeframes, previous journeys. The article concludes with an assessment of the opportunities and challenges associated with QL research.</p></div>","PeriodicalId":101075,"journal":{"name":"Research Methods in Applied Linguistics","volume":"3 1","pages":"Article 100102"},"PeriodicalIF":0.0,"publicationDate":"2024-03-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2772766124000089/pdfft?md5=5aba005d45f00fddd9aaa02bfd0a1299&pid=1-s2.0-S2772766124000089-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140030353","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}