{"title":"A Polish adaptation of the usage-based approach to metaphor identification and analysis in caregiver interactions with children","authors":"Dorota Gaskins","doi":"10.1016/j.rmal.2024.100100","DOIUrl":"https://doi.org/10.1016/j.rmal.2024.100100","url":null,"abstract":"<div><p>As metaphors are difficult to elicit through experimental tools, especially at a young age, it has been proposed that corpora of naturalistic interactions between children and their primary caregivers present an alternative avenue for accessing the language of very young speakers (<span>Gaskins et al., 2023</span>). However, this approach has been developed with English data in mind, adding to the predominantly Anglocentric nature of child language research. The current article demonstrates how the approach can be adapted for use with children acquiring Polish and, by extension, other inflected Slavic languages, where metaphors are often encoded word-internally. The article justifies the motivations which have shaped the development of this adaptation and demonstrates what metaphors it has unearthed in the speech of a Polish-speaking two- to five-year-old child, and her primary caregivers. It is argued that the approach could carry a significant potential in future research if applied to densely sampled data from monolingual acquisition in Polish settings.</p></div>","PeriodicalId":101075,"journal":{"name":"Research Methods in Applied Linguistics","volume":"3 1","pages":"Article 100100"},"PeriodicalIF":0.0,"publicationDate":"2024-02-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2772766124000065/pdfft?md5=4530a4cf1451feed6f43895746e72e5d&pid=1-s2.0-S2772766124000065-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139748809","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"The language learning orientations scale and language learners’ motivation in Japan: A partial replication study","authors":"Paul Leeming, Justin Harris","doi":"10.1016/j.rmal.2024.100096","DOIUrl":"https://doi.org/10.1016/j.rmal.2024.100096","url":null,"abstract":"<div><p>Motivation is central to success in most academic domains. This paper builds on previous research into measurement of motivation within the framework of self-determination theory. Instruments measuring motivation often need to be adapted, revised, and improved. There have been repeated calls for replication studies within second language acquisition, and yet there remains some reluctance to build on and develop previous research. To address this issue, this paper reports on a partial replication of Leeming and Harris (2022). That study employed Rasch analysis to investigate the functioning of the Language Learning Orientations Scale (LLOS), allowing identification of problematic items that negatively influenced measurement of the target constructs. Based on the results and discussion of that paper, for this study, questionnaire items were edited, resulting in a new version of the instrument, the LLOS-J. This revised survey was administered to a similar cohort of participants who also completed a test of English reading and listening proficiency. The LLOS-J was examined using the Rasch model, and relationships between data from this questionnaire and English proficiency were also investigated. Rasch analysis allowed comparison with the initial study. Results showed improvement in the unidimensionality of the external motivation construct, and improved fit to the Rasch model for individual items, although this improvement was limited. The relationship between motivational variables and English proficiency was different from the initial study, and possible reasons are discussed.</p></div>","PeriodicalId":101075,"journal":{"name":"Research Methods in Applied Linguistics","volume":"3 1","pages":"Article 100096"},"PeriodicalIF":0.0,"publicationDate":"2024-02-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2772766124000028/pdfft?md5=3baa4a375b2b4de05e87b9de8e0e3375&pid=1-s2.0-S2772766124000028-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139743462","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Interrater agreement in genre analysis: A methodological review and a comparison of three measures","authors":"Minjin Kim, Xixin Qiu, Yuanheng (Arthur) Wang","doi":"10.1016/j.rmal.2024.100097","DOIUrl":"https://doi.org/10.1016/j.rmal.2024.100097","url":null,"abstract":"<div><p>This study examines the coding procedures, practices, and measures of interrater agreement (IRA) for conducting rhetorical move analysis. We first systematically reviewed 65 English for Academic Purposes (EAP) genre studies, focusing primarily on their IRA rationales and practices. Based on the review outcome, we explored three IRA measures: percent agreement, Kappa coefficients (κ), and Krippendorff's multi-valued alpha (<em>mv</em>-α) in terms of their suitability for measuring IRA in rhetorical move analysis under different scenarios such as different sample sizes, number of coders, and multivalued coding. Specifically, the three researchers annotated 35 texts from the Corpus of Social Sciences Research Article Introductions (COSSRAI) (Lu et al., 2020) and subsequently compared the potential of the three IRA measures. Drawing on findings of the systematic review and the corpus study, we recommended strategies for ensuring methodological rigors and transparency in annotation and IRA practices for EAP genre analysis.</p></div>","PeriodicalId":101075,"journal":{"name":"Research Methods in Applied Linguistics","volume":"3 1","pages":"Article 100097"},"PeriodicalIF":0.0,"publicationDate":"2024-02-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S277276612400003X/pdfft?md5=7ef3bf5885ffbcd33ec8cc08eab6e51f&pid=1-s2.0-S277276612400003X-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139710219","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Eye-tracking in vocabulary research: Introduction to the special issue","authors":"Ana Pellicer-Sánchez , Maribel Montero Perez","doi":"10.1016/j.rmal.2024.100095","DOIUrl":"https://doi.org/10.1016/j.rmal.2024.100095","url":null,"abstract":"<div><p>Vocabulary researchers are increasingly making use of the eye-tracking method to investigate topics that were traditionally examined using offline tests. Eye-tracking provides a direct measure of processing effort and attention allocation to lexical items. Previous research has provided useful insights about how different types of lexical items are processed in context and of the factors that affect processing patterns. More recent research has also contributed to our understanding of how unknown lexical items are processed in different learning conditions and its relation to learning gains. While eye-tracking has clearly supported researchers in gaining a clearer and more comprehensive understanding of vocabulary processing and learning, and has become a crucial tool in vocabulary research, currently there are no methodological discussions of eye-tracking with a particular focus on vocabulary. This special issue aims at addressing this gap and provides a detailed discussion of the uses and applications of eye-tracking in vocabulary research. This introduction to the special issue provides a brief review of current topics in eye-tracking based vocabulary research, identifying the main gaps that the special issue sets to answer, and introduces the different contributions of the special issue. The collection of papers that constitute this special issue aims at supporting researchers in conducting eye-tracking studies on lexical processing and learning and thus will help to move the field forward.</p></div>","PeriodicalId":101075,"journal":{"name":"Research Methods in Applied Linguistics","volume":"3 1","pages":"Article 100095"},"PeriodicalIF":0.0,"publicationDate":"2024-01-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2772766124000016/pdfft?md5=9bb0cc217137f2eb9c1f2946b492fe54&pid=1-s2.0-S2772766124000016-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139653535","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Issues with pedagogical implications in applied linguistics research: A mixed-methods systematic evaluation","authors":"Matthew D. Coss , Hyun-Bin Hwang","doi":"10.1016/j.rmal.2023.100094","DOIUrl":"https://doi.org/10.1016/j.rmal.2023.100094","url":null,"abstract":"<div><p>Applied linguists often aim to conduct research with implications for practitioners (widely construed), but only recently has a research agenda emerged which empirically investigates whether this aim is being regularly met (see <span>Sato, 2023</span>). While multiple survey studies (e.g., <span>Marsden & Kasprowicz, 2017</span>; <span>Sato et al., 2021</span>) have made important contributions to this literature, no study has systematically examined <em>how</em> researchers offer implications to intended practitioner audiences. To explore this topic, we conducted a systematic analysis of 118 empirical studies published in <em>TESOL Quarterly</em>. We developed highly reliable scales (avg. IRR = 0.88) to assess the quantity, salience, and quality of pedagogical implications (PIs). Qualitative genre analysis further allowed us to synthesize the features of highly informative PIs. Based on these findings, we offer concrete recommendations for maximizing PI quality for researchers, editors, and reviewers.</p></div>","PeriodicalId":101075,"journal":{"name":"Research Methods in Applied Linguistics","volume":"3 1","pages":"Article 100094"},"PeriodicalIF":0.0,"publicationDate":"2024-01-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S277276612300054X/pdfft?md5=cd8b1dd29bb7786ece22e48fc1135a73&pid=1-s2.0-S277276612300054X-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139107639","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Eye movements in the investigation of different properties of multi-word expressions: A systematic review","authors":"Irene Fioravanti , Anna Siyanova-Chanturia","doi":"10.1016/j.rmal.2023.100092","DOIUrl":"https://doi.org/10.1016/j.rmal.2023.100092","url":null,"abstract":"<div><p>The last ten years have seen an increased use of the eye-tracking methodology in the investigation of vocabulary processing in both L1 and L2. In particular, some of the advantages afforded by this method – such as, the ability to analyse multiple areas of interest (AOIs) and to distinguish between early and late stages of processing – have contributed to our deeper understanding of the mechanisms behind the online processing of sequences above the word level, known as multi-word expressions (MWEs). One key finding widely reported in the eye-tracking literature is that MWEs are processed faster than novel sequences. Different properties of MWEs – frequency, figurativeness, literality, familiarity, transparency, predictability, collocation strength, contextual predictability, adjacency, flexibility, modifiability, and congruency – have been shown to contribute to this processing advantage and to affect different types of MWEs differently. In this review, we first focus on the specific methodological aspects that need to be considered in the application of eye-tracking in the investigation of MWEs. We then discuss how these aspects have been treated in the literature to examine the different properties of MWEs.</p></div>","PeriodicalId":101075,"journal":{"name":"Research Methods in Applied Linguistics","volume":"3 1","pages":"Article 100092"},"PeriodicalIF":0.0,"publicationDate":"2024-01-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2772766123000526/pdfft?md5=fc69ac260a79b3886b0201c76fea595c&pid=1-s2.0-S2772766123000526-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139100158","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Modelling the use of the tool for the automatic analysis of syntactic sophistication and complexity (TAASSC)","authors":"Sangeun Kim , Phoenix Williams , Lee McCallum","doi":"10.1016/j.rmal.2023.100087","DOIUrl":"https://doi.org/10.1016/j.rmal.2023.100087","url":null,"abstract":"<div><p>This methods tutorial introduces the Tool for the Automatic Analysis of Syntactic Sophistication and Complexity (TAASSC), a linguistic analysis tool developed by Kyle (2016). In the first part, the tutorial offers an accessible introduction to the key concepts and considerations for using the syntactic complexity and sophistication measures provided by TAASSC. It also overviews the incorporation of new lexico-grammatical features in more recent versions of TAASSC and compares the new versions with earlier versions. The second part of the tutorial guides users through the tool's application by demonstrating a case study of applying TAASSC to a linguistic analysis. It details the process of utilising TAASSC to obtain initial index profiles and conducting mixed-effects modelling using R. The focus is on analysing one aspect of the phrasal complexity development in British school children's writing across academic years, employing mixed-effects models to account for complex data structures and observation interdependence. This tutorial equips researchers with the knowledge to effectively employ TAASSC in linguistic analysis and showcases its utility in exploring syntactic complexity development.</p></div>","PeriodicalId":101075,"journal":{"name":"Research Methods in Applied Linguistics","volume":"3 1","pages":"Article 100087"},"PeriodicalIF":0.0,"publicationDate":"2024-01-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2772766123000472/pdfft?md5=0682b7a35fb5641d74a430ef83ed0e4d&pid=1-s2.0-S2772766123000472-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139100159","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Why replicate? Systematic review of calls for replication in Language Teaching","authors":"Taichi Yamashita , Reza Neiriz","doi":"10.1016/j.rmal.2023.100091","DOIUrl":"https://doi.org/10.1016/j.rmal.2023.100091","url":null,"abstract":"<div><p>A first and critical step towards successful engagement with replication is to provide justifications to replicate the initial study. Despite existing guidelines, many researchers are still left uninformed of how to justify their replication. In order to explore what justifications were made in the past and thereby to provide additional guidelines, the present study conducted a systematic review of calls for replication in the journal of <em>Language Teaching</em>. The study analyzed 24 calls for replication published from 2010 to 2020 that encouraged replication of 50 initial studies published from 1976 to 2019. These calls for replication were coded for suggested modifications to initial studies and aspects of validity. Three hundred suggested modifications were identified, many of which were associated with external validity (38%) or internal validity (34%). Construct validity (15%) and statistical conclusion validity (7%) were rarely mentioned. Further analyses showed that suggestions on exploratory replication studies tended to address construct validity (e.g., pragmatic competence) and focus less on external validity, but the opposite was true for suggestions on confirmatory replication studies (e.g., corrective feedback). Suggestions for future replication research and calls for replication are discussed.</p></div>","PeriodicalId":101075,"journal":{"name":"Research Methods in Applied Linguistics","volume":"3 1","pages":"Article 100091"},"PeriodicalIF":0.0,"publicationDate":"2024-01-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2772766123000514/pdfft?md5=e527c8d1f8bcd83c793299f9b8cf49c8&pid=1-s2.0-S2772766123000514-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139100170","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"The use of eye movement corpora in vocabulary research","authors":"Marc Brysbaert , Denis Drieghe","doi":"10.1016/j.rmal.2023.100093","DOIUrl":"https://doi.org/10.1016/j.rmal.2023.100093","url":null,"abstract":"<div><p>Analysis of existing datasets of eye movements in reading is a valuable tool for vocabulary research because it allows researchers to examine word recognition in an authentic context. We argue that such secondary analysis is an important addition to new experimental studies and existing mega-studies because it examines word recognition in real text rather than in crammed conditions or in isolation. Corpora in which participants read long texts are particularly interesting because they provide rich material that can be better controlled for confounding variables, but a collection of small data sets can also be interesting because it contains more variation than is typically possible in a single study. We discuss the considerations to take into account when dealing with eye movement data in reading and urge colleagues to make their eye movement data available in the spirit of open science so that a larger database can be built more quickly.</p></div>","PeriodicalId":101075,"journal":{"name":"Research Methods in Applied Linguistics","volume":"3 1","pages":"Article 100093"},"PeriodicalIF":0.0,"publicationDate":"2023-12-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2772766123000538/pdfft?md5=6324f7350b02b025e93235a9b1653dd4&pid=1-s2.0-S2772766123000538-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138838763","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Validating a scale to measure self-regulated learning strategies for independent listening beyond the EFL classroom","authors":"Tomoko Yabukoshi","doi":"10.1016/j.rmal.2023.100090","DOIUrl":"https://doi.org/10.1016/j.rmal.2023.100090","url":null,"abstract":"<div><p>The present study aimed to validate a self-report questionnaire created and used in Yabukoshi (2023) to assess learners’ perceived use of self-regulated learning (SRL) strategies for practicing listening skills to improve the TOEIC® listening scores outside the classroom in an English as a foreign language (EFL) context. The instrument comprised 14 items on metacognitive SRL strategies used for out-of-class listening practice, which were divided into three subscales: strategies used in the forethought, performance, and self-reflection phases, drawing on Zimmerman's SRL model. The questionnaire was administered to 135 EFL undergraduates in Japan and subjected to a psychometric evaluation to determine its structural aspect of validity through reliability tests and confirmatory factor analysis (CFA), as well as to assess its convergent and discriminant validity and its external aspect of validity (i.e., predictive validity). The instrument had sufficient internal consistency based on reliability tests (Cronbach's alpha). The CFA results indicated a relatively good and reasonable model fit, and the convergent validity was found to be adequate. The discriminant validity was not satisfactory, which was discussed based on SRL theory and previous empirical evidence. Multiple regression analysis revealed that the three strategy factors as a whole were a strong predictor of learners’ listening proficiency. The empirical evidence provides preliminary support for the application of SRL theory to the field of EFL listening. The results of this study contribute to the limited research on the assessment of SRL strategy use for listening practice outside EFL classrooms.</p></div>","PeriodicalId":101075,"journal":{"name":"Research Methods in Applied Linguistics","volume":"3 1","pages":"Article 100090"},"PeriodicalIF":0.0,"publicationDate":"2023-12-12","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2772766123000502/pdfft?md5=e551ee422e0cba06831de466f4c46c51&pid=1-s2.0-S2772766123000502-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138570636","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}