Research Methods in Applied Linguistics最新文献_第4页

Network science in a dynamic usage-based approach 基于动态使用方法的网络科学

Research Methods in Applied Linguistics Pub Date : 2024-09-30 DOI: 10.1016/j.rmal.2024.100150

Susanne DeVore , Marjolijn Verspoor

{"title":"Network science in a dynamic usage-based approach","authors":"Susanne DeVore , Marjolijn Verspoor","doi":"10.1016/j.rmal.2024.100150","DOIUrl":"10.1016/j.rmal.2024.100150","url":null,"abstract":"<div><div>In this study, we test the ability of network science to capture linguistic development over time in individuals from a dynamic usage-based perspective, a combination of a complex dynamic systems theory (CDST) approach and usage-based (UB) linguistics. Network science is designed to quantitatively analyze entire systems and captures complex interrelationships between components of those systems. We select network science measures that have potential to represent theoretically predicted individual language learning processes, specifically focusing on the development from prototype to schematized constructions at the macro- (network), micro- (word), and meso‑level (syntactic structure). To test this approach, we traced the beginning L2 Chinese development of two English speakers. The results are generally aligned to dynamic usage-based predictions in terms of prototypicality, schematization variability, and variation. Additionally, the network science approach allows us to identify a core set of words that emerges at the early stage of learning and is highly connected, seeming to drive development; it also suggests that variability plays different roles at different levels of analysis. Although it is preliminary to make strong conclusions about this set of words, it suggests that, as with other areas of inquiry, network science can reveal previously unidentified information about linguistic development and should be further explored.</div></div>","PeriodicalId":101075,"journal":{"name":"Research Methods in Applied Linguistics","volume":"3 3","pages":"Article 100150"},"PeriodicalIF":0.0,"publicationDate":"2024-09-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142358790","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

A methodological exploration of the P-frame approach: Implications for developing phrase lists 对 P 框架方法的方法论探索：对编制短语表的影响

Research Methods in Applied Linguistics Pub Date : 2024-09-19 DOI: 10.1016/j.rmal.2024.100154

Aysel Şahin Kızıl , Benet Vincent , Lee McCallum

{"title":"A methodological exploration of the P-frame approach: Implications for developing phrase lists","authors":"Aysel Şahin Kızıl , Benet Vincent , Lee McCallum","doi":"10.1016/j.rmal.2024.100154","DOIUrl":"10.1016/j.rmal.2024.100154","url":null,"abstract":"<div><p>The widespread availability of corpora and corpus tools has led to considerable advances in our understanding of phraseology and how it can be investigated. An increasingly influential approach to investigating phraseology is the retrieval and analysis of phrase frames (p-frames), recurrent word sequences with a variable slot. Although the p-frame approach is quite well-established, pedagogically oriented research in this area is still quite new, in particular the application of phrase frames to generate useful lists of phrases. This paper aims to contribute to methodological efforts in this direction by presenting a case study to illustrate decision-making throughout the process from corpus compilation to the generation of a final pedagogical list of phrases. Using a corpus of research article (RA) introductions in Health Sciences, this study shows how key decisions including p-frame length, frequency and range thresholds were arrived at. It also discusses exclusion criteria focusing on variability and predictability of p-frame fillers, and the fine-tuning of the resulting list, focusing on semantic coherence and pedagogical usefulness. Finally, we present the results of an initial evaluation of the list by stakeholders. The main contributions of the study to p-frame research methodology lie in the clarification of threshold settings, the potential contribution of variability and predictability to decision-making and the proposal of more in-depth concordance analysis of co-text to aid in the identification of phrases.</p></div>","PeriodicalId":101075,"journal":{"name":"Research Methods in Applied Linguistics","volume":"3 3","pages":"Article 100154"},"PeriodicalIF":0.0,"publicationDate":"2024-09-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142270721","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Building custom NLP tools to annotate discourse-functional features for second language writing research: A tutorial 为第二语言写作研究建立自定义 NLP 工具以标注话语功能特征：教程

Research Methods in Applied Linguistics Pub Date : 2024-09-18 DOI: 10.1016/j.rmal.2024.100153

Masaki Eguchi , Kristopher Kyle

引用次数: 0

Moving beyond binary language status in research: Investigating early foreign language learning and linguistic distance 在研究中超越二元语言地位：调查早期外语学习和语言距离

Research Methods in Applied Linguistics Pub Date : 2024-09-09 DOI: 10.1016/j.rmal.2024.100151

Nils Jaekel , Michael Schurig , Eliane Lorenz

{"title":"Moving beyond binary language status in research: Investigating early foreign language learning and linguistic distance","authors":"Nils Jaekel , Michael Schurig , Eliane Lorenz","doi":"10.1016/j.rmal.2024.100151","DOIUrl":"10.1016/j.rmal.2024.100151","url":null,"abstract":"<div><p>Globalization and migration continue to shape our societies, including educational contexts such as school classrooms. In response to young learners’ linguistic needs, particularly in the context of foreign language learning in Germany, educational approaches need to be adapted to meet the needs of multilingual students. Current, binary approaches accounting for diverse linguistic backgrounds of students in research assume a high degree of homogeneity among multilingual students. Linguistic distance measures may provide alternative, more fine-grained, continuous tools to account for linguistic diversity. This study employs lexical linguistic distance to account for young language learners’ linguistic diversity in a reanalysis of Jaekel et al. (2017). Additionally, mixed-effects modeling was employed to factor in within-class effects for within-class factors versus structural equation modeling, which was previously used. The results outline that linguistic distance provides additional information beyond binary language status. Mixed effects modeling renders comparable results with the same tendencies, but yields more nuanced perspectives on the data.</p></div>","PeriodicalId":101075,"journal":{"name":"Research Methods in Applied Linguistics","volume":"3 3","pages":"Article 100151"},"PeriodicalIF":0.0,"publicationDate":"2024-09-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2772766124000570/pdfft?md5=9492363d23de861a48c0f3725af5df5f&pid=1-s2.0-S2772766124000570-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142162284","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Integrated geospatial methods for multilingual cities: Combining GPS, electronically activated recorder, and map-based ethnographic interviews 多语言城市的综合地理空间方法：将全球定位系统、电子激活记录仪和基于地图的人种学访谈相结合

Research Methods in Applied Linguistics Pub Date : 2024-09-06 DOI: 10.1016/j.rmal.2024.100147

Bernadette O'Rourke , Qunshan Zhao , Alejandro Dayán-Fernández , Euan Dickson , Ruiyu Wang , Mingkang Wang , Lei Zhang , Muhammad Imran

{"title":"Integrated geospatial methods for multilingual cities: Combining GPS, electronically activated recorder, and map-based ethnographic interviews","authors":"Bernadette O'Rourke , Qunshan Zhao , Alejandro Dayán-Fernández , Euan Dickson , Ruiyu Wang , Mingkang Wang , Lei Zhang , Muhammad Imran","doi":"10.1016/j.rmal.2024.100147","DOIUrl":"10.1016/j.rmal.2024.100147","url":null,"abstract":"<div><p>Multilingual speakers’ linguistic practices are typically investigated via self-report measures, often relying on subjective memory recall. This article examines the potential of an interdisciplinary methodology which would allow us to examine the experiences of multilingual speakers as they are played out in real time and space through a combination of GPS monitoring, the use of the Electronically Activated Recorder (EAR), and map-based ethnographic interviews. GPS and EAR offer promising opportunities to investigate the spatial dynamics of multilingual practices as well as the acquisition of a new language and its subsequent use. Despite frequent applications in adjacent fields such as Human Geography, Urban Analytics, Sociology and Psychology, the use of these methods in Applied Linguistics is still relatively scarce. In this article, we examine the potential benefits and limitations of using automated processes for observing human language behaviour, such as those provided by GPS and EAR technologies. We address timely ethical questions around tracked and recorded data collection processes and present solutions used to devise privacy-preserving tools when using GPS and EAR technologies in a pilot study of Gaelic multilingual speakers in the city of Glasgow. By optimising the potential of these technologies when combined with qualitative and ethnographic approaches, our article proposes a multidisciplinary methodological approach that can provide a more nuanced understanding of the spatial dynamics of multilingual speakers in cities.</p></div>","PeriodicalId":101075,"journal":{"name":"Research Methods in Applied Linguistics","volume":"3 3","pages":"Article 100147"},"PeriodicalIF":0.0,"publicationDate":"2024-09-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2772766124000533/pdfft?md5=d6f9b6b88d828f37d0366064b24e25d0&pid=1-s2.0-S2772766124000533-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142150212","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

More accurate estimation for nonrandom sampling surveys: A post hoc correction method 为非随机抽样调查提供更准确的估算：事后修正法

Research Methods in Applied Linguistics Pub Date : 2024-09-05 DOI: 10.1016/j.rmal.2024.100152

Takunori Terasawa

{"title":"More accurate estimation for nonrandom sampling surveys: A post hoc correction method","authors":"Takunori Terasawa","doi":"10.1016/j.rmal.2024.100152","DOIUrl":"10.1016/j.rmal.2024.100152","url":null,"abstract":"<div><p>Nonprobability sample surveys are commonly used in applied linguistics research, but their lack of representativeness makes it difficult to generalize their results to the wider population. To address this issue, this study introduces a post hoc statistical correction method that uses an existing probability sample survey as reference data. The paper begins by outlining the importance of such corrections and provides details of a practical correction procedure that employs propensity scores as a balancing factor. The method is then applied to real-world data from the 2022 Survey of Workers’ English Use, a nonprobability web panel survey investigating English use among Japanese people as an international language. The corrected estimates are subsequently compared to those from a nationally representative survey. The results showed that the proposed correction method effectively adjusted the proportions and mean values of self-reported English proficiency and replicated the population. However, the method was less effective in adjusting the mean values for attitudes toward globalization as well as correlation coefficients, although it did not worsen these estimates. Based on these findings, the paper advocates for the adoption of this correction method in applied linguistic studies where feasible, with some critical considerations and caveats highlighted.</p></div>","PeriodicalId":101075,"journal":{"name":"Research Methods in Applied Linguistics","volume":"3 3","pages":"Article 100152"},"PeriodicalIF":0.0,"publicationDate":"2024-09-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142150211","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Assessing interactional competence through group discussion: A mixed methods validation 通过小组讨论评估互动能力：混合方法验证

Research Methods in Applied Linguistics Pub Date : 2024-09-03 DOI: 10.1016/j.rmal.2024.100144

John Syquia , Paul Leeming

{"title":"Assessing interactional competence through group discussion: A mixed methods validation","authors":"John Syquia , Paul Leeming","doi":"10.1016/j.rmal.2024.100144","DOIUrl":"10.1016/j.rmal.2024.100144","url":null,"abstract":"<div><p>The purpose of this mixed methods study was to assess the validity and functionality of an analytic rating scale for the assessment of interactional competence (IC). The participants were 79 low- to high-proficiency Japanese university students who completed 10-minute small-group discussions. Video recordings of the discussions were assessed by raters using the rating scale. The rater scores were then analyzed using many-facet Rasch measurement (MFRM) which indicated a very good fit to the model. The data were subsequently analyzed using generalizability theory in the form of a G-study and d-study. Those studies showed that the rating scale could be used with fewer raters, therefore increasing practicality without a substantial decrease in reliability. In addition to quantitative data, qualitative data were also collected in the form of interviews with raters and comments they made during assessment. Several raters noted unexpected participant behaviors which were difficult to evaluate using the rating scale, as well as ambiguous language in some category descriptors. The qualitative data provided an invaluable supplement to the quantitative analyses which did not indicate major issues with the rubric. Both forms of data were used to revise the original rating scale and those changes are discussed. This study adds to the limited but growing number of mixed methods studies on IC assessment.</p></div>","PeriodicalId":101075,"journal":{"name":"Research Methods in Applied Linguistics","volume":"3 3","pages":"Article 100144"},"PeriodicalIF":0.0,"publicationDate":"2024-09-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142128901","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Random-item Rasch models and explanatory extensions: A worked example using L2 vocabulary test item responses 随机项目 Rasch 模型和解释性扩展：使用 L2 词汇测试项目回答的工作示例

Research Methods in Applied Linguistics Pub Date : 2024-08-30 DOI: 10.1016/j.rmal.2024.100143

Karen J. Dunn

引用次数: 0

Analyzing metadiscourse in L2 writing for academic purposes: Models and approaches 分析以学术为目的的第二语言写作中的元话语：模式和方法

Research Methods in Applied Linguistics Pub Date : 2024-08-24 DOI: 10.1016/j.rmal.2024.100149

Shuyi Amelia Sun, Feng (Kevin) Jiang

引用次数: 0

Representativeness and metadata presentation in learner/child corpora: Lessons from the GiG and TRAWL corpora 学习者/儿童语料库的代表性和元数据展示：GiG 和 TRAWL 语料库的经验教训

Research Methods in Applied Linguistics Pub Date : 2024-08-23 DOI: 10.1016/j.rmal.2024.100145

Hildegunn Dirdal , Stine H. Johansen , Philip Durrant

引用次数: 0