Research Methods in Applied Linguistics最新文献_第10页

Validating the multi-dimensional structure of self-efficacy beliefs in peer feedback for L2 writing: A bifactor-exploratory structural equation modeling approach 验证第二语言写作同伴反馈中自我效能信念的多维结构：双因素-探索性结构方程建模方法

Research Methods in Applied Linguistics Pub Date : 2024-07-16 DOI: 10.1016/j.rmal.2024.100136

Mark Feng Teng , Lin Sophie Teng

{"title":"Validating the multi-dimensional structure of self-efficacy beliefs in peer feedback for L2 writing: A bifactor-exploratory structural equation modeling approach","authors":"Mark Feng Teng , Lin Sophie Teng","doi":"10.1016/j.rmal.2024.100136","DOIUrl":"10.1016/j.rmal.2024.100136","url":null,"abstract":"<div><p>The present study aims to validate a new scale, i.e., self-efficacy beliefs in peer feedback (SEBPF), using an advanced method of bifactor ESEM. Informed by sociocognitive theory and self-regulated learning, the SEBPF was designed to measure five distinct factors: self-incentives for peer feedback, perceived use of peer feedback, confidence in peer feedback, managing stress in peer feedback, and setting proximal goals for peer feedback. The items for the SEBPF scale were developed by extracting relevant themes from published studies and conducting interviews with a sample of English as a Foreign Language (EFL) student writers in China. This paper provides a comprehensive account of the developing and validating process of the SEBPF scale. Comparisons of confirmatory factor analysis and exploratory factor analysis support the criterion-related validity of a coherent 5-factor structure comprising 22 items, indicating the reliability and multifaceted nature of the SEBPF scale. The findings demonstrate the robustness and practical applicability of the SEBPF scale in assessing EFL writers’ self-efficacy beliefs associated with peer feedback, as well as its predictive effects on different sub-scores of writing performance. This paper is an empirical application of validating a new scale through bifactor ESEM. Implications were proposed based on the findings.</p></div>","PeriodicalId":101075,"journal":{"name":"Research Methods in Applied Linguistics","volume":"3 3","pages":"Article 100136"},"PeriodicalIF":0.0,"publicationDate":"2024-07-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141630073","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Prompt response variation in learner corpus research: Implications for data interpretation 学习者语料库研究中的提示回答变化：对数据解释的影响

Research Methods in Applied Linguistics Pub Date : 2024-07-13 DOI: 10.1016/j.rmal.2024.100134

Claudia H. Sánchez-Gutiérrez , Sophia Minnillo , Paloma Fernández Mira , Andrea Hernández

{"title":"Prompt response variation in learner corpus research: Implications for data interpretation","authors":"Claudia H. Sánchez-Gutiérrez , Sophia Minnillo , Paloma Fernández Mira , Andrea Hernández","doi":"10.1016/j.rmal.2024.100134","DOIUrl":"https://doi.org/10.1016/j.rmal.2024.100134","url":null,"abstract":"<div><p>While general first language corpora are composed of samples from various naturalistic sources (e.g., websites, books), language samples in most written learner corpora (LC) are texts produced in response to prompts. In this context, LC users need to develop a clear awareness of the affordances and limitations of specific prompts and how responses to said prompts may affect the investigation of their intended object(s) of study. Through an analysis of the presence/absence of specific Spanish verb tenses in texts written in response to two supposedly narrative prompts in a Spanish LC (COWS-L2H; Yamada et al., 2020), this article illustrates the impact of inter- and intra-prompt response variation on LC data interpretation. Based on this evidence, we caution against rapid assumptions about text content based solely on the superficial phrasing of LC writing prompts. Instead, we recommend that LC users perform in-depth quantitative and qualitative analyses of learners’ samples written in response to each prompt they aim to include in their study prior to running statistical models on those data.</p></div>","PeriodicalId":101075,"journal":{"name":"Research Methods in Applied Linguistics","volume":"3 3","pages":"Article 100134"},"PeriodicalIF":0.0,"publicationDate":"2024-07-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2772766124000405/pdfft?md5=9ae1dc51ab75db3bd5c43c28ad1a5600&pid=1-s2.0-S2772766124000405-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141607429","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Qualitative online interviews: Voices of applied linguistics researchers 定性在线访谈：应用语言学研究人员的声音

Research Methods in Applied Linguistics Pub Date : 2024-07-09 DOI: 10.1016/j.rmal.2024.100130

Dongni Guo , Roberto L.M. Ramos , Fang Wang

{"title":"Qualitative online interviews: Voices of applied linguistics researchers","authors":"Dongni Guo , Roberto L.M. Ramos , Fang Wang","doi":"10.1016/j.rmal.2024.100130","DOIUrl":"https://doi.org/10.1016/j.rmal.2024.100130","url":null,"abstract":"<div><p>The power, convenience, and efficiency made possible by online communication tools have become increasingly important in qualitative research. The tradition's most central data collection method, interviewing, is in turn rapidly changing shape as these tools are integrated into data collection processes. Drawing from the perspective of interviewing as a social process (Talmy, 2010), as well as the Online Interviewing Ecology framework (Meskill et al., 2024), which includes three main elements—modalities, time, and relationship, this study examines the emerging strategies and characteristics of qualitative online interviewing in applied linguistics. Applying specific selection criteria, we interviewed the interviewer/authors of 6 recent empirical studies in applied linguistics that employed online qualitative interviewing for data collection. Thematic analysis of resulting transcripts in tandem with the authors' published empirical papers provides the basis for rich description of how researchers conceived of and deepened interviews through a dialogic meaning making approach. Findings suggest that online interviewing can be a very productive means for co-constructing meaning between interviewers and interviewees. Participants' responses also helped us to reconceive our initial framework: the interconnected categories of time and modalities serve to support the development of the interviewer-interviewee relationships that more directly shapes the flow and quality of the co-constructed interview discourse.</p></div>","PeriodicalId":101075,"journal":{"name":"Research Methods in Applied Linguistics","volume":"3 3","pages":"Article 100130"},"PeriodicalIF":0.0,"publicationDate":"2024-07-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2772766124000363/pdfft?md5=2ded9776928e6784aeaebe233c72e703&pid=1-s2.0-S2772766124000363-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141594197","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Implementing discourse-gating tasks to study the timing of speech act recognition 实施话语门控任务，研究言语行为识别的时间安排

Research Methods in Applied Linguistics Pub Date : 2024-07-03 DOI: 10.1016/j.rmal.2024.100122

Kathleen Bardovi-Harlig , Yunwen Su

{"title":"Implementing discourse-gating tasks to study the timing of speech act recognition","authors":"Kathleen Bardovi-Harlig , Yunwen Su","doi":"10.1016/j.rmal.2024.100122","DOIUrl":"https://doi.org/10.1016/j.rmal.2024.100122","url":null,"abstract":"<div><p>This paper presents the development of two novel discourse-gating tasks to investigate the processing of pragmatic information, namely, the timing of the recognition of genuine (sincere) and ostensible (transparently insincere) refusals in Chinese and provides preliminary validity evidence for the tasks. Gating tasks were introduced to investigate spoken word recognition and have been successfully extended to spoken language processing, most notably sentences. Following Grosjean's (1996) observation that gating tasks could be used to investigate a variety of linguistic features, we extended the gating tasks to spoken discourse using turns as gates. The open-prediction gating task allows participants to make a single prediction about the outcome of each of 12 recorded conversations as soon as they can. The fixed-prediction gating task asks participants to make predictions at regular intervals while listening to a second set of 12 conversations. One hundred and seven participants (60 L1 speakers and 47 third- and fourth-year learners of Chinese) were recruited to test the tasks. The tasks reveal a lag in speech-act identification not found when retrospective speech-act identification tasks are used. The fixed-prediction task additionally reveals alternatives that are considered during processing. The paper discusses the benefits of the discourse gating tasks and the merits of each, the quantitative and qualitative evidence for the tasks, and future directions for discourse gating tasks.</p></div>","PeriodicalId":101075,"journal":{"name":"Research Methods in Applied Linguistics","volume":"3 3","pages":"Article 100122"},"PeriodicalIF":0.0,"publicationDate":"2024-07-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141541612","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Accuracy scoring of elicited imitation: A tutorial of automating speech data with commercial NLP support 诱导模仿的准确性评分：利用商业 NLP 支持实现语音数据自动化教程

Research Methods in Applied Linguistics Pub Date : 2024-07-02 DOI: 10.1016/j.rmal.2024.100127

Kathy Minhye Kim , Xiaobin Chen , Xiaoyi Liu

引用次数: 0

Coding all clauses in L2 data: A call for consistency 对 L2 数据中的所有条款进行编码：呼吁一致性

Research Methods in Applied Linguistics Pub Date : 2024-06-28 DOI: 10.1016/j.rmal.2024.100132

MaryLou Vercellotti , Sean Hall

{"title":"Coding all clauses in L2 data: A call for consistency","authors":"MaryLou Vercellotti , Sean Hall","doi":"10.1016/j.rmal.2024.100132","DOIUrl":"https://doi.org/10.1016/j.rmal.2024.100132","url":null,"abstract":"<div><p>Linguistic complexity is considered a hallmark of language proficiency (Norris & Ortega, 2009), and it is often a focus of second language (L2) research (Pallotti, 2015). Within the construct of complexity, syntactic complexity considers the combination of words and clauses. The term <em>clause</em>, however, is underspecified in the field, and L2 researchers only occasionally define how <em>clause</em> is operationalized in the coding. After a review of the importance of consistent clause coding, this commentary argues that coordinated verb phrases, nonfinite clauses, and verbal small clauses can reach the complexity of finite clauses by the production of another element, making these constructions commensurate with subordinate finite clauses. Since these constructions are structurally similar to accepted clauses (e.g., imperatives), their exclusion from the clausal complexity calculation threatens the validity and reliability of the coding. Because a narrow definition requires an arbitrary division along a continuum of complex verbal constructions, the field should adopt this broader definition of <em>clause</em>. Further, researchers should clarify their methodology choices and acknowledge coding challenges, which are common in L2 data, especially L2 speech data. The increased transparency in research methodology supports the interpretation of research results and facilitates comparisons across L2 studies.</p></div>","PeriodicalId":101075,"journal":{"name":"Research Methods in Applied Linguistics","volume":"3 3","pages":"Article 100132"},"PeriodicalIF":0.0,"publicationDate":"2024-06-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2772766124000387/pdfft?md5=667b85078cff314d57b7f33f6518ba46&pid=1-s2.0-S2772766124000387-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141480781","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

An application of many-facet Rasch measurement to evaluate automated essay scoring: A case of ChatGPT-4.0 应用多面 Rasch 测量法评估自动作文评分：以 ChatGPT-4.0 为例

Research Methods in Applied Linguistics Pub Date : 2024-06-27 DOI: 10.1016/j.rmal.2024.100133

Taichi Yamashita

{"title":"An application of many-facet Rasch measurement to evaluate automated essay scoring: A case of ChatGPT-4.0","authors":"Taichi Yamashita","doi":"10.1016/j.rmal.2024.100133","DOIUrl":"https://doi.org/10.1016/j.rmal.2024.100133","url":null,"abstract":"<div><p>Automated essay scoring (AES) has the great potential to reduce human raters’ workload while providing feedback for language learners. Given that scores from AES tools can impact stakeholders’ decision-making, independent researchers’ evaluation is essential. For this purpose, AES tools have been evaluated primarily in terms of their alignment with human raters by the use of correlation and agreement indices. The present study aimed to showcase the potential of many-facet Rasch measurement (MFRM) as another approach to evaluate ChatGPT-4.0 as an AES tool. Capitalizing on the International Corpus Network of Asian Learners of English (ICNALE), the study used 80 human raters’ ratings for 136 argumentative essays written by English language learners in Asian regions. Additional data were collected by asking ChatGPT-4.0 to assign scores for the 136 essays. It was found that ChatGPT-4.0 distinguished essays written by three proficiency groups on the CEFR scale recorded in the ICNALE as human raters did. Correlations between human raters’ ratings and ChatGPT-4.0′s ratings were moderate to strong (<em>r</em> = 0.67–.82), and only half of their ratings were identical. Furthermore, ChatGPT-4.0′s severity level was comparable with human raters’, and ChatGPT-4.0′s ratings were extremely consistent within itself, rendering it difficult to tease apart variance in its ratings from the measurement perspective. Neither human raters nor ChatGPT-4.0 exercised significant biases towards writers’ gender. These findings indicate the potential of ChatGPT-4.0 as an AES tool while highlighting the benefits of MFRM as an approach that complements correlation and agreement indices.</p></div>","PeriodicalId":101075,"journal":{"name":"Research Methods in Applied Linguistics","volume":"3 3","pages":"Article 100133"},"PeriodicalIF":0.0,"publicationDate":"2024-06-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141486423","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

“I feel my inner child out”: Zine-making as a data collection tool in narrative inquiry "我感受到自己内心的童真"：将制作 Zine 作为叙事探究中的数据收集工具

Research Methods in Applied Linguistics Pub Date : 2024-06-18 DOI: 10.1016/j.rmal.2024.100131

Meifang Zhuo

{"title":"“I feel my inner child out”: Zine-making as a data collection tool in narrative inquiry","authors":"Meifang Zhuo","doi":"10.1016/j.rmal.2024.100131","DOIUrl":"https://doi.org/10.1016/j.rmal.2024.100131","url":null,"abstract":"<div><p>This article attempts to answer two current calls in applied linguistics, including a specific call for more methodological investment in narrative inquiry (Barkhuizen & Consoli, 2021) and a general call for methodological innovation in all areas of applied linguistics (Li et al., 2023; Li & Prior, 2022). This article proposes zine-making as a fun, creative, ethical, and empowering data collection method in narrative inquiry (NI) in applied linguistics. Following a literature review of NI, zines and zine-making, I delineate the theoretical links between zine-making and NI in applied linguistics. I then demonstrate how zine-making was used to elicit individuals’ life stories by reflecting on my experiences. An illustration of a sample of the findings from the zine-making data in NI is presented, along with a discussion of the strengths and limitations of zine-making from participants’ perspectives. The article concludes with implications of zine-making as a methodological innovation in NI. Readers of this article will understand the basics of using zine-making for data collection in NI while being aware of and prepared for its limitations.</p></div>","PeriodicalId":101075,"journal":{"name":"Research Methods in Applied Linguistics","volume":"3 3","pages":"Article 100131"},"PeriodicalIF":0.0,"publicationDate":"2024-06-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2772766124000375/pdfft?md5=c2883a0ef86a8f68582e92a7fb881481&pid=1-s2.0-S2772766124000375-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141423639","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Validating a new method for assessing young foreign language learners’ metacognitive knowledge 验证评估年轻外语学习者元认知知识的新方法

Research Methods in Applied Linguistics Pub Date : 2024-06-07 DOI: 10.1016/j.rmal.2024.100121

Mark Feng Teng , Lawrence Jun Zhang

{"title":"Validating a new method for assessing young foreign language learners’ metacognitive knowledge","authors":"Mark Feng Teng , Lawrence Jun Zhang","doi":"10.1016/j.rmal.2024.100121","DOIUrl":"https://doi.org/10.1016/j.rmal.2024.100121","url":null,"abstract":"<div><p>Assessing young foreign language learners’ metacognitive knowledge presents challenges, especially in data collection. The need to understand young learners’ metacognitive knowledge underscores the importance of developing and validating an effective assessment method. The present study aimed to validate a new method for assessing young foreign language learners’ metacognitive knowledge. By analyzing children's verbal explanations, we gained insights into their understanding of cognitive processes. The findings revealed that, by the third grade, children developed a foundational level of metacognitive knowledge, including awareness of strategies that could impact their cognitive activities in language learning. Notably, the study uncovered variations in the children's metacognitive thinking, particularly in how they processed information related to memory, learning, and comprehension. The three aspects—memory, learning, and comprehension—were found to be significantly interconnected, suggesting that they collectively contributed to a broader metacognitive knowledge framework. This method of assessing metacognitive knowledge in young EFL learners carries significant implications for foreign language education, highlighting the importance of nurturing children's metacognitive awareness from an early age to enhance foreign language learning.</p></div>","PeriodicalId":101075,"journal":{"name":"Research Methods in Applied Linguistics","volume":"3 2","pages":"Article 100121"},"PeriodicalIF":0.0,"publicationDate":"2024-06-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S2772766124000272/pdfft?md5=7edda40ef698ed63030f13885f3b83bb&pid=1-s2.0-S2772766124000272-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141286331","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Leveraging multimodal visualization reflections for L2 writing research 利用多模态可视化反思开展中级写作研究

Research Methods in Applied Linguistics Pub Date : 2024-06-07 DOI: 10.1016/j.rmal.2024.100126

Matt Kessler

{"title":"Leveraging multimodal visualization reflections for L2 writing research","authors":"Matt Kessler","doi":"10.1016/j.rmal.2024.100126","DOIUrl":"https://doi.org/10.1016/j.rmal.2024.100126","url":null,"abstract":"<div><p>This paper introduces readers to the use of multimodal visualization reflections (MVRs) in applied linguistics research, with special attention paid to its applications for researching various topics within second language (L2) writing. MVRs are a method of data elicitation, in which participants are asked to illustrate something (either in print or digitally) as a means of visualizing a process, an idea, and/or their current knowledge state on a given topic. Participants are then typically asked to describe what their visualization represents, including all parts of their illustration. Although MVRs have been used in a handful of L2 writing studies, their full potential has yet to be realized. Thus, this paper advocates for their use in future studies. The paper opens with a review of the concept of multimodality and its place within contemporary applied linguistics scholarship. Next, discussed is the theoretical support behind leveraging MVRs. Example studies are then outlined, showcasing how MVRs have been leveraged by previous researchers when investigating different phenomena (e.g., L2 learners’ genre awareness, identities, ideologies, and issues involving language testing). The article closes with a discussion of future research directions covering how L2 writing scholars might adopt MVRs in future studies.</p></div>","PeriodicalId":101075,"journal":{"name":"Research Methods in Applied Linguistics","volume":"3 3","pages":"Article 100126"},"PeriodicalIF":0.0,"publicationDate":"2024-06-07","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141291352","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0