Assessing Writing最新文献_第10页

The effects of task complexity and language aptitude on EFL learners’ writing performance 任务复杂性和语言能力对英语学习者写作表现的影响

IF 3.9 1区文学

Assessing Writing Pub Date : 2023-10-01 DOI: 10.1016/j.asw.2023.100791

Chun-yan Liu , Li-ting Sun , Yan He , Nian-zhe Wu

{"title":"The effects of task complexity and language aptitude on EFL learners’ writing performance","authors":"Chun-yan Liu , Li-ting Sun , Yan He , Nian-zhe Wu","doi":"10.1016/j.asw.2023.100791","DOIUrl":"https://doi.org/10.1016/j.asw.2023.100791","url":null,"abstract":"<div><p>The present study investigated the effects of task complexity and language aptitude on upper-intermediate EFL learners’ argumentative writing performance in terms of syntactic complexity, lexical complexity, accuracy and fluency. The findings of this study demonstrated that increasing task complexity manipulated by the number of elements and the degree of reasoning along the resource-directing dimension leads to enhancement of syntactic complexity and lexical diversity, and there are low correlations between language aptitude (mainly number learning and spelling clues) and writing performance. What’s more, task complexity and language aptitude (and its components) are predictors for writing performance in terms of intraclausal level of syntactic complexity, lexical diversity and fluency. These findings lend partial support to the Cognition hypothesis and Aptitude Complexes Hypothesis in L2 writing. Theoretical, methodological, and pedagogical implications of the study for task design and implementation as well as for task-based assessment in language education programs are discussed.</p></div>","PeriodicalId":46865,"journal":{"name":"Assessing Writing","volume":"58 ","pages":"Article 100791"},"PeriodicalIF":3.9,"publicationDate":"2023-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"92045169","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Profiling support in literacy development: Use of natural language processing to identify learning needs in higher education 对读写能力发展的分析支持:利用自然语言处理来识别高等教育中的学习需求

IF 3.9 1区文学

Assessing Writing Pub Date : 2023-10-01 DOI: 10.1016/j.asw.2023.100787

Patricio A. Pino Castillo , Christian Soto , Rodrigo A. Asún , Fernando Gutiérrez

{"title":"Profiling support in literacy development: Use of natural language processing to identify learning needs in higher education","authors":"Patricio A. Pino Castillo , Christian Soto , Rodrigo A. Asún , Fernando Gutiérrez","doi":"10.1016/j.asw.2023.100787","DOIUrl":"https://doi.org/10.1016/j.asw.2023.100787","url":null,"abstract":"<div><p>Reading and writing are core activities in higher education, by means of which students learn to participate in specialized discourses. Although there is consensus on the conceptualization of reading comprehension, its measurement, and development, the same is not true for written expression. Writing complexity has been found to improve with schooling, but there are ample differences between literacy practices at school and at the university that require extra attention in diagnosing students’ compositions. The present study set out to test a natural language processing<span> tool to build domain profiles of writing complexity in first-year university students at a private university. The processing of texts resulted in 49 indices which, after exploratory factor analysis and theoretical discussion, gave rise to 4 dimensions of complexity explaining 52.3% of variance: lexical richness, syntactic complexity, informative text structure and specialized language use. Significant differences were found between more and less skilled writers in the aggregated scores, lexical richness, and syntactic complexity. Interestingly, novice and expert writers did not differ significantly in more over-arching aspects of writing. We discuss how this technology can help identify students’ needs in more superficial aspects of writing complexity that have been shown to improve by means of different strategies.</span></p></div>","PeriodicalId":46865,"journal":{"name":"Assessing Writing","volume":"58 ","pages":"Article 100787"},"PeriodicalIF":3.9,"publicationDate":"2023-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"49739939","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 1

Insights from lexical and syntactic analyses of a French for academic purposes assessment 对一篇学术法语评价的词法和句法分析

IF 3.9 1区文学

Assessing Writing Pub Date : 2023-10-01 DOI: 10.1016/j.asw.2023.100789

Randy Appel , Angel Arias , Beverly Baker , Guillaume Loignon

{"title":"Insights from lexical and syntactic analyses of a French for academic purposes assessment","authors":"Randy Appel , Angel Arias , Beverly Baker , Guillaume Loignon","doi":"10.1016/j.asw.2023.100789","DOIUrl":"https://doi.org/10.1016/j.asw.2023.100789","url":null,"abstract":"<div><p>With the objective of improving writing assessment of language instruction, we examine the lexical and syntactic features in two corpora of high and low scoring French texts of the <em>Test du Certificat de Compétence en Langue Seconde</em> (Second Language Certification Test; TCCLS) at the University of Ottawa (uOttawa). We first situate the test in its local context, demonstrating how our research objectives are born from specific needs to improve student outcomes. We then describe our creation of two corpora of high and low performing test takers, followed by lexical bundle (LB) analyses (Phase 1) and further linguistic complexity analyses with a French-language tool (Phase 2). Results indicate that high level writers used more LBs and borrowed more text from the prompt than low level writers. In addition, specific elements of linguistic complexity were identified, suggesting high level writers produced texts that were lexically richer and more syntactically advanced. We discuss the importance of these findings in improving our writing instruction, as well as the challenges of adapting tools and approaches traditionally associated with English to French.</p></div>","PeriodicalId":46865,"journal":{"name":"Assessing Writing","volume":"58 ","pages":"Article 100789"},"PeriodicalIF":3.9,"publicationDate":"2023-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"49740284","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Student engagement with peer feedback in L2 writing: Insights from reflective journaling and revising practices 二语写作中学生与同伴反馈的互动：反思性日记和复习实践的启示

IF 3.9 1区文学

Assessing Writing Pub Date : 2023-10-01 DOI: 10.1016/j.asw.2023.100784

Zhe (Victor) Zhang , Ken Hyland

{"title":"Student engagement with peer feedback in L2 writing: Insights from reflective journaling and revising practices","authors":"Zhe (Victor) Zhang , Ken Hyland","doi":"10.1016/j.asw.2023.100784","DOIUrl":"https://doi.org/10.1016/j.asw.2023.100784","url":null,"abstract":"<div><p>The torrent of research into peer feedback in academic writing in recent years has largely overlooked student revision process – how individual students engage with this feedback to revise their texts and why certain changes are made in their texts. In other words, the cognitive dimension of student engagement with peer feedback in revision is little known. Drawing on multiple student drafts, peer feedback on these drafts, reflective journals and interviews with students, this study examines how two L2 students engage with peer feedback to conduct revisions. We found that the two participants differed considerably in their revision processes and identified two patterns of engagement: deep engagement, characterized by self-regulated revising practices, and surface engagement, concerned with other-regulated revision operations. We were not only interested in students’ revision operations in their drafts, but also their reflective practices in their reflective journals that their teacher had assigned. The study suggests that effective student engagement with peer feedback largely depends on how they make use of cognitive and metacognitive strategies in the revision process. The study recommends that teachers seek to provide instructional scaffolding to facilitate student cognitive engagement with peer feedback on L2 writing.</p></div>","PeriodicalId":46865,"journal":{"name":"Assessing Writing","volume":"58 ","pages":"Article 100784"},"PeriodicalIF":3.9,"publicationDate":"2023-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"49763019","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Understanding EFL students’ feedback literacy development in academic writing: A longitudinal case study 理解EFL学生在学术写作中的反馈素养发展：一个纵向案例研究

IF 3.9 1区文学

Assessing Writing Pub Date : 2023-10-01 DOI: 10.1016/j.asw.2023.100770

Fuhui Zhang , Hui-Tzu Min , Ping He , Sisi Chen , Shan Ren

{"title":"Understanding EFL students’ feedback literacy development in academic writing: A longitudinal case study","authors":"Fuhui Zhang , Hui-Tzu Min , Ping He , Sisi Chen , Shan Ren","doi":"10.1016/j.asw.2023.100770","DOIUrl":"https://doi.org/10.1016/j.asw.2023.100770","url":null,"abstract":"<div><p>Although many studies have elaborated the nature and importance of feedback literacy, a longitudinal approach to delving into the development of EFL students’ feedback literacy is scarce. Informed by an evidence-based framework of feedback literacy improvement in the context of academic writing (<span>Yu & Liu, 2021</span>), the study explored the development of feedback literacy of three first-year students who studied English as a Foreign Language (EFL) in understanding, evaluating, reflecting on, and using peer feedback and their emotional responses during a semester-long online writing program. By analyzing students’ voiced peer feedback, written drafts, immediate reflections after peer feedback, monthly reflection journals, end-of-term stimulated recalls and interviews, we found positive changes in their cognitive, behavioral, and emotional capacities in response to peer feedback, and increasing improvement in students’ assessment criteria knowledge through self-reflections after peer feedback, incorporation of peer feedback and reflections into revision. However, students did not develop at the same pace due to personal factors. Variations in students’ reflections and proactive actions were found in relation to the development of feedback literacy evidenced in their revision improvement. Implications for pedagogical facilitation of peer feedback literacy and use of peer feedback in revision in academic writing are discussed.</p></div>","PeriodicalId":46865,"journal":{"name":"Assessing Writing","volume":"58 ","pages":"Article 100770"},"PeriodicalIF":3.9,"publicationDate":"2023-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"49763022","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 1

Feedback literacy in writing research and teaching: Advancing L2 WCF research agendas 写作研究与教学中的反馈素养:推进第二语言WCF研究议程

IF 3.9 1区文学

Assessing Writing Pub Date : 2023-10-01 DOI: 10.1016/j.asw.2023.100786

Jill A. Boggs , Rosa M. Manchón

{"title":"Feedback literacy in writing research and teaching: Advancing L2 WCF research agendas","authors":"Jill A. Boggs , Rosa M. Manchón","doi":"10.1016/j.asw.2023.100786","DOIUrl":"https://doi.org/10.1016/j.asw.2023.100786","url":null,"abstract":"<div><p>Research on corrective feedback (CF) has developed from its original focus on identifying which type of CF is most effective for developing L2 language learners’ grammatical accuracy to focusing on how learners use CF. Underpinning this is the assumption that learners know what to do with CF when they receive it. The concept of “feedback literacy” challenges this assumption. Carless and Boud (2018), define feedback literacy as “the understandings, capacities and dispositions needed to make sense of information and use it to enhance work or learning strategies” (p. 1316). Our intention in this paper is to reflect on the manner in which theoretical and empirical work on feedback literacy can contribute to advancing L2 written corrective feedback (WCF) research agendas. Central in our proposal is the partially under-researched aspect of <em>experience</em> in terms of the L2 writers’ educational background experience, particularly experience with L1 and L2 writing. We further argue that how learners were taught L1 writing and how the L1 educational culture/ society values writing can impact on how learners approach L2 writing tasks and accompanying feedback. Implications of this inclusive view of the learner for future research and pedagogy is discussed.</p></div>","PeriodicalId":46865,"journal":{"name":"Assessing Writing","volume":"58 ","pages":"Article 100786"},"PeriodicalIF":3.9,"publicationDate":"2023-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"49740243","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Assessing Korean writing ability through a scenario-based assessment approach 通过情景评估法评估韩国语的写作能力

IF 3.9 1区文学

Assessing Writing Pub Date : 2023-10-01 DOI: 10.1016/j.asw.2023.100766

Soo Hyoung Joo , Yuna Seong , Joowon Suh , Ji-Young Jung , James E. Purpura

{"title":"Assessing Korean writing ability through a scenario-based assessment approach","authors":"Soo Hyoung Joo , Yuna Seong , Joowon Suh , Ji-Young Jung , James E. Purpura","doi":"10.1016/j.asw.2023.100766","DOIUrl":"https://doi.org/10.1016/j.asw.2023.100766","url":null,"abstract":"<div><p>Advocating for measuring a broadened construct of writing ability, scenario-based assessment (SBA) has recently been used to assess writing ability. While SBA for writing has been explored in ESL contexts (e.g., Banerjee, 2019; Purpura, 2021), it has been rarely used or examined in the context of languages other than English, especially those that are typologically distant from English, such as Korean. This study explores the feasibility of designing a scenario-based Korean writing assessment (K-SBA). A pilot study was conducted with 51 participants from a Korean as a foreign language program at a US university. Through a goal-oriented scenario of a study abroad program in South Korea, examinees were presented with a collaborative problem-solving task where they were expected to learn about two potential class trip destinations and write a summary of the pros and cons of each destination based on what they learned. The results indicated that the K-SBA was psychometrically sound, providing adequate evidence of reliability. It elicited construct-relevant performances reflecting features unique to the Korean language, such as sociolinguistic competence through the use of honorifics or rhetorical control through a range of cohesive devices. Additionally, variations in examinee performances were observed across the different course levels.</p></div>","PeriodicalId":46865,"journal":{"name":"Assessing Writing","volume":"58 ","pages":"Article 100766"},"PeriodicalIF":3.9,"publicationDate":"2023-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"49740281","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Developments in learners’ affective engagement with written peer feedback: The affordances of in situ translanguaging 同伴书面反馈对学习者情感参与的发展：原位迁移的可供性

IF 3.9 1区文学

Assessing Writing Pub Date : 2023-10-01 DOI: 10.1016/j.asw.2023.100788

Hooman Saeli , Payam Rahmati

{"title":"Developments in learners’ affective engagement with written peer feedback: The affordances of in situ translanguaging","authors":"Hooman Saeli , Payam Rahmati","doi":"10.1016/j.asw.2023.100788","DOIUrl":"https://doi.org/10.1016/j.asw.2023.100788","url":null,"abstract":"<div><p>The literature on peer feedback has yet to investigate the effects of translanguaging on learners’ affective engagement with feedback. Therefore, this case study 1) explored the affordances of translanguaging between two English learners in Iran, and 2) investigated any developments in these learners’ affective engagement with peer feedback mediated by translanguaging. The analysis of eight samples of student writing with peer feedback, stimulated recalls, and reflection journals showed that translanguaging mediated the learners’ affective engagement with peer feedback. Using their first language, Persian, helped improve their affective engagement with peer feedback on content-related issues. As shown by a sociocultural theory-motivated analysis, the learners’ affective engagement with peer feedback was nonlinear, dynamic, and evolving over the course of six weeks. Indeed, the participants deemed Persian as an effective tool in providing meta-feedback on content-related, and at times, grammar issues, thus leading to more positive affective engagement with peer feedback. We think that teachers should consider allowing their students to use their first language during the process of peer feedback to enhance their affective engagement with peer feedback.</p></div>","PeriodicalId":46865,"journal":{"name":"Assessing Writing","volume":"58 ","pages":"Article 100788"},"PeriodicalIF":3.9,"publicationDate":"2023-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"49763014","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Chinese character matters!: An examination of linguistic accuracy in writing performances on the HSK test 汉字很重要！：HSK考试中语言准确性的考察

IF 3.9 1区文学

Assessing Writing Pub Date : 2023-07-01 DOI: 10.1016/j.asw.2023.100767

Xun Yan , Jiani Lin

{"title":"Chinese character matters!: An examination of linguistic accuracy in writing performances on the HSK test","authors":"Xun Yan , Jiani Lin","doi":"10.1016/j.asw.2023.100767","DOIUrl":"https://doi.org/10.1016/j.asw.2023.100767","url":null,"abstract":"<div><p>The orthographic and morphological system of Mandarin Chinese requires more time and developmental stages for learners to acquire. This source of difficulty might present unique challenges and opportunities for writing assessment for Chinese as a Second Language (CSL). This study employed a corpus-based approach to examine the accuracy features of 10,750 essays written by test-takers from 17 first language (L1) backgrounds on the HSK test. Based on both orthographic types and economic-geopolitical factors, we classified test-taker L1s into 3 groups. We first factor-analyzed a comprehensive array of error types to identify the underlying dimensions of Chinese writing accuracy. Then, dimension scores were included in regression models to predict HSK writing scores for different L1 groups. The results revealed five dimensions related to syntactic, morphological, and lexical errors. Among them, dimensions on character and word-level errors were stronger predictors of HSK scores, although the discrimination power was stronger for test-takers from L1s that are orthographically dissimilar and economic-geopolitically distant from Mandarin Chinese. These findings suggest that Chinese morphology (i.e., the acquisition of characters and how characters form words) constitutes a unique source of difficulty for L2 learners. We argue that morphological elements should be an important subconstruct in Chinese writing assessments. (200 words)</p></div>","PeriodicalId":46865,"journal":{"name":"Assessing Writing","volume":"57 ","pages":"Article 100767"},"PeriodicalIF":3.9,"publicationDate":"2023-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"49817983","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Resiliency and vulnerability in early grades writing performance during the COVID-19 pandemic 2019冠状病毒病大流行期间初中生写作表现的弹性和脆弱性

IF 3.9 1区文学

Assessing Writing Pub Date : 2023-07-01 DOI: 10.1016/j.asw.2023.100741

Deborah K. Reed , Jing Ma , Hope K. Gerde

{"title":"Resiliency and vulnerability in early grades writing performance during the COVID-19 pandemic","authors":"Deborah K. Reed , Jing Ma , Hope K. Gerde","doi":"10.1016/j.asw.2023.100741","DOIUrl":"10.1016/j.asw.2023.100741","url":null,"abstract":"<div><p>To explore potential pandemic-related learning gaps on expressive writing skills, predominantly Hispanic (≈50%) and White (≈30%) primary-grade students responded to grade-specific writing prompts in the fall semesters before and after school closures. Responses were evaluated with an analytic rubric consisting of five traits (focus, organization, development, grammar, mechanics), each scored on a 1–4 scale. Data first were analyzed descriptively and, after propensity score weighting, with ordinal response models (for analytic scores) and generalized linear mixed effects models (for composite scores). Compared to first graders in 2019 (<em>n</em> = 310), those in 2020 (<em>n</em> = 203) scored significantly lower overall as well as on all rubric criteria and were more likely to write unintelligible responses. Second graders in 2020 (<em>n</em> = 194) performed significantly lower than those in 2019 (<em>n</em> = 328) in some traits but not all, and there was a widening gap between students who did/not score proficiently. A three-level longitudinal model analyzing the sample of students moving from first to second grade in fall 2020 (<em>n</em> = 90) revealed significant improvements, but students still performed significantly lower than second graders in the previous year. Implications for student resiliency and instructional planning are discussed.</p></div>","PeriodicalId":46865,"journal":{"name":"Assessing Writing","volume":"57 ","pages":"Article 100741"},"PeriodicalIF":3.9,"publicationDate":"2023-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10196154/pdf/","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"9537914","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0