Assessing Writing最新文献

Trinka: Facilitating academic writing through an intelligent writing evaluation system Trinka：通过智能写作评估系统促进学术写作

IF 4.2 1区文学

Assessing Writing Pub Date : 2025-05-28 DOI: 10.1016/j.asw.2025.100953

Jessie S. Barrot

引用次数: 0

Using ChatGPT to facilitate vocabulary learning in continuation writing assessment tasks 在继续写作评估任务中使用ChatGPT促进词汇学习

IF 4.2 1区文学

Assessing Writing Pub Date : 2025-05-28 DOI: 10.1016/j.asw.2025.100952

Fengkai Liu , Xiaofei Lu , Tan Jin

引用次数: 0

Making things happen: A study of grammatical metaphors in L2 writing scripts 让事情发生：二语写作脚本的语法隐喻研究

IF 4.2 1区文学

Assessing Writing Pub Date : 2025-05-12 DOI: 10.1016/j.asw.2025.100939

Nicholas Glasson, Andrew Kitney

引用次数: 0

Promoting cognitive engagement with peer feedback through peer review training: The case of Chinese tertiary-level EFL learners 通过同伴评议培训促进认知参与：以中国大专英语学习者为例

IF 4.2 1区文学

Assessing Writing Pub Date : 2025-05-08 DOI: 10.1016/j.asw.2025.100947

Jia He , Jun Xia , Chun-mei Zhang , Jian-nan Liu

{"title":"Promoting cognitive engagement with peer feedback through peer review training: The case of Chinese tertiary-level EFL learners","authors":"Jia He , Jun Xia , Chun-mei Zhang , Jian-nan Liu","doi":"10.1016/j.asw.2025.100947","DOIUrl":"10.1016/j.asw.2025.100947","url":null,"abstract":"<div><div>Peer review training is reported as an important scaffolding for students’ peer review practices in second language (L2) writing research, yet its effect on L2 learners’ cognitive engagement with peer feedback requires further exploration. This study examined the impact of ongoing peer review training on 45 Chinese EFL undergraduates’ cognitive engagement in peer reviews at a 12-week English public speaking and writing course. Drawing on multiple data, including reflective journals, written peer feedback and semi-structured retrospective interviews, this mixed-methods study found that students developed an enhanced awareness of deeper-level, content-related writing problems and peer feedback after receiving peer review training. However, understanding peer feedback occurred later than noticing writing problems. The employment of cognitive and meta-cognitive strategies varied throughout the training sessions, with initial emphasis on analyzing, evaluating, monitoring, and reflecting, and later collective incorporation of comparing and integrating. The quality of post-training written peer feedback also triangulated the enhancement of cognitive engagement. These findings extend previous research that students had deeper cognitive feedback engagement over time, by unveiling asynchronous awareness and evolving cognitive and meta-cognitive operations, and indicated the critical role of language teachers in promoting students’ cognitive engagement in peer reviews in the EFL context.</div></div>","PeriodicalId":46865,"journal":{"name":"Assessing Writing","volume":"65 ","pages":"Article 100947"},"PeriodicalIF":4.2,"publicationDate":"2025-05-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143918349","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Toward the fair and valid use of curriculum-based measurement for students with intensive writing needs and linguistically diverse backgrounds 为具有强烈写作需求和不同语言背景的学生公平有效地使用基于课程的测量方法

IF 4.2 1区文学

Assessing Writing Pub Date : 2025-05-06 DOI: 10.1016/j.asw.2025.100948

Seohyeon Choi, Kristen L. McMaster, Nana Kim

{"title":"Toward the fair and valid use of curriculum-based measurement for students with intensive writing needs and linguistically diverse backgrounds","authors":"Seohyeon Choi, Kristen L. McMaster, Nana Kim","doi":"10.1016/j.asw.2025.100948","DOIUrl":"10.1016/j.asw.2025.100948","url":null,"abstract":"<div><div>Curriculum-based measurement (CBM) is a valuable method for assessing students with intensive learning needs, including writing. However, research on English writing CBMs has paid insufficient attention to linguistic diversity, especially among young or beginning writers, raising questions about the validity of CBMs in evaluating multilingual students’ early writing development in English. The purpose of this study was to evaluate the measurement invariance of Word Dictation, a CBM writing task measuring English transcription skills at the word level, across multilingual and English-monolingual students with intensive writing needs in the U.S. Using data from 349 students, primarily in Grades 1–3, we evaluated measurement invariance at both item and assessment levels. Using different scoring metrics and various analytical methods, results revealed a few items as potentially displaying differential item functioning. Results also showed that, at the assessment level, Word Dictation did not function differently across the two student groups. The findings provide important evidence supporting the measure’s validity, fairness, and its CBM Stage 1 technical adequacy. We discuss the limitations of the study, along with future research directions and implications for educators using Word Dictation to serve linguistically diverse students requiring intensive support in developing English writing skills.</div></div>","PeriodicalId":46865,"journal":{"name":"Assessing Writing","volume":"65 ","pages":"Article 100948"},"PeriodicalIF":4.2,"publicationDate":"2025-05-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143912603","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Unveiling the precursors of negative emotions in second language writing through control-value theory: An explanatory sequential design approach 通过控制价值理论揭示第二语言写作中负面情绪的前兆：一个解释性顺序设计方法

IF 4.2 1区文学

Assessing Writing Pub Date : 2025-05-05 DOI: 10.1016/j.asw.2025.100949

Haijing Zhang , Fangwei Huang

{"title":"Unveiling the precursors of negative emotions in second language writing through control-value theory: An explanatory sequential design approach","authors":"Haijing Zhang , Fangwei Huang","doi":"10.1016/j.asw.2025.100949","DOIUrl":"10.1016/j.asw.2025.100949","url":null,"abstract":"<div><div>With the emergence of the psychological focus on second language acquisition, research on second language (L2) writing has gradually transitioned to a comprehensive exploration of the writing process. However, few studies have explored the potential trigger mechanism of negative emotions in L2 writing, especially in learning Chinese as a second language (CSL). To fill this gap, the explanatory sequential design was employed to investigate the relationships among CSL learners’ writing self-efficacy, perceived writing task value, writing anger, and writing boredom based on the control-value theory. The quantitative results illustrate that 1) writing self-efficacy positively predicts perceived writing task value, writing anger, and writing boredom; 2) perceived writing task value negatively predicts writing anger and writing boredom; and 3) perceived writing task value mediates the relationship between writing self-efficacy and writing anger/boredom. The qualitative results add insight to the L2 writing process, revealing that 1) writing self-efficacy exhibited dialectical tension during the writing process; 2) perceived writing task value illustrated contextual immediacy in L2 writing; and 3) writing anger/boredom demonstrated dynamism throughout the procedure of completing the L2 writing task. These results extend the application scope and deepen the theoretical understanding of control-value theory, offering significant pedagogical implications for L2 education.</div></div>","PeriodicalId":46865,"journal":{"name":"Assessing Writing","volume":"65 ","pages":"Article 100949"},"PeriodicalIF":4.2,"publicationDate":"2025-05-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143906760","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

The impact of self-revision, machine translation, and ChatGPT on L2 writing: Raters’ assessments, linguistic complexity, and error correction 自我修改、机器翻译和聊天翻译对第二语言写作的影响：评分者的评估、语言复杂性和错误纠正

IF 4.2 1区文学

Assessing Writing Pub Date : 2025-05-01 DOI: 10.1016/j.asw.2025.100950

Minjoo Kim , Yuah V. Chon

{"title":"The impact of self-revision, machine translation, and ChatGPT on L2 writing: Raters’ assessments, linguistic complexity, and error correction","authors":"Minjoo Kim , Yuah V. Chon","doi":"10.1016/j.asw.2025.100950","DOIUrl":"10.1016/j.asw.2025.100950","url":null,"abstract":"<div><div>This study explores how learners in a South Korean high school English as a Foreign Language (EFL) context can effectively use neural machine translation (MT) and ChatGPT to enhance their L2 writing. While recent AI tools offer significant potential for supporting human writing feedback, a comparative analysis of how these tools impact writing outcomes—compared to when L2 writers independently proofread and revise their writing—has not been fully examined. To address this gap, a controlled experiment was conducted using three distinct proofreading interventions—self-proofreading (SP), MT-assisted proofreading (MAP), and ChatGPT-assisted proofreading (CAP). Learners were encouraged to first compose their texts in their L2 and then use either MT through inverse translation or ChatGPT through a structured proofreading process. The findings revealed that learners using MAP and CAP demonstrated substantial improvements in overall writing quality compared to those relying solely on SP. CAP users, in particular, produced longer texts, exhibited greater lexical diversity, and constructed more complex sentences, although this was accompanied by reduced verb cohesion. Both MAP and CAP significantly reduced grammatical errors, but did not affect prepositional errors. These findings provide practical recommendations for integrating MT and ChatGPT into L2 writing pedagogy.</div></div>","PeriodicalId":46865,"journal":{"name":"Assessing Writing","volume":"65 ","pages":"Article 100950"},"PeriodicalIF":4.2,"publicationDate":"2025-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143892141","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

Comparative judgment in L2 writing assessment: Reliability and validity across crowdsourced, community-driven, and trained rater groups of judges 第二语言写作评估中的比较判断：在众包、社区驱动和训练有素的评判员群体中的信度和效度

IF 4.2 1区文学

Assessing Writing Pub Date : 2025-04-04 DOI: 10.1016/j.asw.2025.100937

Peter Thwaites , Pauline Jadoulle , Magali Paquot

{"title":"Comparative judgment in L2 writing assessment: Reliability and validity across crowdsourced, community-driven, and trained rater groups of judges","authors":"Peter Thwaites , Pauline Jadoulle , Magali Paquot","doi":"10.1016/j.asw.2025.100937","DOIUrl":"10.1016/j.asw.2025.100937","url":null,"abstract":"<div><div>Several recent studies have explored the use of comparative judgement for assessing second language writing. One of the claimed advantages of this method is that it generates valid assessments even when judgements are conducted by individuals outside of the traditional language assessment community. However, evidence in support of this claim largely focuses on concurrent validity – i.e. the extent to which CJ rating scales generated by various groups of judges correlate with rubric-based assessments. Little evidence exists of the construct validity of using CJ for L2 writing assessment. The present study seeks to address this by exploring what judges pay attention to while making comparative judgements. Three distinct groups of judges assessed the same set of 25 English L2 argumentative essays, leaving comments after each of their decisions. These comments were then analysed in order to explore the construct relevance and construct representativeness of each judge group’s rating scale. The results suggest that these scales differ in the extent to which they can be considered valid assessments of the target essays.</div></div>","PeriodicalId":46865,"journal":{"name":"Assessing Writing","volume":"65 ","pages":"Article 100937"},"PeriodicalIF":4.2,"publicationDate":"2025-04-04","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143769269","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

The relationship between executive functions, source use, and integrated writing performance 执行功能、来源使用与综合写作表现之间的关系

IF 4.2 1区文学

Assessing Writing Pub Date : 2025-03-26 DOI: 10.1016/j.asw.2025.100936

Xian Liao , Pengfei Zhao , Zicheng Li

{"title":"The relationship between executive functions, source use, and integrated writing performance","authors":"Xian Liao , Pengfei Zhao , Zicheng Li","doi":"10.1016/j.asw.2025.100936","DOIUrl":"10.1016/j.asw.2025.100936","url":null,"abstract":"<div><div>An accurate assessment of writing relies on a thorough understanding of its underlying processes and related factors. While integrated writing (IW) is crucial for students’ academic success and future career development, the factors influencing performance in such complex tasks remain under scientific investigation. In particular, although the core role of source use in completing IW tasks is widely acknowledged, we still need to explore factors that could facilitate writers’ effective use of sources. While recent studies have highlighted the critical role of executive functions (EFs)—such as working memory, inhibition, and cognitive flexibility—during writing activities, the exact influence of these foundational cognitive skills on source use and IW performance remains unclear. To this end, this study recruited 233 secondary students in Hong Kong to complete a set of standardized EF tasks and a Chinese reading-to-write IW task. The students’ written products were analyzed regarding the use of content ideas and linguistic transformation based on source materials. We found that visual-spatial working memory had a significant direct effect on IW performance. Two critical aspects of source use—ideas from sources and near copy—mediated the relationship between EF skills and IW performance. These findings contribute to our understanding of the role of EF skills in complex IW tasks. We highlight the implications of our results for the assessment, teaching, and learning of integrated writing.</div></div>","PeriodicalId":46865,"journal":{"name":"Assessing Writing","volume":"65 ","pages":"Article 100936"},"PeriodicalIF":4.2,"publicationDate":"2025-03-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"143705348","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

引用次数: 0

A mixed-methods approach to English-L1 teachers’ implementation of written feedback in EFL classrooms 英语-母语教师在英语课堂中实施书面反馈的混合方法

IF 4.2 1区文学

Assessing Writing Pub Date : 2025-03-22 DOI: 10.1016/j.asw.2025.100935

Xiaolong Cheng , Jinfen Xu

引用次数: 0