Assessing WritingPub Date : 2024-09-05DOI: 10.1016/j.asw.2024.100889
Qi Lu , Xinhua Zhu , Siyu Zhu , Yuan Yao
{"title":"Effects of writing feedback literacies on feedback engagement and writing performance: A cross-linguistic perspective","authors":"Qi Lu , Xinhua Zhu , Siyu Zhu , Yuan Yao","doi":"10.1016/j.asw.2024.100889","DOIUrl":"10.1016/j.asw.2024.100889","url":null,"abstract":"<div><p>While the educational field has made progress in comprehending student feedback literacy, its impact on feedback engagement and student writing performance remains insufficiently explored. Furthermore, the cross-linguistic perspective has not yet been introduced to the literature on student feedback literacy, even though this approach has seen increased utilization in both L1 and L2 learning research. The current study examined the relationship between L1 and L2 writing feedback literacies and how they may contribute to L2 feedback engagement and L2 writing performance. Data were collected from 231 English major sophomore students from a Chinese university. The structural equation modeling analyses results showed that students’ L1 writing feedback literacy had a positive effect on their L2 writing feedback literacy. Further, L1 writing feedback literacy exerted an indirect effect on L2 writing performance via L2 writing feedback literacy and L2 feedback engagement. These findings underscore the pivotal role of L1 writing feedback literacy in L2 development and provide empirical evidence elucidating the close relationship between student feedback literacy and feedback engagement. The study concludes with pedagogical suggestions based on the observed outcomes.</p></div>","PeriodicalId":46865,"journal":{"name":"Assessing Writing","volume":"62 ","pages":"Article 100889"},"PeriodicalIF":4.2,"publicationDate":"2024-09-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142149877","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Assessing WritingPub Date : 2024-07-01DOI: 10.1016/j.asw.2024.100878
Min Kyu Kim , Jinho Kim , Ali Heidari
{"title":"Exploring the multi-dimensional human mind: Model-based and text-based approaches","authors":"Min Kyu Kim , Jinho Kim , Ali Heidari","doi":"10.1016/j.asw.2024.100878","DOIUrl":"10.1016/j.asw.2024.100878","url":null,"abstract":"<div><p>In this study, we conceptualize two approaches, model-based and text-based, grounded on mental models and discourse comprehension theories, to computerized summary analysis. We juxtapose the model-based approach with the text-based approach to explore shared knowledge dimensions and associated measures from both approaches and use them to examine changes in students' summaries over time. We used 108 cases in which we computed model-based and text-based measures for two versions of students' summaries (i.e., initial and final revisions), resulting in a total of 216 observations. We used correlations, Principal Components Analysis (PCA), and Linear Mixed-Effects models. This exploratory investigation suggested a shortlist of text-based measures, and the findings of the PCA demonstrated that both model-based and text-based measures explained the three-dimensional model (i.e., surface, structure, and semantic). Overall, model-based measures were better for tracking changes in the surface dimension, while text-based measures were descriptive of the structure dimension. Both approaches worked well for the semantic dimension. The tested text-based measures can serve as a cross-reference to evaluate students' summaries along with the model-based measures. The current study shows the potential of using multidimensional measures to provide formative feedback on students' knowledge structure and writing styles along the three dimensions.</p></div>","PeriodicalId":46865,"journal":{"name":"Assessing Writing","volume":"61 ","pages":"Article 100878"},"PeriodicalIF":4.2,"publicationDate":"2024-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141954088","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Assessing WritingPub Date : 2024-07-01DOI: 10.1016/j.asw.2024.100871
Murad Abdu Saeed , Atef AbuSa'aleek , Mohammed Abdullah Alharbi
{"title":"Examining teacher’s evaluative language in written, audio and screencast feedback on EFL learners’ writing from the appraisal framework: A linguistic perspective","authors":"Murad Abdu Saeed , Atef AbuSa'aleek , Mohammed Abdullah Alharbi","doi":"10.1016/j.asw.2024.100871","DOIUrl":"https://doi.org/10.1016/j.asw.2024.100871","url":null,"abstract":"<div><p>Technology facilitates teacher corrective feedback on students' writing, but there is a need to examine how written, audio and screencast modes affect teacher's evaluative language of electronic (e-) feedback from linguistic approaches. By using the engagement resources of the appraisal framework within Systemic Functional Linguistics, this study examined the effect of written, audio and screencast modes on the instructor's evaluative language in his e-feedback on writing and the text revisions of 15 pairs of Saudi EFL learners. The linguistic analysis of the e-feedback revealed that the instructor's engagement resources differed across the three e-feedback modes. Specifically, the screencast and audio e-feedback modes were dominated by expanding resources (resources expanding the space for dialogue) as opposed to the prevalence of contracting resources (resources limiting/shutting down the space for dialogue) in the written feedback mode. Moreover, the audio and screencast feedback modes contained more statements and suggestions whereas the written feedback mode was dominated by commands/orders and suggested corrections. The content analysis revealed that the screencast e-feedback mode addressed a higher number of global issues in writing; however, the audio and written e-feedback modes addressed a higher number of local issues in writing. Despite the higher overall rate of successful text revisions resulting from the screencast and audio e-feedback modes, no significant differences were found except in relation to students' global text revisions. The study offers useful pedagogical implications for instructors in effectively responding to students' writing.</p></div>","PeriodicalId":46865,"journal":{"name":"Assessing Writing","volume":"61 ","pages":"Article 100871"},"PeriodicalIF":4.2,"publicationDate":"2024-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141543227","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Assessing WritingPub Date : 2024-07-01DOI: 10.1016/j.asw.2024.100876
Carrie Xin Peng
{"title":"Beyond accuracy gains: Investigating the impact of individual and collaborative feedback processing on L2 writing development","authors":"Carrie Xin Peng","doi":"10.1016/j.asw.2024.100876","DOIUrl":"10.1016/j.asw.2024.100876","url":null,"abstract":"<div><p>Despite the burgeoning research on exploring learner engagement with feedback, how second language (L2) learners’ engagement with feedback in different processing conditions influences their subsequent writing development is under-explored. This study examines the effects of individual and collaborative processing (languaging) of teacher feedback on Chinese lower-secondary school EFL learners’ writing development. Eighty-one students aged 13–14 with A1-A2 levels of English proficiency (according to the Common European Framework of Reference) from two classes and two experienced English teachers participated in the study. Students were provided with comprehensive teacher feedback and were asked to process feedback provided on three writing tasks through either individual written or collaborative oral languaging over six weeks. Pre-, post-, and delayed post-tests were administered. Students’ writing development was analysed using complexity, accuracy, and fluency measures, as well as content and organisation writing scores. Findings showed that the two conditions did not influence students’ writing complexity and fluency differently, while only the collaborative oral languaging condition contributed to students’ sustainable accuracy gains. Results based on the analytic writing scores suggested that students in the two conditions significantly improved content and organisation scores over time. Pedagogical and research implications regarding implementing the two feedback processing conditions are discussed.</p></div>","PeriodicalId":46865,"journal":{"name":"Assessing Writing","volume":"61 ","pages":"Article 100876"},"PeriodicalIF":4.2,"publicationDate":"2024-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S1075293524000692/pdfft?md5=f166583fc6f801f5b2a71d5e058cf1ce&pid=1-s2.0-S1075293524000692-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141844063","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Assessing WritingPub Date : 2024-07-01DOI: 10.1016/j.asw.2024.100868
Huiying Cai , Xun Yan
{"title":"Examining the direct and indirect impacts of verbatim source use on linguistic complexity in integrated argumentative writing assessment","authors":"Huiying Cai , Xun Yan","doi":"10.1016/j.asw.2024.100868","DOIUrl":"https://doi.org/10.1016/j.asw.2024.100868","url":null,"abstract":"<div><p>Verbatim source use (VSU) in integrated argumentative writing tasks may enhance linguistic complexity of writing performance. This assistance might present an unequal advantage for test-takers across levels of writing proficiency, engendering validity and fairness concerns. While previous research has mostly examined the relationships between source use characteristics and proficiency levels, the relationship between VSU and linguistic complexity remains underexplored. To further unpack these relationships, this study examined both the direct impact of VSU on linguistic complexity of writing performances and its indirect impact through interaction with writing proficiency. Using natural language processing tools and techniques, we examined 34 linguistic complexity features and three VSU features of 3250 argumentative writing performances on a university-level English Placement Test (EPT). We performed exploratory factor analysis to identify linguistic complexity dimensions and applied mixed-effect models to examine how VSU features and proficiency level impacted these dimensions. Post-hoc analyses suggested weak direct impacts of different VSU features on linguistic complexity, which might reflect different essay writing strategies. However, no meaningful indirect impact was found. The findings help unravel the impact of VSU on argumentative writing and provide empirical evidence for validity arguments for integrated writing assessments.</p></div>","PeriodicalId":46865,"journal":{"name":"Assessing Writing","volume":"61 ","pages":"Article 100868"},"PeriodicalIF":4.2,"publicationDate":"2024-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S1075293524000618/pdfft?md5=faa5261e073280115613145d7ef0bb9e&pid=1-s2.0-S1075293524000618-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141543225","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Assessing WritingPub Date : 2024-07-01DOI: 10.1016/j.asw.2024.100875
Yuxin Peng , Yafu Zheng , Jie Sun , Yue Jiang , Jiexin Lin , Haomin Zhang
{"title":"Modeling relationships among large-grained, fine-grained absolute syntactic complexity and assessed L2 writing quality: An SEM approach","authors":"Yuxin Peng , Yafu Zheng , Jie Sun , Yue Jiang , Jiexin Lin , Haomin Zhang","doi":"10.1016/j.asw.2024.100875","DOIUrl":"10.1016/j.asw.2024.100875","url":null,"abstract":"<div><p>The current study investigated the relationships among large-grained and fine-grained aspects of absolute syntactic complexity (SC) and expert-assessed writing quality of 446 argumentative writing samples of college-level Chinese EFL learners. Computational indices tapping into large-grained and fine-grained aspects of absolute SC were computed by TAASSC and L2SCA. Drawing upon rigorous SEM analyses, this paper demonstrated the utility of computational indices that tap into absolute SC. Overall, the measurements of absolute SC accounted for 42 % of the variance in human-judged overall writing scores. The results revealed that (1) noun phrase (NP) complexity was the underlying cause that determined trained raters’ judgement on argumentative writing quality; (2) among traditional large-grained indices, MLC, CN/C, and CN/T, were dependable metrics in representing SC and predicting writing quality; (3) among fine-grained indices, prepositional phrases and relative clauses as noun modifiers were prominent in representing NP complexity; (4) relative clause and adjectival modifiers had unique and complementary effects to large-grained NP complexity in affording explanations for human judgement; (5) the use of prepositions in NP was the most prominent contributor to the increase of large-grained NP complexity among the noun phrase modifiers in this specific corpus. Situated in previous research, the results provide an opportunity to evaluate L2 writing within the theoretical framework of absolute syntactic complexity.</p></div>","PeriodicalId":46865,"journal":{"name":"Assessing Writing","volume":"61 ","pages":"Article 100875"},"PeriodicalIF":4.2,"publicationDate":"2024-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141838360","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Assessing WritingPub Date : 2024-07-01DOI: 10.1016/j.asw.2024.100872
Jack Pun , Sheng Tan , Xiang Li
{"title":"Discourse competence in Hong Kong secondary students’ disciplinary research writing","authors":"Jack Pun , Sheng Tan , Xiang Li","doi":"10.1016/j.asw.2024.100872","DOIUrl":"10.1016/j.asw.2024.100872","url":null,"abstract":"<div><p>The study examined the frequency and accuracy of four discourse competence (DC) parameters (i.e., establishment of a smooth old-to-new information flow, stance display, engagement with readers, and mastery of knowledge of discourse structure) in Hong Kong English-as-a-second-language (ESL) secondary students’ disciplinary research reports. The results showed that: (1) elements of establishment of a smooth old-to-new information flow constituted, on average, less than 9 % of the reports’ length, with mean accuracy rates ranging from 64.31 % to 80.33 %; (2) elements of stance display constituted, on average, no more than 3 % of the reports’ length, with mean accuracy rates ranging from 58.33 % to 98.17 %; (3) elements of engagement with readers constituted, on average, no more than 2 % of the reports’ length, with mean accuracy rates ranging from 33.33% to 88.64 %; (4) the mean accuracy rates of mastery of knowledge of discourse structure ranged from 0 % to 100 %. The findings reveal the secondary students’ DC in disciplinary research writing and pinpoint weak areas that instructors can work on. The proposed DC framework forms a foundation for future research on DC in discipline-specific research writing.</p></div>","PeriodicalId":46865,"journal":{"name":"Assessing Writing","volume":"61 ","pages":"Article 100872"},"PeriodicalIF":4.2,"publicationDate":"2024-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141736645","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Assessing WritingPub Date : 2024-07-01DOI: 10.1016/j.asw.2024.100877
Lawrence Jun Zhang , Jianhua Zhang
{"title":"EFL students' syntactic complexity development in argumentative writing:A latent class growth analysis (LCGA) approach","authors":"Lawrence Jun Zhang , Jianhua Zhang","doi":"10.1016/j.asw.2024.100877","DOIUrl":"10.1016/j.asw.2024.100877","url":null,"abstract":"<div><p>The study explored EFL students' development of syntactic complexity by employing the Latent Class Growth Analysis (LCGA) approach. A total of 214 tertiary EFL students from Southwest China were invited to write four argumentative essays over an academic semester. The unconditional models of LCGA were utilized to explore the optimal latent classes of students' development trajectories of syntactic complexity. The conditional models of LCGA were employed to investigate the predictive effect of English proficiency on the optimal latent classes. Results of the unconditional models revealed different latent classes of development trajectories for six indices of syntactic complexity rather than the remaining ones, which offers tentative evidence for the heterogeneity of L2 development trajectories. Results of the conditional models showed that English proficiency did not predict the membership in these latent classes. These results are discussed and implications for L2 instruction are attempted.</p></div>","PeriodicalId":46865,"journal":{"name":"Assessing Writing","volume":"61 ","pages":"Article 100877"},"PeriodicalIF":4.2,"publicationDate":"2024-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.sciencedirect.com/science/article/pii/S1075293524000709/pdfft?md5=222daba9822dda6a976ca3099ac77902&pid=1-s2.0-S1075293524000709-main.pdf","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141954675","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Analysis and recommendation system-based on PRISMA checklist to write systematic review","authors":"Smita Agrawal , Parita Oza , Riya Kakkar , Sudeep Tanwar , Vishv Jetani , Jatin Undhad , Anupam Singh","doi":"10.1016/j.asw.2024.100866","DOIUrl":"https://doi.org/10.1016/j.asw.2024.100866","url":null,"abstract":"<div><p>A systematic review prepared by the researchers or users is transparent, complete, and accurate information that gives deep insights into why the review was done, what they did, and what they found. Various tools can be utilized to conduct a systematic review of the research papers, which is essential for researchers or users who wish to write and publish papers and those who review and evaluate them. By conducting a systematic review, users can gain valuable insights into the landscape of existing literature and identify key trends and influential works in their field from references they used in the article. Many researchers enhance the strength of their systematic review articles by manually preparing and including the analysis of the preferred reporting items for systematic reviews and meta-analyses (PRISMA)-2020 checklist and flow diagram. Motivated by the aforementioned discussion, this paper uses a web-based application to provide a graphical visualization of the analysis and flow diagram for the PRISMA. This application is valuable for stakeholders or users involved in the research process, including researchers, students, editors, reviewers, academic institutions, funding agencies, and publication houses. The proposed application enables stakeholders or users to assess the quality of the articles considered for systematic review more effectively along with the student writing assessment. Offering a visual display of the results from individual studies and syntheses enhances their ability to analyze and interpret the findings of the research articles by analyzing reference of research papers concerning year, entry type, authors, keywords, and journals.</p></div>","PeriodicalId":46865,"journal":{"name":"Assessing Writing","volume":"61 ","pages":"Article 100866"},"PeriodicalIF":4.2,"publicationDate":"2024-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141487095","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":1,"RegionCategory":"文学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}