K. Oddis, J. Burstein, D. McCaffrey, Steven L. Holtzman
{"title":"A Framework for Analyzing Features of Writing Curriculum in Studies of Student Writing Achievement","authors":"K. Oddis, J. Burstein, D. McCaffrey, Steven L. Holtzman","doi":"10.37514/jwa-j.2022.6.1.05","DOIUrl":"https://doi.org/10.37514/jwa-j.2022.6.1.05","url":null,"abstract":"• Background: Researchers interested in quantitative measures of student “success” in writing cannot control completely for contextual factors which are local and site-based (i.e., in context of a specific instructor’s writing classroom at a specific institution). (In)ability to control for curriculum in studies of student writing achievement complicates interpretation of features measured in student writing. This article demonstrates how identifying and analyzing features of writing curriculum can provide dimensions of local context not captured in analysis of student-generated texts alone. Using a dataset of 48 curricular texts collected from 21 instructors teaching in five disciplines across six four-year public universities in the United States, this article: 1) presents a set of curriculum scoring rubrics developed through qualitative analysis, 2) describes a protocol for training raters to use the rubrics to score curricular texts to achieve rater agreement and generate quantitative data, and 3) explores how this framework","PeriodicalId":92857,"journal":{"name":"The journal of writing analytics","volume":"36 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2022-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"77568366","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Revisiting �Family Matters�: How Citation Patterns in the Journal of Second Language Writing Reveal the Changing Nature of the Second Language Writing Field and the Decreasing Role of Composition Studies in It","authors":"Aleksandra M. Swatek, Zehra Ta?k?n, N. Jackson","doi":"10.37514/jwa-j.2022.6.1.06","DOIUrl":"https://doi.org/10.37514/jwa-j.2022.6.1.06","url":null,"abstract":"","PeriodicalId":92857,"journal":{"name":"The journal of writing analytics","volume":"36 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2022-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"85488306","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Book Review of Geisler, C., and Swarts, J. (2019). Coding streams of language: Techniques for the systematic coding of text, talk, and other verbal data. The WAC Clearinghouse; University Press of Colorado.","authors":"K. Walkup","doi":"10.37514/jwa-j.2022.6.1.08","DOIUrl":"https://doi.org/10.37514/jwa-j.2022.6.1.08","url":null,"abstract":"","PeriodicalId":92857,"journal":{"name":"The journal of writing analytics","volume":"56 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2022-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"72736905","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"ThesisWorkshopper: An Automated Thesis Statement Evaluator","authors":"Raymond Oenbring","doi":"10.37514/jwa-j.2022.6.1.02","DOIUrl":"https://doi.org/10.37514/jwa-j.2022.6.1.02","url":null,"abstract":"● Identification of Innovation: While scholars in rhetoric and composition are showing increasing interest in using large corpora of student writing to analyze student essays and instructor feedback on them, they have largely avoided developing natural language processing technologies designed to provide rich feedback to students on their writing. At the same time, those involved with the development of automated essay evaluation (AEE) systems—who are, almost always, not compositionists—are increasingly developing systems that provide rich feedback on a variety of essay features, rather than simple scores. The current study aims to show an example of how a web-based natural language processing tool can provide students with rich feedback on their papers under a process pedagogy framework.","PeriodicalId":92857,"journal":{"name":"The journal of writing analytics","volume":"170 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2022-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"83445171","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"The Relationship Between Teacher Efficacy, Writing Apprehension, and Writing to Learn Using Structural Equation Modeling","authors":"M. Perkins","doi":"10.37514/jwa-j.2022.6.1.03","DOIUrl":"https://doi.org/10.37514/jwa-j.2022.6.1.03","url":null,"abstract":"• Background: In the United States, students continue to struggle in the core content areas of language arts, social studies, math, and science. To improve student content learning, writing to learn (WTL) across the content emerged as a potential mechanism. However, few studies examine the extent to which secondary content teachers are ready and willing to implement WTL to improve student learning in those content areas. This study uses structural equation modeling (SEM) to examine how much teaching efficacy, writing apprehension, years teaching, grade level, and content area contribute to teachers’ efficacy of using WTL and their perception of the relevance of WTL to their content areas.","PeriodicalId":92857,"journal":{"name":"The journal of writing analytics","volume":"86 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2022-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"88397408","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Linguistic Features of Writing Quality and Development: A Longitudinal Approach","authors":"S. Crossley, Minkyun Kim","doi":"10.37514/jwa-j.2022.6.1.04","DOIUrl":"https://doi.org/10.37514/jwa-j.2022.6.1.04","url":null,"abstract":"• Background: In terms of understanding writing through a linguistic lens, a number of recent studies have focused on assessing writing quality, likely because of rising interest in automated essay scoring, the availability of large corpora of scored essays, and the development of advanced natural language processing tools that can assess linguistic features in texts quickly and accurately. Fewer studies, however, have focused on investigating writing development in terms of linguistic features. Many of the studies that do investigate writing development use crosssectional data to better understand how writing changes as a function of age or grade level.","PeriodicalId":92857,"journal":{"name":"The journal of writing analytics","volume":"187 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2022-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"80661048","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Book Review of Kelly-Riley, D., and Elliot, N. (Eds.). (2021). Improving outcomes: Disciplinary writing, local assessment, and the aim of fairness. MLA Press.","authors":"N. Lerner","doi":"10.37514/jwa-j.2022.6.1.09","DOIUrl":"https://doi.org/10.37514/jwa-j.2022.6.1.09","url":null,"abstract":"","PeriodicalId":92857,"journal":{"name":"The journal of writing analytics","volume":"1 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2022-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"79938596","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Incubating Writing Analytics Research in the Time of COVID-19","authors":"Susan Lang","doi":"10.37514/jwa-j.2022.6.1.01","DOIUrl":"https://doi.org/10.37514/jwa-j.2022.6.1.01","url":null,"abstract":"","PeriodicalId":92857,"journal":{"name":"The journal of writing analytics","volume":"46 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2022-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"80462462","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Across Performance Contexts: Using Automated Writing Evaluation to Explore Student Writing","authors":"D. McCaffrey, Mo Zhang, J. Burstein","doi":"10.37514/jwa-j.2022.6.1.07","DOIUrl":"https://doi.org/10.37514/jwa-j.2022.6.1.07","url":null,"abstract":"• Background: This exploratory writing analytics study uses argumentative writing samples from two performance contexts—standardized writing assessments and university English course writing assignments—to compare (1) linguistic features in argumentative writing and (2) relationships between linguistic characteristics and academic performance outcomes. Writing data from this study come from 180 students enrolled at five four-year universities in the United States. Automated writing evaluation (AWE) tools were used to generate linguistic features from students’ writing.","PeriodicalId":92857,"journal":{"name":"The journal of writing analytics","volume":"1 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2022-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"83277735","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
M. Oliveri, David Slomp, Andr� A. Rupp, R. Mislevy
{"title":"Principled Development of Workplace English Communication Part 3: An Integrated Design and Appraisal Framework","authors":"M. Oliveri, David Slomp, Andr� A. Rupp, R. Mislevy","doi":"10.37514/jwa-j.2021.5.1.04","DOIUrl":"https://doi.org/10.37514/jwa-j.2021.5.1.04","url":null,"abstract":"","PeriodicalId":92857,"journal":{"name":"The journal of writing analytics","volume":"39 1","pages":""},"PeriodicalIF":0.0,"publicationDate":"2021-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"74133499","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}