{"title":"Oral Reading Assessment: Four Conditions Where Caution Is Warranted","authors":"R. Zipoli, Sujini Ramachandar","doi":"10.1177/15345084231220526","DOIUrl":"https://doi.org/10.1177/15345084231220526","url":null,"abstract":"Assessments of oral reading are widely used for screening, progress monitoring, and comprehensive evaluations. Despite the utility and technical adequacy of these tools, there are subgroups of students for whom measures of oral reading may be inappropriate. The first section of this article focuses on how tests of oral reading may underestimate word reading ability and reading fluency among four subgroups of students with speech, language, or learning difficulties. These include school-age students who demonstrate word-finding difficulties (which are common among students with a learning disability or developmental language disorder), developmental stuttering, childhood apraxia of speech, and pediatric dysarthria. The second section offers practical recommendations for more accurate assessment procedures, correct placement decisions, relevant professional learning activities, and strategic interdisciplinary teaming.","PeriodicalId":46264,"journal":{"name":"ASSESSMENT FOR EFFECTIVE INTERVENTION","volume":"15 1","pages":""},"PeriodicalIF":1.3,"publicationDate":"2023-12-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"139159912","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Jason C. Chow, Robin Sayers, Yang Fu, Kristen L. Granger, Shannon McCullough, Corinne Kingsbery, Ashley Morse
{"title":"A Systematic Meta-Review of Measures of Classroom Management in School Settings","authors":"Jason C. Chow, Robin Sayers, Yang Fu, Kristen L. Granger, Shannon McCullough, Corinne Kingsbery, Ashley Morse","doi":"10.1177/15345084231208671","DOIUrl":"https://doi.org/10.1177/15345084231208671","url":null,"abstract":"The purpose of this study was to conduct a systematic meta-review with the goal of documenting the landscape of measures of classroom management in the school-based literature. Our systematic search for systematic reviews and extraction of primary studies in the classroom management research yielded 73 studies for inclusion that captured 76 different classroom management measures. We present an inclusive repository of measures from the field. Results revealed high levels of variability in aspects of both scales and observational measures across a range of domains assessed. We discuss our descriptive analysis of the landscape of classroom management measures and provide implications for future work.","PeriodicalId":46264,"journal":{"name":"ASSESSMENT FOR EFFECTIVE INTERVENTION","volume":" 22","pages":""},"PeriodicalIF":1.3,"publicationDate":"2023-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138611256","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Assessing Classroom Management Practices: Setting the Stage for Effective and Equitable Intervention","authors":"Nathan A. Stevenson, Sara McDaniel, S. Hirsch","doi":"10.1177/15345084231214418","DOIUrl":"https://doi.org/10.1177/15345084231214418","url":null,"abstract":"This introduction to the special issue, “Assessing Classroom Management Practices: Setting the Stage for Effective and Equitable Intervention,” overviews the importance of classroom management and how the field defines classroom management and previews the articles included in this special issue. The purpose of the special issue was to provide readers with wide-ranging assessment tools, their strengths, and weaknesses used to assess classroom management practices. This extends to how researchers analyze classroom management data and novel approaches to analyses. Readers will see the special issue leads with a thorough meta-analysis of existing classroom management assessment tools, followed by descriptions of other tools and related practices.","PeriodicalId":46264,"journal":{"name":"ASSESSMENT FOR EFFECTIVE INTERVENTION","volume":" 10","pages":""},"PeriodicalIF":1.3,"publicationDate":"2023-12-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"138616988","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Ensuring Test Access for Students With Disabilities: A Special Issue of <i>Assessment for Effective Intervention</i>","authors":"Benjamin J. Lovett, Judith R. Harrison","doi":"10.1177/15345084231205314","DOIUrl":"https://doi.org/10.1177/15345084231205314","url":null,"abstract":"Ensuring that educational tests are accessible to students with disabilities is a core aspect of fairness in assessment, regardless of the exact uses of the testing. Disability accommodations, as well as universally available accessibility features, can facilitate that access, but determining which supports to offer should be guided by sound empirical research and defensible theoretical frameworks. Here the guest editors introduce a special issue of Assessment for Effective Intervention on this topic of accessibility in assessment. We discuss the importance of the topic, we provide an overview of each article in the issue, and we offer reflections on the present and future of research on this topic.","PeriodicalId":46264,"journal":{"name":"ASSESSMENT FOR EFFECTIVE INTERVENTION","volume":"16 2 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-10-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135618089","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Effects of Principled Digitalized Interactive Components on Geometry Computer-Based Assessment in High Schoolers With Learning Difficulties in Mathematics: A Preliminary Investigation","authors":"Changyun Liu, Dake Zhang, Max Pandolpho, Julia Yi","doi":"10.1177/15345084231203235","DOIUrl":"https://doi.org/10.1177/15345084231203235","url":null,"abstract":"This study investigated the effectiveness of four Digitalized Interactive Components (DICs) designed based on cognitive principles to accommodate individual differences among students with learning difficulties in geometry during computer-based assessments. The four DICs included annotations (allowing students to make notes on the screen), pop-up glossary (providing definitions of math terms upon clicking), signaling (displaying corresponding visual information upon clicking verbal information), and rotation (allowing students to rotate shapes). Sixteen high school students with mathematics difficulties participated in the study and were tested with and without the principled DICs. The findings indicate that the principled DICs statistically significantly improved students’ accuracy on the majority of tested problems and increased the average duration engaged in solving geometry problems. Analysis of video data revealed that the pop-up glossary was the most frequently used DIC, followed by signaling, while annotation was the least used.","PeriodicalId":46264,"journal":{"name":"ASSESSMENT FOR EFFECTIVE INTERVENTION","volume":"67 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-10-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135617975","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Development of a Fraction Vocabulary Measure","authors":"Xin Lin, Sarah R. Powell","doi":"10.1177/15345084231202407","DOIUrl":"https://doi.org/10.1177/15345084231202407","url":null,"abstract":"Developing mathematics proficiency requires an understanding of mathematics vocabulary. Although previous research has developed several measures of mathematics vocabulary at different grade levels, no study focused solely on fraction vocabularies. We developed and tested a measure of fraction vocabulary for students in Grade 4 to determine the internal consistency and difficulty level of such a measure. Analysis indicated the measure demonstrated high internal consistency. Students, on average, answered less than one-third of fraction vocabularies correctly. We also detected performance differences between students with and without mathematics difficulty and dual-language learners and their peers.","PeriodicalId":46264,"journal":{"name":"ASSESSMENT FOR EFFECTIVE INTERVENTION","volume":"1 1","pages":"0"},"PeriodicalIF":0.0,"publicationDate":"2023-10-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"135759644","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Catherine P. Bradshaw, Heather L. McDaniel, Chelsea A. Kaihoi, Summer S. Braun, Elise T. Pas, Jessika H. Bottiani, A. Cash, Katrina J. Debnam
{"title":"Examining the Psychometrics and Characteristics of the Assessing School Settings: Interactions of Students and Teachers","authors":"Catherine P. Bradshaw, Heather L. McDaniel, Chelsea A. Kaihoi, Summer S. Braun, Elise T. Pas, Jessika H. Bottiani, A. Cash, Katrina J. Debnam","doi":"10.1177/15345084231187087","DOIUrl":"https://doi.org/10.1177/15345084231187087","url":null,"abstract":"This article focuses on the psychometric properties and characteristics of the Assessing School Settings: Interactions of Students and Teachers (ASSIST), an observational assessment administered by trained external observers of teacher practices, classroom context, and student behaviors at the classroom level. Study 1 examines variability, reliability, and convergence between ASSIST scores with data from 3,298 classrooms nested within 185 elementary, middle, and high schools. We report school-level intraclass correlations (ICCs), standard deviations, means, and reliability estimates of ASSIST scales; investigate the correspondence among ASSIST-measured constructs with multilevel correlations; and explore school-level predictors of ASSIST global scale scores. Study 2 further examines reliability over time and convergent validity using repeated ASSIST and Classroom Assessment Scoring System–Secondary (CLASS-S) observations in classrooms of 335 teachers in 41 middle schools. The ASSIST global measures exhibited moderate to good reliability across three same-teacher observations (ICCs ranged from .69 to .82). Associations between all ASSIST and CLASS-S scales suggested close correspondence of the measures, especially at the teacher level and school level. Together, these findings highlight the utility of the ASSIST observational measure, both as a research and practice tool, across multiple school types and classroom contexts, and with potential to inform coaching to improve teachers’ classroom management.","PeriodicalId":46264,"journal":{"name":"ASSESSMENT FOR EFFECTIVE INTERVENTION","volume":" ","pages":""},"PeriodicalIF":1.3,"publicationDate":"2023-08-05","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"47293886","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Jessica N. Torelli, Christina R. Noel, T. Gross, Kaitlin A. Morris
{"title":"The Potential Promise of Using Adapted Alternating Treatment Designs to Assess Teachers’ Use of Classroom Management Practices","authors":"Jessica N. Torelli, Christina R. Noel, T. Gross, Kaitlin A. Morris","doi":"10.1177/15345084231190285","DOIUrl":"https://doi.org/10.1177/15345084231190285","url":null,"abstract":"Teachers critically need classroom management skills. To develop these skills, teachers need high-quality professional development (PD). To support teachers, schools need practical tools for assessing the effects of PD on teachers’ use of classroom management practices. The adapted alternating treatments design (AATD) may be a tool for this purpose. We conducted an initial pilot investigation testing the potential of AATDs to evaluate the effects of PD on teachers’ use of classroom management practices for eight P–12 teachers. We successfully used AATDs to evaluate PD effects in all cases across two phases of PD (online module instruction, online module + peer coaching). Results suggest the potential promise of using AATDs to evaluate the effects of PD on teachers’ use of classroom management practices. Results also showed didactic training alone was often insufficient to increase use of practices, whereas peer coaching was effective in increasing use of at least one practice for all teachers.","PeriodicalId":46264,"journal":{"name":"ASSESSMENT FOR EFFECTIVE INTERVENTION","volume":" ","pages":""},"PeriodicalIF":1.3,"publicationDate":"2023-08-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"49146502","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
{"title":"Evidence for the Technical Adequacy of the Teacher Social and Emotional Learning (SEL) Beliefs Scale","authors":"Faith G. Miller, Anna Li","doi":"10.1177/15345084231189893","DOIUrl":"https://doi.org/10.1177/15345084231189893","url":null,"abstract":"Implementation of social and emotional learning (SEL) programs and practices is becoming increasingly prevalent in Pre-K through Grade 12 educational settings. Research provides robust evidence to support positive outcomes associated with SEL implementation; however, we also know that implementation can be impacted by a variety of different individual and organizational factors. Teacher beliefs can influence how teachers implement SEL programming and represent an important area of study. The purpose of this study was to explore evidence for the technical adequacy of the Teacher SEL Beliefs Scale by examining the internal structure, internal consistency, and relations between subscale scores and teacher self-reported implementation fidelity of the Second Step SEL program. Confirmatory factor analysis of 103 teachers’ responses indicated that the three-factor solution found by prior authors, consisting of Comfort, Commitment, and Culture subscales, was also supported in the current sample. Moreover, ordinal logistic regression analyses suggested that the Comfort factor was significantly associated with how consistently teachers reported implementing the Second Step program. Implications for practice and future research are discussed.","PeriodicalId":46264,"journal":{"name":"ASSESSMENT FOR EFFECTIVE INTERVENTION","volume":"48 1","pages":"223 - 228"},"PeriodicalIF":1.3,"publicationDate":"2023-07-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"41678469","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}
Seohyeon Choi, Emma Shanahan, Jechun An, Kristen L. McMaster
{"title":"Monitoring Elementary Students’ Progress Using Word Dictation: Technical Features of Slope and Growth Analysis","authors":"Seohyeon Choi, Emma Shanahan, Jechun An, Kristen L. McMaster","doi":"10.1177/15345084231182718","DOIUrl":"https://doi.org/10.1177/15345084231182718","url":null,"abstract":"The purpose of this study was to examine the technical features of slopes produced from the curriculum-based measurement in writing (CBM-W) word dictation task. Seventy-nine elementary students in the U.S. Midwest with intensive learning needs responded to weekly word dictation probes across 20 weeks; responses were scored for correct letter sequences (CLS). Scores showed evidence of high reliability and sensitivity to growth in a short period. Linear mixed modeling revealed that students gained an average of 0.91 CLS for each additional week of instruction. Initial writing levels and growth rates did not significantly differ depending on students’ demographic characteristics. Based on these findings, we illustrate how word dictation slopes can be used as indicators of writing growth for students with intensive learning needs.","PeriodicalId":46264,"journal":{"name":"ASSESSMENT FOR EFFECTIVE INTERVENTION","volume":"48 1","pages":"201 - 210"},"PeriodicalIF":1.3,"publicationDate":"2023-06-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"49482544","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}