Nicole B. Wiggs, L. Reddy, Ryan J. Kettler, Anh N. Hua, C. Dudek, Adam J. Lekwa, B. Bronstein
{"title":"基于课堂策略评估系统的教师自我报告与学校管理者观察评分的融合","authors":"Nicole B. Wiggs, L. Reddy, Ryan J. Kettler, Anh N. Hua, C. Dudek, Adam J. Lekwa, B. Bronstein","doi":"10.1177/15345084221112858","DOIUrl":null,"url":null,"abstract":"The Classroom Strategies Assessment System (CSAS) is a multi-rater, multi-method (direct observation and rating scale methodology) assessment of teachers’ use of research-based instructional and behavior management strategies. The present study investigated the association between teacher self-report and school administrator ratings using the CSAS Teacher (CSAS-T) and Observer (CSAS-O) Forms in 15 high-poverty U.S. charter schools. The CSAS-T and CSAS-O were designed to be used concurrently as a valid formative assessment of teacher practice. Findings include small, but statistically significant correlations between the CSAS-T and CSAS-O. Analysis of a multi-trait–multi-method (MTMM) matrix found teachers and observers to be measuring different constructs. No mean score differences were found between teacher self-reported instruction and behavior management strategy use compared with school administrators’ observed ratings. Furthermore, school administrators and teachers have similar ratings of overall effectiveness, with the majority of teachers in the sample being rated at or above effective. Overall, findings offer support for using the CSAS-O and CSAS-T for guiding professional development conversations.","PeriodicalId":46264,"journal":{"name":"ASSESSMENT FOR EFFECTIVE INTERVENTION","volume":"48 1","pages":"113 - 123"},"PeriodicalIF":1.2000,"publicationDate":"2022-07-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":"{\"title\":\"Convergence Between Teacher Self-Report and School Administrator Observation Ratings Using the Classroom Strategies Assessment System\",\"authors\":\"Nicole B. Wiggs, L. Reddy, Ryan J. Kettler, Anh N. Hua, C. Dudek, Adam J. Lekwa, B. Bronstein\",\"doi\":\"10.1177/15345084221112858\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"The Classroom Strategies Assessment System (CSAS) is a multi-rater, multi-method (direct observation and rating scale methodology) assessment of teachers’ use of research-based instructional and behavior management strategies. The present study investigated the association between teacher self-report and school administrator ratings using the CSAS Teacher (CSAS-T) and Observer (CSAS-O) Forms in 15 high-poverty U.S. charter schools. The CSAS-T and CSAS-O were designed to be used concurrently as a valid formative assessment of teacher practice. Findings include small, but statistically significant correlations between the CSAS-T and CSAS-O. Analysis of a multi-trait–multi-method (MTMM) matrix found teachers and observers to be measuring different constructs. No mean score differences were found between teacher self-reported instruction and behavior management strategy use compared with school administrators’ observed ratings. Furthermore, school administrators and teachers have similar ratings of overall effectiveness, with the majority of teachers in the sample being rated at or above effective. Overall, findings offer support for using the CSAS-O and CSAS-T for guiding professional development conversations.\",\"PeriodicalId\":46264,\"journal\":{\"name\":\"ASSESSMENT FOR EFFECTIVE INTERVENTION\",\"volume\":\"48 1\",\"pages\":\"113 - 123\"},\"PeriodicalIF\":1.2000,\"publicationDate\":\"2022-07-29\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"1\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"ASSESSMENT FOR EFFECTIVE INTERVENTION\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1177/15345084221112858\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"EDUCATION & EDUCATIONAL RESEARCH\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"ASSESSMENT FOR EFFECTIVE INTERVENTION","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1177/15345084221112858","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"EDUCATION & EDUCATIONAL RESEARCH","Score":null,"Total":0}
Convergence Between Teacher Self-Report and School Administrator Observation Ratings Using the Classroom Strategies Assessment System
The Classroom Strategies Assessment System (CSAS) is a multi-rater, multi-method (direct observation and rating scale methodology) assessment of teachers’ use of research-based instructional and behavior management strategies. The present study investigated the association between teacher self-report and school administrator ratings using the CSAS Teacher (CSAS-T) and Observer (CSAS-O) Forms in 15 high-poverty U.S. charter schools. The CSAS-T and CSAS-O were designed to be used concurrently as a valid formative assessment of teacher practice. Findings include small, but statistically significant correlations between the CSAS-T and CSAS-O. Analysis of a multi-trait–multi-method (MTMM) matrix found teachers and observers to be measuring different constructs. No mean score differences were found between teacher self-reported instruction and behavior management strategy use compared with school administrators’ observed ratings. Furthermore, school administrators and teachers have similar ratings of overall effectiveness, with the majority of teachers in the sample being rated at or above effective. Overall, findings offer support for using the CSAS-O and CSAS-T for guiding professional development conversations.