Matthew K. Burns, Heba Z. Abdelnaby, Jonie B. Welland, Katherine A. Graves, Kari Kurto
{"title":"Reliability of Ratings of an English Language Arts Curriculum With the Curriculum Evaluation Guidelines","authors":"Matthew K. Burns, Heba Z. Abdelnaby, Jonie B. Welland, Katherine A. Graves, Kari Kurto","doi":"10.1177/15345084241271926","DOIUrl":null,"url":null,"abstract":"The current study examined the reliability of The Reading League Curriculum-Evaluation Guidelines (CEGs), which were developed to help school-based teams rate the presence of red flags when considering adopting specific literacy curricula. Coders ( n = 30) independently used the CEGs to evaluate a free online English language arts curriculum. The results indicated strong internal consistency ( a = 0.96) and high interrater reliability ( H<jats:sub>M</jats:sub> = .91, 95% CI = .89 to .93, p < .01). Overall, the CEGs hold the potential as a psychometrically sound tool for evaluating reading curricula. Limitations and implications for practice and research are discussed.","PeriodicalId":1,"journal":{"name":"Accounts of Chemical Research","volume":null,"pages":null},"PeriodicalIF":16.4000,"publicationDate":"2024-08-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Accounts of Chemical Research","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1177/15345084241271926","RegionNum":1,"RegionCategory":"化学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"CHEMISTRY, MULTIDISCIPLINARY","Score":null,"Total":0}
引用次数: 0
Abstract
The current study examined the reliability of The Reading League Curriculum-Evaluation Guidelines (CEGs), which were developed to help school-based teams rate the presence of red flags when considering adopting specific literacy curricula. Coders ( n = 30) independently used the CEGs to evaluate a free online English language arts curriculum. The results indicated strong internal consistency ( a = 0.96) and high interrater reliability ( HM = .91, 95% CI = .89 to .93, p < .01). Overall, the CEGs hold the potential as a psychometrically sound tool for evaluating reading curricula. Limitations and implications for practice and research are discussed.
期刊介绍:
Accounts of Chemical Research presents short, concise and critical articles offering easy-to-read overviews of basic research and applications in all areas of chemistry and biochemistry. These short reviews focus on research from the author’s own laboratory and are designed to teach the reader about a research project. In addition, Accounts of Chemical Research publishes commentaries that give an informed opinion on a current research problem. Special Issues online are devoted to a single topic of unusual activity and significance.
Accounts of Chemical Research replaces the traditional article abstract with an article "Conspectus." These entries synopsize the research affording the reader a closer look at the content and significance of an article. Through this provision of a more detailed description of the article contents, the Conspectus enhances the article's discoverability by search engines and the exposure for the research.