Too Much Information: When Does Additional Testing Benefit Schools?

Vanitha Virudachalam, Sergei Savin, Matthew P. Steinberg
{"title":"Too Much Information: When Does Additional Testing Benefit Schools?","authors":"Vanitha Virudachalam, Sergei Savin, Matthew P. Steinberg","doi":"10.2139/ssrn.3884543","DOIUrl":null,"url":null,"abstract":"In the United States, most K-12 students now take annual standardized tests. As a result, school districts that traditionally utilized ongoing \"formative'' assessments of student progress increasingly rely on additional \"interim\" assessments to predict student performance on standardized tests. Moreover, some districts are experimenting with merit-based teacher incentives tied to student performance on state tests. We examine the relationship between predictive midyear assessments and teacher incentives using a two-period principal-agent model. The school district (principal) decides whether to implement interim assessments and how much merit pay to offer, while teachers (agents) choose how much effort to exert each period. We use two-state (\"proficient\" vs. \"not proficient'') Markovian dynamics to describe the evolution of student test readiness. Our results indicate that even free interim assessments are not always beneficial. For \"not-proficient'' schools, interim assessments only improve performance if the probability of achieving proficiency absent additional teacher effort is non-zero. The interim assessment's value is shaped by the merit-pay budget and the \"achievement gap factor,'' the ratio of probabilities of achieving proficiency, under the same level of teacher effort, for a school in the not-proficient vs. proficient state. The interim assessment is valuable under low budget levels if the achievement gap factor is high and under moderate budget levels if it is low. For \"proficient'' schools, if the probability of moving to the proficient state without additional teacher effort is zero, the school district should invest in an interim assessment if the budget is moderate and the achievement gap factor is high.","PeriodicalId":149553,"journal":{"name":"Political Economy - Development: Public Service Delivery eJournal","volume":"368 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-07-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Political Economy - Development: Public Service Delivery eJournal","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.2139/ssrn.3884543","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

In the United States, most K-12 students now take annual standardized tests. As a result, school districts that traditionally utilized ongoing "formative'' assessments of student progress increasingly rely on additional "interim" assessments to predict student performance on standardized tests. Moreover, some districts are experimenting with merit-based teacher incentives tied to student performance on state tests. We examine the relationship between predictive midyear assessments and teacher incentives using a two-period principal-agent model. The school district (principal) decides whether to implement interim assessments and how much merit pay to offer, while teachers (agents) choose how much effort to exert each period. We use two-state ("proficient" vs. "not proficient'') Markovian dynamics to describe the evolution of student test readiness. Our results indicate that even free interim assessments are not always beneficial. For "not-proficient'' schools, interim assessments only improve performance if the probability of achieving proficiency absent additional teacher effort is non-zero. The interim assessment's value is shaped by the merit-pay budget and the "achievement gap factor,'' the ratio of probabilities of achieving proficiency, under the same level of teacher effort, for a school in the not-proficient vs. proficient state. The interim assessment is valuable under low budget levels if the achievement gap factor is high and under moderate budget levels if it is low. For "proficient'' schools, if the probability of moving to the proficient state without additional teacher effort is zero, the school district should invest in an interim assessment if the budget is moderate and the achievement gap factor is high.
过多的信息:额外的考试什么时候对学校有利?
在美国,大多数K-12学生现在每年都参加标准化考试。因此,传统上使用持续的“形成性”学生进步评估的学区越来越依赖额外的“临时”评估来预测学生在标准化考试中的表现。此外,一些地区正在试验与学生在州考试中的表现挂钩的择优教师激励机制。我们使用两期委托代理模型检验了预测性年中评估与教师激励之间的关系。学区(校长)决定是否实施中期评估和支付多少绩效工资,教师(代理人)决定每个阶段的努力程度。我们使用两种状态(“精通”vs。“不熟练”)马尔可夫动力学来描述学生考试准备的演变。我们的研究结果表明,即使是免费的中期评估也并不总是有益的。对于“不熟练”的学校,只有在教师不付出额外努力而达到熟练程度的可能性不为零的情况下,中期评估才能提高绩效。中期评估的价值是由绩效薪酬预算和“成就差距因素”决定的。“成就差距因素”是在教师付出同样努力的情况下,一所学校在不熟练和熟练状态下达到熟练程度的概率之比。在低预算水平下,如果成绩差距系数高,则中期评价是有价值的,在中等预算水平下,如果成绩差距系数低。对于“熟练”的学校,如果不需要额外的教师努力就能达到熟练状态的概率为零,那么如果预算适中且成绩差距系数很高,学区应该投资进行中期评估。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信