Vanitha Virudachalam, Sergei Savin, Matthew P. Steinberg
{"title":"过多的信息:额外的考试什么时候对学校有利?","authors":"Vanitha Virudachalam, Sergei Savin, Matthew P. Steinberg","doi":"10.2139/ssrn.3884543","DOIUrl":null,"url":null,"abstract":"In the United States, most K-12 students now take annual standardized tests. As a result, school districts that traditionally utilized ongoing \"formative'' assessments of student progress increasingly rely on additional \"interim\" assessments to predict student performance on standardized tests. Moreover, some districts are experimenting with merit-based teacher incentives tied to student performance on state tests. We examine the relationship between predictive midyear assessments and teacher incentives using a two-period principal-agent model. The school district (principal) decides whether to implement interim assessments and how much merit pay to offer, while teachers (agents) choose how much effort to exert each period. We use two-state (\"proficient\" vs. \"not proficient'') Markovian dynamics to describe the evolution of student test readiness. Our results indicate that even free interim assessments are not always beneficial. For \"not-proficient'' schools, interim assessments only improve performance if the probability of achieving proficiency absent additional teacher effort is non-zero. The interim assessment's value is shaped by the merit-pay budget and the \"achievement gap factor,'' the ratio of probabilities of achieving proficiency, under the same level of teacher effort, for a school in the not-proficient vs. proficient state. The interim assessment is valuable under low budget levels if the achievement gap factor is high and under moderate budget levels if it is low. For \"proficient'' schools, if the probability of moving to the proficient state without additional teacher effort is zero, the school district should invest in an interim assessment if the budget is moderate and the achievement gap factor is high.","PeriodicalId":149553,"journal":{"name":"Political Economy - Development: Public Service Delivery eJournal","volume":"368 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2021-07-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Too Much Information: When Does Additional Testing Benefit Schools?\",\"authors\":\"Vanitha Virudachalam, Sergei Savin, Matthew P. Steinberg\",\"doi\":\"10.2139/ssrn.3884543\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"In the United States, most K-12 students now take annual standardized tests. As a result, school districts that traditionally utilized ongoing \\\"formative'' assessments of student progress increasingly rely on additional \\\"interim\\\" assessments to predict student performance on standardized tests. Moreover, some districts are experimenting with merit-based teacher incentives tied to student performance on state tests. We examine the relationship between predictive midyear assessments and teacher incentives using a two-period principal-agent model. The school district (principal) decides whether to implement interim assessments and how much merit pay to offer, while teachers (agents) choose how much effort to exert each period. We use two-state (\\\"proficient\\\" vs. \\\"not proficient'') Markovian dynamics to describe the evolution of student test readiness. Our results indicate that even free interim assessments are not always beneficial. For \\\"not-proficient'' schools, interim assessments only improve performance if the probability of achieving proficiency absent additional teacher effort is non-zero. The interim assessment's value is shaped by the merit-pay budget and the \\\"achievement gap factor,'' the ratio of probabilities of achieving proficiency, under the same level of teacher effort, for a school in the not-proficient vs. proficient state. The interim assessment is valuable under low budget levels if the achievement gap factor is high and under moderate budget levels if it is low. For \\\"proficient'' schools, if the probability of moving to the proficient state without additional teacher effort is zero, the school district should invest in an interim assessment if the budget is moderate and the achievement gap factor is high.\",\"PeriodicalId\":149553,\"journal\":{\"name\":\"Political Economy - Development: Public Service Delivery eJournal\",\"volume\":\"368 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2021-07-11\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Political Economy - Development: Public Service Delivery eJournal\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.2139/ssrn.3884543\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Political Economy - Development: Public Service Delivery eJournal","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.2139/ssrn.3884543","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Too Much Information: When Does Additional Testing Benefit Schools?
In the United States, most K-12 students now take annual standardized tests. As a result, school districts that traditionally utilized ongoing "formative'' assessments of student progress increasingly rely on additional "interim" assessments to predict student performance on standardized tests. Moreover, some districts are experimenting with merit-based teacher incentives tied to student performance on state tests. We examine the relationship between predictive midyear assessments and teacher incentives using a two-period principal-agent model. The school district (principal) decides whether to implement interim assessments and how much merit pay to offer, while teachers (agents) choose how much effort to exert each period. We use two-state ("proficient" vs. "not proficient'') Markovian dynamics to describe the evolution of student test readiness. Our results indicate that even free interim assessments are not always beneficial. For "not-proficient'' schools, interim assessments only improve performance if the probability of achieving proficiency absent additional teacher effort is non-zero. The interim assessment's value is shaped by the merit-pay budget and the "achievement gap factor,'' the ratio of probabilities of achieving proficiency, under the same level of teacher effort, for a school in the not-proficient vs. proficient state. The interim assessment is valuable under low budget levels if the achievement gap factor is high and under moderate budget levels if it is low. For "proficient'' schools, if the probability of moving to the proficient state without additional teacher effort is zero, the school district should invest in an interim assessment if the budget is moderate and the achievement gap factor is high.