{"title":"Detection of and Correction for Violation of the Common Trend Assumption in Gain Score Analysis","authors":"Yongnam Kim, Sangyun Lee, Naram Gwak","doi":"10.31158/jeev.2022.35.4.743","DOIUrl":null,"url":null,"abstract":"Gain score analysis or difference-in-differences allows researchers to identify valid causal effects even in the presence of unmeasured confounding. This identification hinges on its own unique assumption referred to as the common trend assumption. The assumption requires that the impacts of the confounding variables on the pre- and posttest scores are identical. Despite the importance, however, researchers have no way to empirically evaluate the assumption and, thus, have not well discussed or justified its plausibility in their research. This paper makes two contributions. First, the paper introduces a novel strategy that uses an additional variable that helps one to test the plausibility of the common trend assumption. Second, the papers develops a formal gain score analysis that corrects the violation of the common trend assumption and returns unbiased causal effects even though the common trend assumption is violated. The proposed approaches are illustrated by real data analysis.","PeriodicalId":207460,"journal":{"name":"Korean Society for Educational Evaluation","volume":"120 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2022-12-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Korean Society for Educational Evaluation","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.31158/jeev.2022.35.4.743","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
Gain score analysis or difference-in-differences allows researchers to identify valid causal effects even in the presence of unmeasured confounding. This identification hinges on its own unique assumption referred to as the common trend assumption. The assumption requires that the impacts of the confounding variables on the pre- and posttest scores are identical. Despite the importance, however, researchers have no way to empirically evaluate the assumption and, thus, have not well discussed or justified its plausibility in their research. This paper makes two contributions. First, the paper introduces a novel strategy that uses an additional variable that helps one to test the plausibility of the common trend assumption. Second, the papers develops a formal gain score analysis that corrects the violation of the common trend assumption and returns unbiased causal effects even though the common trend assumption is violated. The proposed approaches are illustrated by real data analysis.