{"title":"An Investigation of the Raudenbush (1988) Test for Studying Variance Heterogeneity.","authors":"Michael R. Harwell","doi":"10.1080/00220973.1997.9943791","DOIUrl":null,"url":null,"abstract":"Abstract The meta-analytic method proposed by Raudenbush (1988) for studying variance heterogeneity was investigated. This method uses the difference in two weighted log-standard deviations (e.g., treatment vs. control group) as an effect size and provides a test of the homogeneity of effect sizes. The relationship between study characteristics and effect sizes can also be investigated. Although appealing, the performance of this procedure for realistic data sets characterized by nonnormal data and small study sample sizes is unknown. The results of a Monte Carlo study indicated that the Type I error rate of the test was sensitive to even modestly platykurtic score distributions and to the ratio of study sample size to the number of studies, even if the data were normally distributed. On the whole, this test cannot be recommended to meta-analysts.","PeriodicalId":47911,"journal":{"name":"Journal of Experimental Education","volume":"48 1","pages":"181-190"},"PeriodicalIF":2.2000,"publicationDate":"1996-10-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://sci-hub-pdf.com/10.1080/00220973.1997.9943791","citationCount":"3","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Experimental Education","FirstCategoryId":"95","ListUrlMain":"https://doi.org/10.1080/00220973.1997.9943791","RegionNum":4,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"Social Sciences","Score":null,"Total":0}
引用次数: 3
Abstract
Abstract The meta-analytic method proposed by Raudenbush (1988) for studying variance heterogeneity was investigated. This method uses the difference in two weighted log-standard deviations (e.g., treatment vs. control group) as an effect size and provides a test of the homogeneity of effect sizes. The relationship between study characteristics and effect sizes can also be investigated. Although appealing, the performance of this procedure for realistic data sets characterized by nonnormal data and small study sample sizes is unknown. The results of a Monte Carlo study indicated that the Type I error rate of the test was sensitive to even modestly platykurtic score distributions and to the ratio of study sample size to the number of studies, even if the data were normally distributed. On the whole, this test cannot be recommended to meta-analysts.
期刊介绍:
The Journal of Experimental Education publishes theoretical, laboratory, and classroom research studies that use the range of quantitative and qualitative methodologies. Recent articles have explored the correlation between test preparation and performance, enhancing students" self-efficacy, the effects of peer collaboration among students, and arguments about statistical significance and effect size reporting. In recent issues, JXE has published examinations of statistical methodologies and editorial practices used in several educational research journals.