Kai Pastor, Thorsten Schank, O. Troitschanskaia, K. Wälde
{"title":"A practical approach to overcoming biases in comparing student performance in higher education","authors":"Kai Pastor, Thorsten Schank, O. Troitschanskaia, K. Wälde","doi":"10.1080/02602938.2022.2134841","DOIUrl":null,"url":null,"abstract":"Abstract In times of rankings and performance benchmarks, data on average marks of higher education students are very common internationally and are often used as quality indicators in practice. We discuss the principles behind the distribution of average marks of students. These principles need to be taken into account when calculating the percentile of (the average mark of) a student. An informative percentile is obtained only if the average mark is compared to a distribution of averages that have been calculated based on the same number of credit points obtained by the student. We provide an empirical example from a university in Germany, which shows that percentile information can differ considerably when based upon different samples. Our findings indicate that the approach proposed in this study may not only be the most efficient approach for ranking students to be implemented into university practice, but may also contribute to a much more objective and credible grade reporting system for student performance.","PeriodicalId":48267,"journal":{"name":"Assessment & Evaluation in Higher Education","volume":"48 1","pages":"834 - 846"},"PeriodicalIF":4.1000,"publicationDate":"2022-11-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Assessment & Evaluation in Higher Education","FirstCategoryId":"95","ListUrlMain":"https://doi.org/10.1080/02602938.2022.2134841","RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"EDUCATION & EDUCATIONAL RESEARCH","Score":null,"Total":0}
引用次数: 0
Abstract
Abstract In times of rankings and performance benchmarks, data on average marks of higher education students are very common internationally and are often used as quality indicators in practice. We discuss the principles behind the distribution of average marks of students. These principles need to be taken into account when calculating the percentile of (the average mark of) a student. An informative percentile is obtained only if the average mark is compared to a distribution of averages that have been calculated based on the same number of credit points obtained by the student. We provide an empirical example from a university in Germany, which shows that percentile information can differ considerably when based upon different samples. Our findings indicate that the approach proposed in this study may not only be the most efficient approach for ranking students to be implemented into university practice, but may also contribute to a much more objective and credible grade reporting system for student performance.