{"title":"How robust are socio-economic achievement gradients using PISA data? A case study from Germany","authors":"John Jerrim, Laura Zieger","doi":"10.1002/berj.3934","DOIUrl":null,"url":null,"abstract":"<p>Large-scale international achievement studies such as PISA have been widely used to study how educational inequality compares across countries. Yet the various different biases that may affect these estimates are often not considered or are poorly understood. In this paper we draw upon the total survey error framework to provide a case study of the potential biases affecting estimates of the socio-economic achievement gaps using PISA data from Germany. The results illustrate how procedural and measurement errors have a substantial impact upon estimates of socio-economic achievement gradients in Germany, including how it compares with other countries. This leads us to conclude that estimates of socio-economic achievement gaps using the PISA data for Germany do not seem to be particularly robust. More generally, we argue that better articulation and reporting of such challenges with comparing socio-economic achievement gaps using large-scale international assessment data such as PISA are needed.</p>","PeriodicalId":51410,"journal":{"name":"British Educational Research Journal","volume":null,"pages":null},"PeriodicalIF":3.0000,"publicationDate":"2023-11-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://onlinelibrary.wiley.com/doi/epdf/10.1002/berj.3934","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"British Educational Research Journal","FirstCategoryId":"95","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1002/berj.3934","RegionNum":3,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"EDUCATION & EDUCATIONAL RESEARCH","Score":null,"Total":0}
引用次数: 0
Abstract
Large-scale international achievement studies such as PISA have been widely used to study how educational inequality compares across countries. Yet the various different biases that may affect these estimates are often not considered or are poorly understood. In this paper we draw upon the total survey error framework to provide a case study of the potential biases affecting estimates of the socio-economic achievement gaps using PISA data from Germany. The results illustrate how procedural and measurement errors have a substantial impact upon estimates of socio-economic achievement gradients in Germany, including how it compares with other countries. This leads us to conclude that estimates of socio-economic achievement gaps using the PISA data for Germany do not seem to be particularly robust. More generally, we argue that better articulation and reporting of such challenges with comparing socio-economic achievement gaps using large-scale international assessment data such as PISA are needed.
期刊介绍:
The British Educational Research Journal is an international peer reviewed medium for the publication of articles of interest to researchers in education and has rapidly become a major focal point for the publication of educational research from throughout the world. For further information on the association please visit the British Educational Research Association web site. The journal is interdisciplinary in approach, and includes reports of case studies, experiments and surveys, discussions of conceptual and methodological issues and of underlying assumptions in educational research, accounts of research in progress, and book reviews.