{"title":"On the quantitative analysis of assessment scores with implicit and explicit constraints","authors":"Sanjeeb Shrestha , Xiaoying Kong , Paul Kwan","doi":"10.1016/j.stueduc.2025.101509","DOIUrl":null,"url":null,"abstract":"<div><div>Overrating or underrating assessment scores is common in educational settings. Solutions include rubrics, marker training, and moderation. A less common approach is score standardisation due to perceived complexity and challenges in maintaining the integrity of the original data. This paper presents a standardisation approach for assessment scores that transforms original data into final scores subject to implicit and explicit constraints. Scores from a unit administered under similar marking standards and policies at two campuses is used for verification. Implicit constraints address anomalies like diverse assessors, leniency, harshness in marking, and design variations. Explicit constraints arise from institutional policies and practices. We propose an analytical expression for transforming raw to final scores that preserves raw data's integrity while varying the standard deviation to satisfy constraints. A data filtering algorithm is applied to remove redundant and null scores. Verification reveals that the approach produces a Z-statistical score of 1.63, demonstrating comparable distributions.</div></div>","PeriodicalId":47539,"journal":{"name":"Studies in Educational Evaluation","volume":"87 ","pages":"Article 101509"},"PeriodicalIF":2.6000,"publicationDate":"2025-08-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Studies in Educational Evaluation","FirstCategoryId":"95","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0191491X25000665","RegionNum":2,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"EDUCATION & EDUCATIONAL RESEARCH","Score":null,"Total":0}
引用次数: 0
Abstract
Overrating or underrating assessment scores is common in educational settings. Solutions include rubrics, marker training, and moderation. A less common approach is score standardisation due to perceived complexity and challenges in maintaining the integrity of the original data. This paper presents a standardisation approach for assessment scores that transforms original data into final scores subject to implicit and explicit constraints. Scores from a unit administered under similar marking standards and policies at two campuses is used for verification. Implicit constraints address anomalies like diverse assessors, leniency, harshness in marking, and design variations. Explicit constraints arise from institutional policies and practices. We propose an analytical expression for transforming raw to final scores that preserves raw data's integrity while varying the standard deviation to satisfy constraints. A data filtering algorithm is applied to remove redundant and null scores. Verification reveals that the approach produces a Z-statistical score of 1.63, demonstrating comparable distributions.
期刊介绍:
Studies in Educational Evaluation publishes original reports of evaluation studies. Four types of articles are published by the journal: (a) Empirical evaluation studies representing evaluation practice in educational systems around the world; (b) Theoretical reflections and empirical studies related to issues involved in the evaluation of educational programs, educational institutions, educational personnel and student assessment; (c) Articles summarizing the state-of-the-art concerning specific topics in evaluation in general or in a particular country or group of countries; (d) Book reviews and brief abstracts of evaluation studies.