{"title":"mooc的相对同伴评分系统模型","authors":"Timothy Holston, D. Wilkins","doi":"10.1145/3190645.3190684","DOIUrl":null,"url":null,"abstract":"This paper defines a model for a relative grading system that scales from low enrollment to large enrollment courses. The model allows peer grader to rank a small subset of submissions that are later merged into a global ranked set of all submissions for an assignment. This global set of ranked submissions and grades produced by expert graders(instructors and/or teachers assistants) who perform absolute grading of their own small subset of the submissions, are used to interpolate a cardinal grade for each submission of an assignment but excluding the ones graded by the experts. This model will be simulated to define the values of different parameters that produces valid and reliable grades. The research will also show that the model is scalable for different size courses by examining the effort of peer graders and expert graders.","PeriodicalId":403177,"journal":{"name":"Proceedings of the ACMSE 2018 Conference","volume":"1 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2018-03-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":"{\"title\":\"A model of a relative peer grading system for MOOCs\",\"authors\":\"Timothy Holston, D. Wilkins\",\"doi\":\"10.1145/3190645.3190684\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"This paper defines a model for a relative grading system that scales from low enrollment to large enrollment courses. The model allows peer grader to rank a small subset of submissions that are later merged into a global ranked set of all submissions for an assignment. This global set of ranked submissions and grades produced by expert graders(instructors and/or teachers assistants) who perform absolute grading of their own small subset of the submissions, are used to interpolate a cardinal grade for each submission of an assignment but excluding the ones graded by the experts. This model will be simulated to define the values of different parameters that produces valid and reliable grades. The research will also show that the model is scalable for different size courses by examining the effort of peer graders and expert graders.\",\"PeriodicalId\":403177,\"journal\":{\"name\":\"Proceedings of the ACMSE 2018 Conference\",\"volume\":\"1 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2018-03-29\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"1\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Proceedings of the ACMSE 2018 Conference\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1145/3190645.3190684\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings of the ACMSE 2018 Conference","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1145/3190645.3190684","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
A model of a relative peer grading system for MOOCs
This paper defines a model for a relative grading system that scales from low enrollment to large enrollment courses. The model allows peer grader to rank a small subset of submissions that are later merged into a global ranked set of all submissions for an assignment. This global set of ranked submissions and grades produced by expert graders(instructors and/or teachers assistants) who perform absolute grading of their own small subset of the submissions, are used to interpolate a cardinal grade for each submission of an assignment but excluding the ones graded by the experts. This model will be simulated to define the values of different parameters that produces valid and reliable grades. The research will also show that the model is scalable for different size courses by examining the effort of peer graders and expert graders.