{"title":"面向大规模自动评分的科学视觉模型","authors":"C. W. Leong, Lei Liu, Rutuja Ubale, L. Chen","doi":"10.1145/3231644.3231681","DOIUrl":null,"url":null,"abstract":"Visual models of scientific concepts drawn by students afford expanded opportunities for showing their understanding beyond textual descriptions, but also introduce other elements characterized by artistic creativity and complexity. In this paper, we describe a standardized framework for evaluation of scientific visual models by human raters. This framework attempts to disentangle the interaction between the scientific modeling skills and artistic skills of representing real objects of students, and potentially provides a fair and valid way to assess understanding of scientific concepts e.g. structure and properties of Matter. Additionally, we report ongoing efforts to build automated assessment models based on the evaluation framework. Preliminary findings suggest the promise of such an automated approach.","PeriodicalId":20634,"journal":{"name":"Proceedings of the Fifth Annual ACM Conference on Learning at Scale","volume":"57 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2018-06-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"1","resultStr":"{\"title\":\"Toward large-scale automated scoring of scientific visual models\",\"authors\":\"C. W. Leong, Lei Liu, Rutuja Ubale, L. Chen\",\"doi\":\"10.1145/3231644.3231681\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Visual models of scientific concepts drawn by students afford expanded opportunities for showing their understanding beyond textual descriptions, but also introduce other elements characterized by artistic creativity and complexity. In this paper, we describe a standardized framework for evaluation of scientific visual models by human raters. This framework attempts to disentangle the interaction between the scientific modeling skills and artistic skills of representing real objects of students, and potentially provides a fair and valid way to assess understanding of scientific concepts e.g. structure and properties of Matter. Additionally, we report ongoing efforts to build automated assessment models based on the evaluation framework. Preliminary findings suggest the promise of such an automated approach.\",\"PeriodicalId\":20634,\"journal\":{\"name\":\"Proceedings of the Fifth Annual ACM Conference on Learning at Scale\",\"volume\":\"57 1\",\"pages\":\"\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2018-06-26\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"1\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Proceedings of the Fifth Annual ACM Conference on Learning at Scale\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1145/3231644.3231681\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings of the Fifth Annual ACM Conference on Learning at Scale","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1145/3231644.3231681","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Toward large-scale automated scoring of scientific visual models
Visual models of scientific concepts drawn by students afford expanded opportunities for showing their understanding beyond textual descriptions, but also introduce other elements characterized by artistic creativity and complexity. In this paper, we describe a standardized framework for evaluation of scientific visual models by human raters. This framework attempts to disentangle the interaction between the scientific modeling skills and artistic skills of representing real objects of students, and potentially provides a fair and valid way to assess understanding of scientific concepts e.g. structure and properties of Matter. Additionally, we report ongoing efforts to build automated assessment models based on the evaluation framework. Preliminary findings suggest the promise of such an automated approach.