{"title":"一种衡量评估工具与课程学习目标的一致性的软件工具","authors":"R. Ramesh, M. Sasikumar, Sridhar V. Iyer","doi":"10.1109/ICALT.2016.10","DOIUrl":null,"url":null,"abstract":"In this paper, we present a software tool to measure alignment of Assessment instrument (AI) with a set of learning objectives (LOs) of a course. Alignment of syllabus, LO and AI is a major parameter determining the quality of an AI. The tool helps to considerably reduce the time and effort needed by teachers to ensure this alignment. It takes syllabus, a set of LOs and domain ontology as input. An ontology based knowledge representation mechanism is designed to integrate the contents of syllabus, LOs and AI. Alignment is measured in terms of both concepts covered and cognitive level used. The Data Structures course of second year engineering curriculum is chosen as the domain. The accuracy of this tool is tested by comparing the system generated alignment measure with the expert teachers and a confusion matrix is generated. We got an average accuracy of 90% for concepts alignment and 95% agreement in cognitive level alignment.","PeriodicalId":188900,"journal":{"name":"2016 IEEE 16th International Conference on Advanced Learning Technologies (ICALT)","volume":"42 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2016-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"3","resultStr":"{\"title\":\"A Software Tool to Measure the Alignment of Assessment Instrument with a Set of Learning Objectives of a Course\",\"authors\":\"R. Ramesh, M. Sasikumar, Sridhar V. Iyer\",\"doi\":\"10.1109/ICALT.2016.10\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"In this paper, we present a software tool to measure alignment of Assessment instrument (AI) with a set of learning objectives (LOs) of a course. Alignment of syllabus, LO and AI is a major parameter determining the quality of an AI. The tool helps to considerably reduce the time and effort needed by teachers to ensure this alignment. It takes syllabus, a set of LOs and domain ontology as input. An ontology based knowledge representation mechanism is designed to integrate the contents of syllabus, LOs and AI. Alignment is measured in terms of both concepts covered and cognitive level used. The Data Structures course of second year engineering curriculum is chosen as the domain. The accuracy of this tool is tested by comparing the system generated alignment measure with the expert teachers and a confusion matrix is generated. We got an average accuracy of 90% for concepts alignment and 95% agreement in cognitive level alignment.\",\"PeriodicalId\":188900,\"journal\":{\"name\":\"2016 IEEE 16th International Conference on Advanced Learning Technologies (ICALT)\",\"volume\":\"42 1\",\"pages\":\"0\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2016-07-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"3\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"2016 IEEE 16th International Conference on Advanced Learning Technologies (ICALT)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1109/ICALT.2016.10\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"2016 IEEE 16th International Conference on Advanced Learning Technologies (ICALT)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1109/ICALT.2016.10","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
A Software Tool to Measure the Alignment of Assessment Instrument with a Set of Learning Objectives of a Course
In this paper, we present a software tool to measure alignment of Assessment instrument (AI) with a set of learning objectives (LOs) of a course. Alignment of syllabus, LO and AI is a major parameter determining the quality of an AI. The tool helps to considerably reduce the time and effort needed by teachers to ensure this alignment. It takes syllabus, a set of LOs and domain ontology as input. An ontology based knowledge representation mechanism is designed to integrate the contents of syllabus, LOs and AI. Alignment is measured in terms of both concepts covered and cognitive level used. The Data Structures course of second year engineering curriculum is chosen as the domain. The accuracy of this tool is tested by comparing the system generated alignment measure with the expert teachers and a confusion matrix is generated. We got an average accuracy of 90% for concepts alignment and 95% agreement in cognitive level alignment.