Hector Vargas;Ruben Heradio;Gonzalo Farias;Zhongcheng Lei;Luis de la Torre
{"title":"评估能力本位课程学习成果的实用框架","authors":"Hector Vargas;Ruben Heradio;Gonzalo Farias;Zhongcheng Lei;Luis de la Torre","doi":"10.1109/TE.2023.3347273","DOIUrl":null,"url":null,"abstract":"Contribution: A competency assessment framework that enables learning analytics for course monitoring and continuous improvement. Our work fills the gap in systematic methods for competency assessment in higher education. Background: Many institutions are shifting toward competency-based education (CBE), thus encouraging their educators to start evaluating their students under this paradigm. Previous research shows that structured assessment models are fundamental in guiding educators toward this adoption. Intended Outcomes: An assessment model for CBE that is easy to adopt and use, while facilitating the application of learning analytics techniques. Application Design: The new framework considerably extends a prior model we proposed three years ago. Two engineering competency-based courses used the framework for assessment. Assessment rubrics were prepared and used for evaluating and collecting the students’ data progressively, thus enabling the use of learning analytics for decision-making. Findings: Thanks to the model: 1) students received a detailed report of their achievements, including a thorough explanation and justification of the evaluation criteria and 2) instructors could improve the course and provide objective evidence of their actions to quality assurance agencies. As a result, the framework is presently being used in 15 courses taught at eight different university degrees at the Pontifical Catholic University of Valparaiso (PUCV).","PeriodicalId":55011,"journal":{"name":"IEEE Transactions on Education","volume":"67 2","pages":"224-233"},"PeriodicalIF":2.1000,"publicationDate":"2024-01-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10409233","citationCount":"0","resultStr":"{\"title\":\"A Pragmatic Framework for Assessing Learning Outcomes in Competency-Based Courses\",\"authors\":\"Hector Vargas;Ruben Heradio;Gonzalo Farias;Zhongcheng Lei;Luis de la Torre\",\"doi\":\"10.1109/TE.2023.3347273\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Contribution: A competency assessment framework that enables learning analytics for course monitoring and continuous improvement. Our work fills the gap in systematic methods for competency assessment in higher education. Background: Many institutions are shifting toward competency-based education (CBE), thus encouraging their educators to start evaluating their students under this paradigm. Previous research shows that structured assessment models are fundamental in guiding educators toward this adoption. Intended Outcomes: An assessment model for CBE that is easy to adopt and use, while facilitating the application of learning analytics techniques. Application Design: The new framework considerably extends a prior model we proposed three years ago. Two engineering competency-based courses used the framework for assessment. Assessment rubrics were prepared and used for evaluating and collecting the students’ data progressively, thus enabling the use of learning analytics for decision-making. Findings: Thanks to the model: 1) students received a detailed report of their achievements, including a thorough explanation and justification of the evaluation criteria and 2) instructors could improve the course and provide objective evidence of their actions to quality assurance agencies. As a result, the framework is presently being used in 15 courses taught at eight different university degrees at the Pontifical Catholic University of Valparaiso (PUCV).\",\"PeriodicalId\":55011,\"journal\":{\"name\":\"IEEE Transactions on Education\",\"volume\":\"67 2\",\"pages\":\"224-233\"},\"PeriodicalIF\":2.1000,\"publicationDate\":\"2024-01-19\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10409233\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Transactions on Education\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10409233/\",\"RegionNum\":2,\"RegionCategory\":\"工程技术\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"EDUCATION, SCIENTIFIC DISCIPLINES\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Education","FirstCategoryId":"5","ListUrlMain":"https://ieeexplore.ieee.org/document/10409233/","RegionNum":2,"RegionCategory":"工程技术","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"EDUCATION, SCIENTIFIC DISCIPLINES","Score":null,"Total":0}
A Pragmatic Framework for Assessing Learning Outcomes in Competency-Based Courses
Contribution: A competency assessment framework that enables learning analytics for course monitoring and continuous improvement. Our work fills the gap in systematic methods for competency assessment in higher education. Background: Many institutions are shifting toward competency-based education (CBE), thus encouraging their educators to start evaluating their students under this paradigm. Previous research shows that structured assessment models are fundamental in guiding educators toward this adoption. Intended Outcomes: An assessment model for CBE that is easy to adopt and use, while facilitating the application of learning analytics techniques. Application Design: The new framework considerably extends a prior model we proposed three years ago. Two engineering competency-based courses used the framework for assessment. Assessment rubrics were prepared and used for evaluating and collecting the students’ data progressively, thus enabling the use of learning analytics for decision-making. Findings: Thanks to the model: 1) students received a detailed report of their achievements, including a thorough explanation and justification of the evaluation criteria and 2) instructors could improve the course and provide objective evidence of their actions to quality assurance agencies. As a result, the framework is presently being used in 15 courses taught at eight different university degrees at the Pontifical Catholic University of Valparaiso (PUCV).
期刊介绍:
The IEEE Transactions on Education (ToE) publishes significant and original scholarly contributions to education in electrical and electronics engineering, computer engineering, computer science, and other fields within the scope of interest of IEEE. Contributions must address discovery, integration, and/or application of knowledge in education in these fields. Articles must support contributions and assertions with compelling evidence and provide explicit, transparent descriptions of the processes through which the evidence is collected, analyzed, and interpreted. While characteristics of compelling evidence cannot be described to address every conceivable situation, generally assessment of the work being reported must go beyond student self-report and attitudinal data.