Manuel F. Caro , Elviara P. Flórez , Isabel C. Muñoz
{"title":"评估学术课程学习成果的正式模型","authors":"Manuel F. Caro , Elviara P. Flórez , Isabel C. Muñoz","doi":"10.1016/j.evalprogplan.2025.102644","DOIUrl":null,"url":null,"abstract":"<div><div>Many academic programs face persistent challenges in evaluating learning outcomes with consistency, traceability, and alignment to curricular goals. This study introduces a formal model for the systematic assessment of learning outcomes across an academic program. The model is grounded in set theory and matrix algebra, integrates the SOLO taxonomy to classify levels of cognitive performance, and structures evaluation across three defined assessment moments: early, mid, and final stages of the academic trajectory.</div><div>The model was applied to a five-year teacher training program in Computer Science and validated through empirical data collection and statistical analysis. A paired t-test confirmed a significant decline in learning outcome performance between the initial and final stages of the program, while ANOVA results indicated consistent performance across courses at each stage. Based on these findings, the model also supports the generation of outcome-specific improvement plans, recalibrating performance expectations iteratively.</div><div>The proposed model contributes to outcome-based education by offering a replicable framework for aligning course-level evidence with program-level competencies. Its integration of structured assessment, cognitive benchmarking, and iterative feedback enables academic institutions to monitor student achievement longitudinally and support continuous curriculum improvement.</div></div>","PeriodicalId":48046,"journal":{"name":"Evaluation and Program Planning","volume":"114 ","pages":"Article 102644"},"PeriodicalIF":2.0000,"publicationDate":"2025-08-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A formal model for assessing the learning outcomes of academic programs\",\"authors\":\"Manuel F. Caro , Elviara P. Flórez , Isabel C. Muñoz\",\"doi\":\"10.1016/j.evalprogplan.2025.102644\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><div>Many academic programs face persistent challenges in evaluating learning outcomes with consistency, traceability, and alignment to curricular goals. This study introduces a formal model for the systematic assessment of learning outcomes across an academic program. The model is grounded in set theory and matrix algebra, integrates the SOLO taxonomy to classify levels of cognitive performance, and structures evaluation across three defined assessment moments: early, mid, and final stages of the academic trajectory.</div><div>The model was applied to a five-year teacher training program in Computer Science and validated through empirical data collection and statistical analysis. A paired t-test confirmed a significant decline in learning outcome performance between the initial and final stages of the program, while ANOVA results indicated consistent performance across courses at each stage. Based on these findings, the model also supports the generation of outcome-specific improvement plans, recalibrating performance expectations iteratively.</div><div>The proposed model contributes to outcome-based education by offering a replicable framework for aligning course-level evidence with program-level competencies. Its integration of structured assessment, cognitive benchmarking, and iterative feedback enables academic institutions to monitor student achievement longitudinally and support continuous curriculum improvement.</div></div>\",\"PeriodicalId\":48046,\"journal\":{\"name\":\"Evaluation and Program Planning\",\"volume\":\"114 \",\"pages\":\"Article 102644\"},\"PeriodicalIF\":2.0000,\"publicationDate\":\"2025-08-28\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Evaluation and Program Planning\",\"FirstCategoryId\":\"90\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0149718925001119\",\"RegionNum\":4,\"RegionCategory\":\"社会学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"SOCIAL SCIENCES, INTERDISCIPLINARY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Evaluation and Program Planning","FirstCategoryId":"90","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0149718925001119","RegionNum":4,"RegionCategory":"社会学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"SOCIAL SCIENCES, INTERDISCIPLINARY","Score":null,"Total":0}
A formal model for assessing the learning outcomes of academic programs
Many academic programs face persistent challenges in evaluating learning outcomes with consistency, traceability, and alignment to curricular goals. This study introduces a formal model for the systematic assessment of learning outcomes across an academic program. The model is grounded in set theory and matrix algebra, integrates the SOLO taxonomy to classify levels of cognitive performance, and structures evaluation across three defined assessment moments: early, mid, and final stages of the academic trajectory.
The model was applied to a five-year teacher training program in Computer Science and validated through empirical data collection and statistical analysis. A paired t-test confirmed a significant decline in learning outcome performance between the initial and final stages of the program, while ANOVA results indicated consistent performance across courses at each stage. Based on these findings, the model also supports the generation of outcome-specific improvement plans, recalibrating performance expectations iteratively.
The proposed model contributes to outcome-based education by offering a replicable framework for aligning course-level evidence with program-level competencies. Its integration of structured assessment, cognitive benchmarking, and iterative feedback enables academic institutions to monitor student achievement longitudinally and support continuous curriculum improvement.
期刊介绍:
Evaluation and Program Planning is based on the principle that the techniques and methods of evaluation and planning transcend the boundaries of specific fields and that relevant contributions to these areas come from people representing many different positions, intellectual traditions, and interests. In order to further the development of evaluation and planning, we publish articles from the private and public sectors in a wide range of areas: organizational development and behavior, training, planning, human resource development, health and mental, social services, mental retardation, corrections, substance abuse, and education.