Exploring the alignment of first-year summative assessments with Bloom’s Taxonomy: A longitudinal study

IF 0.6 Q3 EDUCATION & EDUCATIONAL RESEARCH
K. dos Reis, C. Swanepoel, D. Yu
{"title":"Exploring the alignment of first-year summative assessments with Bloom’s Taxonomy: A longitudinal study","authors":"K. dos Reis, C. Swanepoel, D. Yu","doi":"10.20853/36-5-4784","DOIUrl":null,"url":null,"abstract":"The correlation between the level of difficulty of assessments, Bloom’s Taxonomy as well as pass rates of courses has been a seriously under-researched area in South Africa. In this study, we proposed the revised Bloom’s taxonomy level of difficulty index, before we examined 112 first-year 2017‒2019 final and supplementary assessment papers from the Economic and Management Sciences Faculty of a university in Western Cape. The descriptive statistics showed that these assessment papers are different in terms of duration, total marks, type of questions asked as well as pass rates. It was also found that these first-year summative assessments asked questions mainly at levels two (understand) and three (apply) of the revised Bloom’s Taxonomy. In addition, the correlation and econometric analysis did not find a strong correlation between the level of difficulty index and pass rates. Nonetheless, the above-mentioned results need to be interpreted with great caution, because strictly speaking, one should also control for differences in other characteristics (e.g., students’ personal characteristics, school characteristics and lecture attendance). To conclude, there is no explicit national policy that guides higher education institutions (HEIs) on how to use Bloom’s or any other taxonomy to assess students at the appropriate National Qualifications Framework (NQF) level. Hence, our findings suggest that there is a need for a national assessment policy framework to guide HEIs on how to assess undergraduate students at different cognitive levels as required by the NQF. Keywords: Revised Bloom's Taxonomy, assessment, undergraduate first-year studies","PeriodicalId":44786,"journal":{"name":"South African Journal of Higher Education","volume":"1 1","pages":""},"PeriodicalIF":0.6000,"publicationDate":"2022-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"South African Journal of Higher Education","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.20853/36-5-4784","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"EDUCATION & EDUCATIONAL RESEARCH","Score":null,"Total":0}
引用次数: 0

Abstract

The correlation between the level of difficulty of assessments, Bloom’s Taxonomy as well as pass rates of courses has been a seriously under-researched area in South Africa. In this study, we proposed the revised Bloom’s taxonomy level of difficulty index, before we examined 112 first-year 2017‒2019 final and supplementary assessment papers from the Economic and Management Sciences Faculty of a university in Western Cape. The descriptive statistics showed that these assessment papers are different in terms of duration, total marks, type of questions asked as well as pass rates. It was also found that these first-year summative assessments asked questions mainly at levels two (understand) and three (apply) of the revised Bloom’s Taxonomy. In addition, the correlation and econometric analysis did not find a strong correlation between the level of difficulty index and pass rates. Nonetheless, the above-mentioned results need to be interpreted with great caution, because strictly speaking, one should also control for differences in other characteristics (e.g., students’ personal characteristics, school characteristics and lecture attendance). To conclude, there is no explicit national policy that guides higher education institutions (HEIs) on how to use Bloom’s or any other taxonomy to assess students at the appropriate National Qualifications Framework (NQF) level. Hence, our findings suggest that there is a need for a national assessment policy framework to guide HEIs on how to assess undergraduate students at different cognitive levels as required by the NQF. Keywords: Revised Bloom's Taxonomy, assessment, undergraduate first-year studies
探索第一年总结性评估与布鲁姆分类法的一致性:一项纵向研究
在南非,评估难度、布鲁姆分类法和课程通过率之间的关系一直是一个严重缺乏研究的领域。在本研究中,我们提出了修改后的Bloom分类法难度指数水平,然后对西开普省一所大学经济与管理科学学院的112篇2017-2019年一年级期末和补充评估论文进行了研究。描述性统计表明,这些评估试卷在持续时间、总分、问题类型以及通过率方面都有所不同。研究还发现,这些第一年的总结性评估主要针对修订后的布鲁姆分类法的第二级(理解)和第三级(应用)提出问题。此外,相关分析和计量分析均未发现难度指数水平与通过率之间存在较强的相关性。然而,上述结果需要非常谨慎地解释,因为严格地说,还应该控制其他特征的差异(例如,学生的个人特征,学校特征和讲座出勤率)。总而言之,没有明确的国家政策指导高等教育机构(HEIs)如何使用布鲁姆或任何其他分类来评估适当的国家资格框架(NQF)水平的学生。因此,我们的研究结果表明,有必要制定一个全国性的评估政策框架,以指导高等教育机构如何根据NQF的要求评估不同认知水平的本科生。关键词:修订的布鲁姆分类法,评估,本科一年级学习
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
South African Journal of Higher Education
South African Journal of Higher Education EDUCATION & EDUCATIONAL RESEARCH-
自引率
28.60%
发文量
38
审稿时长
12 weeks
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信