Instruments to assess students’ critical thinking—A qualitative approach

IF 0.8 Q3 EDUCATION & EDUCATIONAL RESEARCH
Jomon A. Paul, Mona Sinha, Justin D. Cochran
{"title":"Instruments to assess students’ critical thinking—A qualitative approach","authors":"Jomon A. Paul,&nbsp;Mona Sinha,&nbsp;Justin D. Cochran","doi":"10.1111/dsji.12295","DOIUrl":null,"url":null,"abstract":"<div>\n \n <p>Critical thinking (CT) skills are essential to academic and professional success. Instruments to assess CT often rely on multiple-choice formats with inherent problems. This research presents two instruments for assessing CT, an essay and open-ended group-discussion format, which were implemented in an undergraduate business course at a large public university. The topics were intentionally chosen to be digitally-related (internet access and social media) since they raise complex issues, are applicable in many disciplines, and students are avid users, thereby making these instruments relevant, multidisciplinary, engaging, and multifaceted. These instruments may be adapted to enable educators to effectively assess undergraduate students’ ability to think critically. Qualitative analysis of the verbatim data with NVivo helps demonstrate the instruments’ efficacy in assessing CT, with (1) high-quality responses receiving high grades, and (2) overarching themes identified by content analysis, that coalesce into the three dimensions of social justice theory (distributive, procedural, and interactional), thus illustrating students’ consideration of complex fairness norms and societal needs. Excerpts of student responses are provided as illustrations of the indicators/evidence of critical thinking. Educators can use these instruments to first assess students’ CT skills, and then devise targeted interventions to improve the quality of students’ thought processes.</p>\n </div>","PeriodicalId":46210,"journal":{"name":"Decision Sciences-Journal of Innovative Education","volume":"21 3","pages":"123-143"},"PeriodicalIF":0.8000,"publicationDate":"2023-06-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Decision Sciences-Journal of Innovative Education","FirstCategoryId":"1085","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1111/dsji.12295","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"EDUCATION & EDUCATIONAL RESEARCH","Score":null,"Total":0}
引用次数: 0

Abstract

Critical thinking (CT) skills are essential to academic and professional success. Instruments to assess CT often rely on multiple-choice formats with inherent problems. This research presents two instruments for assessing CT, an essay and open-ended group-discussion format, which were implemented in an undergraduate business course at a large public university. The topics were intentionally chosen to be digitally-related (internet access and social media) since they raise complex issues, are applicable in many disciplines, and students are avid users, thereby making these instruments relevant, multidisciplinary, engaging, and multifaceted. These instruments may be adapted to enable educators to effectively assess undergraduate students’ ability to think critically. Qualitative analysis of the verbatim data with NVivo helps demonstrate the instruments’ efficacy in assessing CT, with (1) high-quality responses receiving high grades, and (2) overarching themes identified by content analysis, that coalesce into the three dimensions of social justice theory (distributive, procedural, and interactional), thus illustrating students’ consideration of complex fairness norms and societal needs. Excerpts of student responses are provided as illustrations of the indicators/evidence of critical thinking. Educators can use these instruments to first assess students’ CT skills, and then devise targeted interventions to improve the quality of students’ thought processes.

评估学生批判性思维的工具——定性方法
批判性思维(CT)技能对学术和职业成功至关重要。评估CT的仪器通常依赖于具有固有问题的多项选择格式。本研究提出了两种评估CT的工具,一种是论文,另一种是开放式的小组讨论形式,这两种工具已在一所大型公立大学的本科商业课程中实施。这些主题被有意选择与数字相关(互联网访问和社交媒体),因为它们提出了复杂的问题,适用于许多学科,学生是热心的用户,从而使这些工具具有相关性、多学科性、吸引力和多面性。这些工具可以使教育工作者能够有效地评估本科生的批判性思维能力。使用NVivo对逐字数据进行定性分析有助于证明工具在评估CT方面的有效性,(1)高质量的回答获得高分,(2)通过内容分析确定的总体主题,这些主题融合到社会正义理论的三个维度(分配、程序和互动)中,从而说明学生对复杂公平规范和社会需求的考虑。学生回答的节选作为批判性思维的指标/证据的例证。教育工作者可以使用这些工具首先评估学生的CT技能,然后设计有针对性的干预措施来提高学生思维过程的质量。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Decision Sciences-Journal of Innovative Education
Decision Sciences-Journal of Innovative Education EDUCATION & EDUCATIONAL RESEARCH-
CiteScore
3.60
自引率
36.80%
发文量
25
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信