Impact of Ungraded Readiness Assurance Tests on Student Preparation and Performance in an Integrated Required Pharmacy Course.

IF 3.8 4区 教育学 Q1 EDUCATION, SCIENTIFIC DISCIPLINES
Cheryl D Wood, Michelle Z Farland, Lindsey M Childs-Kean
{"title":"Impact of Ungraded Readiness Assurance Tests on Student Preparation and Performance in an Integrated Required Pharmacy Course.","authors":"Cheryl D Wood, Michelle Z Farland, Lindsey M Childs-Kean","doi":"10.1016/j.ajpe.2025.101426","DOIUrl":null,"url":null,"abstract":"<p><strong>Objective: </strong>To examine the impact of ungraded Readiness Assurance Tests (RATs) on students' pre-class preparation and performance in a team-based learning integrated required professional pharmacy course.</p><p><strong>Methods: </strong>This retrospective cohort study compared student performance and pre-class preparation quantitatively and qualitatively when RATs in a team-based learning course were ungraded vs. graded in a course in the second professional year. Student perceptions of the course were also summarized for the cohort that experienced ungraded RATs (2021). Four cohorts (2018, 2019, 2021, and 2022) were included in this study. Student performance was measured through individual RAT (iRAT) and exam scores. Student's pre-class preparation was measured by the number of unique viewers and portion of each video viewed for each pre-recorded lecture. The 2021 cohort's student evaluations of teaching were then analyzed for themes.</p><p><strong>Results: </strong>iRAT scores decreased in the ungraded 2021 cohort (mean score 7.5) compared to graded cohorts (2018: 8.1, 2019: 8.1, 2022: 8.4). Overall exam performance was consistent across cohorts. The mean of unique viewers accessing pre-recorded lectures and the portion of each pre-recorded lecture viewed ranged from 72.9% to 83.1% and 74.3% to 80.5%, respectively. Themes from student evaluations of teaching in the ungraded 2021 cohort included change in course structure caused stress; change in motivation and pre-class preparation; benefits of retrieval practice; preference for graded iRAT.</p><p><strong>Conclusion: </strong>Ungrading a single portion of the course resulted in lower performance on formative assessments, but similar performance on course exams. Students were uncomfortable with the change in grading structure in this course, which differed from their experiences in prior courses in the curriculum.</p>","PeriodicalId":55530,"journal":{"name":"American Journal of Pharmaceutical Education","volume":" ","pages":"101426"},"PeriodicalIF":3.8000,"publicationDate":"2025-05-24","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"American Journal of Pharmaceutical Education","FirstCategoryId":"95","ListUrlMain":"https://doi.org/10.1016/j.ajpe.2025.101426","RegionNum":4,"RegionCategory":"教育学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"EDUCATION, SCIENTIFIC DISCIPLINES","Score":null,"Total":0}
引用次数: 0

Abstract

Objective: To examine the impact of ungraded Readiness Assurance Tests (RATs) on students' pre-class preparation and performance in a team-based learning integrated required professional pharmacy course.

Methods: This retrospective cohort study compared student performance and pre-class preparation quantitatively and qualitatively when RATs in a team-based learning course were ungraded vs. graded in a course in the second professional year. Student perceptions of the course were also summarized for the cohort that experienced ungraded RATs (2021). Four cohorts (2018, 2019, 2021, and 2022) were included in this study. Student performance was measured through individual RAT (iRAT) and exam scores. Student's pre-class preparation was measured by the number of unique viewers and portion of each video viewed for each pre-recorded lecture. The 2021 cohort's student evaluations of teaching were then analyzed for themes.

Results: iRAT scores decreased in the ungraded 2021 cohort (mean score 7.5) compared to graded cohorts (2018: 8.1, 2019: 8.1, 2022: 8.4). Overall exam performance was consistent across cohorts. The mean of unique viewers accessing pre-recorded lectures and the portion of each pre-recorded lecture viewed ranged from 72.9% to 83.1% and 74.3% to 80.5%, respectively. Themes from student evaluations of teaching in the ungraded 2021 cohort included change in course structure caused stress; change in motivation and pre-class preparation; benefits of retrieval practice; preference for graded iRAT.

Conclusion: Ungrading a single portion of the course resulted in lower performance on formative assessments, but similar performance on course exams. Students were uncomfortable with the change in grading structure in this course, which differed from their experiences in prior courses in the curriculum.

未分级准备保证测试对学生在药学综合必修课程中的准备和表现的影响。
目的:探讨非分级准备保证测验(RATs)对团队学习综合药学专业必修课程学生课前准备和成绩的影响。方法:本研究采用回顾性队列研究方法,从定量和定性的角度比较两组学生的表现和课前准备情况。还总结了经历未分级RATs的队列(2021年)的学生对课程的看法。本研究包括四个队列(2018年、2019年、2021年和2022年)。学生的表现通过个人RAT (iRAT)和考试成绩来衡量。学生的课前准备是通过独立观众的数量和每个预先录制的讲座视频的观看比例来衡量的。然后对2021年的学生对教学的评价进行主题分析。结果:与分级队列(2018年:8.1,2019年:8.1,2022年:8.4)相比,未分级2021队列的iRAT评分(平均评分7.5)有所下降。整个队列的考试成绩是一致的。独立观众访问预录讲座的平均人数和每次预录讲座的观看比例分别为72.9% ~ 83.1%和74.3% ~ 80.5%。在未评分的2021年队列中,学生对教学的评估主题包括课程结构的变化导致压力;动机和课前准备的改变;检索练习的好处;优先考虑分级iRAT。结论:取消课程的单个部分的评分导致在形成性评估中的表现较低,但在课程考试中的表现相似。学生对这门课程的评分结构变化感到不舒服,这与他们在课程中先前课程的经历不同。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
CiteScore
4.30
自引率
15.20%
发文量
114
期刊介绍: The Journal accepts unsolicited manuscripts that have not been published and are not under consideration for publication elsewhere. The Journal only considers material related to pharmaceutical education for publication. Authors must prepare manuscripts to conform to the Journal style (Author Instructions). All manuscripts are subject to peer review and approval by the editor prior to acceptance for publication. Reviewers are assigned by the editor with the advice of the editorial board as needed. Manuscripts are submitted and processed online (Submit a Manuscript) using Editorial Manager, an online manuscript tracking system that facilitates communication between the editorial office, editor, associate editors, reviewers, and authors. After a manuscript is accepted, it is scheduled for publication in an upcoming issue of the Journal. All manuscripts are formatted and copyedited, and returned to the author for review and approval of the changes. Approximately 2 weeks prior to publication, the author receives an electronic proof of the article for final review and approval. Authors are not assessed page charges for publication.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信