Lindsay A Mazotti, Delores A Amorelli, Ronald A Navarro, Abbas A Hyderi, Michael H Kanter, Carla S Lupi
{"title":"临床评估专家:改进见习评估的新教师角色。","authors":"Lindsay A Mazotti, Delores A Amorelli, Ronald A Navarro, Abbas A Hyderi, Michael H Kanter, Carla S Lupi","doi":"10.7812/TPP/23.062","DOIUrl":null,"url":null,"abstract":"<p><strong>Introduction: </strong>Ambulatory clerkships, including longitudinal integrated clerkships (LICs), face challenges to assessment, including time pressure and clinical demands on preceptors. High-quality clinical assessment is critical to implementing competency-based medical education, generating valid grades, and supporting learning. This importance is further heightened with the new pass/fail scoring for US Medical Licensing Exam Step 1, discontinuation of US Medical Licensing Exam Step 2 Clinical Skills, and the growing concern for bias in assessment.</p><p><strong>Methods: </strong>The Kaiser Permanente Bernard J. Tyson School of Medicine's LIC spans the first 2 years with 50 students per class. In 2021-2022, the authors created a new faculty role, the clinical assessment specialist (CASp). CASps are highly trained clinical teachers who directly observe clerkship students in the ambulatory setting, provide feedback, and complete competency-based assessment forms.</p><p><strong>Results: </strong>CASps completed 186 assessments of first-year (Y1) LIC students and 333 assessments of second-year (Y2) LIC students. Y2 students achieved average higher milestones and were rated as requiring less supervision compared to Y1 students. Y1 students rated CASps more favorably than Y2 students. Preceptors rated the contribution of CASps similarly across both years. Clerkship directors described benefits including identification of at-risk students and value of augmenting preceptor assessments.</p><p><strong>Discussion: </strong>The CASp role may offer an innovative way to generate valid assessment of student performance, offset clinical pressures faced by preceptors, identify at-risk students, and mitigate bias, especially in an LIC. Future studies may examine assessment validity, including use in summative assessment.</p><p><strong>Conclusion: </strong>CASps are an innovative approach to clinical clerkship assessment.</p>","PeriodicalId":23037,"journal":{"name":"The Permanente journal","volume":" ","pages":"76-80"},"PeriodicalIF":0.0000,"publicationDate":"2024-03-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10940249/pdf/","citationCount":"0","resultStr":"{\"title\":\"Clinical Assessment Specialists: A New Faculty Role to Improve Clerkship Assessment.\",\"authors\":\"Lindsay A Mazotti, Delores A Amorelli, Ronald A Navarro, Abbas A Hyderi, Michael H Kanter, Carla S Lupi\",\"doi\":\"10.7812/TPP/23.062\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Introduction: </strong>Ambulatory clerkships, including longitudinal integrated clerkships (LICs), face challenges to assessment, including time pressure and clinical demands on preceptors. High-quality clinical assessment is critical to implementing competency-based medical education, generating valid grades, and supporting learning. This importance is further heightened with the new pass/fail scoring for US Medical Licensing Exam Step 1, discontinuation of US Medical Licensing Exam Step 2 Clinical Skills, and the growing concern for bias in assessment.</p><p><strong>Methods: </strong>The Kaiser Permanente Bernard J. Tyson School of Medicine's LIC spans the first 2 years with 50 students per class. In 2021-2022, the authors created a new faculty role, the clinical assessment specialist (CASp). CASps are highly trained clinical teachers who directly observe clerkship students in the ambulatory setting, provide feedback, and complete competency-based assessment forms.</p><p><strong>Results: </strong>CASps completed 186 assessments of first-year (Y1) LIC students and 333 assessments of second-year (Y2) LIC students. Y2 students achieved average higher milestones and were rated as requiring less supervision compared to Y1 students. Y1 students rated CASps more favorably than Y2 students. Preceptors rated the contribution of CASps similarly across both years. Clerkship directors described benefits including identification of at-risk students and value of augmenting preceptor assessments.</p><p><strong>Discussion: </strong>The CASp role may offer an innovative way to generate valid assessment of student performance, offset clinical pressures faced by preceptors, identify at-risk students, and mitigate bias, especially in an LIC. Future studies may examine assessment validity, including use in summative assessment.</p><p><strong>Conclusion: </strong>CASps are an innovative approach to clinical clerkship assessment.</p>\",\"PeriodicalId\":23037,\"journal\":{\"name\":\"The Permanente journal\",\"volume\":\" \",\"pages\":\"76-80\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-03-15\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10940249/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"The Permanente journal\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.7812/TPP/23.062\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2023/12/1 0:00:00\",\"PubModel\":\"Epub\",\"JCR\":\"Q2\",\"JCRName\":\"Social Sciences\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"The Permanente journal","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.7812/TPP/23.062","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2023/12/1 0:00:00","PubModel":"Epub","JCR":"Q2","JCRName":"Social Sciences","Score":null,"Total":0}
引用次数: 0
摘要
简介:门诊见习,包括纵向综合见习(LICs),面临着评估的挑战,包括时间压力和临床对辅导员的要求。高质量的临床评估对于实施以能力为基础的医学教育、产生有效的成绩和支持学习至关重要。随着美国医疗执照考试第1步的新及格/不及格评分,美国医疗执照考试第2步临床技能的终止,以及对评估偏差的日益关注,这一重要性进一步提高。方法:Kaiser Permanente Bernard J. Tyson医学院的LIC跨越前两年,每班50名学生。在2021-2022年,作者创建了一个新的教师角色,临床评估专家(CASp)。casp是训练有素的临床教师,他们直接在门诊环境中观察见习学生,提供反馈,并完成基于能力的评估表格。结果:CASps完成了186项一年级(Y1)学生评估和333项二年级(Y2)学生评估。与一年级学生相比,二年级学生达到了更高的平均里程碑,并且被认为需要更少的监督。一年级学生对CASps的评价高于二年级学生。在这两年中,导师对CASps贡献的评价相似。见习主任描述的好处包括识别有风险的学生和增加教师评估的价值。讨论:CASp的作用可能提供一种创新的方式来产生有效的学生表现评估,抵消教师面临的临床压力,识别有风险的学生,并减轻偏见,特别是在LIC中。未来的研究可能会检查评估的有效性,包括在总结性评估中使用。结论:CASps是一种创新的临床见习评估方法。
Clinical Assessment Specialists: A New Faculty Role to Improve Clerkship Assessment.
Introduction: Ambulatory clerkships, including longitudinal integrated clerkships (LICs), face challenges to assessment, including time pressure and clinical demands on preceptors. High-quality clinical assessment is critical to implementing competency-based medical education, generating valid grades, and supporting learning. This importance is further heightened with the new pass/fail scoring for US Medical Licensing Exam Step 1, discontinuation of US Medical Licensing Exam Step 2 Clinical Skills, and the growing concern for bias in assessment.
Methods: The Kaiser Permanente Bernard J. Tyson School of Medicine's LIC spans the first 2 years with 50 students per class. In 2021-2022, the authors created a new faculty role, the clinical assessment specialist (CASp). CASps are highly trained clinical teachers who directly observe clerkship students in the ambulatory setting, provide feedback, and complete competency-based assessment forms.
Results: CASps completed 186 assessments of first-year (Y1) LIC students and 333 assessments of second-year (Y2) LIC students. Y2 students achieved average higher milestones and were rated as requiring less supervision compared to Y1 students. Y1 students rated CASps more favorably than Y2 students. Preceptors rated the contribution of CASps similarly across both years. Clerkship directors described benefits including identification of at-risk students and value of augmenting preceptor assessments.
Discussion: The CASp role may offer an innovative way to generate valid assessment of student performance, offset clinical pressures faced by preceptors, identify at-risk students, and mitigate bias, especially in an LIC. Future studies may examine assessment validity, including use in summative assessment.
Conclusion: CASps are an innovative approach to clinical clerkship assessment.