The Surgical Education Checklist: A Novel Tool to Improve the Use of Entrustable Professional Activities in Operative Training in Competence by Design

IF 2.6 3区医学 Q1 EDUCATION, SCIENTIFIC DISCIPLINES

Journal of Surgical Education Pub Date : 2025-02-15 DOI:10.1016/j.jsurg.2025.103470

Yung Lee MD, MPH , Jigish Khamar MD , Yasith Samarasinghe BHSc , Tyler McKechnie MD, MSc , Bradley Petrisor MD , Ilun Yang MD, MMEd

{"title":"The Surgical Education Checklist: A Novel Tool to Improve the Use of Entrustable Professional Activities in Operative Training in Competence by Design","authors":"Yung Lee MD, MPH , Jigish Khamar MD , Yasith Samarasinghe BHSc , Tyler McKechnie MD, MSc , Bradley Petrisor MD , Ilun Yang MD, MMEd","doi":"10.1016/j.jsurg.2025.103470","DOIUrl":null,"url":null,"abstract":"<div><h3>Objective</h3><div>Surgical residents face significant challenges in meeting Entrustable Professional Activity (EPA) assessment requirements under the Competence By Design (CBD) framework, potentially impacting their surgical training and readiness for practice. This study seeks to assess the effectiveness of the Surgical Education Checklist (SEC) in increasing the proportion of completed EPA assessments within the Division of General Surgery.</div></div><div><h3>Design</h3><div>This prospective cohort study implemented the SEC between January 1, 2023, and June 30, 2023. A pre and postchecklist survey collected experiences with the SEC and overall CBD framework. The primary outcome was the proportion of completed EPA assessments. Descriptive statistics were reported and subgroup analyses were performed based on resident postgraduate year (PGY).</div></div><div><h3>Setting</h3><div>About 5 tertiary academic-affiliated teaching hospitals with McMaster University (Hamilton, Ontario)</div></div><div><h3>Participants</h3><div>All general surgery residents and staff faculty were invited to utilize the survey, with an approximate sample size of 71 participants. The overall response rate was 34 (47.9%) for the prechecklist survey and 11 (15.5%) for the postchecklist survey.</div></div><div><h3>Results</h3><div>The number of EPA assessments triggered increased from 485 to 639, with a significant increase in the absolute number of EPA assessments completed (400 vs 477, p < 0.01). There was an increase in the proportion of expired assessments (85 [17.5%] vs 162 [25.4%], p < 0.01) after the implementation of the SEC. In the subgroup analysis based on resident PGY, PGY1 to 3 general surgery residents triggered significantly more EPA assessments after the implementation of the SEC.</div></div><div><h3>Conclusions</h3><div>The SEC demonstrated its effectiveness as a perioperative prompt for triggering EPA assessments, particularly amongst junior general surgery residents, indicating its potential to facilitate early engagement with essential surgical training tasks. However, there remains gaps in follow-through and completion of triggered EPA assessments.</div></div>","PeriodicalId":50033,"journal":{"name":"Journal of Surgical Education","volume":"82 5","pages":"Article 103470"},"PeriodicalIF":2.6000,"publicationDate":"2025-02-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Surgical Education","FirstCategoryId":"3","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1931720425000510","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"EDUCATION, SCIENTIFIC DISCIPLINES","Score":null,"Total":0}

引用次数: 0

Abstract

Objective

Surgical residents face significant challenges in meeting Entrustable Professional Activity (EPA) assessment requirements under the Competence By Design (CBD) framework, potentially impacting their surgical training and readiness for practice. This study seeks to assess the effectiveness of the Surgical Education Checklist (SEC) in increasing the proportion of completed EPA assessments within the Division of General Surgery.

Design

This prospective cohort study implemented the SEC between January 1, 2023, and June 30, 2023. A pre and postchecklist survey collected experiences with the SEC and overall CBD framework. The primary outcome was the proportion of completed EPA assessments. Descriptive statistics were reported and subgroup analyses were performed based on resident postgraduate year (PGY).

Setting

About 5 tertiary academic-affiliated teaching hospitals with McMaster University (Hamilton, Ontario)

Participants

All general surgery residents and staff faculty were invited to utilize the survey, with an approximate sample size of 71 participants. The overall response rate was 34 (47.9%) for the prechecklist survey and 11 (15.5%) for the postchecklist survey.

Results

The number of EPA assessments triggered increased from 485 to 639, with a significant increase in the absolute number of EPA assessments completed (400 vs 477, p < 0.01). There was an increase in the proportion of expired assessments (85 [17.5%] vs 162 [25.4%], p < 0.01) after the implementation of the SEC. In the subgroup analysis based on resident PGY, PGY1 to 3 general surgery residents triggered significantly more EPA assessments after the implementation of the SEC.

Conclusions

The SEC demonstrated its effectiveness as a perioperative prompt for triggering EPA assessments, particularly amongst junior general surgery residents, indicating its potential to facilitate early engagement with essential surgical training tasks. However, there remains gaps in follow-through and completion of triggered EPA assessments.

查看原文本刊更多论文

外科教育检查表：一种新颖的工具，以提高使用可信赖的专业活动在手术能力训练设计

目的外科住院医师在满足能力设计（CBD）框架下的可信赖专业活动（EPA）评估要求方面面临重大挑战，这可能会影响他们的手术培训和实践准备。本研究旨在评估外科教育清单（SEC）在提高普通外科完成的EPA评估比例方面的有效性。该前瞻性队列研究在2023年1月1日至2023年6月30日期间实施了SEC。清单前和清单后的调查收集了SEC和整个CBD框架的经验。主要结果是完成EPA评估的比例。报告描述性统计数据，并基于研究生居住年（PGY）进行亚组分析。研究背景麦克马斯特大学（Hamilton, Ontario）约5所三级附属教学医院的研究对象所有普通外科住院医师和教职员工被邀请参与调查，样本量约为71人。检查前调查的总应答率为34(47.9%)，检查后调查的总应答率为11（15.5%）。结果触发的EPA评估数量从485次增加到639次，完成的EPA评估绝对数量显著增加(400次vs 477次，p <；0.01)。过期评估的比例有所增加(85例[17.5%]vs 162例[25.4%],p <；在基于住院医师PGY的亚组分析中，PGY1至3普外科住院医师在实施SEC后触发了更多的EPA评估。结论SEC证明了其作为触发EPA评估的围手术期提示的有效性，特别是在初级普外科住院医师中，表明其促进早期参与基本外科培训任务的潜力。然而，在执行和完成触发的EPA评估方面仍存在差距。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

Journal of Surgical Education EDUCATION, SCIENTIFIC DISCIPLINES-SURGERY

CiteScore

5.60

自引率

10.30%

发文量

261

审稿时长

48 days

期刊介绍： The Journal of Surgical Education (JSE) is dedicated to advancing the field of surgical education through original research. The journal publishes research articles in all surgical disciplines on topics relative to the education of surgical students, residents, and fellows, as well as practicing surgeons. Our readers look to JSE for timely, innovative research findings from the international surgical education community. As the official journal of the Association of Program Directors in Surgery (APDS), JSE publishes the proceedings of the annual APDS meeting held during Surgery Education Week.