The Surgical Education Checklist: A Novel Tool to Improve the Use of Entrustable Professional Activities in Operative Training in Competence by Design

IF 2.6 3区医学 Q1 EDUCATION, SCIENTIFIC DISCIPLINES

Journal of Surgical Education Pub Date : 2025-02-15 DOI:10.1016/j.jsurg.2025.103470

Yung Lee MD, MPH , Jigish Khamar MD , Yasith Samarasinghe BHSc , Tyler McKechnie MD, MSc , Bradley Petrisor MD , Ilun Yang MD, MMEd

{"title":"The Surgical Education Checklist: A Novel Tool to Improve the Use of Entrustable Professional Activities in Operative Training in Competence by Design","authors":"Yung Lee MD, MPH , Jigish Khamar MD , Yasith Samarasinghe BHSc , Tyler McKechnie MD, MSc , Bradley Petrisor MD , Ilun Yang MD, MMEd","doi":"10.1016/j.jsurg.2025.103470","DOIUrl":null,"url":null,"abstract":"<div><h3>Objective</h3><div>Surgical residents face significant challenges in meeting Entrustable Professional Activity (EPA) assessment requirements under the Competence By Design (CBD) framework, potentially impacting their surgical training and readiness for practice. This study seeks to assess the effectiveness of the Surgical Education Checklist (SEC) in increasing the proportion of completed EPA assessments within the Division of General Surgery.</div></div><div><h3>Design</h3><div>This prospective cohort study implemented the SEC between January 1, 2023, and June 30, 2023. A pre and postchecklist survey collected experiences with the SEC and overall CBD framework. The primary outcome was the proportion of completed EPA assessments. Descriptive statistics were reported and subgroup analyses were performed based on resident postgraduate year (PGY).</div></div><div><h3>Setting</h3><div>About 5 tertiary academic-affiliated teaching hospitals with McMaster University (Hamilton, Ontario)</div></div><div><h3>Participants</h3><div>All general surgery residents and staff faculty were invited to utilize the survey, with an approximate sample size of 71 participants. The overall response rate was 34 (47.9%) for the prechecklist survey and 11 (15.5%) for the postchecklist survey.</div></div><div><h3>Results</h3><div>The number of EPA assessments triggered increased from 485 to 639, with a significant increase in the absolute number of EPA assessments completed (400 vs 477, p < 0.01). There was an increase in the proportion of expired assessments (85 [17.5%] vs 162 [25.4%], p < 0.01) after the implementation of the SEC. In the subgroup analysis based on resident PGY, PGY1 to 3 general surgery residents triggered significantly more EPA assessments after the implementation of the SEC.</div></div><div><h3>Conclusions</h3><div>The SEC demonstrated its effectiveness as a perioperative prompt for triggering EPA assessments, particularly amongst junior general surgery residents, indicating its potential to facilitate early engagement with essential surgical training tasks. However, there remains gaps in follow-through and completion of triggered EPA assessments.</div></div>","PeriodicalId":50033,"journal":{"name":"Journal of Surgical Education","volume":"82 5","pages":"Article 103470"},"PeriodicalIF":2.6000,"publicationDate":"2025-02-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Surgical Education","FirstCategoryId":"3","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1931720425000510","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"EDUCATION, SCIENTIFIC DISCIPLINES","Score":null,"Total":0}

引用次数: 0

Abstract

Objective

Surgical residents face significant challenges in meeting Entrustable Professional Activity (EPA) assessment requirements under the Competence By Design (CBD) framework, potentially impacting their surgical training and readiness for practice. This study seeks to assess the effectiveness of the Surgical Education Checklist (SEC) in increasing the proportion of completed EPA assessments within the Division of General Surgery.

Design

This prospective cohort study implemented the SEC between January 1, 2023, and June 30, 2023. A pre and postchecklist survey collected experiences with the SEC and overall CBD framework. The primary outcome was the proportion of completed EPA assessments. Descriptive statistics were reported and subgroup analyses were performed based on resident postgraduate year (PGY).

Setting

About 5 tertiary academic-affiliated teaching hospitals with McMaster University (Hamilton, Ontario)

Participants

All general surgery residents and staff faculty were invited to utilize the survey, with an approximate sample size of 71 participants. The overall response rate was 34 (47.9%) for the prechecklist survey and 11 (15.5%) for the postchecklist survey.

Results

The number of EPA assessments triggered increased from 485 to 639, with a significant increase in the absolute number of EPA assessments completed (400 vs 477, p < 0.01). There was an increase in the proportion of expired assessments (85 [17.5%] vs 162 [25.4%], p < 0.01) after the implementation of the SEC. In the subgroup analysis based on resident PGY, PGY1 to 3 general surgery residents triggered significantly more EPA assessments after the implementation of the SEC.

Conclusions

The SEC demonstrated its effectiveness as a perioperative prompt for triggering EPA assessments, particularly amongst junior general surgery residents, indicating its potential to facilitate early engagement with essential surgical training tasks. However, there remains gaps in follow-through and completion of triggered EPA assessments.

查看原文本刊更多论文

求助全文

约1分钟内获得全文求助全文

来源期刊

Journal of Surgical Education EDUCATION, SCIENTIFIC DISCIPLINES-SURGERY

CiteScore

5.60

自引率

10.30%

发文量

261

审稿时长

48 days

期刊介绍： The Journal of Surgical Education (JSE) is dedicated to advancing the field of surgical education through original research. The journal publishes research articles in all surgical disciplines on topics relative to the education of surgical students, residents, and fellows, as well as practicing surgeons. Our readers look to JSE for timely, innovative research findings from the international surgical education community. As the official journal of the Association of Program Directors in Surgery (APDS), JSE publishes the proceedings of the annual APDS meeting held during Surgery Education Week.