{"title":"EHR-Driven Delivery of EPA Assessments Significantly Improves Participation","authors":"","doi":"10.1016/j.jsurg.2024.06.015","DOIUrl":null,"url":null,"abstract":"<div><h3>INTRODUCTION</h3><div>Digital education tools are a cornerstone in the evolution to CBME through EPAs. Successful implementation requires understanding the variable impacts of EHR-driven delivery of EPAs, flexible digital device access to EPAs, and user-behavior trends.</div></div><div><h3>METHODS</h3><div>Through a HIPAA compliant, flexible-device accessible, surgical education platform, general surgery training programs at 21 institutions collected EPA from July 2023 to April 2024. At 5 EHR-integrated institutions (EHR+), EPA were created for clinical activities based on the OR schedule, automatically pushed to attendings and residents with built in completion reminders. At 16 institutions without EHR integration (EHR-), EPA were initiated manually. To improve user experience, care phases were bundled (cEPA). We compared the EHR+ and EHR− groups, computing descriptive statistics on the cEPAs completed and user behavior metrics.</div></div><div><h3>RESULTS</h3><div>We collected 4187 cEPAs in total, with 82% at EHR+ institutions and 18% at EHR- institutions. Platform triggering dramatically drove cEPA completion for both faculty and residents, 88% and 81%, respectively. Only 3% were initiated by the faculty or resident. Faculty at EHR+ institutions strongly preferred the automated OR-triggered workflow to start their EPAs (Chi-squared test, p ≈ 0). Faculty completed all 3 care phases nearly 80% of the time. Time reminders specifically drive EPA completion for residents and faculty on weekdays and build habits on weekends. 71% of cEPAs completed were by computer, and 29% by phone. More comments were provided when computers were used. Residents reviewed feedback with a median lag of 1 hour and 29 min after results were available.</div></div><div><h3>CONCLUSIONS</h3><div>EHR-driven delivery of EPA leads to a 4.6-fold increase in EPAs completed. EPA initiation is the most critical phase in the workflow and EHR-data driven alerts drive this action. These alerts are also effective drivers of habit formation. Flexible device access is important to increase EPAs completed and improve the usefulness through comments for residents.</div></div>","PeriodicalId":50033,"journal":{"name":"Journal of Surgical Education","volume":"81 11","pages":"Pages A12-A22"},"PeriodicalIF":2.6000,"publicationDate":"2024-07-03","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Surgical Education","FirstCategoryId":"3","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1931720424002873","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"EDUCATION, SCIENTIFIC DISCIPLINES","Score":null,"Total":0}
引用次数: 0
Abstract
INTRODUCTION
Digital education tools are a cornerstone in the evolution to CBME through EPAs. Successful implementation requires understanding the variable impacts of EHR-driven delivery of EPAs, flexible digital device access to EPAs, and user-behavior trends.
METHODS
Through a HIPAA compliant, flexible-device accessible, surgical education platform, general surgery training programs at 21 institutions collected EPA from July 2023 to April 2024. At 5 EHR-integrated institutions (EHR+), EPA were created for clinical activities based on the OR schedule, automatically pushed to attendings and residents with built in completion reminders. At 16 institutions without EHR integration (EHR-), EPA were initiated manually. To improve user experience, care phases were bundled (cEPA). We compared the EHR+ and EHR− groups, computing descriptive statistics on the cEPAs completed and user behavior metrics.
RESULTS
We collected 4187 cEPAs in total, with 82% at EHR+ institutions and 18% at EHR- institutions. Platform triggering dramatically drove cEPA completion for both faculty and residents, 88% and 81%, respectively. Only 3% were initiated by the faculty or resident. Faculty at EHR+ institutions strongly preferred the automated OR-triggered workflow to start their EPAs (Chi-squared test, p ≈ 0). Faculty completed all 3 care phases nearly 80% of the time. Time reminders specifically drive EPA completion for residents and faculty on weekdays and build habits on weekends. 71% of cEPAs completed were by computer, and 29% by phone. More comments were provided when computers were used. Residents reviewed feedback with a median lag of 1 hour and 29 min after results were available.
CONCLUSIONS
EHR-driven delivery of EPA leads to a 4.6-fold increase in EPAs completed. EPA initiation is the most critical phase in the workflow and EHR-data driven alerts drive this action. These alerts are also effective drivers of habit formation. Flexible device access is important to increase EPAs completed and improve the usefulness through comments for residents.
期刊介绍:
The Journal of Surgical Education (JSE) is dedicated to advancing the field of surgical education through original research. The journal publishes research articles in all surgical disciplines on topics relative to the education of surgical students, residents, and fellows, as well as practicing surgeons. Our readers look to JSE for timely, innovative research findings from the international surgical education community. As the official journal of the Association of Program Directors in Surgery (APDS), JSE publishes the proceedings of the annual APDS meeting held during Surgery Education Week.