Operative Performance and Autonomy Across Training Years: Does a Preliminary Year Matter?

IF 2.6 3区 医学 Q1 EDUCATION, SCIENTIFIC DISCIPLINES
Rebecca Moreci MD , Kayla M. Marcotte MS , Alyssa Pradarelli MD , Chia Chye Yee PhD , Tanvi Gupta MEng , Stefanie S. Sebok-Syer PhD , Andrew E. Krumm PhD , Brian C. George MD, MAEd
{"title":"Operative Performance and Autonomy Across Training Years: Does a Preliminary Year Matter?","authors":"Rebecca Moreci MD ,&nbsp;Kayla M. Marcotte MS ,&nbsp;Alyssa Pradarelli MD ,&nbsp;Chia Chye Yee PhD ,&nbsp;Tanvi Gupta MEng ,&nbsp;Stefanie S. Sebok-Syer PhD ,&nbsp;Andrew E. Krumm PhD ,&nbsp;Brian C. George MD, MAEd","doi":"10.1016/j.jsurg.2024.09.016","DOIUrl":null,"url":null,"abstract":"<div><h3>OBJECTIVE</h3><div>Preliminary surgery positions are associated with a negative stigma, and this stigma may persist for those residents who later go on to obtain a categorical position. However, it is currently unknown if general surgery residents who complete a preliminary year perform differently than their categorical peers throughout training. To examine these potential differences, we compared operative performance and autonomy across all 5 years of training for those who completed a nondesignated preliminary training year with those who did not.</div></div><div><h3>DESIGN</h3><div>Faculty ratings of categorical general surgery residents were collected from the Society for Improving Medical and Professional Learning (SIMPL) application. Residents were categorized based on the completion of a nondesignated preliminary year (“Previous Prelim” [PP]) or not (“Traditional Categorical” [TC]). Operative performance and autonomy ratings were tracked over 5 training years and analyzed using generalized mixed effects models. Performance and autonomy outcomes were dichotomized: “not competent” or “competent” and “no meaningful autonomy” or “meaningful autonomy”, respectively. Fixed effects included cohort group, academic month, case complexity, resident level (junior [PGYs 1 and 2] vs senior [PGYs 3, 4, and 5] residents), and an interaction term between cohort group and resident level, while random effects included resident, faculty, program, and procedure.</div></div><div><h3>SETTING</h3><div>Operative performance and autonomy ratings were collected from the SIMPL application between 2015 and 2023.</div></div><div><h3>PARTICIPANTS</h3><div>A total of 89 general surgery residency programs, which encompassed 1,108 categorical general surgery residents.</div></div><div><h3>RESULTS</h3><div>A total of 42,416 evaluations were analyzed. Of these, 809 evaluations were from PP residents. Faculty ratings of PP vs TC residents revealed no significant differences in adjusted probabilities of achieving a “competent” rating as a junior (5.6%, 95% Confidence Interval [CI] 2.7%-11.1% vs 3.0%, 95% CI 2.4%-3.7%, p = 0.28) or senior (23.7%, 95% CI 12.2%-41% vs 34.1%, 95% CI 29.1%-39.5%, p = 0.59) resident. Similarly, no significant differences were identified in adjusted probabilities of achieving a “meaningful autonomy” rating between PP and TC junior (9.0%, 95% CI 5.4%-14.6% vs 8.1%, 95% CI 6.9%-9.5%, p = 0.97) or senior (42.3%, 95% CI 28.7%-57.1% vs 49.6%, 95% CI 44.9%-54.2%, p = 0.76) residents.</div></div><div><h3>CONCLUSIONS</h3><div>PP and TC residents may have similar operative performance and autonomy ratings throughout their residency training. Although further study of more senior residents is warranted, these initial findings could help combat the negative stigma associated with a preliminary year of training.</div></div>","PeriodicalId":50033,"journal":{"name":"Journal of Surgical Education","volume":"82 1","pages":"Article 103297"},"PeriodicalIF":2.6000,"publicationDate":"2024-10-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Surgical Education","FirstCategoryId":"3","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1931720424004367","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"EDUCATION, SCIENTIFIC DISCIPLINES","Score":null,"Total":0}
引用次数: 0

Abstract

OBJECTIVE

Preliminary surgery positions are associated with a negative stigma, and this stigma may persist for those residents who later go on to obtain a categorical position. However, it is currently unknown if general surgery residents who complete a preliminary year perform differently than their categorical peers throughout training. To examine these potential differences, we compared operative performance and autonomy across all 5 years of training for those who completed a nondesignated preliminary training year with those who did not.

DESIGN

Faculty ratings of categorical general surgery residents were collected from the Society for Improving Medical and Professional Learning (SIMPL) application. Residents were categorized based on the completion of a nondesignated preliminary year (“Previous Prelim” [PP]) or not (“Traditional Categorical” [TC]). Operative performance and autonomy ratings were tracked over 5 training years and analyzed using generalized mixed effects models. Performance and autonomy outcomes were dichotomized: “not competent” or “competent” and “no meaningful autonomy” or “meaningful autonomy”, respectively. Fixed effects included cohort group, academic month, case complexity, resident level (junior [PGYs 1 and 2] vs senior [PGYs 3, 4, and 5] residents), and an interaction term between cohort group and resident level, while random effects included resident, faculty, program, and procedure.

SETTING

Operative performance and autonomy ratings were collected from the SIMPL application between 2015 and 2023.

PARTICIPANTS

A total of 89 general surgery residency programs, which encompassed 1,108 categorical general surgery residents.

RESULTS

A total of 42,416 evaluations were analyzed. Of these, 809 evaluations were from PP residents. Faculty ratings of PP vs TC residents revealed no significant differences in adjusted probabilities of achieving a “competent” rating as a junior (5.6%, 95% Confidence Interval [CI] 2.7%-11.1% vs 3.0%, 95% CI 2.4%-3.7%, p = 0.28) or senior (23.7%, 95% CI 12.2%-41% vs 34.1%, 95% CI 29.1%-39.5%, p = 0.59) resident. Similarly, no significant differences were identified in adjusted probabilities of achieving a “meaningful autonomy” rating between PP and TC junior (9.0%, 95% CI 5.4%-14.6% vs 8.1%, 95% CI 6.9%-9.5%, p = 0.97) or senior (42.3%, 95% CI 28.7%-57.1% vs 49.6%, 95% CI 44.9%-54.2%, p = 0.76) residents.

CONCLUSIONS

PP and TC residents may have similar operative performance and autonomy ratings throughout their residency training. Although further study of more senior residents is warranted, these initial findings could help combat the negative stigma associated with a preliminary year of training.
不同培训年限的操作绩效和自主性:第一年是否重要?
目的:外科预科职位与负面烙印有关,这种烙印可能会持续到后来获得分类职位的住院医师身上。然而,目前尚不清楚完成预科一年的普外科住院医师在整个培训期间的表现是否与分类住院医师不同。为了研究这些潜在的差异,我们比较了完成非指定预科培训年的住院医师与未完成预科培训年的住院医师在5年培训期间的手术表现和自主性:设计:从改善医学和专业学习协会(SIMPL)应用程序中收集了教师对分类普外科住院医师的评分。住院医师根据是否完成了非指定的预科培训年("Previous Prelim" [PP])进行分类("Traditional Categorical" [TC])。对5年培训期间的手术表现和自主性评分进行跟踪,并使用广义混合效应模型进行分析。成绩和自主性结果被二分:分别为 "不称职 "或 "称职",以及 "无意义自主 "或 "有意义自主"。固定效应包括队列组、学月、病例复杂程度、住院医师级别(初级[PGYs 1 和 2] vs 高级[PGYs 3、4 和 5] 住院医师)以及队列组和住院医师级别之间的交互项,随机效应包括住院医师、教员、项目和手术:从2015年至2023年期间的SIMPL应用程序中收集手术表现和自主性评分:共有89个普外科住院医师培训项目,包括1108名分类普外科住院医师:结果:共分析了 42,416 份评估。结果:共分析了 42,416 份评估,其中 809 份评估来自 PP 住院医师。教员对PP与TC住院医师的评价显示,初级(5.6%,95% 置信区间[CI] 2.7%-11.1% vs 3.0%,95% CI 2.4%-3.7%,p = 0.28)或高级(23.7%,95% CI 12.2%-41% vs 34.1%,95% CI 29.1%-39.5% ,p = 0.59)住院医师获得 "胜任 "评级的调整概率无显著差异。同样,PP 和 TC 初级住院医师(9.0%,95% CI 5.4%-14.6% vs 8.1%,95% CI 6.9%-9.5%,p = 0.97)或高级住院医师(42.3%,95% CI 28.7%-57.1% vs 49.6%,95% CI 44.9%-54.2%,p = 0.76)获得 "有意义自主 "评级的调整后概率也无明显差异:结论:PP和TC住院医师在整个住院医师培训期间的手术表现和自主性评分可能相似。结论:PP 和 TC 住院医师在整个住院医师培训期间的手术表现和自主性评分可能相似。虽然还需要对更高级别的住院医师进行进一步研究,但这些初步研究结果有助于消除与第一年培训相关的负面印象。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Journal of Surgical Education
Journal of Surgical Education EDUCATION, SCIENTIFIC DISCIPLINES-SURGERY
CiteScore
5.60
自引率
10.30%
发文量
261
审稿时长
48 days
期刊介绍: The Journal of Surgical Education (JSE) is dedicated to advancing the field of surgical education through original research. The journal publishes research articles in all surgical disciplines on topics relative to the education of surgical students, residents, and fellows, as well as practicing surgeons. Our readers look to JSE for timely, innovative research findings from the international surgical education community. As the official journal of the Association of Program Directors in Surgery (APDS), JSE publishes the proceedings of the annual APDS meeting held during Surgery Education Week.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信