Can ACGME Milestones predict surgical specialty board passage: an example in Obstetrics and Gynecology.

IF 0.4 4区医学 Q4 OBSTETRICS & GYNECOLOGY

Clinical and experimental obstetrics & gynecology Pub Date : 2021-10-15 DOI:10.31083/j.ceog4805168

Sarah Ottum, Conrad Chao, Sejal Tamakuwala, Joshua Dean, Adib Shafi, Katherine Jennifer Kramer, Satinder Kaur, Maurice-Andre Recanati

{"title":"Can ACGME Milestones predict surgical specialty board passage: an example in Obstetrics and Gynecology.","authors":"Sarah Ottum, Conrad Chao, Sejal Tamakuwala, Joshua Dean, Adib Shafi, Katherine Jennifer Kramer, Satinder Kaur, Maurice-Andre Recanati","doi":"10.31083/j.ceog4805168","DOIUrl":null,"url":null,"abstract":"Background: Multiple tools including Accreditation Council for Graduate Medical Education (ACGME) standardized milestones can be utilized to assess trainee and residency program performance. However, little is known regarding the objective validation of these tools in predicting written board passage.Methods: In this retrospective study, data was gathered on n = 45 Wayne State University Obstetrics and Gynecology program graduates over the five-year period ending July 2018. United States Medical Licensing Examination (USMLE) scores, Council on Resident Education in Obstetrics and Gynecology (CREOG) in-training scores and ACGME milestones were used to predict American Board of Obstetrics and Gynecology (ABOG) board passage success on first attempt. Significance was set at p < 0.05.Results: Written board passage was associated with average CREOGs (p = 0.01) and milestones (p = 0.008) while USMLE1 was not significantly associated (p = 0.055). USMLE1 <217 (Positive predictive value (PPV) = 96%). CREOGs <197 (PPV = 100%) and milestones <3.25 (PPV = 100%), particularly practice-based learning and systems-based practice milestones were most strongly correlated with board failure. Using a combination of these two milestones, it is possible to correctly predict board passage using our model (PPV = 86%).Discussion: This study is the first validating the utility of milestones in a surgical specialty by demonstrating their ability to predict board passage. Residents with CREOGs or milestones below thresholds are at risk for board failure and may warrant early intervention.","PeriodicalId":10312,"journal":{"name":"Clinical and experimental obstetrics & gynecology","volume":"48 5","pages":"1048-1055"},"PeriodicalIF":0.4000,"publicationDate":"2021-10-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8555913/pdf/","citationCount":"2","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Clinical and experimental obstetrics & gynecology","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.31083/j.ceog4805168","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q4","JCRName":"OBSTETRICS & GYNECOLOGY","Score":null,"Total":0}

引用次数: 2

Abstract

Background: Multiple tools including Accreditation Council for Graduate Medical Education (ACGME) standardized milestones can be utilized to assess trainee and residency program performance. However, little is known regarding the objective validation of these tools in predicting written board passage.

Methods: In this retrospective study, data was gathered on n = 45 Wayne State University Obstetrics and Gynecology program graduates over the five-year period ending July 2018. United States Medical Licensing Examination (USMLE) scores, Council on Resident Education in Obstetrics and Gynecology (CREOG) in-training scores and ACGME milestones were used to predict American Board of Obstetrics and Gynecology (ABOG) board passage success on first attempt. Significance was set at p < 0.05.

Results: Written board passage was associated with average CREOGs (p = 0.01) and milestones (p = 0.008) while USMLE1 was not significantly associated (p = 0.055). USMLE1 <217 (Positive predictive value (PPV) = 96%). CREOGs <197 (PPV = 100%) and milestones <3.25 (PPV = 100%), particularly practice-based learning and systems-based practice milestones were most strongly correlated with board failure. Using a combination of these two milestones, it is possible to correctly predict board passage using our model (PPV = 86%).

Discussion: This study is the first validating the utility of milestones in a surgical specialty by demonstrating their ability to predict board passage. Residents with CREOGs or milestones below thresholds are at risk for board failure and may warrant early intervention.

Abstract Image

查看原文本刊更多论文

ACGME里程碑能否预测外科专业委员会的通过:以妇产科为例。

背景:包括研究生医学教育认证委员会(ACGME)标准化里程碑在内的多种工具可用于评估实习生和住院医师计划的绩效。然而，很少有人知道关于这些工具在预测书面董事会通过的客观验证。方法:在这项回顾性研究中，收集了截至2018年7月的五年期间n = 45名韦恩州立大学妇产科专业毕业生的数据。美国医师执照考试(USMLE)分数、妇产科住院医师教育委员会(CREOG)培训分数和ACGME里程碑被用来预测美国妇产科委员会(ABOG)第一次通过委员会的成功。p < 0.05为显著性。结果:书面板通过与平均CREOGs (p = 0.01)和里程碑(p = 0.008)相关，而USMLE1无显著相关性(p = 0.055)。USMLE1讨论:本研究首次通过证明里程碑预测董事会通过的能力，验证了里程碑在外科专业中的实用性。CREOGs或里程碑低于阈值的居民有董事会失败的风险，可能需要早期干预。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

Clinical and experimental obstetrics & gynecology 医学-妇产科学

CiteScore

0.50

自引率

0.00%

发文量

241

审稿时长

1 months

期刊介绍： CEOG is an international, peer-reviewed, open access journal. CEOG covers all aspects of Obstetrics and Gynecology, including obstetrics, prenatal diagnosis, maternal-fetal medicine, perinatology, general gynecology, gynecologic oncology, uro-gynecology, reproductive medicine, infertility, reproductive endocrinology, sexual medicine. All submissions of cutting-edge advances of medical research in the area of women''s health worldwide are encouraged.