Sarah Ottum, Conrad Chao, Sejal Tamakuwala, Joshua Dean, Adib Shafi, Katherine Jennifer Kramer, Satinder Kaur, Maurice-Andre Recanati
{"title":"ACGME里程碑能否预测外科专业委员会的通过:以妇产科为例。","authors":"Sarah Ottum, Conrad Chao, Sejal Tamakuwala, Joshua Dean, Adib Shafi, Katherine Jennifer Kramer, Satinder Kaur, Maurice-Andre Recanati","doi":"10.31083/j.ceog4805168","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Multiple tools including Accreditation Council for Graduate Medical Education (ACGME) standardized milestones can be utilized to assess trainee and residency program performance. However, little is known regarding the objective validation of these tools in predicting written board passage.</p><p><strong>Methods: </strong>In this retrospective study, data was gathered on n = 45 Wayne State University Obstetrics and Gynecology program graduates over the five-year period ending July 2018. United States Medical Licensing Examination (USMLE) scores, Council on Resident Education in Obstetrics and Gynecology (CREOG) in-training scores and ACGME milestones were used to predict American Board of Obstetrics and Gynecology (ABOG) board passage success on first attempt. Significance was set at <i>p</i> < 0.05.</p><p><strong>Results: </strong>Written board passage was associated with average CREOGs (<i>p</i> = 0.01) and milestones (<i>p</i> = 0.008) while USMLE1 was not significantly associated (<i>p</i> = 0.055). USMLE1 <217 (Positive predictive value (PPV) = 96%). CREOGs <197 (PPV = 100%) and milestones <3.25 (PPV = 100%), particularly practice-based learning and systems-based practice milestones were most strongly correlated with board failure. Using a combination of these two milestones, it is possible to correctly predict board passage using our model (PPV = 86%).</p><p><strong>Discussion: </strong>This study is the first validating the utility of milestones in a surgical specialty by demonstrating their ability to predict board passage. Residents with CREOGs or milestones below thresholds are at risk for board failure and may warrant early intervention.</p>","PeriodicalId":10312,"journal":{"name":"Clinical and experimental obstetrics & gynecology","volume":null,"pages":null},"PeriodicalIF":0.4000,"publicationDate":"2021-10-15","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8555913/pdf/","citationCount":"2","resultStr":"{\"title\":\"Can ACGME Milestones predict surgical specialty board passage: an example in Obstetrics and Gynecology.\",\"authors\":\"Sarah Ottum, Conrad Chao, Sejal Tamakuwala, Joshua Dean, Adib Shafi, Katherine Jennifer Kramer, Satinder Kaur, Maurice-Andre Recanati\",\"doi\":\"10.31083/j.ceog4805168\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Background: </strong>Multiple tools including Accreditation Council for Graduate Medical Education (ACGME) standardized milestones can be utilized to assess trainee and residency program performance. However, little is known regarding the objective validation of these tools in predicting written board passage.</p><p><strong>Methods: </strong>In this retrospective study, data was gathered on n = 45 Wayne State University Obstetrics and Gynecology program graduates over the five-year period ending July 2018. United States Medical Licensing Examination (USMLE) scores, Council on Resident Education in Obstetrics and Gynecology (CREOG) in-training scores and ACGME milestones were used to predict American Board of Obstetrics and Gynecology (ABOG) board passage success on first attempt. Significance was set at <i>p</i> < 0.05.</p><p><strong>Results: </strong>Written board passage was associated with average CREOGs (<i>p</i> = 0.01) and milestones (<i>p</i> = 0.008) while USMLE1 was not significantly associated (<i>p</i> = 0.055). USMLE1 <217 (Positive predictive value (PPV) = 96%). CREOGs <197 (PPV = 100%) and milestones <3.25 (PPV = 100%), particularly practice-based learning and systems-based practice milestones were most strongly correlated with board failure. Using a combination of these two milestones, it is possible to correctly predict board passage using our model (PPV = 86%).</p><p><strong>Discussion: </strong>This study is the first validating the utility of milestones in a surgical specialty by demonstrating their ability to predict board passage. Residents with CREOGs or milestones below thresholds are at risk for board failure and may warrant early intervention.</p>\",\"PeriodicalId\":10312,\"journal\":{\"name\":\"Clinical and experimental obstetrics & gynecology\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":0.4000,\"publicationDate\":\"2021-10-15\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC8555913/pdf/\",\"citationCount\":\"2\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Clinical and experimental obstetrics & gynecology\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.31083/j.ceog4805168\",\"RegionNum\":4,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q4\",\"JCRName\":\"OBSTETRICS & GYNECOLOGY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Clinical and experimental obstetrics & gynecology","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.31083/j.ceog4805168","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q4","JCRName":"OBSTETRICS & GYNECOLOGY","Score":null,"Total":0}
Can ACGME Milestones predict surgical specialty board passage: an example in Obstetrics and Gynecology.
Background: Multiple tools including Accreditation Council for Graduate Medical Education (ACGME) standardized milestones can be utilized to assess trainee and residency program performance. However, little is known regarding the objective validation of these tools in predicting written board passage.
Methods: In this retrospective study, data was gathered on n = 45 Wayne State University Obstetrics and Gynecology program graduates over the five-year period ending July 2018. United States Medical Licensing Examination (USMLE) scores, Council on Resident Education in Obstetrics and Gynecology (CREOG) in-training scores and ACGME milestones were used to predict American Board of Obstetrics and Gynecology (ABOG) board passage success on first attempt. Significance was set at p < 0.05.
Results: Written board passage was associated with average CREOGs (p = 0.01) and milestones (p = 0.008) while USMLE1 was not significantly associated (p = 0.055). USMLE1 <217 (Positive predictive value (PPV) = 96%). CREOGs <197 (PPV = 100%) and milestones <3.25 (PPV = 100%), particularly practice-based learning and systems-based practice milestones were most strongly correlated with board failure. Using a combination of these two milestones, it is possible to correctly predict board passage using our model (PPV = 86%).
Discussion: This study is the first validating the utility of milestones in a surgical specialty by demonstrating their ability to predict board passage. Residents with CREOGs or milestones below thresholds are at risk for board failure and may warrant early intervention.
期刊介绍:
CEOG is an international, peer-reviewed, open access journal. CEOG covers all aspects of Obstetrics and Gynecology, including obstetrics, prenatal diagnosis, maternal-fetal medicine, perinatology, general gynecology, gynecologic oncology, uro-gynecology, reproductive medicine, infertility, reproductive endocrinology, sexual medicine. All submissions of cutting-edge advances of medical research in the area of women''s health worldwide are encouraged.