Brian M. Clemency, Susan J. Burnett, Johanna C. Innes, Michael O'Brien, Renoj Varughese, Nan Nan, Changxing Ma, Marta Plonka, Evan Shaw, Mohamud R. Daya, Marianne Gausche-Hill
{"title":"急诊医疗服务培训考试成绩与通过急诊医疗服务资格考试的关系","authors":"Brian M. Clemency, Susan J. Burnett, Johanna C. Innes, Michael O'Brien, Renoj Varughese, Nan Nan, Changxing Ma, Marta Plonka, Evan Shaw, Mohamud R. Daya, Marianne Gausche-Hill","doi":"10.1002/aet2.70092","DOIUrl":null,"url":null,"abstract":"<div>\n \n \n <section>\n \n <h3> Background</h3>\n \n <p>Prior studies have demonstrated a correlation between in-training exam performance and success on the certifying exam in various medical specialties. It is unknown if a relationship exists between performance on the Emergency Medical Services (EMS) In-Training Exam (EMSITE) and success on the EMS Certifying Exam (EMSCE); consequently, EMSITE score reports include percentile rankings to compare performance against other fellows, but do not offer a criterion score or prediction of success on the EMSCE. The goal of this study was to examine if an association exists between EMSITE score and success on the EMSCE.</p>\n </section>\n \n <section>\n \n <h3> Methods</h3>\n \n <p>This was a retrospective data review, linking data from EMSITE records and EMSCE records. Performances on the 2020 and 2021 EMSITE were compared to the 2021 EMSCE results. Fellows who took the EMSITE but did not take the EMSCE were excluded. EMSITE performance was examined based on overall score and for each of the four content areas. EMSCE results were dichotomized as “pass” or “fail.” Odds ratios were obtained using an unadjusted univariate logistic regression and reported with 95% confidence intervals.</p>\n </section>\n \n <section>\n \n <h3> Results</h3>\n \n <p>During the 2019–2020 and 2020–2021 academic years, 161 fellows took the EMSITE. This includes 132 (82.0%) who took the EMSCE in 2021. Among those who took the EMSCE, 117 (88.6%) passed. There was an association between the overall EMSITE score and passing the EMSCE (OR 1.17, 95% CI: 1.05–1.30). This association was demonstrated in the content areas of Medical Oversight of EMS (OR 1.14, 95% CI 1.05–1.23) and Quality Management and Research (OR 1.06, 95% CI 1.01–1.10). This association was not significant in the content areas of Clinical Aspects of EMS Medicine (OR 1.09, 95% CI 1.00–1.20) and Special Operations (OR 1.02, 95% CI 0.96–1.09).</p>\n </section>\n \n <section>\n \n <h3> Conclusion</h3>\n \n <p>These data demonstrate an association between performance on the EMSITE and success on the EMSCE.</p>\n </section>\n </div>","PeriodicalId":37032,"journal":{"name":"AEM Education and Training","volume":"9 4","pages":""},"PeriodicalIF":1.8000,"publicationDate":"2025-08-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"The Association Between Performance on the Emergency Medical Services In-Training Exam and Passing the Emergency Medical Services Certifying Exam\",\"authors\":\"Brian M. Clemency, Susan J. Burnett, Johanna C. Innes, Michael O'Brien, Renoj Varughese, Nan Nan, Changxing Ma, Marta Plonka, Evan Shaw, Mohamud R. Daya, Marianne Gausche-Hill\",\"doi\":\"10.1002/aet2.70092\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div>\\n \\n \\n <section>\\n \\n <h3> Background</h3>\\n \\n <p>Prior studies have demonstrated a correlation between in-training exam performance and success on the certifying exam in various medical specialties. It is unknown if a relationship exists between performance on the Emergency Medical Services (EMS) In-Training Exam (EMSITE) and success on the EMS Certifying Exam (EMSCE); consequently, EMSITE score reports include percentile rankings to compare performance against other fellows, but do not offer a criterion score or prediction of success on the EMSCE. The goal of this study was to examine if an association exists between EMSITE score and success on the EMSCE.</p>\\n </section>\\n \\n <section>\\n \\n <h3> Methods</h3>\\n \\n <p>This was a retrospective data review, linking data from EMSITE records and EMSCE records. Performances on the 2020 and 2021 EMSITE were compared to the 2021 EMSCE results. Fellows who took the EMSITE but did not take the EMSCE were excluded. EMSITE performance was examined based on overall score and for each of the four content areas. EMSCE results were dichotomized as “pass” or “fail.” Odds ratios were obtained using an unadjusted univariate logistic regression and reported with 95% confidence intervals.</p>\\n </section>\\n \\n <section>\\n \\n <h3> Results</h3>\\n \\n <p>During the 2019–2020 and 2020–2021 academic years, 161 fellows took the EMSITE. This includes 132 (82.0%) who took the EMSCE in 2021. Among those who took the EMSCE, 117 (88.6%) passed. There was an association between the overall EMSITE score and passing the EMSCE (OR 1.17, 95% CI: 1.05–1.30). This association was demonstrated in the content areas of Medical Oversight of EMS (OR 1.14, 95% CI 1.05–1.23) and Quality Management and Research (OR 1.06, 95% CI 1.01–1.10). This association was not significant in the content areas of Clinical Aspects of EMS Medicine (OR 1.09, 95% CI 1.00–1.20) and Special Operations (OR 1.02, 95% CI 0.96–1.09).</p>\\n </section>\\n \\n <section>\\n \\n <h3> Conclusion</h3>\\n \\n <p>These data demonstrate an association between performance on the EMSITE and success on the EMSCE.</p>\\n </section>\\n </div>\",\"PeriodicalId\":37032,\"journal\":{\"name\":\"AEM Education and Training\",\"volume\":\"9 4\",\"pages\":\"\"},\"PeriodicalIF\":1.8000,\"publicationDate\":\"2025-08-28\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"AEM Education and Training\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://onlinelibrary.wiley.com/doi/10.1002/aet2.70092\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"EDUCATION, SCIENTIFIC DISCIPLINES\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"AEM Education and Training","FirstCategoryId":"1085","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1002/aet2.70092","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"EDUCATION, SCIENTIFIC DISCIPLINES","Score":null,"Total":0}
引用次数: 0
摘要
背景先前的研究已经证明了培训考试成绩与各种医学专业认证考试的成功之间的相关性。目前尚不清楚急诊医疗服务(EMS)培训考试(EMSITE)的表现与EMS认证考试(EMSCE)的成功之间是否存在关系;因此,EMSITE分数报告包括百分位排名,以比较与其他研究员的表现,但不提供标准分数或预测成功的EMSCE。本研究的目的是检查EMSITE评分与EMSCE成功之间是否存在关联。方法回顾性分析EMSITE记录和EMSCE记录。将2020年和2021年EMSITE的性能与2021年EMSCE的结果进行了比较。参加了EMSITE但没有参加EMSCE的研究员被排除在外。EMSITE的表现是根据总分和四个内容领域中的每一个进行检查的。EMSCE结果分为“合格”和“不合格”。优势比采用未调整的单变量逻辑回归获得,报告的置信区间为95%。结果2019-2020学年和2020-2021学年,161名研究员参加了EMSITE。其中包括在2021年参加EMSCE考试的132人(82.0%)。参加高考的117人(88.6%)通过了考试。总体EMSITE评分与通过EMSCE之间存在关联(OR 1.17, 95% CI: 1.05-1.30)。这种关联在EMS的医疗监督(OR 1.14, 95% CI 1.05-1.23)和质量管理与研究(OR 1.06, 95% CI 1.01-1.10)的内容领域得到证实。这种关联在EMS医学临床方面(OR 1.09, 95% CI 1.00-1.20)和特殊手术(OR 1.02, 95% CI 0.96-1.09)的内容领域不显著。结论:这些数据证明了EMSITE的表现与EMSCE的成功之间存在关联。
The Association Between Performance on the Emergency Medical Services In-Training Exam and Passing the Emergency Medical Services Certifying Exam
Background
Prior studies have demonstrated a correlation between in-training exam performance and success on the certifying exam in various medical specialties. It is unknown if a relationship exists between performance on the Emergency Medical Services (EMS) In-Training Exam (EMSITE) and success on the EMS Certifying Exam (EMSCE); consequently, EMSITE score reports include percentile rankings to compare performance against other fellows, but do not offer a criterion score or prediction of success on the EMSCE. The goal of this study was to examine if an association exists between EMSITE score and success on the EMSCE.
Methods
This was a retrospective data review, linking data from EMSITE records and EMSCE records. Performances on the 2020 and 2021 EMSITE were compared to the 2021 EMSCE results. Fellows who took the EMSITE but did not take the EMSCE were excluded. EMSITE performance was examined based on overall score and for each of the four content areas. EMSCE results were dichotomized as “pass” or “fail.” Odds ratios were obtained using an unadjusted univariate logistic regression and reported with 95% confidence intervals.
Results
During the 2019–2020 and 2020–2021 academic years, 161 fellows took the EMSITE. This includes 132 (82.0%) who took the EMSCE in 2021. Among those who took the EMSCE, 117 (88.6%) passed. There was an association between the overall EMSITE score and passing the EMSCE (OR 1.17, 95% CI: 1.05–1.30). This association was demonstrated in the content areas of Medical Oversight of EMS (OR 1.14, 95% CI 1.05–1.23) and Quality Management and Research (OR 1.06, 95% CI 1.01–1.10). This association was not significant in the content areas of Clinical Aspects of EMS Medicine (OR 1.09, 95% CI 1.00–1.20) and Special Operations (OR 1.02, 95% CI 0.96–1.09).
Conclusion
These data demonstrate an association between performance on the EMSITE and success on the EMSCE.