Brian M. Clemency, Susan J. Burnett, Johanna C. Innes, Michael O'Brien, Renoj Varughese, Nan Nan, Changxing Ma, Marta Plonka, Evan Shaw, Mohamud R. Daya, Marianne Gausche-Hill
{"title":"The Association Between Performance on the Emergency Medical Services In-Training Exam and Passing the Emergency Medical Services Certifying Exam","authors":"Brian M. Clemency, Susan J. Burnett, Johanna C. Innes, Michael O'Brien, Renoj Varughese, Nan Nan, Changxing Ma, Marta Plonka, Evan Shaw, Mohamud R. Daya, Marianne Gausche-Hill","doi":"10.1002/aet2.70092","DOIUrl":null,"url":null,"abstract":"<div>\n \n \n <section>\n \n <h3> Background</h3>\n \n <p>Prior studies have demonstrated a correlation between in-training exam performance and success on the certifying exam in various medical specialties. It is unknown if a relationship exists between performance on the Emergency Medical Services (EMS) In-Training Exam (EMSITE) and success on the EMS Certifying Exam (EMSCE); consequently, EMSITE score reports include percentile rankings to compare performance against other fellows, but do not offer a criterion score or prediction of success on the EMSCE. The goal of this study was to examine if an association exists between EMSITE score and success on the EMSCE.</p>\n </section>\n \n <section>\n \n <h3> Methods</h3>\n \n <p>This was a retrospective data review, linking data from EMSITE records and EMSCE records. Performances on the 2020 and 2021 EMSITE were compared to the 2021 EMSCE results. Fellows who took the EMSITE but did not take the EMSCE were excluded. EMSITE performance was examined based on overall score and for each of the four content areas. EMSCE results were dichotomized as “pass” or “fail.” Odds ratios were obtained using an unadjusted univariate logistic regression and reported with 95% confidence intervals.</p>\n </section>\n \n <section>\n \n <h3> Results</h3>\n \n <p>During the 2019–2020 and 2020–2021 academic years, 161 fellows took the EMSITE. This includes 132 (82.0%) who took the EMSCE in 2021. Among those who took the EMSCE, 117 (88.6%) passed. There was an association between the overall EMSITE score and passing the EMSCE (OR 1.17, 95% CI: 1.05–1.30). This association was demonstrated in the content areas of Medical Oversight of EMS (OR 1.14, 95% CI 1.05–1.23) and Quality Management and Research (OR 1.06, 95% CI 1.01–1.10). This association was not significant in the content areas of Clinical Aspects of EMS Medicine (OR 1.09, 95% CI 1.00–1.20) and Special Operations (OR 1.02, 95% CI 0.96–1.09).</p>\n </section>\n \n <section>\n \n <h3> Conclusion</h3>\n \n <p>These data demonstrate an association between performance on the EMSITE and success on the EMSCE.</p>\n </section>\n </div>","PeriodicalId":37032,"journal":{"name":"AEM Education and Training","volume":"9 4","pages":""},"PeriodicalIF":1.8000,"publicationDate":"2025-08-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"AEM Education and Training","FirstCategoryId":"1085","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1002/aet2.70092","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"EDUCATION, SCIENTIFIC DISCIPLINES","Score":null,"Total":0}
引用次数: 0
Abstract
Background
Prior studies have demonstrated a correlation between in-training exam performance and success on the certifying exam in various medical specialties. It is unknown if a relationship exists between performance on the Emergency Medical Services (EMS) In-Training Exam (EMSITE) and success on the EMS Certifying Exam (EMSCE); consequently, EMSITE score reports include percentile rankings to compare performance against other fellows, but do not offer a criterion score or prediction of success on the EMSCE. The goal of this study was to examine if an association exists between EMSITE score and success on the EMSCE.
Methods
This was a retrospective data review, linking data from EMSITE records and EMSCE records. Performances on the 2020 and 2021 EMSITE were compared to the 2021 EMSCE results. Fellows who took the EMSITE but did not take the EMSCE were excluded. EMSITE performance was examined based on overall score and for each of the four content areas. EMSCE results were dichotomized as “pass” or “fail.” Odds ratios were obtained using an unadjusted univariate logistic regression and reported with 95% confidence intervals.
Results
During the 2019–2020 and 2020–2021 academic years, 161 fellows took the EMSITE. This includes 132 (82.0%) who took the EMSCE in 2021. Among those who took the EMSCE, 117 (88.6%) passed. There was an association between the overall EMSITE score and passing the EMSCE (OR 1.17, 95% CI: 1.05–1.30). This association was demonstrated in the content areas of Medical Oversight of EMS (OR 1.14, 95% CI 1.05–1.23) and Quality Management and Research (OR 1.06, 95% CI 1.01–1.10). This association was not significant in the content areas of Clinical Aspects of EMS Medicine (OR 1.09, 95% CI 1.00–1.20) and Special Operations (OR 1.02, 95% CI 0.96–1.09).
Conclusion
These data demonstrate an association between performance on the EMSITE and success on the EMSCE.