Predictive Validity of Preclerkship Performance Metrics on USMLE Step 2 CK Outcomes in the Step 1 Pass/Fail Era.

IF 1.8 Q2 EDUCATION, SCIENTIFIC DISCIPLINES
Advances in Medical Education and Practice Pub Date : 2025-02-25 eCollection Date: 2025-01-01 DOI:10.2147/AMEP.S505612
Karl Aharonian, Maggie Sanders, Tal Schlesinger, Victoria Winter, Edward Simanton
{"title":"Predictive Validity of Preclerkship Performance Metrics on USMLE Step 2 CK Outcomes in the Step 1 Pass/Fail Era.","authors":"Karl Aharonian, Maggie Sanders, Tal Schlesinger, Victoria Winter, Edward Simanton","doi":"10.2147/AMEP.S505612","DOIUrl":null,"url":null,"abstract":"<p><strong>Purpose: </strong>With the transition of USMLE Step 1 to pass/fail, Step 2 CK has become a critical factor in residency selection. This study evaluates the predictive value of preclinical academic metrics for Step 2 CK outcomes to help students assess their metrics for residency before starting clerkships.</p><p><strong>Methods: </strong>We analyzed data from 58 students at the Kirk Kerkorian School of Medicine at UNLV. Academic metrics included MCAT scores, NBME-style Phase 1 exam performance, and CBSE scores. Pearson correlation coefficients were calculated between each predictor and Step 2 CK scores. Binary logistic regression was used, with Step 2 CK upper quartile (score >255) as the dependent variable and thresholds for each predictor as independent variables.</p><p><strong>Results: </strong>MCAT scores showed a moderate positive correlation with Step 2 CK (r=0.37, p=0.004). Students scoring >510 on the MCAT were significantly more likely to achieve >255 on Step 2 CK. Phase 1 NBME exam performance had the strongest correlation (r=0.67, p<0.0001), with students scoring above the national mean on >75% of exams more likely to achieve >255. While CBSE scores showed a similar correlation (r=0.67, p<0.0001), logistic regression analysis revealed that their predictive ability was less consistent for students in the middle performance range, indicating variability in classification utility.</p><p><strong>Conclusion: </strong>Preclinical NBME exam performance emerged as the strongest predictor of Step 2 CK success in our cohort, with MCAT and CBSE scores offering additional, though less robust, predictive value. These findings highlight the importance of early academic guidance to optimize residency preparedness and provide actionable insights for students assessing their readiness within the new Step 1 pass/fail framework. Further multi-institutional research is warranted to validate and generalize these results.</p>","PeriodicalId":47404,"journal":{"name":"Advances in Medical Education and Practice","volume":"16 ","pages":"323-330"},"PeriodicalIF":1.8000,"publicationDate":"2025-02-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11871918/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Advances in Medical Education and Practice","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.2147/AMEP.S505612","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2025/1/1 0:00:00","PubModel":"eCollection","JCR":"Q2","JCRName":"EDUCATION, SCIENTIFIC DISCIPLINES","Score":null,"Total":0}
引用次数: 0

Abstract

Purpose: With the transition of USMLE Step 1 to pass/fail, Step 2 CK has become a critical factor in residency selection. This study evaluates the predictive value of preclinical academic metrics for Step 2 CK outcomes to help students assess their metrics for residency before starting clerkships.

Methods: We analyzed data from 58 students at the Kirk Kerkorian School of Medicine at UNLV. Academic metrics included MCAT scores, NBME-style Phase 1 exam performance, and CBSE scores. Pearson correlation coefficients were calculated between each predictor and Step 2 CK scores. Binary logistic regression was used, with Step 2 CK upper quartile (score >255) as the dependent variable and thresholds for each predictor as independent variables.

Results: MCAT scores showed a moderate positive correlation with Step 2 CK (r=0.37, p=0.004). Students scoring >510 on the MCAT were significantly more likely to achieve >255 on Step 2 CK. Phase 1 NBME exam performance had the strongest correlation (r=0.67, p<0.0001), with students scoring above the national mean on >75% of exams more likely to achieve >255. While CBSE scores showed a similar correlation (r=0.67, p<0.0001), logistic regression analysis revealed that their predictive ability was less consistent for students in the middle performance range, indicating variability in classification utility.

Conclusion: Preclinical NBME exam performance emerged as the strongest predictor of Step 2 CK success in our cohort, with MCAT and CBSE scores offering additional, though less robust, predictive value. These findings highlight the importance of early academic guidance to optimize residency preparedness and provide actionable insights for students assessing their readiness within the new Step 1 pass/fail framework. Further multi-institutional research is warranted to validate and generalize these results.

目的:随着 USMLE 第 1 步过渡到通过/失败,第 2 步 CK 已成为住院医师选择的关键因素。本研究评估了临床前学术指标对第 2 步 CK 结果的预测价值,以帮助学生在开始实习前评估自己的住院医师指标:我们分析了来自UNLV的Kirk Kerkorian医学院58名学生的数据。学术指标包括 MCAT 分数、NBME-style 第一阶段考试成绩和 CBSE 分数。计算了每个预测指标与第二阶段 CK 分数之间的皮尔逊相关系数。采用二元逻辑回归法,将步骤 2 CK 上四分位数(得分大于 255 分)作为因变量,将各预测因子的阈值作为自变量:MCAT分数与第二阶段CK呈中度正相关(r=0.37,p=0.004)。MCAT考试成绩大于510分的学生在第二阶段CK考试中成绩大于255分的可能性明显更大。第一阶段NBME考试成绩的相关性最强(r=0.67,p75%的考试成绩更有可能达到255分以上。而CBSE分数也显示出类似的相关性(r=0.67,p结论:临床前NBME考试成绩是我们队列中第二步CK成功率的最强预测因素,而MCAT和CBSE成绩则提供了额外的预测价值,尽管这种预测价值并不那么强大。这些发现强调了早期学术指导对优化住院医师培训准备的重要性,并为学生在新的第 1 步通过/未通过框架内评估自己的准备情况提供了可操作的见解。有必要进一步开展多机构研究,以验证和推广这些结果。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Advances in Medical Education and Practice
Advances in Medical Education and Practice EDUCATION, SCIENTIFIC DISCIPLINES-
CiteScore
3.10
自引率
10.00%
发文量
189
审稿时长
16 weeks
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信