Understanding COMLEX-USA Level-1 as a Pass/Fail examination: impact and opportunities.

IF 1.4 Q2 MEDICINE, GENERAL & INTERNAL
Ashley Gerhardson, Melissa Efurd, Patricia Sexton, Donald Sefcik
{"title":"Understanding COMLEX-USA Level-1 as a Pass/Fail examination: impact and opportunities.","authors":"Ashley Gerhardson, Melissa Efurd, Patricia Sexton, Donald Sefcik","doi":"10.1515/jom-2024-0139","DOIUrl":null,"url":null,"abstract":"<p><strong>Context: </strong>In late 2020, the National Board of Osteopathic Medical Examiners (NBOME) announced that the Comprehensive Osteopathic Medical Licensing Examination (COMLEX-USA) Level 1 would discontinue reporting numeric scores, only providing a Pass/Fail designation. The National Board of Medical Examiners (NBME) changed the core reports for the United States Medical Licensing Examination (USMLE) Step-1 to Pass/Fail in early 2020. Subsequently, residency program directors were reported to migrate toward increased reliance on COMLEX-USA Level 2CE and USMLE Step 2CK scores, the prestige of medical schools, and the status of the authors of letters of reference during their review of residency applicants.</p><p><strong>Objectives: </strong>Funded by an American Association of Colleges of Osteopathic Medicine (AACOM) research grant, A.T. Still University - Kirksville College of Osteopathic Medicine (ATSU-KCOM) and the Arkansas College of Osteopathic Medicine (ARCOM) generated a series of five hypotheses to investigate the perceived impact of the transition to Pass/Fail scoring.</p><p><strong>Methods: </strong>Both institutional review boards (IRBs) provided exempt status for this study. The hypotheses were examined through surveys distributed to current osteopathic medical students (OMS), recent graduates (classes of 2021 and 2022), academic advisors, and college of osteopathic medicine (COM) curriculum committee members in this cohort study. The investigative process consisted of two surveys: an initial survey to collect data on all five hypotheses and a focused, follow-up survey designed to better understand the impact of the scoring change. The surveys collected respondent feedback based on a Likert Scale. Standard descriptive statistics were assembled and analyzed. Qualitative responses were coded into thematic elements to examine response patterns.</p><p><strong>Results: </strong>The initial survey collected responses from 302 respondents (23.2 % response rate) based on a scale from 1 (strongly disagree) to 4 (strongly agree). The survey results revealed the means for the following items based on a 4-point Likert scale (1=Strongly Disagree; 2=Disagree; 3=Agree; 4=Strongly Agree): (1) Increase chances of matching into residency: 2.35; (2) Pass/Fail is a positive change: 2.71; (3) Pass/Fail will reduce competition in competitive residency programs: 1.94; (4) clinical skills will be more strongly considered: 2.60; and (5) new score reports provide a robust analysis of strengths and weaknesses in basic science: 2.24. Almost half (46 %) of the respondents expressed negative sentiments toward the Pass/Fail change. Reasons included more emphasis on COMLEX-USA Level 2CE, decreased motivation to perform on COMLEX-USA Level 1, and the perceived disadvantages that resulted during the residency match process.</p><p><strong>Conclusions: </strong>Among the survey respondents, many, especially students, do not view the change as favorable. Respondents cited the primary reasons for their unfavorable perception as a lack of motivation to perform on COMLEX-USA Level 1 and the added stress of performing on COMLEX-USA Level 2CE. Additionally, respondents viewed the change as negatively impacting their audition rotations and subsequent residency competitiveness.</p>","PeriodicalId":36050,"journal":{"name":"Journal of Osteopathic Medicine","volume":" ","pages":""},"PeriodicalIF":1.4000,"publicationDate":"2025-03-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Osteopathic Medicine","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1515/jom-2024-0139","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"MEDICINE, GENERAL & INTERNAL","Score":null,"Total":0}
引用次数: 0

Abstract

Context: In late 2020, the National Board of Osteopathic Medical Examiners (NBOME) announced that the Comprehensive Osteopathic Medical Licensing Examination (COMLEX-USA) Level 1 would discontinue reporting numeric scores, only providing a Pass/Fail designation. The National Board of Medical Examiners (NBME) changed the core reports for the United States Medical Licensing Examination (USMLE) Step-1 to Pass/Fail in early 2020. Subsequently, residency program directors were reported to migrate toward increased reliance on COMLEX-USA Level 2CE and USMLE Step 2CK scores, the prestige of medical schools, and the status of the authors of letters of reference during their review of residency applicants.

Objectives: Funded by an American Association of Colleges of Osteopathic Medicine (AACOM) research grant, A.T. Still University - Kirksville College of Osteopathic Medicine (ATSU-KCOM) and the Arkansas College of Osteopathic Medicine (ARCOM) generated a series of five hypotheses to investigate the perceived impact of the transition to Pass/Fail scoring.

Methods: Both institutional review boards (IRBs) provided exempt status for this study. The hypotheses were examined through surveys distributed to current osteopathic medical students (OMS), recent graduates (classes of 2021 and 2022), academic advisors, and college of osteopathic medicine (COM) curriculum committee members in this cohort study. The investigative process consisted of two surveys: an initial survey to collect data on all five hypotheses and a focused, follow-up survey designed to better understand the impact of the scoring change. The surveys collected respondent feedback based on a Likert Scale. Standard descriptive statistics were assembled and analyzed. Qualitative responses were coded into thematic elements to examine response patterns.

Results: The initial survey collected responses from 302 respondents (23.2 % response rate) based on a scale from 1 (strongly disagree) to 4 (strongly agree). The survey results revealed the means for the following items based on a 4-point Likert scale (1=Strongly Disagree; 2=Disagree; 3=Agree; 4=Strongly Agree): (1) Increase chances of matching into residency: 2.35; (2) Pass/Fail is a positive change: 2.71; (3) Pass/Fail will reduce competition in competitive residency programs: 1.94; (4) clinical skills will be more strongly considered: 2.60; and (5) new score reports provide a robust analysis of strengths and weaknesses in basic science: 2.24. Almost half (46 %) of the respondents expressed negative sentiments toward the Pass/Fail change. Reasons included more emphasis on COMLEX-USA Level 2CE, decreased motivation to perform on COMLEX-USA Level 1, and the perceived disadvantages that resulted during the residency match process.

Conclusions: Among the survey respondents, many, especially students, do not view the change as favorable. Respondents cited the primary reasons for their unfavorable perception as a lack of motivation to perform on COMLEX-USA Level 1 and the added stress of performing on COMLEX-USA Level 2CE. Additionally, respondents viewed the change as negatively impacting their audition rotations and subsequent residency competitiveness.

求助全文
约1分钟内获得全文 求助全文
来源期刊
Journal of Osteopathic Medicine
Journal of Osteopathic Medicine Health Professions-Complementary and Manual Therapy
CiteScore
2.20
自引率
13.30%
发文量
118
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信