Michelle L Shui, Weronika Armstrong, Marie Altendahl, Anthony Shanks, Shireen M Sims, Rini B Ratan, Said S Saab
{"title":"妇产科医学生绩效考核见习叙述分析:来自PRIME+框架的洞察。","authors":"Michelle L Shui, Weronika Armstrong, Marie Altendahl, Anthony Shanks, Shireen M Sims, Rini B Ratan, Said S Saab","doi":"10.4300/JGME-D-24-00660.1","DOIUrl":null,"url":null,"abstract":"<p><p><b>Background</b> Despite existing guidelines for writing clerkship summative assessment narratives, their quality, structure, and utility remain variable. Categorizing Medical Student Performance Evaluation (MSPE) narratives using a framework can reveal patterns and gaps in content, offering actionable insights. <b>Objective</b> This study aimed to (1) categorize MSPE narrative comments using the PRIME+ framework (professionalism, reporting, interpreting, managing, and educating, and areas for improvement [+]), and (2) examine differences in length and content by gender, race, origin of medical school, and final clerkship grade. <b>Methods</b> Seven hundred twenty applications to our obstetrics and gynecology (OB/GYN) residency program in 2023 were reviewed, focusing on the OB/GYN core clerkship narrative. Narratives were categorized using the PRIME+ framework, and differences in length and content were assessed by gender, race, origin of medical school, and final grade. Differences between groups were evaluated with nonparametric tests. <b>Results</b> Six hundred fifty-three narratives from 231 medical schools were included. Fifty-one unique grading systems were reported. PRIME+ domains were represented as follows: professionalism (94.8%, 619 of 653), reporter (71.1%, 464 of 653), interpreter (37.5%, 245 of 653), manager (69.1%, 451 of 653), educator (69.7%, 455 of 653), and areas for improvement (3.7%, 24 of 653). For each domain, <13% of narratives included ≥1 specific example. Median word count differed between US-based (155 words; 95% CI, 148-162) and international (61 words; 95% CI, 51-75) applicants (<i>P</i>=.001). Students earning \"honors\" had longer narratives (median words 149; 95% CI, 131-164 vs 117; 95% CI, 97-134; <i>P</i>=.001) with more specific examples (1.2 examples; 95% CI, 0.97-1.4 vs 0.88; 95% CI, 0.53-1.2; <i>P</i>=.024) and advanced PRIME+ domains, specifically educator (<i>P</i>=.016). The number of specific examples differed by race (<i>P</i>=.02) but not gender. <b>Conclusions</b> MSPE narratives for the OB/GYN clerkship demonstrate variability in content and length.</p>","PeriodicalId":37886,"journal":{"name":"Journal of graduate medical education","volume":"17 2","pages":"189-195"},"PeriodicalIF":0.0000,"publicationDate":"2025-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12096132/pdf/","citationCount":"0","resultStr":"{\"title\":\"An Analysis of Obstetrics and Gynecology Medical Student Performance Evaluation Clerkship Narratives: Insights From the PRIME+ Framework.\",\"authors\":\"Michelle L Shui, Weronika Armstrong, Marie Altendahl, Anthony Shanks, Shireen M Sims, Rini B Ratan, Said S Saab\",\"doi\":\"10.4300/JGME-D-24-00660.1\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p><b>Background</b> Despite existing guidelines for writing clerkship summative assessment narratives, their quality, structure, and utility remain variable. Categorizing Medical Student Performance Evaluation (MSPE) narratives using a framework can reveal patterns and gaps in content, offering actionable insights. <b>Objective</b> This study aimed to (1) categorize MSPE narrative comments using the PRIME+ framework (professionalism, reporting, interpreting, managing, and educating, and areas for improvement [+]), and (2) examine differences in length and content by gender, race, origin of medical school, and final clerkship grade. <b>Methods</b> Seven hundred twenty applications to our obstetrics and gynecology (OB/GYN) residency program in 2023 were reviewed, focusing on the OB/GYN core clerkship narrative. Narratives were categorized using the PRIME+ framework, and differences in length and content were assessed by gender, race, origin of medical school, and final grade. Differences between groups were evaluated with nonparametric tests. <b>Results</b> Six hundred fifty-three narratives from 231 medical schools were included. Fifty-one unique grading systems were reported. PRIME+ domains were represented as follows: professionalism (94.8%, 619 of 653), reporter (71.1%, 464 of 653), interpreter (37.5%, 245 of 653), manager (69.1%, 451 of 653), educator (69.7%, 455 of 653), and areas for improvement (3.7%, 24 of 653). For each domain, <13% of narratives included ≥1 specific example. Median word count differed between US-based (155 words; 95% CI, 148-162) and international (61 words; 95% CI, 51-75) applicants (<i>P</i>=.001). Students earning \\\"honors\\\" had longer narratives (median words 149; 95% CI, 131-164 vs 117; 95% CI, 97-134; <i>P</i>=.001) with more specific examples (1.2 examples; 95% CI, 0.97-1.4 vs 0.88; 95% CI, 0.53-1.2; <i>P</i>=.024) and advanced PRIME+ domains, specifically educator (<i>P</i>=.016). The number of specific examples differed by race (<i>P</i>=.02) but not gender. <b>Conclusions</b> MSPE narratives for the OB/GYN clerkship demonstrate variability in content and length.</p>\",\"PeriodicalId\":37886,\"journal\":{\"name\":\"Journal of graduate medical education\",\"volume\":\"17 2\",\"pages\":\"189-195\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2025-04-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12096132/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of graduate medical education\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.4300/JGME-D-24-00660.1\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2025/4/15 0:00:00\",\"PubModel\":\"Epub\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of graduate medical education","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.4300/JGME-D-24-00660.1","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2025/4/15 0:00:00","PubModel":"Epub","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
摘要
背景:尽管已有关于撰写见习总结性评估叙述的指导方针,但其质量、结构和效用仍然是可变的。使用框架对医学生绩效评估(MSPE)叙述进行分类可以揭示内容中的模式和差距,提供可操作的见解。本研究旨在(1)使用PRIME+框架(专业、报告、解释、管理和教育,以及需要改进的领域[+])对MSPE叙事性评论进行分类,(2)根据性别、种族、医学院出身和最终实习成绩检查长度和内容的差异。方法回顾2023年我院妇产科住院医师项目申请720份,重点介绍妇产科核心见习叙述。使用PRIME+框架对叙事进行分类,并根据性别、种族、医学院出身和最终成绩评估长度和内容的差异。用非参数检验评估组间差异。结果共纳入来自231所医学院的653篇叙述。报告了51种独特的分级制度。PRIME+领域的表现如下:专业(94.8%,619人)、记者(71.1%,664人)、口译员(37.5%,653人中的245人)、经理(69.1%,653人中的451人)、教育工作者(69.7%,655人)和有待改进的领域(3.7%,653人中的24人)。对于每个域,P=.001)。获得“荣誉”的学生的叙述较长(平均字数为149;95% CI, 131-164 vs 117;95% ci, 97-134;P=.001),有更具体的例子(1.2个例子;95% CI, 0.97-1.4 vs 0.88;95% ci, 0.53-1.2;P= 0.024)和高级PRIME+领域,特别是教育家(P= 0.016)。具体例子的数量因种族而异(P= 0.02),但性别没有差异。结论:妇产科员工的MSPE叙述在内容和长度上存在差异。
An Analysis of Obstetrics and Gynecology Medical Student Performance Evaluation Clerkship Narratives: Insights From the PRIME+ Framework.
Background Despite existing guidelines for writing clerkship summative assessment narratives, their quality, structure, and utility remain variable. Categorizing Medical Student Performance Evaluation (MSPE) narratives using a framework can reveal patterns and gaps in content, offering actionable insights. Objective This study aimed to (1) categorize MSPE narrative comments using the PRIME+ framework (professionalism, reporting, interpreting, managing, and educating, and areas for improvement [+]), and (2) examine differences in length and content by gender, race, origin of medical school, and final clerkship grade. Methods Seven hundred twenty applications to our obstetrics and gynecology (OB/GYN) residency program in 2023 were reviewed, focusing on the OB/GYN core clerkship narrative. Narratives were categorized using the PRIME+ framework, and differences in length and content were assessed by gender, race, origin of medical school, and final grade. Differences between groups were evaluated with nonparametric tests. Results Six hundred fifty-three narratives from 231 medical schools were included. Fifty-one unique grading systems were reported. PRIME+ domains were represented as follows: professionalism (94.8%, 619 of 653), reporter (71.1%, 464 of 653), interpreter (37.5%, 245 of 653), manager (69.1%, 451 of 653), educator (69.7%, 455 of 653), and areas for improvement (3.7%, 24 of 653). For each domain, <13% of narratives included ≥1 specific example. Median word count differed between US-based (155 words; 95% CI, 148-162) and international (61 words; 95% CI, 51-75) applicants (P=.001). Students earning "honors" had longer narratives (median words 149; 95% CI, 131-164 vs 117; 95% CI, 97-134; P=.001) with more specific examples (1.2 examples; 95% CI, 0.97-1.4 vs 0.88; 95% CI, 0.53-1.2; P=.024) and advanced PRIME+ domains, specifically educator (P=.016). The number of specific examples differed by race (P=.02) but not gender. Conclusions MSPE narratives for the OB/GYN clerkship demonstrate variability in content and length.
期刊介绍:
- Be the leading peer-reviewed journal in graduate medical education; - Promote scholarship and enhance the quality of research in the field; - Disseminate evidence-based approaches for teaching, assessment, and improving the learning environment; and - Generate new knowledge that enhances graduates'' ability to provide high-quality, cost-effective care.