The standardized letter of evaluation (SLOE) in emergency medicine: The internal validity of the SLOE 2.0

IF 1.7 Q2 EDUCATION, SCIENTIFIC DISCIPLINES

AEM Education and Training Pub Date : 2025-02-14 DOI:10.1002/aet2.70000

Alexandra Mannix MD, Cullen B. Hegarty MD, Sharon Bord MD, Thomas Beardsley MD, Sandra Monteiro Ph.D., Alai Alvarez MD, Teresa Davis MD, Katarzyna Gore MD, Melissa Parsons MD, Aman Pandey MD, Sara M. Krzyzaniak MD, Michael Gottlieb MD

{"title":"The standardized letter of evaluation (SLOE) in emergency medicine: The internal validity of the SLOE 2.0","authors":"Alexandra Mannix MD, Cullen B. Hegarty MD, Sharon Bord MD, Thomas Beardsley MD, Sandra Monteiro Ph.D., Alai Alvarez MD, Teresa Davis MD, Katarzyna Gore MD, Melissa Parsons MD, Aman Pandey MD, Sara M. Krzyzaniak MD, Michael Gottlieb MD","doi":"10.1002/aet2.70000","DOIUrl":null,"url":null,"abstract":"<div>\n \n \n <section>\n \n <h3> Background</h3>\n \n <p>The standardized letter of evaluation (SLOE) is a crucial component of emergency medicine (EM) residency applications. Initially developed in 1995 and revised to electronic SLOE (eSLOE) 2.0, this tool aims to provide a standardized evaluation of medical students.</p>\n </section>\n \n <section>\n \n <h3> Objective</h3>\n \n <p>This study aimed to conduct internal validation by analyzing the distribution and correlation of scores in eSLOE 2.0 and identify any ranking skew.</p>\n </section>\n \n <section>\n \n <h3> Methods</h3>\n \n <p>A multi-institutional cross-sectional study conducted using eSLOE 2.0 data from applicants to five geographically diverse U.S. EM residency programs during the 2022–2023 application cycle. Data from 2891 eSLOE 2.0 s across 1633 applicants were analyzed using descriptive statistics, chi-square, and Spearman's rho.</p>\n </section>\n \n <section>\n \n <h3> Results</h3>\n \n <p>Scores for all questions were moderately left-skewed. The mean scores for all part B questions were above 4.0. Strong correlations were found between part A and B scores with anticipated guidance (AG) and rank list (RL) positions. The AG had a higher correlation with RL positions than grades. The mean RL score indicated that the average student fell between the middle and top thirds.</p>\n </section>\n \n <section>\n \n <h3> Conclusions</h3>\n \n <p>The study demonstrates left skew in eSLOE 2.0 scoring, including a higher prevalence of scores in the fully and mostly entrustable ranges for part A and the consistently high scores in part B.</p>\n </section>\n </div>","PeriodicalId":37032,"journal":{"name":"AEM Education and Training","volume":"9 1","pages":""},"PeriodicalIF":1.7000,"publicationDate":"2025-02-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"AEM Education and Training","FirstCategoryId":"1085","ListUrlMain":"https://onlinelibrary.wiley.com/doi/10.1002/aet2.70000","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"EDUCATION, SCIENTIFIC DISCIPLINES","Score":null,"Total":0}

引用次数: 0

Abstract

Background

The standardized letter of evaluation (SLOE) is a crucial component of emergency medicine (EM) residency applications. Initially developed in 1995 and revised to electronic SLOE (eSLOE) 2.0, this tool aims to provide a standardized evaluation of medical students.

Objective

This study aimed to conduct internal validation by analyzing the distribution and correlation of scores in eSLOE 2.0 and identify any ranking skew.

Methods

A multi-institutional cross-sectional study conducted using eSLOE 2.0 data from applicants to five geographically diverse U.S. EM residency programs during the 2022–2023 application cycle. Data from 2891 eSLOE 2.0 s across 1633 applicants were analyzed using descriptive statistics, chi-square, and Spearman's rho.

Results

Scores for all questions were moderately left-skewed. The mean scores for all part B questions were above 4.0. Strong correlations were found between part A and B scores with anticipated guidance (AG) and rank list (RL) positions. The AG had a higher correlation with RL positions than grades. The mean RL score indicated that the average student fell between the middle and top thirds.

Conclusions

The study demonstrates left skew in eSLOE 2.0 scoring, including a higher prevalence of scores in the fully and mostly entrustable ranges for part A and the consistently high scores in part B.

查看原文本刊更多论文

急诊医学标准化评价信（swe）： swe 2.0的内部效度

背景标准评价书（SLOE）是急诊医学（EM）住院医师申请的重要组成部分。该工具最初开发于 1995 年，现已修订为电子 SLOE（eSLOE）2.0，旨在为医科学生提供标准化评价。目的本研究旨在通过分析 eSLOE 2.0 中分数的分布和相关性来进行内部验证，并找出排名偏差。方法在2022-2023年申请周期内，使用来自五个不同地域的美国EM住院医师项目申请者的eSLOE 2.0数据进行了一项多机构横断面研究。研究使用描述性统计、卡方差和斯皮尔曼rho对来自1633名申请者的2891份eSLOE 2.0数据进行了分析。结果所有问题的得分都呈中度左偏。所有 B 部分问题的平均分都高于 4.0。A 部分和 B 部分得分与预期指导（AG）和排名表（RL）位置之间存在很强的相关性。AG 与 RL 职位的相关性高于成绩。RL 的平均分表明，学生的平均成绩介于中间和前三分之一之间。结论该研究表明，eSLOE 2.0 的评分存在左倾现象，包括 A 部分完全和大部分可委托范围内的分数较高，以及 B 部分的分数一直较高。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

AEM Education and Training Nursing-Emergency Nursing

CiteScore

2.60

自引率

22.20%

发文量