OSVE or multiple-choice test: Is that a relevant question?

IF 2.2 4区医学 Q2 MEDICINE, GENERAL & INTERNAL

Clinics Pub Date : 2025-01-01 DOI:10.1016/j.clinsp.2024.100519

Francine Jomara Lopes , Renato Fraga Righetti , Matheus Belloni Torsani , Gustavo Silva Azevedo , Fernando Mauad Sacramento , Iolanda de Fátima Lopes Calvo Tibério

{"title":"OSVE or multiple-choice test: Is that a relevant question?","authors":"Francine Jomara Lopes , Renato Fraga Righetti , Matheus Belloni Torsani , Gustavo Silva Azevedo , Fernando Mauad Sacramento , Iolanda de Fátima Lopes Calvo Tibério","doi":"10.1016/j.clinsp.2024.100519","DOIUrl":null,"url":null,"abstract":"<div><h3>Introduction</h3><div>The OSCE has been a robust tool for assessing clinical skills in medical education, adaptable across various clinical domains and stages. The COVID-19 pandemic, however, posed significant challenges to traditional assessment methods. This led to the development of the OSVE as an alternative.</div></div><div><h3>Objective</h3><div>This study aimed to correlate OSVE results with MCT scores and Grade Point Average (GPA) of clerkship.</div></div><div><h3>Methods</h3><div>This cross-sectional study involved 129 clerkships. It compared two OSVEs and two MCTs, covering content from the 5th and 6th years of the curriculum, against final graduation grades.</div></div><div><h3>Results</h3><div>The score of GPA was 8.13 ± 0.43. The authors compared OSVE-5th (7.13 ± 0.93) and OSVE-6th (7.23 ± 0.83, NS), MCT-5th (7.08 ± 0.91) vs. MCT-6th (7.68 ± 1.21, <em>p</em> < 0.001), OSVE-5th (7.13 ± 0.93) and MCT-5th (7.08 ± 0.91, NS), OSVE-6th (7.23 ± 0.83) and MCT-6th (7.68 ± 1.21, <em>p</em> < 0.001) OSVE-5th (7.13 ± 0.93) and MCT-6th (7.68 ± 1.21, <em>p</em> < 0.001), OSVE-6th (7.23 ± 0.83) and MCT-5th (7.08 ± 0.91, NS), OSVE-5th (7.13 ± 0.93) and GPA (8.13 ± 0.43, <em>p</em> < 0.001), OSVE-6th (7.23 ± 0.83) and GPA (8.13 ± 0.43, <em>p</em> < 0.001), MCT-5th (7.08 ± 0.91) and GPA (8.13 ± 0.43, <em>p</em> < 0.001), and MCT-6th (7.68 ± 1.21) and GPA (8.13 ± 0.43, <em>p</em> < 0.001). There were positive correlations between OSVE-5th and OSVE-6th (<em>R</em> = 0.418, <em>p</em> < 0.05), OSVE-5th and MCT-5th (<em>R</em> = 0.475, <em>p</em> < 0.05), MCT-5th, OSVE-6th and MCT-6th (<em>R</em> = 0,180, <em>p</em> < 0.05), MCT-6th (<em>R</em> = 0.227, <em>p</em> < 0.05), with OSVE-6th and MCT-5th (<em>R</em> = 0.478, <em>p</em> < 0.05), OSVE-5th and GPA (<em>R</em> = 0.481, <em>p</em> < 0.05), OSVE-6th and GPA (<em>R</em> = 0,439, <em>p</em> < 0.05), MCT-5th and GPA (<em>R</em> = 0.681, <em>p</em> < 0.05) and MCT-6th and GPA (<em>R</em> = 0.195, <em>p</em> < 0.05), no correlation was found between OSVE-6th and MCT-6th (<em>R</em> = 0.070, NS).</div></div><div><h3>Conclusions</h3><div>The correlations between the assessments revealed mild to moderate, suggesting that the assessments can be used interchangeably in the context of formative assessment. These results indicate the feasibility of using both OSVE and multiple-choice tests as effective tools to enhance intern training and monitoring<strong>.</strong></div></div>","PeriodicalId":10472,"journal":{"name":"Clinics","volume":"80 ","pages":"Article 100519"},"PeriodicalIF":2.2000,"publicationDate":"2025-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Clinics","FirstCategoryId":"3","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1807593224001960","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"MEDICINE, GENERAL & INTERNAL","Score":null,"Total":0}

引用次数: 0

Abstract

Introduction

The OSCE has been a robust tool for assessing clinical skills in medical education, adaptable across various clinical domains and stages. The COVID-19 pandemic, however, posed significant challenges to traditional assessment methods. This led to the development of the OSVE as an alternative.

Objective

This study aimed to correlate OSVE results with MCT scores and Grade Point Average (GPA) of clerkship.

Methods

This cross-sectional study involved 129 clerkships. It compared two OSVEs and two MCTs, covering content from the 5th and 6th years of the curriculum, against final graduation grades.

Results

The score of GPA was 8.13 ± 0.43. The authors compared OSVE-5th (7.13 ± 0.93) and OSVE-6th (7.23 ± 0.83, NS), MCT-5th (7.08 ± 0.91) vs. MCT-6th (7.68 ± 1.21, p < 0.001), OSVE-5th (7.13 ± 0.93) and MCT-5th (7.08 ± 0.91, NS), OSVE-6th (7.23 ± 0.83) and MCT-6th (7.68 ± 1.21, p < 0.001) OSVE-5th (7.13 ± 0.93) and MCT-6th (7.68 ± 1.21, p < 0.001), OSVE-6th (7.23 ± 0.83) and MCT-5th (7.08 ± 0.91, NS), OSVE-5th (7.13 ± 0.93) and GPA (8.13 ± 0.43, p < 0.001), OSVE-6th (7.23 ± 0.83) and GPA (8.13 ± 0.43, p < 0.001), MCT-5th (7.08 ± 0.91) and GPA (8.13 ± 0.43, p < 0.001), and MCT-6th (7.68 ± 1.21) and GPA (8.13 ± 0.43, p < 0.001). There were positive correlations between OSVE-5th and OSVE-6th (R = 0.418, p < 0.05), OSVE-5th and MCT-5th (R = 0.475, p < 0.05), MCT-5th, OSVE-6th and MCT-6th (R = 0,180, p < 0.05), MCT-6th (R = 0.227, p < 0.05), with OSVE-6th and MCT-5th (R = 0.478, p < 0.05), OSVE-5th and GPA (R = 0.481, p < 0.05), OSVE-6th and GPA (R = 0,439, p < 0.05), MCT-5th and GPA (R = 0.681, p < 0.05) and MCT-6th and GPA (R = 0.195, p < 0.05), no correlation was found between OSVE-6th and MCT-6th (R = 0.070, NS).

Conclusions

The correlations between the assessments revealed mild to moderate, suggesting that the assessments can be used interchangeably in the context of formative assessment. These results indicate the feasibility of using both OSVE and multiple-choice tests as effective tools to enhance intern training and monitoring.

查看原文本刊更多论文

求助全文

约1分钟内获得全文求助全文

来源期刊

Clinics 医学-医学：内科

CiteScore

4.10

自引率

3.70%

发文量

129

审稿时长

52 days

期刊介绍： CLINICS is an electronic journal that publishes peer-reviewed articles in continuous flow, of interest to clinicians and researchers in the medical sciences. CLINICS complies with the policies of funding agencies which request or require deposition of the published articles that they fund into publicly available databases. CLINICS supports the position of the International Committee of Medical Journal Editors (ICMJE) on trial registration.