Análisis del rendimiento de ChatGPT-4 en las preguntas de oftalmología del examen MIR

Q3 Medicine

Archivos De La Sociedad Espanola De Oftalmologia Pub Date : 2025-06-01 DOI:10.1016/j.oftal.2025.02.005

C.E. Monera Lucas , C. Mora Caballero , J. Escolano Serrano , A. Machan , G. Castilla Martínez , D. Romero Valero , J. Campello Lluch

{"title":"Análisis del rendimiento de ChatGPT-4 en las preguntas de oftalmología del examen MIR","authors":"C.E. Monera Lucas , C. Mora Caballero , J. Escolano Serrano , A. Machan , G. Castilla Martínez , D. Romero Valero , J. Campello Lluch","doi":"10.1016/j.oftal.2025.02.005","DOIUrl":null,"url":null,"abstract":"<div><h3>Purpose</h3><div>To evaluate the performance of ChatGPT in solving clinical scenarios in ophthalmology, specifically questions from the specialty exams for Resident Medical Interns (MIR).</div></div><div><h3>Design</h3><div>Cross-sectional design for evaluating a diagnostic tool.</div></div><div><h3>Method</h3><div>Ophthalmology questions from the MIR exams from the 2010-2023 sessions were collected. The performance of ChatGPT in successfully answering the questions was calculated. The results were also compared with those obtained by ophthalmology professionals. Additionally, sensitivity, specificity, and positive and negative probability coefficients were calculated.</div></div><div><h3>Results</h3><div>A total of 54 questions were collected, with those from the subspecialty “Retina” being the most frequent. ChatGPT's overall score was 90.2%, with a sensitivity of 92.59% and a specificity of 96.8%. The average concordance with the evaluators’ answers was 86.41%. The agreement between the evaluators was 79.62%.</div></div><div><h3>Conclusions</h3><div>ChatGPT-4 is a useful tool for solving clinical scenarios and theoretical questions in ophthalmology. Proper use of the tool, supervised by professionals, can help optimize the care processes for ophthalmology patients.</div></div>","PeriodicalId":8348,"journal":{"name":"Archivos De La Sociedad Espanola De Oftalmologia","volume":"100 6","pages":"Pages 314-319"},"PeriodicalIF":0.0000,"publicationDate":"2025-06-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Archivos De La Sociedad Espanola De Oftalmologia","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0365669125000309","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"Medicine","Score":null,"Total":0}

引用次数: 0

Abstract

Purpose

To evaluate the performance of ChatGPT in solving clinical scenarios in ophthalmology, specifically questions from the specialty exams for Resident Medical Interns (MIR).

Design

Cross-sectional design for evaluating a diagnostic tool.

Method

Ophthalmology questions from the MIR exams from the 2010-2023 sessions were collected. The performance of ChatGPT in successfully answering the questions was calculated. The results were also compared with those obtained by ophthalmology professionals. Additionally, sensitivity, specificity, and positive and negative probability coefficients were calculated.

Results

A total of 54 questions were collected, with those from the subspecialty “Retina” being the most frequent. ChatGPT's overall score was 90.2%, with a sensitivity of 92.59% and a specificity of 96.8%. The average concordance with the evaluators’ answers was 86.41%. The agreement between the evaluators was 79.62%.

Conclusions

ChatGPT-4 is a useful tool for solving clinical scenarios and theoretical questions in ophthalmology. Proper use of the tool, supervised by professionals, can help optimize the care processes for ophthalmology patients.

查看原文本刊更多论文

ChatGPT-4在MIR考试眼科问题中的表现分析

目的评价ChatGPT在解决眼科临床问题，特别是住院医师专业考试（MIR）中的问题方面的表现。设计评估诊断工具的横断面设计。方法收集2010-2023年MIR考试眼科问题。计算了ChatGPT成功回答问题的性能。并与眼科专业人员的结果进行比较。此外，还计算了敏感性、特异性和正、负概率系数。结果共收集到54个问题，其中“视网膜”亚专科的问题最多。ChatGPT的总评分为90.2%，敏感性为92.59%，特异性为96.8%。与评价者回答的平均一致性为86.41%。评价者的一致性为79.62%。结论schatgpt -4是解决眼科临床问题和理论问题的有效工具。在专业人员的监督下正确使用该工具，可以帮助优化眼科患者的护理过程。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

求助全文

约1分钟内获得全文求助全文

来源期刊

Archivos De La Sociedad Espanola De Oftalmologia Medicine-Ophthalmology

CiteScore

1.20

自引率

0.00%

发文量

109

审稿时长

78 days

期刊介绍： La revista Archivos de la Sociedad Española de Oftalmología, editada mensualmente por la propia Sociedad, tiene como objetivo publicar trabajos de investigación básica y clínica como artículos originales; casos clínicos, innovaciones técnicas y correlaciones clinicopatológicas en forma de comunicaciones cortas; editoriales; revisiones; cartas al editor; comentarios de libros; información de eventos; noticias personales y anuncios comerciales, así como trabajos de temas históricos y motivos inconográficos relacionados con la Oftalmología. El título abreviado es Arch Soc Esp Oftalmol, y debe ser utilizado en bibliografías, notas a pie de página y referencias bibliográficas.