Vera Sorin, Noa Kapelushnik, Idan Hecht, Ofira Zloto, Benjamin S. Glicksberg, Hila Bufman, Yiftach Barash, Girish N. Nadkarni, Eyal Klang
{"title":"GPT-4 Multimodal Analysis on Ophthalmology Clinical Cases Including Text and Images","authors":"Vera Sorin, Noa Kapelushnik, Idan Hecht, Ofira Zloto, Benjamin S. Glicksberg, Hila Bufman, Yiftach Barash, Girish N. Nadkarni, Eyal Klang","doi":"10.1101/2023.11.24.23298953","DOIUrl":null,"url":null,"abstract":"<strong>Objective</strong> Recent advancements in GPT-4 have enabled analysis of text with visual data. Diagnosis in ophthalmology is often based on ocular examinations and imaging, alongside the clinical context. The aim of this study was to evaluate the performance of multimodal GPT-4 (GPT-4V) in an integrated analysis of ocular images and clinical text.","PeriodicalId":501390,"journal":{"name":"medRxiv - Ophthalmology","volume":"14 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2023-11-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"medRxiv - Ophthalmology","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1101/2023.11.24.23298953","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
Objective Recent advancements in GPT-4 have enabled analysis of text with visual data. Diagnosis in ophthalmology is often based on ocular examinations and imaging, alongside the clinical context. The aim of this study was to evaluate the performance of multimodal GPT-4 (GPT-4V) in an integrated analysis of ocular images and clinical text.