眼科学临床病例的GPT-4多模态分析包括文字和图像

medRxiv - Ophthalmology Pub Date : 2023-11-27 DOI:10.1101/2023.11.24.23298953

Vera Sorin, Noa Kapelushnik, Idan Hecht, Ofira Zloto, Benjamin S. Glicksberg, Hila Bufman, Yiftach Barash, Girish N. Nadkarni, Eyal Klang

{"title":"眼科学临床病例的GPT-4多模态分析包括文字和图像","authors":"Vera Sorin, Noa Kapelushnik, Idan Hecht, Ofira Zloto, Benjamin S. Glicksberg, Hila Bufman, Yiftach Barash, Girish N. Nadkarni, Eyal Klang","doi":"10.1101/2023.11.24.23298953","DOIUrl":null,"url":null,"abstract":"<strong>Objective</strong> Recent advancements in GPT-4 have enabled analysis of text with visual data. Diagnosis in ophthalmology is often based on ocular examinations and imaging, alongside the clinical context. The aim of this study was to evaluate the performance of multimodal GPT-4 (GPT-4V) in an integrated analysis of ocular images and clinical text.","PeriodicalId":501390,"journal":{"name":"medRxiv - Ophthalmology","volume":"14 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2023-11-27","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"GPT-4 Multimodal Analysis on Ophthalmology Clinical Cases Including Text and Images\",\"authors\":\"Vera Sorin, Noa Kapelushnik, Idan Hecht, Ofira Zloto, Benjamin S. Glicksberg, Hila Bufman, Yiftach Barash, Girish N. Nadkarni, Eyal Klang\",\"doi\":\"10.1101/2023.11.24.23298953\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<strong>Objective</strong> Recent advancements in GPT-4 have enabled analysis of text with visual data. Diagnosis in ophthalmology is often based on ocular examinations and imaging, alongside the clinical context. The aim of this study was to evaluate the performance of multimodal GPT-4 (GPT-4V) in an integrated analysis of ocular images and clinical text.\",\"PeriodicalId\":501390,\"journal\":{\"name\":\"medRxiv - Ophthalmology\",\"volume\":\"14 1\",\"pages\":\"\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2023-11-27\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"medRxiv - Ophthalmology\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1101/2023.11.24.23298953\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"medRxiv - Ophthalmology","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1101/2023.11.24.23298953","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}

引用次数: 0

摘要

GPT-4的最新进展使文本分析与视觉数据成为可能。眼科的诊断通常是基于眼部检查和成像，以及临床情况。本研究的目的是评估多模态GPT-4 (GPT-4V)在眼部图像和临床文本的综合分析中的表现。

本文章由计算机程序翻译，如有差异，请以英文原文为准。

查看原文本刊更多论文

GPT-4 Multimodal Analysis on Ophthalmology Clinical Cases Including Text and Images

Objective Recent advancements in GPT-4 have enabled analysis of text with visual data. Diagnosis in ophthalmology is often based on ocular examinations and imaging, alongside the clinical context. The aim of this study was to evaluate the performance of multimodal GPT-4 (GPT-4V) in an integrated analysis of ocular images and clinical text.

求助全文

通过发布文献求助，成功后即可免费获取论文全文。去求助

来源期刊

medRxiv - Ophthalmology

自引率

0.00%

发文量