LASIK Versus PRK Based on Increased Risk of Corneal Haze: Assessing Current Decision-Making Capabilities of Six Artificial Intelligence Models in Refractive Surgery.
Majid Moshirfar, Kayvon A Moin, Soroush Omidvarnia, Spencer D Moulton, Preston B Willey, Isabella M Stoakes, Phillip C Hoopes
{"title":"LASIK Versus PRK Based on Increased Risk of Corneal Haze: Assessing Current Decision-Making Capabilities of Six Artificial Intelligence Models in Refractive Surgery.","authors":"Majid Moshirfar, Kayvon A Moin, Soroush Omidvarnia, Spencer D Moulton, Preston B Willey, Isabella M Stoakes, Phillip C Hoopes","doi":"10.3928/1081597X-20240611-05","DOIUrl":null,"url":null,"abstract":"<p><strong>Purpose: </strong>To investigate the current decision-making capabilities of 6 different artificial intelligence (AI) models by assessing their refractive surgery recommendations (laser in-situ keratomileusis [LASIK] or photorefractive keratectomy [PRK]) for a theoretical patient with a history of keloid formation.</p><p><strong>Methods: </strong>Claude-2 (Anthropic, 2023), GPT-4 (OpenAI, 2023), GPT-3.5 (OpenAI, 2022), Gemini 1.0 (Google DeepMind, 2023), Microsoft Copilot (Microsoft AI, 2023), and Google-PaLM (Google AI, 2022) underwent three systematic queries to determine the most appropriate surgical plan (LASIK or PRK) for a theoretical patient with an increasing manifest refraction of -3.50, -5.00, and -7.00 diopters (D) in both eyes, an uncomplicated ocular examination, and history of keloid formation. They were then tasked with providing published scientific references to support their responses. The AI models' recommendations were compared to those of a group of 6 experienced ophthalmologists, serving as a benchmark.</p><p><strong>Results: </strong>The group of ophthalmologists unanimously recommended LASIK (6/6 ophthalmologists), in contrast to the unanimous initial recommendation for PRK from the AI models (6/6 models). Of the 42 references provided by the AI models, 55% were fictitious and 45% were authentic. Only 1 of the 6 models altered its initial recommendation to LASIK when presented with the same patient with a history of keloid formation but with increasing severity of myopia (-3.50 to 5.00 to 7.00 D).</p><p><strong>Discussion: </strong>It is evident that current AI models lack the critical-thinking abilities required to accurately analyze and assess apparent risk factors in clinical scenarios, such as the risk of corneal haze after PRK at higher levels of myopia, particularly in cases with a history of keloid formation. <b>[<i>J Refract Surg</i>. 2024;40(8):e533-e538.]</b>.</p>","PeriodicalId":16951,"journal":{"name":"Journal of refractive surgery","volume":"40 8","pages":"e533-e538"},"PeriodicalIF":2.9000,"publicationDate":"2024-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of refractive surgery","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.3928/1081597X-20240611-05","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"OPHTHALMOLOGY","Score":null,"Total":0}
引用次数: 0
Abstract
Purpose: To investigate the current decision-making capabilities of 6 different artificial intelligence (AI) models by assessing their refractive surgery recommendations (laser in-situ keratomileusis [LASIK] or photorefractive keratectomy [PRK]) for a theoretical patient with a history of keloid formation.
Methods: Claude-2 (Anthropic, 2023), GPT-4 (OpenAI, 2023), GPT-3.5 (OpenAI, 2022), Gemini 1.0 (Google DeepMind, 2023), Microsoft Copilot (Microsoft AI, 2023), and Google-PaLM (Google AI, 2022) underwent three systematic queries to determine the most appropriate surgical plan (LASIK or PRK) for a theoretical patient with an increasing manifest refraction of -3.50, -5.00, and -7.00 diopters (D) in both eyes, an uncomplicated ocular examination, and history of keloid formation. They were then tasked with providing published scientific references to support their responses. The AI models' recommendations were compared to those of a group of 6 experienced ophthalmologists, serving as a benchmark.
Results: The group of ophthalmologists unanimously recommended LASIK (6/6 ophthalmologists), in contrast to the unanimous initial recommendation for PRK from the AI models (6/6 models). Of the 42 references provided by the AI models, 55% were fictitious and 45% were authentic. Only 1 of the 6 models altered its initial recommendation to LASIK when presented with the same patient with a history of keloid formation but with increasing severity of myopia (-3.50 to 5.00 to 7.00 D).
Discussion: It is evident that current AI models lack the critical-thinking abilities required to accurately analyze and assess apparent risk factors in clinical scenarios, such as the risk of corneal haze after PRK at higher levels of myopia, particularly in cases with a history of keloid formation. [J Refract Surg. 2024;40(8):e533-e538.].
期刊介绍:
The Journal of Refractive Surgery, the official journal of the International Society of Refractive Surgery, a partner of the American Academy of Ophthalmology, has been a monthly peer-reviewed forum for original research, review, and evaluation of refractive and lens-based surgical procedures for more than 30 years. Practical, clinically valuable articles provide readers with the most up-to-date information regarding advances in the field of refractive surgery. Begin to explore the Journal and all of its great benefits such as:
• Columns including “Translational Science,” “Surgical Techniques,” and “Biomechanics”
• Supplemental videos and materials available for many articles
• Access to current articles, as well as several years of archived content
• Articles posted online just 2 months after acceptance.