Majid Moshirfar, Kayvon A Moin, Soroush Omidvarnia, Spencer D Moulton, Preston B Willey, Isabella M Stoakes, Phillip C Hoopes
{"title":"基于角膜混浊风险增加的 LASIK 与 PRK 对比:评估屈光手术中六种人工智能模型的当前决策能力。","authors":"Majid Moshirfar, Kayvon A Moin, Soroush Omidvarnia, Spencer D Moulton, Preston B Willey, Isabella M Stoakes, Phillip C Hoopes","doi":"10.3928/1081597X-20240611-05","DOIUrl":null,"url":null,"abstract":"<p><strong>Purpose: </strong>To investigate the current decision-making capabilities of 6 different artificial intelligence (AI) models by assessing their refractive surgery recommendations (laser in-situ keratomileusis [LASIK] or photorefractive keratectomy [PRK]) for a theoretical patient with a history of keloid formation.</p><p><strong>Methods: </strong>Claude-2 (Anthropic, 2023), GPT-4 (OpenAI, 2023), GPT-3.5 (OpenAI, 2022), Gemini 1.0 (Google DeepMind, 2023), Microsoft Copilot (Microsoft AI, 2023), and Google-PaLM (Google AI, 2022) underwent three systematic queries to determine the most appropriate surgical plan (LASIK or PRK) for a theoretical patient with an increasing manifest refraction of -3.50, -5.00, and -7.00 diopters (D) in both eyes, an uncomplicated ocular examination, and history of keloid formation. They were then tasked with providing published scientific references to support their responses. The AI models' recommendations were compared to those of a group of 6 experienced ophthalmologists, serving as a benchmark.</p><p><strong>Results: </strong>The group of ophthalmologists unanimously recommended LASIK (6/6 ophthalmologists), in contrast to the unanimous initial recommendation for PRK from the AI models (6/6 models). Of the 42 references provided by the AI models, 55% were fictitious and 45% were authentic. Only 1 of the 6 models altered its initial recommendation to LASIK when presented with the same patient with a history of keloid formation but with increasing severity of myopia (-3.50 to 5.00 to 7.00 D).</p><p><strong>Discussion: </strong>It is evident that current AI models lack the critical-thinking abilities required to accurately analyze and assess apparent risk factors in clinical scenarios, such as the risk of corneal haze after PRK at higher levels of myopia, particularly in cases with a history of keloid formation. <b>[<i>J Refract Surg</i>. 2024;40(8):e533-e538.]</b>.</p>","PeriodicalId":16951,"journal":{"name":"Journal of refractive surgery","volume":"40 8","pages":"e533-e538"},"PeriodicalIF":2.9000,"publicationDate":"2024-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"LASIK Versus PRK Based on Increased Risk of Corneal Haze: Assessing Current Decision-Making Capabilities of Six Artificial Intelligence Models in Refractive Surgery.\",\"authors\":\"Majid Moshirfar, Kayvon A Moin, Soroush Omidvarnia, Spencer D Moulton, Preston B Willey, Isabella M Stoakes, Phillip C Hoopes\",\"doi\":\"10.3928/1081597X-20240611-05\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Purpose: </strong>To investigate the current decision-making capabilities of 6 different artificial intelligence (AI) models by assessing their refractive surgery recommendations (laser in-situ keratomileusis [LASIK] or photorefractive keratectomy [PRK]) for a theoretical patient with a history of keloid formation.</p><p><strong>Methods: </strong>Claude-2 (Anthropic, 2023), GPT-4 (OpenAI, 2023), GPT-3.5 (OpenAI, 2022), Gemini 1.0 (Google DeepMind, 2023), Microsoft Copilot (Microsoft AI, 2023), and Google-PaLM (Google AI, 2022) underwent three systematic queries to determine the most appropriate surgical plan (LASIK or PRK) for a theoretical patient with an increasing manifest refraction of -3.50, -5.00, and -7.00 diopters (D) in both eyes, an uncomplicated ocular examination, and history of keloid formation. They were then tasked with providing published scientific references to support their responses. The AI models' recommendations were compared to those of a group of 6 experienced ophthalmologists, serving as a benchmark.</p><p><strong>Results: </strong>The group of ophthalmologists unanimously recommended LASIK (6/6 ophthalmologists), in contrast to the unanimous initial recommendation for PRK from the AI models (6/6 models). Of the 42 references provided by the AI models, 55% were fictitious and 45% were authentic. Only 1 of the 6 models altered its initial recommendation to LASIK when presented with the same patient with a history of keloid formation but with increasing severity of myopia (-3.50 to 5.00 to 7.00 D).</p><p><strong>Discussion: </strong>It is evident that current AI models lack the critical-thinking abilities required to accurately analyze and assess apparent risk factors in clinical scenarios, such as the risk of corneal haze after PRK at higher levels of myopia, particularly in cases with a history of keloid formation. <b>[<i>J Refract Surg</i>. 2024;40(8):e533-e538.]</b>.</p>\",\"PeriodicalId\":16951,\"journal\":{\"name\":\"Journal of refractive surgery\",\"volume\":\"40 8\",\"pages\":\"e533-e538\"},\"PeriodicalIF\":2.9000,\"publicationDate\":\"2024-08-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of refractive surgery\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.3928/1081597X-20240611-05\",\"RegionNum\":3,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"OPHTHALMOLOGY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of refractive surgery","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.3928/1081597X-20240611-05","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"OPHTHALMOLOGY","Score":null,"Total":0}
LASIK Versus PRK Based on Increased Risk of Corneal Haze: Assessing Current Decision-Making Capabilities of Six Artificial Intelligence Models in Refractive Surgery.
Purpose: To investigate the current decision-making capabilities of 6 different artificial intelligence (AI) models by assessing their refractive surgery recommendations (laser in-situ keratomileusis [LASIK] or photorefractive keratectomy [PRK]) for a theoretical patient with a history of keloid formation.
Methods: Claude-2 (Anthropic, 2023), GPT-4 (OpenAI, 2023), GPT-3.5 (OpenAI, 2022), Gemini 1.0 (Google DeepMind, 2023), Microsoft Copilot (Microsoft AI, 2023), and Google-PaLM (Google AI, 2022) underwent three systematic queries to determine the most appropriate surgical plan (LASIK or PRK) for a theoretical patient with an increasing manifest refraction of -3.50, -5.00, and -7.00 diopters (D) in both eyes, an uncomplicated ocular examination, and history of keloid formation. They were then tasked with providing published scientific references to support their responses. The AI models' recommendations were compared to those of a group of 6 experienced ophthalmologists, serving as a benchmark.
Results: The group of ophthalmologists unanimously recommended LASIK (6/6 ophthalmologists), in contrast to the unanimous initial recommendation for PRK from the AI models (6/6 models). Of the 42 references provided by the AI models, 55% were fictitious and 45% were authentic. Only 1 of the 6 models altered its initial recommendation to LASIK when presented with the same patient with a history of keloid formation but with increasing severity of myopia (-3.50 to 5.00 to 7.00 D).
Discussion: It is evident that current AI models lack the critical-thinking abilities required to accurately analyze and assess apparent risk factors in clinical scenarios, such as the risk of corneal haze after PRK at higher levels of myopia, particularly in cases with a history of keloid formation. [J Refract Surg. 2024;40(8):e533-e538.].
期刊介绍:
The Journal of Refractive Surgery, the official journal of the International Society of Refractive Surgery, a partner of the American Academy of Ophthalmology, has been a monthly peer-reviewed forum for original research, review, and evaluation of refractive and lens-based surgical procedures for more than 30 years. Practical, clinically valuable articles provide readers with the most up-to-date information regarding advances in the field of refractive surgery. Begin to explore the Journal and all of its great benefits such as:
• Columns including “Translational Science,” “Surgical Techniques,” and “Biomechanics”
• Supplemental videos and materials available for many articles
• Access to current articles, as well as several years of archived content
• Articles posted online just 2 months after acceptance.