Gregor S Reiter, Dmitrii Lachinov, Wolf Bühl, Günther Weigert, Christoph Grechenig, Julia Mai, Hrvoje Bogunović, Ursula Schmidt-Erfurth
{"title":"老年性黄斑变性的新管理挑战:人工智能和专家对地理萎缩的预测。","authors":"Gregor S Reiter, Dmitrii Lachinov, Wolf Bühl, Günther Weigert, Christoph Grechenig, Julia Mai, Hrvoje Bogunović, Ursula Schmidt-Erfurth","doi":"10.1016/j.oret.2024.10.029","DOIUrl":null,"url":null,"abstract":"<p><strong>Purpose: </strong>The progression of geographic atrophy (GA) secondary to age-related macular degeneration is highly variable among individuals. Prediction of the progression is critical to identify patients who will benefit most from the first treatments currently approved. The aim of this study was to investigate the value and difference in predictive power between ophthalmologists and artificial intelligence (AI) in reliably assessing individual speed of GA progression.</p><p><strong>Design: </strong>Prospective, expert and AI comparison study.</p><p><strong>Participants: </strong>Eyes with natural progression of GA from a prospective study (NCT02503332).</p><p><strong>Methods: </strong>Ophthalmologists predicted yearly growth speed of GA as well as selected the potentially faster-growing lesions from 2 eyes based on fundus autofluorescence (FAF), near-infrared reflectance (NIR), and OCT. A deep learning algorithm predicted progression solely on the baseline OCT (Spectralis, Heidelberg Engineering).</p><p><strong>Main outcome measures: </strong>Accuracy, weighted κ, and concordance index (c-index) between the prediction made by ophthalmology specialists, ophthalmology residents, and the AI algorithm.</p><p><strong>Results: </strong>A total of 134 eyes of 134 patients from a phase II clinical trial were included; among them, 53 were from the sham arm, and 81 were from untreated fellow eyes. Four ophthalmologists performed 2880 gradings. Human experts reached an accuracy of 0.37, 0.43, and 0.41 and a κ of 0.06, 0.16, and 0.18 on FAF, NIR + OCT, and FAF + NIR + OCT, respectively. On a pairwise comparison task, human experts achieved a c-index of 0.62, 0.59, and 0.60. Automated AI-based analysis reached an accuracy of 0.48 and κ of 0.23 on the first task, and c-index of 0.69 on the second task solely utilizing OCT imaging.</p><p><strong>Conclusions: </strong>Prediction of individual progression will become an important task for patient counseling, most importantly with the treatments becoming available. Human gradings improved with the availability of OCT. However, automated AI performed better than ophthalmologists in several comparisons. Artificial intelligence-supported decisions improve clinical precision, access to timely care for the community, and socioeconomic feasibility in the management of the leading cause of irreversible vision loss.</p><p><strong>Financial disclosure(s): </strong>The author(s) have no proprietary or commercial interest in any materials discussed in this article.</p>","PeriodicalId":19501,"journal":{"name":"Ophthalmology. Retina","volume":" ","pages":""},"PeriodicalIF":4.4000,"publicationDate":"2024-11-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"A Novel Management Challenge in Age-Related Macular Degeneration: Artificial Intelligence and Expert Prediction of Geographic Atrophy.\",\"authors\":\"Gregor S Reiter, Dmitrii Lachinov, Wolf Bühl, Günther Weigert, Christoph Grechenig, Julia Mai, Hrvoje Bogunović, Ursula Schmidt-Erfurth\",\"doi\":\"10.1016/j.oret.2024.10.029\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Purpose: </strong>The progression of geographic atrophy (GA) secondary to age-related macular degeneration is highly variable among individuals. Prediction of the progression is critical to identify patients who will benefit most from the first treatments currently approved. The aim of this study was to investigate the value and difference in predictive power between ophthalmologists and artificial intelligence (AI) in reliably assessing individual speed of GA progression.</p><p><strong>Design: </strong>Prospective, expert and AI comparison study.</p><p><strong>Participants: </strong>Eyes with natural progression of GA from a prospective study (NCT02503332).</p><p><strong>Methods: </strong>Ophthalmologists predicted yearly growth speed of GA as well as selected the potentially faster-growing lesions from 2 eyes based on fundus autofluorescence (FAF), near-infrared reflectance (NIR), and OCT. A deep learning algorithm predicted progression solely on the baseline OCT (Spectralis, Heidelberg Engineering).</p><p><strong>Main outcome measures: </strong>Accuracy, weighted κ, and concordance index (c-index) between the prediction made by ophthalmology specialists, ophthalmology residents, and the AI algorithm.</p><p><strong>Results: </strong>A total of 134 eyes of 134 patients from a phase II clinical trial were included; among them, 53 were from the sham arm, and 81 were from untreated fellow eyes. Four ophthalmologists performed 2880 gradings. Human experts reached an accuracy of 0.37, 0.43, and 0.41 and a κ of 0.06, 0.16, and 0.18 on FAF, NIR + OCT, and FAF + NIR + OCT, respectively. On a pairwise comparison task, human experts achieved a c-index of 0.62, 0.59, and 0.60. Automated AI-based analysis reached an accuracy of 0.48 and κ of 0.23 on the first task, and c-index of 0.69 on the second task solely utilizing OCT imaging.</p><p><strong>Conclusions: </strong>Prediction of individual progression will become an important task for patient counseling, most importantly with the treatments becoming available. Human gradings improved with the availability of OCT. However, automated AI performed better than ophthalmologists in several comparisons. Artificial intelligence-supported decisions improve clinical precision, access to timely care for the community, and socioeconomic feasibility in the management of the leading cause of irreversible vision loss.</p><p><strong>Financial disclosure(s): </strong>The author(s) have no proprietary or commercial interest in any materials discussed in this article.</p>\",\"PeriodicalId\":19501,\"journal\":{\"name\":\"Ophthalmology. Retina\",\"volume\":\" \",\"pages\":\"\"},\"PeriodicalIF\":4.4000,\"publicationDate\":\"2024-11-09\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Ophthalmology. Retina\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1016/j.oret.2024.10.029\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"OPHTHALMOLOGY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Ophthalmology. Retina","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1016/j.oret.2024.10.029","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"OPHTHALMOLOGY","Score":null,"Total":0}
A Novel Management Challenge in Age-Related Macular Degeneration: Artificial Intelligence and Expert Prediction of Geographic Atrophy.
Purpose: The progression of geographic atrophy (GA) secondary to age-related macular degeneration is highly variable among individuals. Prediction of the progression is critical to identify patients who will benefit most from the first treatments currently approved. The aim of this study was to investigate the value and difference in predictive power between ophthalmologists and artificial intelligence (AI) in reliably assessing individual speed of GA progression.
Design: Prospective, expert and AI comparison study.
Participants: Eyes with natural progression of GA from a prospective study (NCT02503332).
Methods: Ophthalmologists predicted yearly growth speed of GA as well as selected the potentially faster-growing lesions from 2 eyes based on fundus autofluorescence (FAF), near-infrared reflectance (NIR), and OCT. A deep learning algorithm predicted progression solely on the baseline OCT (Spectralis, Heidelberg Engineering).
Main outcome measures: Accuracy, weighted κ, and concordance index (c-index) between the prediction made by ophthalmology specialists, ophthalmology residents, and the AI algorithm.
Results: A total of 134 eyes of 134 patients from a phase II clinical trial were included; among them, 53 were from the sham arm, and 81 were from untreated fellow eyes. Four ophthalmologists performed 2880 gradings. Human experts reached an accuracy of 0.37, 0.43, and 0.41 and a κ of 0.06, 0.16, and 0.18 on FAF, NIR + OCT, and FAF + NIR + OCT, respectively. On a pairwise comparison task, human experts achieved a c-index of 0.62, 0.59, and 0.60. Automated AI-based analysis reached an accuracy of 0.48 and κ of 0.23 on the first task, and c-index of 0.69 on the second task solely utilizing OCT imaging.
Conclusions: Prediction of individual progression will become an important task for patient counseling, most importantly with the treatments becoming available. Human gradings improved with the availability of OCT. However, automated AI performed better than ophthalmologists in several comparisons. Artificial intelligence-supported decisions improve clinical precision, access to timely care for the community, and socioeconomic feasibility in the management of the leading cause of irreversible vision loss.
Financial disclosure(s): The author(s) have no proprietary or commercial interest in any materials discussed in this article.