David Szanto , Asala Erekat , Brian Woods , Jui-Kai Wang , Mona Garvin , Brett A. Johnson , Randy Kardon , Edward Linton , Mark J. Kupersmith
{"title":"Deep Learning Approach Readily Differentiates Papilledema, Non-Arteritic Anterior Ischemic Optic Neuropathy, and Healthy Eyes","authors":"David Szanto , Asala Erekat , Brian Woods , Jui-Kai Wang , Mona Garvin , Brett A. Johnson , Randy Kardon , Edward Linton , Mark J. Kupersmith","doi":"10.1016/j.ajo.2025.04.006","DOIUrl":null,"url":null,"abstract":"<div><h3>OBJECTIVE</h3><div>Deep learning (DL) has been used in differentiating a range of ophthalmic conditions. We describe a model to distinguish among fundus photos of acquired optic disc swelling due to idiopathic intracranial hypertension (IIH), non-arteritic anterior ischemic optic neuropathy (NAION), and healthy eyes.</div></div><div><h3>DESIGN</h3><div>Development and validation of a DL diagnostic algorithm.</div></div><div><h3>SUBJECTS, PARTICIPANTS, AND/OR CONTROLS</h3><div>Our model was trained and validated on 15 088 fundus photos from 5866 eyes, including eyes with IIH with a Frisén grade ≥1 (418), acute NAION (780), and healthy controls (4668). We performed external validation on an additional 1126 photos from 928 eyes across these groups. All images were obtained from randomized and nonrandomized clinical trials, publicly available datasets, and real-world clinical sources.</div></div><div><h3>METHODS</h3><div>After preprocessing images to standardize optic disc position, we fine-tuned a ResNet-50 model. Performance was evaluated using 5-fold cross-validation, with metrics such as accuracy, area under the receiver operating characteristic curve (AUC-ROC), precision, recall, F1 scores, and confusion matrices calculated. We applied gradient-weighted class activation mapping to generate visual activation maps highlighting the regions of interest in the fundus images. External validation evaluation was performed with majority voting of our cross-validated models.</div></div><div><h3>MAIN OUTCOME MEASURES</h3><div>The primary outcome measures were the model's overall accuracy, class-wide AUC-ROC, precision, recall, F1 scores, and confusion matrices.</div></div><div><h3>RESULTS</h3><div>The model achieved an internal validation accuracy of 96.2%, with a macro-average AUC-ROC of 0.995. F1 scores ranged from 0.90 to 0.97 for all classes. The external validation set had an accuracy of 93.6%, F1 scores from 0.90 to 0.95, and a macro-average AUC-ROC of 0.980. Activation maps consistently highlighted the optic disc, with emphasis on the inferior optic disc for IIH, superior optic disc for NAION, and the entire optic disc for healthy eyes.</div></div><div><h3>CONCLUSIONS</h3><div>Our study demonstrates the potential of fundus-based DL models to accurately distinguish among IIH, NAION, and healthy eyes, providing a potentially valuable diagnostic method. With its strong discriminative capabilities, this model can be an important tool for neuro-ophthalmic assessment, particularly when access to specialized neuro-ophthalmologists is limited.</div></div>","PeriodicalId":7568,"journal":{"name":"American Journal of Ophthalmology","volume":"276 ","pages":"Pages 99-108"},"PeriodicalIF":4.1000,"publicationDate":"2025-04-11","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"American Journal of Ophthalmology","FirstCategoryId":"3","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0002939425001746","RegionNum":1,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"OPHTHALMOLOGY","Score":null,"Total":0}
引用次数: 0
Abstract
OBJECTIVE
Deep learning (DL) has been used in differentiating a range of ophthalmic conditions. We describe a model to distinguish among fundus photos of acquired optic disc swelling due to idiopathic intracranial hypertension (IIH), non-arteritic anterior ischemic optic neuropathy (NAION), and healthy eyes.
DESIGN
Development and validation of a DL diagnostic algorithm.
SUBJECTS, PARTICIPANTS, AND/OR CONTROLS
Our model was trained and validated on 15 088 fundus photos from 5866 eyes, including eyes with IIH with a Frisén grade ≥1 (418), acute NAION (780), and healthy controls (4668). We performed external validation on an additional 1126 photos from 928 eyes across these groups. All images were obtained from randomized and nonrandomized clinical trials, publicly available datasets, and real-world clinical sources.
METHODS
After preprocessing images to standardize optic disc position, we fine-tuned a ResNet-50 model. Performance was evaluated using 5-fold cross-validation, with metrics such as accuracy, area under the receiver operating characteristic curve (AUC-ROC), precision, recall, F1 scores, and confusion matrices calculated. We applied gradient-weighted class activation mapping to generate visual activation maps highlighting the regions of interest in the fundus images. External validation evaluation was performed with majority voting of our cross-validated models.
MAIN OUTCOME MEASURES
The primary outcome measures were the model's overall accuracy, class-wide AUC-ROC, precision, recall, F1 scores, and confusion matrices.
RESULTS
The model achieved an internal validation accuracy of 96.2%, with a macro-average AUC-ROC of 0.995. F1 scores ranged from 0.90 to 0.97 for all classes. The external validation set had an accuracy of 93.6%, F1 scores from 0.90 to 0.95, and a macro-average AUC-ROC of 0.980. Activation maps consistently highlighted the optic disc, with emphasis on the inferior optic disc for IIH, superior optic disc for NAION, and the entire optic disc for healthy eyes.
CONCLUSIONS
Our study demonstrates the potential of fundus-based DL models to accurately distinguish among IIH, NAION, and healthy eyes, providing a potentially valuable diagnostic method. With its strong discriminative capabilities, this model can be an important tool for neuro-ophthalmic assessment, particularly when access to specialized neuro-ophthalmologists is limited.
期刊介绍:
The American Journal of Ophthalmology is a peer-reviewed, scientific publication that welcomes the submission of original, previously unpublished manuscripts directed to ophthalmologists and visual science specialists describing clinical investigations, clinical observations, and clinically relevant laboratory investigations. Published monthly since 1884, the full text of the American Journal of Ophthalmology and supplementary material are also presented online at www.AJO.com and on ScienceDirect.
The American Journal of Ophthalmology publishes Full-Length Articles, Perspectives, Editorials, Correspondences, Books Reports and Announcements. Brief Reports and Case Reports are no longer published. We recommend submitting Brief Reports and Case Reports to our companion publication, the American Journal of Ophthalmology Case Reports.
Manuscripts are accepted with the understanding that they have not been and will not be published elsewhere substantially in any format, and that there are no ethical problems with the content or data collection. Authors may be requested to produce the data upon which the manuscript is based and to answer expeditiously any questions about the manuscript or its authors.