Vijitha S Vempuluru, Gaurav Patil, Rajiv Viriyala, Krishna K Dhara, Swathi Kaliki
{"title":"Artificial intelligence and machine learning in ocular oncology, retinoblastoma (ArMOR).","authors":"Vijitha S Vempuluru, Gaurav Patil, Rajiv Viriyala, Krishna K Dhara, Swathi Kaliki","doi":"10.4103/IJO.IJO_1768_24","DOIUrl":null,"url":null,"abstract":"<p><strong>Purpose: </strong>To test the accuracy of a trained artificial intelligence and machine learning (AI/ML) model in the diagnosis and grouping of intraocular retinoblastoma (iRB) based on the International Classification of Retinoblastoma (ICRB) in a larger cohort.</p><p><strong>Methods: </strong>Retrospective observational study that employed AI, ML, and open computer vision techniques.</p><p><strong>Results: </strong>For 1266 images, the AI/ML model displayed accuracy, sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV) of 95%, 94%, 98%, 99%, and 80%, respectively, for the detection of RB. For 173 eyes, the accuracy, sensitivity, specificity, PPV, and NPV of the AI/ML model were 85%, 98%, 94%, 98%, and 94% for detecting RB. Of 173 eyes classified based on the ICRB by two independent ocular oncologists, 9 (5%) were Group A, 32 (19%) were Group B, 21 (12%) were Group C, 37 (21%) were Group D, 38 (22%) were Group E, and 36 (21%) were classified as normal. Based on the ICRB classification of 173 eyes, the AI/ML model displayed accuracy, sensitivity, specificity, PPV, and NPV of 98%, 94%, 99%, 94%, and 99% for normal; 97%, 56%, 99%, 71% and 98% for Group A; 95%, 75%, 99%, 96%, and 95% for Group B; 95%, 86%, 96%, 75%, and 98% for Group C; 92%, 76%, 96%, 85%, and 94% for Group D; and 94%, 100%, 93%, 79%, 100% for Group E, respectively.</p><p><strong>Conclusion: </strong>These observations show that expanding the image datasets, as well as testing and retesting AI models, helps identify deficiencies in the AI/ML model and improves its accuracy.</p>","PeriodicalId":13329,"journal":{"name":"Indian Journal of Ophthalmology","volume":"73 5","pages":"741-743"},"PeriodicalIF":2.1000,"publicationDate":"2025-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Indian Journal of Ophthalmology","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.4103/IJO.IJO_1768_24","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2025/4/24 0:00:00","PubModel":"Epub","JCR":"Q2","JCRName":"OPHTHALMOLOGY","Score":null,"Total":0}
引用次数: 0
Abstract
Purpose: To test the accuracy of a trained artificial intelligence and machine learning (AI/ML) model in the diagnosis and grouping of intraocular retinoblastoma (iRB) based on the International Classification of Retinoblastoma (ICRB) in a larger cohort.
Methods: Retrospective observational study that employed AI, ML, and open computer vision techniques.
Results: For 1266 images, the AI/ML model displayed accuracy, sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV) of 95%, 94%, 98%, 99%, and 80%, respectively, for the detection of RB. For 173 eyes, the accuracy, sensitivity, specificity, PPV, and NPV of the AI/ML model were 85%, 98%, 94%, 98%, and 94% for detecting RB. Of 173 eyes classified based on the ICRB by two independent ocular oncologists, 9 (5%) were Group A, 32 (19%) were Group B, 21 (12%) were Group C, 37 (21%) were Group D, 38 (22%) were Group E, and 36 (21%) were classified as normal. Based on the ICRB classification of 173 eyes, the AI/ML model displayed accuracy, sensitivity, specificity, PPV, and NPV of 98%, 94%, 99%, 94%, and 99% for normal; 97%, 56%, 99%, 71% and 98% for Group A; 95%, 75%, 99%, 96%, and 95% for Group B; 95%, 86%, 96%, 75%, and 98% for Group C; 92%, 76%, 96%, 85%, and 94% for Group D; and 94%, 100%, 93%, 79%, 100% for Group E, respectively.
Conclusion: These observations show that expanding the image datasets, as well as testing and retesting AI models, helps identify deficiencies in the AI/ML model and improves its accuracy.
期刊介绍:
Indian Journal of Ophthalmology covers clinical, experimental, basic science research and translational research studies related to medical, ethical and social issues in field of ophthalmology and vision science. Articles with clinical interest and implications will be given preference.