Using Machine Learning to Identify Ophthalmology Subspecialty Care and Advance Workforce Research with the IRIS® Registry (Intelligent Research in Sight)
Ju Hyun Jeon MS , Ju-Yeun Lee MD, PhD , Tobias Elze PhD , Joan W. Miller MD , Alice C. Lorch MD, MPH , Mei-Sing Ong PhD , Ann Chen Wu MD, MPH , David G. Hunter MD, PhD , Isdin Oke MD, MPH
{"title":"Using Machine Learning to Identify Ophthalmology Subspecialty Care and Advance Workforce Research with the IRIS® Registry (Intelligent Research in Sight)","authors":"Ju Hyun Jeon MS , Ju-Yeun Lee MD, PhD , Tobias Elze PhD , Joan W. Miller MD , Alice C. Lorch MD, MPH , Mei-Sing Ong PhD , Ann Chen Wu MD, MPH , David G. Hunter MD, PhD , Isdin Oke MD, MPH","doi":"10.1016/j.xops.2025.100855","DOIUrl":null,"url":null,"abstract":"<div><h3>Purpose</h3><div>To develop machine-learning models to identify ophthalmology subspecialists using deidentified patient data from a large database.</div></div><div><h3>Design</h3><div>Cross-sectional.</div></div><div><h3>Participants</h3><div>All ophthalmologists participating in the American Academy of Ophthalmology's IRIS® Registry (Intelligent Research in Sight) from 2013 to 2023 were classified under one of the following general or subspecialty categories: comprehensive, cataract, cornea, glaucoma, retina, oculofacial, pediatric, or neuro-ophthalmology.</div></div><div><h3>Methods</h3><div>We collected the diagnosis, procedure, and prescription codes linked to each ophthalmologist. We performed binary subspecialty classification using random forest models with fivefold cross validation and multispecialty classification using 4 approaches (diagnosis only, procedure only, prescription only, and combined).</div></div><div><h3>Main Outcome Measures</h3><div>Model performance was assessed using area under the receiver operating characteristic curve (AUROC), F1 scores, and Matthews correlation coefficient.</div></div><div><h3>Results</h3><div>The study included 9032 ophthalmologists. Classification accuracy differed by subspecialty (AUROC, retina: 0.981; oculofacial: 0.975; pediatric: 0.972; glaucoma: 0.937; cornea: 0.932; neuro: 0.912; cataract: 0.861; and comprehensive: 0.760). The procedure-only random forest model had better performance (AUROC, 0.903) than the diagnosis-only (0.880) and prescription-only (0.835) model.</div></div><div><h3>Conclusions</h3><div>Machine learning models leveraging the IRIS Registry can provide a near real-time assessment of the landscape of ophthalmic subspecialty care. Identifying subspecialty physicians through practice patterns may provide valuable insights into the future trends of eye care delivery with implications for workforce research and policy interventions.</div></div><div><h3>Financial Disclosure(s)</h3><div>Proprietary or commercial disclosure may be found in the Footnotes and Disclosures at the end of this article.</div></div>","PeriodicalId":74363,"journal":{"name":"Ophthalmology science","volume":"5 6","pages":"Article 100855"},"PeriodicalIF":3.2000,"publicationDate":"2025-06-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Ophthalmology science","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2666914525001538","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"OPHTHALMOLOGY","Score":null,"Total":0}
引用次数: 0
Abstract
Purpose
To develop machine-learning models to identify ophthalmology subspecialists using deidentified patient data from a large database.
Design
Cross-sectional.
Participants
All ophthalmologists participating in the American Academy of Ophthalmology's IRIS® Registry (Intelligent Research in Sight) from 2013 to 2023 were classified under one of the following general or subspecialty categories: comprehensive, cataract, cornea, glaucoma, retina, oculofacial, pediatric, or neuro-ophthalmology.
Methods
We collected the diagnosis, procedure, and prescription codes linked to each ophthalmologist. We performed binary subspecialty classification using random forest models with fivefold cross validation and multispecialty classification using 4 approaches (diagnosis only, procedure only, prescription only, and combined).
Main Outcome Measures
Model performance was assessed using area under the receiver operating characteristic curve (AUROC), F1 scores, and Matthews correlation coefficient.
Results
The study included 9032 ophthalmologists. Classification accuracy differed by subspecialty (AUROC, retina: 0.981; oculofacial: 0.975; pediatric: 0.972; glaucoma: 0.937; cornea: 0.932; neuro: 0.912; cataract: 0.861; and comprehensive: 0.760). The procedure-only random forest model had better performance (AUROC, 0.903) than the diagnosis-only (0.880) and prescription-only (0.835) model.
Conclusions
Machine learning models leveraging the IRIS Registry can provide a near real-time assessment of the landscape of ophthalmic subspecialty care. Identifying subspecialty physicians through practice patterns may provide valuable insights into the future trends of eye care delivery with implications for workforce research and policy interventions.
Financial Disclosure(s)
Proprietary or commercial disclosure may be found in the Footnotes and Disclosures at the end of this article.
求助内容：
应助结果提醒方式：
京公网安备 11010802042870号
