The potential of artificial intelligence reading label system on the training of ophthalmologists in retinal diseases, a multicenter bimodal multi-disease study.
{"title":"The potential of artificial intelligence reading label system on the training of ophthalmologists in retinal diseases, a multicenter bimodal multi-disease study.","authors":"Meng Wang, Xiao Zhang, Donghui Li, Qijie Wei, Jianchun Zhao, Xiang Gao, Tianhui Shan, Hao Feng, Guolong Ding, Chan Li, Binghui Wu, Xirong Li, Chan Wu, Weihong Yu","doi":"10.1186/s12909-025-07066-1","DOIUrl":null,"url":null,"abstract":"<p><strong>Objective: </strong>To assess the potential of artificial intelligence reading label system on the training of ophthalmologists in a multicenter bimodal multi-disease study.</p><p><strong>Methods: </strong>The accuracy of 16 ophthalmologists with study duration ranging from one to nine years across multiple annotation rounds and its correlation with the number of rounds and ophthalmology study duration were analyzed. Additionally, this study evaluated the concordance between optical coherence tomography (OCT) or color fundus photography (CFP) and final case diagnosis.</p><p><strong>Results: </strong>The study involved 7777 pairs of OCT and CFP images, cases labeled with nine prevalent retinal diseases including diabetic retinopathy (DR, 2118 cases), retinal detachment (RD, 121 cases), retinal vein occlusion (RVO, 886 cases), dry age-related macular degeneration (dAMD, 549 cases), wet age-related macular degeneration (wAMD, 1023 cases), epiretinal membrane (ERM, 1061 cases), central serous retinopathy (CSC, 150 cases), macular schisis (MS, 128 cases), macular hole (MH, 86 cases) and normal fundus (1036 cases) were selected for further analysis. All images were assigned to 16 ophthalmologists over five rounds. The average diagnostic accuracy for the nine retinal diseases and normal fundus improved significantly across the five rounds (p = 0.013) and is closely correlated to the duration of ophthalmology study (p = 0.007). Furthermore, significant improvements were observed in the diagnostic accuracy of both OCT (p = 0.028) and CFP (p = 0.021) modalities as the number of rounds increased. Notably, OCT single modal diagnosis demonstrated higher consistency with the final diagnosis in cases of RD, ERM, MS, and MH compared to CFP, while CFP single modal diagnosis has higher consistency in DR, RVO and normal fundus.</p><p><strong>Conclusion: </strong>The implementation of an artificial intelligence reading label system enhances the diagnostic accuracy of retinal diseases among ophthalmologists and holds potential for integration into future medical education.</p>","PeriodicalId":51234,"journal":{"name":"BMC Medical Education","volume":"25 1","pages":"503"},"PeriodicalIF":2.7000,"publicationDate":"2025-04-08","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"BMC Medical Education","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1186/s12909-025-07066-1","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"EDUCATION & EDUCATIONAL RESEARCH","Score":null,"Total":0}
引用次数: 0
Abstract
Objective: To assess the potential of artificial intelligence reading label system on the training of ophthalmologists in a multicenter bimodal multi-disease study.
Methods: The accuracy of 16 ophthalmologists with study duration ranging from one to nine years across multiple annotation rounds and its correlation with the number of rounds and ophthalmology study duration were analyzed. Additionally, this study evaluated the concordance between optical coherence tomography (OCT) or color fundus photography (CFP) and final case diagnosis.
Results: The study involved 7777 pairs of OCT and CFP images, cases labeled with nine prevalent retinal diseases including diabetic retinopathy (DR, 2118 cases), retinal detachment (RD, 121 cases), retinal vein occlusion (RVO, 886 cases), dry age-related macular degeneration (dAMD, 549 cases), wet age-related macular degeneration (wAMD, 1023 cases), epiretinal membrane (ERM, 1061 cases), central serous retinopathy (CSC, 150 cases), macular schisis (MS, 128 cases), macular hole (MH, 86 cases) and normal fundus (1036 cases) were selected for further analysis. All images were assigned to 16 ophthalmologists over five rounds. The average diagnostic accuracy for the nine retinal diseases and normal fundus improved significantly across the five rounds (p = 0.013) and is closely correlated to the duration of ophthalmology study (p = 0.007). Furthermore, significant improvements were observed in the diagnostic accuracy of both OCT (p = 0.028) and CFP (p = 0.021) modalities as the number of rounds increased. Notably, OCT single modal diagnosis demonstrated higher consistency with the final diagnosis in cases of RD, ERM, MS, and MH compared to CFP, while CFP single modal diagnosis has higher consistency in DR, RVO and normal fundus.
Conclusion: The implementation of an artificial intelligence reading label system enhances the diagnostic accuracy of retinal diseases among ophthalmologists and holds potential for integration into future medical education.
期刊介绍：
BMC Medical Education is an open access journal publishing original peer-reviewed research articles in relation to the training of healthcare professionals, including undergraduate, postgraduate, and continuing education. The journal has a special focus on curriculum development, evaluations of performance, assessment of training needs and evidence-based medicine.
求助内容：
应助结果提醒方式：
京公网安备 11010802042870号
