Vaidehi D Bhatt, Nikhil Shah, Deepak C Bhatt, Supriya Dabir, Jay Sheth, Tos T J M Berendschot, Roel J Erckens, Carroll A B Webers
{"title":"Development and Evaluation of a Deep Learning Algorithm to Differentiate Between Membranes Attached to the Optic Disc on Ultrasonography.","authors":"Vaidehi D Bhatt, Nikhil Shah, Deepak C Bhatt, Supriya Dabir, Jay Sheth, Tos T J M Berendschot, Roel J Erckens, Carroll A B Webers","doi":"10.2147/OPTH.S501316","DOIUrl":null,"url":null,"abstract":"<p><strong>Purpose: </strong>The purpose of this study was to create and test a deep learning algorithm that could identify and distinguish between membranes attached to optic disc [OD; retinal detachment (RD)/posterior vitreous detachment (PVD)] based on ocular ultrasonography (USG).</p><p><strong>Patients and methods: </strong>We obtained a database of B-scan ultrasonography from a high-volume imaging center. A transformer-based Vision Transformer (ViT) model was employed, pre-trained on ImageNet21K, to classify ultrasound B-scan images into healthy, RD, and PVD. Images were pre-processed using Hugging Face's AutoImage Processor for standardization. Labels were mapped to numerical values, and the dataset was split into training and validation (505 samples), and testing (212 samples) subsets to evaluate model performance. Alternate methods, such as ensemble strategies and object detection pipelines, were explored but showed limited improvement in classification accuracy.</p><p><strong>Results: </strong>The AI model demonstrated high classification performance, achieving an accuracy of 98.21% for PVD, 97.22% for RD, and 95.83% for normal cases. Sensitivity was 98.21% for PVD, 96.55% for RD, and 92.86% for normal cases, while specificity reached 95.16%, 100%, and 95.42%, respectively. Despite the overall strong performance, some misclassification occurred, with seven instances of RD being incorrectly labeled as PVD.</p><p><strong>Conclusion: </strong>We developed a transformer-based deep learning algorithm for ocular ultrasonography that accurately identifies membranes attached to the optic disc, distinguishing between RD (97.22% accuracy) and PVD (98.21% accuracy). Despite seven misclassifications, our model demonstrates robust performance and enhances diagnostic efficiency in high-volume imaging settings, thereby facilitating timely referrals and ultimately improving patient outcomes in urgent care scenarios. Overall, this promising innovation shows potential for clinical adoption.</p>","PeriodicalId":93945,"journal":{"name":"Clinical ophthalmology (Auckland, N.Z.)","volume":"19 ","pages":"939-947"},"PeriodicalIF":0.0000,"publicationDate":"2025-03-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11929409/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Clinical ophthalmology (Auckland, N.Z.)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.2147/OPTH.S501316","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2025/1/1 0:00:00","PubModel":"eCollection","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
Purpose: The purpose of this study was to create and test a deep learning algorithm that could identify and distinguish between membranes attached to optic disc [OD; retinal detachment (RD)/posterior vitreous detachment (PVD)] based on ocular ultrasonography (USG).
Patients and methods: We obtained a database of B-scan ultrasonography from a high-volume imaging center. A transformer-based Vision Transformer (ViT) model was employed, pre-trained on ImageNet21K, to classify ultrasound B-scan images into healthy, RD, and PVD. Images were pre-processed using Hugging Face's AutoImage Processor for standardization. Labels were mapped to numerical values, and the dataset was split into training and validation (505 samples), and testing (212 samples) subsets to evaluate model performance. Alternate methods, such as ensemble strategies and object detection pipelines, were explored but showed limited improvement in classification accuracy.
Results: The AI model demonstrated high classification performance, achieving an accuracy of 98.21% for PVD, 97.22% for RD, and 95.83% for normal cases. Sensitivity was 98.21% for PVD, 96.55% for RD, and 92.86% for normal cases, while specificity reached 95.16%, 100%, and 95.42%, respectively. Despite the overall strong performance, some misclassification occurred, with seven instances of RD being incorrectly labeled as PVD.
Conclusion: We developed a transformer-based deep learning algorithm for ocular ultrasonography that accurately identifies membranes attached to the optic disc, distinguishing between RD (97.22% accuracy) and PVD (98.21% accuracy). Despite seven misclassifications, our model demonstrates robust performance and enhances diagnostic efficiency in high-volume imaging settings, thereby facilitating timely referrals and ultimately improving patient outcomes in urgent care scenarios. Overall, this promising innovation shows potential for clinical adoption.