Optimizing Ocular Pathology Classification with CNNs and OCT Imaging: A Systematic and Performance Review

Walter Hauri-Rosales, Oswaldo Pérez, Marlon Garcia-Roa, Ellery López-Star, Ulises Olivares-Pinto
{"title":"Optimizing Ocular Pathology Classification with CNNs and OCT Imaging: A Systematic and Performance Review","authors":"Walter Hauri-Rosales, Oswaldo Pérez, Marlon Garcia-Roa, Ellery López-Star, Ulises Olivares-Pinto","doi":"10.1101/2024.06.18.24309070","DOIUrl":null,"url":null,"abstract":"Vision loss due to chronic-degenerative diseases is a primary cause of blindness worldwide. Deep learning architectures utilizing optical coherence tomography images have proven effective for the early diagnosis of ocular pathologies. Nevertheless, most studies have emphasized the best outcomes using optimal hyperparameter combinations and extensive data availability. This focus has eclipsed the exploration of how model learning capacity varies with different data volumes. The current study evaluates the learning capabilities of efficient deep-learning classification models across various data amounts, aiming to determine the necessary data portion for effective clinical trial classifications of ocular pathologies. A comprehensive review was conducted, which included 295 papers that employed OCT images to classify one or more of the following retinal pathologies: Drusen, Diabetic Macular Edema, and Choroidal Neovascularization. Performance metrics and dataset details were extracted from these studies. Four Convolutional Neural Networks were selected and trained using three strategies: initializing with random weights, fine-tuning, and retraining only the classification layers. The resultant performance was compared based on training size and strategy to identify the optimal combination of model size, dataset size, and training approach. The findings revealed that, among the models trained with various strategies and data volumes, three achieved 99.9% accuracy, precision, recall, and F1 score. Two of these models were fine-tuned, and one used random weight initialization. Remarkably, two models reached 99% accuracy using only 10% of the original training dataset. Additionally, a model that was less than 10% the size of the others achieved 98.7% accuracy and an F1 score on the test set while requiring 100 times less computing time. This study is the first to assess the impact of training data size and model complexity on performance metrics across three scenarios: random weights initialization, fine-tuning, and retraining classification layers only, specifically utilizing optical coherence tomography images.","PeriodicalId":501390,"journal":{"name":"medRxiv - Ophthalmology","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2024-06-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"medRxiv - Ophthalmology","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1101/2024.06.18.24309070","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

Vision loss due to chronic-degenerative diseases is a primary cause of blindness worldwide. Deep learning architectures utilizing optical coherence tomography images have proven effective for the early diagnosis of ocular pathologies. Nevertheless, most studies have emphasized the best outcomes using optimal hyperparameter combinations and extensive data availability. This focus has eclipsed the exploration of how model learning capacity varies with different data volumes. The current study evaluates the learning capabilities of efficient deep-learning classification models across various data amounts, aiming to determine the necessary data portion for effective clinical trial classifications of ocular pathologies. A comprehensive review was conducted, which included 295 papers that employed OCT images to classify one or more of the following retinal pathologies: Drusen, Diabetic Macular Edema, and Choroidal Neovascularization. Performance metrics and dataset details were extracted from these studies. Four Convolutional Neural Networks were selected and trained using three strategies: initializing with random weights, fine-tuning, and retraining only the classification layers. The resultant performance was compared based on training size and strategy to identify the optimal combination of model size, dataset size, and training approach. The findings revealed that, among the models trained with various strategies and data volumes, three achieved 99.9% accuracy, precision, recall, and F1 score. Two of these models were fine-tuned, and one used random weight initialization. Remarkably, two models reached 99% accuracy using only 10% of the original training dataset. Additionally, a model that was less than 10% the size of the others achieved 98.7% accuracy and an F1 score on the test set while requiring 100 times less computing time. This study is the first to assess the impact of training data size and model complexity on performance metrics across three scenarios: random weights initialization, fine-tuning, and retraining classification layers only, specifically utilizing optical coherence tomography images.
利用 CNN 和 OCT 成像优化眼部病理分类:系统性和性能回顾
慢性退行性疾病导致的视力丧失是全球失明的主要原因。事实证明,利用光学相干断层扫描图像的深度学习架构对眼部病变的早期诊断非常有效。然而,大多数研究都强调利用最佳超参数组合和广泛的数据可用性来获得最佳结果。这一重点忽略了对模型学习能力如何随不同数据量而变化的探索。本研究评估了高效深度学习分类模型在不同数据量下的学习能力,旨在确定有效眼部病理临床试验分类所需的数据量。研究人员对 295 篇采用 OCT 图像对以下一种或多种视网膜病变进行分类的论文进行了全面审查:色素沉着、糖尿病黄斑水肿和脉络膜新生血管。从这些研究中提取了性能指标和数据集详情。我们选择了四个卷积神经网络,并采用三种策略对其进行训练:随机权重初始化、微调和仅对分类层进行再训练。根据训练规模和策略对结果性能进行了比较,以确定模型规模、数据集规模和训练方法的最佳组合。研究结果表明,在采用不同策略和数据量训练的模型中,有三个模型的准确率、精确率、召回率和 F1 分数都达到了 99.9%。其中两个模型进行了微调,一个使用了随机权重初始化。值得注意的是,有两个模型只使用了原始训练数据集的 10%,就达到了 99% 的准确率。此外,一个规模不到其他模型 10%的模型在测试集上达到了 98.7% 的准确率和 F1 分数,而所需的计算时间却减少了 100 倍。这项研究首次评估了训练数据大小和模型复杂度对三种情况下性能指标的影响:随机权重初始化、微调和仅重新训练分类层,特别是利用光学相干断层扫描图像。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信