Detection of graft failure in post-keratoplasty patients by automated deep learning.

IF 1.2 Q4 OPHTHALMOLOGY
Saudi Journal of Ophthalmology Pub Date : 2023-10-19 eCollection Date: 2023-07-01 DOI:10.4103/sjopt.sjopt_70_23
Carlos Méndez Mangana, Anton Barraquer, Álvaro Ferragut-Alegre, Gil Santolaria, Maximiliano Olivera, Rafael Barraquer
{"title":"Detection of graft failure in post-keratoplasty patients by automated deep learning.","authors":"Carlos Méndez Mangana, Anton Barraquer, Álvaro Ferragut-Alegre, Gil Santolaria, Maximiliano Olivera, Rafael Barraquer","doi":"10.4103/sjopt.sjopt_70_23","DOIUrl":null,"url":null,"abstract":"<p><strong>Purpose: </strong>Detection of graft failure of post-penetrating keratoplasty (PKP) patients from the proprietary dataset using algorithms trained in Automated Deep Learning (AutoML).</p><p><strong>Methods: </strong>This was an observational cross-sectional study, for which AutoML algorithms were trained following the success/failure labeling strategy based on clinical notes, on a cohort corresponding to 220 images of post-keratoplasty anterior pole eyes. Once the image quality criteria were analyzed and the dataset was pseudo-anonymized, it was transferred to the Google Cloud Platform, where using the Vertex AI-AutoML API, cloud- and edge-based algorithms were trained, following expert recommendations on dataset splitting (80% training, 10% test, and 10% validation).</p><p><strong>Results: </strong>The metrics obtained in the cloud-based and edge-based models have been similar, but we chose to analyze the edge model as it is an exportable model, lighter and cheaper to train. The initial results of the model presented an accuracy of 95.83%, with a specificity of 91.67% and a sensitivity of 100%, obtaining an F1<sub>SCORE</sub> of 95.996% and a precision of 92.30%. Other metrics, such as the area under the curve, confusion matrix, and activation map development, were contemplated.</p><p><strong>Conclusion: </strong>Initial results indicate the possibility of training algorithms in an automated fashion for the detection of graft failure in patients who underwent PKP. These algorithms are very lightweight tools easily integrated into mobile or desktop applications, potentially allowing every corneal transplant patient to have access to the best knowledge to enable the correct and timely diagnosis and treatment of graft failure. Although the results were good, because of the relatively small dataset, it is possible the data have some tendency to overfitting. AutoML opens the possibility of working in the field of artificial intelligence by computer vision to professionals with little experience and knowledge of programming.</p>","PeriodicalId":46810,"journal":{"name":"Saudi Journal of Ophthalmology","volume":"37 3","pages":"207-210"},"PeriodicalIF":1.2000,"publicationDate":"2023-10-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10701156/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Saudi Journal of Ophthalmology","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.4103/sjopt.sjopt_70_23","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2023/7/1 0:00:00","PubModel":"eCollection","JCR":"Q4","JCRName":"OPHTHALMOLOGY","Score":null,"Total":0}
引用次数: 0

Abstract

Purpose: Detection of graft failure of post-penetrating keratoplasty (PKP) patients from the proprietary dataset using algorithms trained in Automated Deep Learning (AutoML).

Methods: This was an observational cross-sectional study, for which AutoML algorithms were trained following the success/failure labeling strategy based on clinical notes, on a cohort corresponding to 220 images of post-keratoplasty anterior pole eyes. Once the image quality criteria were analyzed and the dataset was pseudo-anonymized, it was transferred to the Google Cloud Platform, where using the Vertex AI-AutoML API, cloud- and edge-based algorithms were trained, following expert recommendations on dataset splitting (80% training, 10% test, and 10% validation).

Results: The metrics obtained in the cloud-based and edge-based models have been similar, but we chose to analyze the edge model as it is an exportable model, lighter and cheaper to train. The initial results of the model presented an accuracy of 95.83%, with a specificity of 91.67% and a sensitivity of 100%, obtaining an F1SCORE of 95.996% and a precision of 92.30%. Other metrics, such as the area under the curve, confusion matrix, and activation map development, were contemplated.

Conclusion: Initial results indicate the possibility of training algorithms in an automated fashion for the detection of graft failure in patients who underwent PKP. These algorithms are very lightweight tools easily integrated into mobile or desktop applications, potentially allowing every corneal transplant patient to have access to the best knowledge to enable the correct and timely diagnosis and treatment of graft failure. Although the results were good, because of the relatively small dataset, it is possible the data have some tendency to overfitting. AutoML opens the possibility of working in the field of artificial intelligence by computer vision to professionals with little experience and knowledge of programming.

Abstract Image

Abstract Image

通过自动深度学习检测角膜移植术后患者的移植失败。
目的:使用自动深度学习(AutoML)训练的算法,从专有数据集中检测穿透性角膜移植术(PKP)术后患者的移植失败情况:这是一项观察性横断面研究,根据临床记录,按照成功/失败标记策略,在与 220 张角膜移植术后前极眼球图像相对应的队列中训练 AutoML 算法。在对图像质量标准进行分析并对数据集进行伪匿名处理后,数据集被转移到谷歌云平台,在该平台上使用顶点人工智能-AutoML应用程序接口(Vertex AI-AutoML API),按照专家关于数据集分割的建议(80%训练、10%测试和10%验证),对基于云和边缘的算法进行了训练:基于云的模型和基于边缘的模型获得的指标相似,但我们选择分析边缘模型,因为它是一个可导出的模型,更轻便,训练成本更低。该模型的初步结果显示准确率为 95.83%,特异性为 91.67%,灵敏度为 100%,F1SCORE 为 95.996%,精确度为 92.30%。还考虑了其他指标,如曲线下面积、混淆矩阵和激活图的发展:初步结果表明,可以通过自动方式训练算法来检测接受 PKP 患者的移植物失败。这些算法是非常轻量级的工具,很容易集成到移动或桌面应用程序中,有可能让每一位角膜移植患者都能获得最佳知识,从而正确、及时地诊断和治疗移植失败。虽然结果不错,但由于数据集相对较小,数据可能存在一些过度拟合的倾向。AutoML 为缺乏编程经验和知识的专业人员提供了在计算机视觉人工智能领域工作的可能性。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
CiteScore
0.90
自引率
0.00%
发文量
79
审稿时长
13 weeks
期刊介绍: Saudi Journal of Ophthalmology is an English language, peer-reviewed scholarly publication in the area of ophthalmology. Saudi Journal of Ophthalmology publishes original papers, clinical studies, reviews and case reports. Saudi Journal of Ophthalmology is the official publication of the Saudi Ophthalmological Society and is published by King Saud University in collaboration with Elsevier and is edited by an international group of eminent researchers.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:604180095
Book学术官方微信