利用视觉转换器模型,根据光学相干断层扫描图像对糖尿病黄斑病变进行分类。

IF 2 Q2 OPHTHALMOLOGY
Liwei Cai, Chi Wen, Jingwen Jiang, Congbi Liang, Hongmei Zheng, Yu Su, Changzheng Chen
{"title":"利用视觉转换器模型,根据光学相干断层扫描图像对糖尿病黄斑病变进行分类。","authors":"Liwei Cai, Chi Wen, Jingwen Jiang, Congbi Liang, Hongmei Zheng, Yu Su, Changzheng Chen","doi":"10.1136/bmjophth-2023-001423","DOIUrl":null,"url":null,"abstract":"<p><strong>Purpose: </strong>To develop a Vision Transformer model to detect different stages of diabetic maculopathy (DM) based on optical coherence tomography (OCT) images.</p><p><strong>Methods: </strong>After removing images with poor quality, a total of 3319 OCT images were extracted from the Eye Center of the Renmin Hospital of Wuhan University and randomly split the images into training and validation sets in a 7:3 ratio. All macular cross-sectional scan OCT images were collected retrospectively from the eyes of DM patients from 2016 to 2022. One of the OCT stages of DM, including early diabetic macular oedema (DME), advanced DME, severe DME and atrophic maculopathy, was labelled on the collected images, respectively. A deep learning (DL) model based on Vision Transformer was trained to detect four OCT grading of DM.</p><p><strong>Results: </strong>The model proposed in our paper can provide an impressive detection performance. We achieved an accuracy of 82.00%, an F1 score of 83.11%, an area under the receiver operating characteristic curve (AUC) of 0.96. The AUC for the detection of four OCT grading (ie, early DME, advanced DME, severe DME and atrophic maculopathy) was 0.96, 0.95, 0.87 and 0.98, respectively, with an accuracy of 90.87%, 89.96%, 94.42% and 95.13%, respectively, a precision of 88.46%, 80.31%, 89.42% and 87.74%, respectively, a sensitivity of 87.03%, 88.18%, 63.39% and 89.42%, respectively, a specificity of 93.02%, 90.72%, 98.40% and 96.66%, respectively and an F1 score of 87.74%, 84.06%, 88.18% and 88.57%, respectively.</p><p><strong>Conclusion: </strong>Our DL model based on Vision Transformer demonstrated a relatively high accuracy in the detection of OCT grading of DM, which can help with patients in a preliminary screening to identify groups with serious conditions. These patients need a further test for an accurate diagnosis, and a timely treatment to obtain a good visual prognosis. These results emphasised the potential of artificial intelligence in assisting clinicians in developing therapeutic strategies with DM in the future.</p>","PeriodicalId":9286,"journal":{"name":"BMJ Open Ophthalmology","volume":null,"pages":null},"PeriodicalIF":2.0000,"publicationDate":"2023-12-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Classification of diabetic maculopathy based on optical coherence tomography images using a Vision Transformer model.\",\"authors\":\"Liwei Cai, Chi Wen, Jingwen Jiang, Congbi Liang, Hongmei Zheng, Yu Su, Changzheng Chen\",\"doi\":\"10.1136/bmjophth-2023-001423\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Purpose: </strong>To develop a Vision Transformer model to detect different stages of diabetic maculopathy (DM) based on optical coherence tomography (OCT) images.</p><p><strong>Methods: </strong>After removing images with poor quality, a total of 3319 OCT images were extracted from the Eye Center of the Renmin Hospital of Wuhan University and randomly split the images into training and validation sets in a 7:3 ratio. All macular cross-sectional scan OCT images were collected retrospectively from the eyes of DM patients from 2016 to 2022. One of the OCT stages of DM, including early diabetic macular oedema (DME), advanced DME, severe DME and atrophic maculopathy, was labelled on the collected images, respectively. A deep learning (DL) model based on Vision Transformer was trained to detect four OCT grading of DM.</p><p><strong>Results: </strong>The model proposed in our paper can provide an impressive detection performance. We achieved an accuracy of 82.00%, an F1 score of 83.11%, an area under the receiver operating characteristic curve (AUC) of 0.96. The AUC for the detection of four OCT grading (ie, early DME, advanced DME, severe DME and atrophic maculopathy) was 0.96, 0.95, 0.87 and 0.98, respectively, with an accuracy of 90.87%, 89.96%, 94.42% and 95.13%, respectively, a precision of 88.46%, 80.31%, 89.42% and 87.74%, respectively, a sensitivity of 87.03%, 88.18%, 63.39% and 89.42%, respectively, a specificity of 93.02%, 90.72%, 98.40% and 96.66%, respectively and an F1 score of 87.74%, 84.06%, 88.18% and 88.57%, respectively.</p><p><strong>Conclusion: </strong>Our DL model based on Vision Transformer demonstrated a relatively high accuracy in the detection of OCT grading of DM, which can help with patients in a preliminary screening to identify groups with serious conditions. These patients need a further test for an accurate diagnosis, and a timely treatment to obtain a good visual prognosis. These results emphasised the potential of artificial intelligence in assisting clinicians in developing therapeutic strategies with DM in the future.</p>\",\"PeriodicalId\":9286,\"journal\":{\"name\":\"BMJ Open Ophthalmology\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":2.0000,\"publicationDate\":\"2023-12-21\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"BMJ Open Ophthalmology\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1136/bmjophth-2023-001423\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"OPHTHALMOLOGY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"BMJ Open Ophthalmology","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1136/bmjophth-2023-001423","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"OPHTHALMOLOGY","Score":null,"Total":0}
引用次数: 0

摘要

目的:基于光学相干断层扫描(OCT)图像,开发一种视觉变换器模型,以检测糖尿病黄斑病变(DM)的不同阶段:剔除质量较差的图像后,从武汉大学人民医院眼科中心提取了 3319 张 OCT 图像,并按 7:3 的比例将图像随机分成训练集和验证集。所有黄斑横断面扫描OCT图像均为2016年至2022年DM患者眼部的回顾性采集。收集到的图像上分别标注了DM的OCT分期之一,包括早期糖尿病黄斑水肿(DME)、晚期DME、重度DME和萎缩性黄斑病变。基于视觉转换器(Vision Transformer)的深度学习(DL)模型经过训练后,可检测出糖尿病黄斑水肿的四个OCT分级:结果:本文提出的模型可以提供令人印象深刻的检测性能。我们的准确率达到了 82.00%,F1 得分为 83.11%,接收者工作特征曲线下面积(AUC)为 0.96。检测四种 OCT 分级(即早期 DME、晚期 DME、重度 DME 和萎缩性黄斑病变)的 AUC 分别为 0.96、0.95、0.87 和 0.98,准确率分别为 90.87%、89.96%、94.42% 和 95.13%,精确度分别为 88.46%、80.31%、89.42% 和 87.74%,灵敏度分别为 87.03%、88.18%、63.39% 和 89.42%,特异度分别为 93.02%、90.72%、98.40% 和 96.66%,F1 分数分别为 87.74%、84.06%、88.18% 和 88.57%:我们基于 Vision Transformer 的 DL 模型在检测 DM 的 OCT 分级方面表现出了较高的准确性,有助于对患者进行初步筛查,以识别病情严重的群体。这些患者需要进一步检测以获得准确诊断,并及时治疗以获得良好的视觉预后。这些结果强调了人工智能在未来协助临床医生制定DM治疗策略方面的潜力。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
Classification of diabetic maculopathy based on optical coherence tomography images using a Vision Transformer model.

Purpose: To develop a Vision Transformer model to detect different stages of diabetic maculopathy (DM) based on optical coherence tomography (OCT) images.

Methods: After removing images with poor quality, a total of 3319 OCT images were extracted from the Eye Center of the Renmin Hospital of Wuhan University and randomly split the images into training and validation sets in a 7:3 ratio. All macular cross-sectional scan OCT images were collected retrospectively from the eyes of DM patients from 2016 to 2022. One of the OCT stages of DM, including early diabetic macular oedema (DME), advanced DME, severe DME and atrophic maculopathy, was labelled on the collected images, respectively. A deep learning (DL) model based on Vision Transformer was trained to detect four OCT grading of DM.

Results: The model proposed in our paper can provide an impressive detection performance. We achieved an accuracy of 82.00%, an F1 score of 83.11%, an area under the receiver operating characteristic curve (AUC) of 0.96. The AUC for the detection of four OCT grading (ie, early DME, advanced DME, severe DME and atrophic maculopathy) was 0.96, 0.95, 0.87 and 0.98, respectively, with an accuracy of 90.87%, 89.96%, 94.42% and 95.13%, respectively, a precision of 88.46%, 80.31%, 89.42% and 87.74%, respectively, a sensitivity of 87.03%, 88.18%, 63.39% and 89.42%, respectively, a specificity of 93.02%, 90.72%, 98.40% and 96.66%, respectively and an F1 score of 87.74%, 84.06%, 88.18% and 88.57%, respectively.

Conclusion: Our DL model based on Vision Transformer demonstrated a relatively high accuracy in the detection of OCT grading of DM, which can help with patients in a preliminary screening to identify groups with serious conditions. These patients need a further test for an accurate diagnosis, and a timely treatment to obtain a good visual prognosis. These results emphasised the potential of artificial intelligence in assisting clinicians in developing therapeutic strategies with DM in the future.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
BMJ Open Ophthalmology
BMJ Open Ophthalmology OPHTHALMOLOGY-
CiteScore
3.40
自引率
4.20%
发文量
104
审稿时长
20 weeks
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信