Jad F. Assaf, MD, Hady Yazbeck, MD, Dan Z. Reinstein, MD, MA(Cantab), FRCOphth, Timothy J. Archer, MA(Oxon), DipCompSci(Cantab), PhD, Juan Arbelaez, MD, Yara Bteich, MD, Maria Clara Arbelaez, MD, Anthony Abou Mrad, MD, Shady T. Awwad, MD
{"title":"利用生成式对抗网络和光学相干断层扫描合成数据加强植入式胶束透镜穹窿的自动检测","authors":"Jad F. Assaf, MD, Hady Yazbeck, MD, Dan Z. Reinstein, MD, MA(Cantab), FRCOphth, Timothy J. Archer, MA(Oxon), DipCompSci(Cantab), PhD, Juan Arbelaez, MD, Yara Bteich, MD, Maria Clara Arbelaez, MD, Anthony Abou Mrad, MD, Shady T. Awwad, MD","doi":"10.3928/1081597x-20240214-01","DOIUrl":null,"url":null,"abstract":"<section><h3>Purpose:</h3><p>To investigate the efficacy of incorporating Generative Adversarial Network (GAN) and synthetic images in enhancing the performance of a convolutional neural network (CNN) for automated estimation of Implantable Collamer Lens (ICL) vault using anterior segment optical coherence tomography (AS-OCT).</p></section><section><h3>Methods:</h3><p>This study was a retrospective evaluation using synthetic data and real patient images in a deep learning framework. Synthetic ICL AS-OCT scans were generated using GANs and a secondary image editing algorithm, creating approximately 100,000 synthetic images. These were used alongside real patient scans to train a CNN for estimating ICL vault distance. The model's performance was evaluated using statistical metrics such as mean absolute percentage error (MAPE), mean absolute error (MAE), root mean squared error (RMSE), and coefficient of determination (<i>R</i><sup>2</sup>) for the estimation of ICL vault distance.</p></section><section><h3>Results:</h3><p>The study analyzed 4,557 AS-OCT B-scans from 138 eyes of 103 patients for training. An independent, retrospectively collected dataset of 2,454 AS-OCT images from 88 eyes of 56 patients, used prospectively for evaluation, served as the test set. When trained solely on real images, the CNN achieved a MAPE of 15.31%, MAE of 44.68 µm, and RMSE of 63.3 µm. However, with the inclusion of GAN-generated and algorithmically edited synthetic images, the performance significantly improved, achieving a MAPE of 8.09%, MAE of 24.83 µm, and RMSE of 32.26 µm. The <i>R</i><sup>2</sup> value was +0.98, indicating a strong positive correlation between actual and predicted ICL vault distances (<i>P</i> < .01). No statistically significant difference was observed between measured and predicted vault values (<i>P</i> = .58).</p></section><section><h3>Conclusions:</h3><p>The integration of GAN-generated and edited synthetic images substantially enhanced ICL vault estimation, demonstrating the efficacy of GANs and synthetic data in enhancing OCT image analysis accuracy. This model not only shows potential for assisting postoperative ICL evaluations, but also for improving OCT automation when data paucity is an issue.</p><p><strong>[<i>J Refract Surg</i>. 2024;40(4):e199–e207.]</strong></p></section>","PeriodicalId":16951,"journal":{"name":"Journal of refractive surgery","volume":"50 1","pages":""},"PeriodicalIF":2.9000,"publicationDate":"2024-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Enhancing the Automated Detection of Implantable Collamer Lens Vault Using Generative Adversarial Networks and Synthetic Data on Optical Coherence Tomography\",\"authors\":\"Jad F. Assaf, MD, Hady Yazbeck, MD, Dan Z. Reinstein, MD, MA(Cantab), FRCOphth, Timothy J. Archer, MA(Oxon), DipCompSci(Cantab), PhD, Juan Arbelaez, MD, Yara Bteich, MD, Maria Clara Arbelaez, MD, Anthony Abou Mrad, MD, Shady T. Awwad, MD\",\"doi\":\"10.3928/1081597x-20240214-01\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<section><h3>Purpose:</h3><p>To investigate the efficacy of incorporating Generative Adversarial Network (GAN) and synthetic images in enhancing the performance of a convolutional neural network (CNN) for automated estimation of Implantable Collamer Lens (ICL) vault using anterior segment optical coherence tomography (AS-OCT).</p></section><section><h3>Methods:</h3><p>This study was a retrospective evaluation using synthetic data and real patient images in a deep learning framework. Synthetic ICL AS-OCT scans were generated using GANs and a secondary image editing algorithm, creating approximately 100,000 synthetic images. These were used alongside real patient scans to train a CNN for estimating ICL vault distance. The model's performance was evaluated using statistical metrics such as mean absolute percentage error (MAPE), mean absolute error (MAE), root mean squared error (RMSE), and coefficient of determination (<i>R</i><sup>2</sup>) for the estimation of ICL vault distance.</p></section><section><h3>Results:</h3><p>The study analyzed 4,557 AS-OCT B-scans from 138 eyes of 103 patients for training. An independent, retrospectively collected dataset of 2,454 AS-OCT images from 88 eyes of 56 patients, used prospectively for evaluation, served as the test set. When trained solely on real images, the CNN achieved a MAPE of 15.31%, MAE of 44.68 µm, and RMSE of 63.3 µm. However, with the inclusion of GAN-generated and algorithmically edited synthetic images, the performance significantly improved, achieving a MAPE of 8.09%, MAE of 24.83 µm, and RMSE of 32.26 µm. The <i>R</i><sup>2</sup> value was +0.98, indicating a strong positive correlation between actual and predicted ICL vault distances (<i>P</i> < .01). No statistically significant difference was observed between measured and predicted vault values (<i>P</i> = .58).</p></section><section><h3>Conclusions:</h3><p>The integration of GAN-generated and edited synthetic images substantially enhanced ICL vault estimation, demonstrating the efficacy of GANs and synthetic data in enhancing OCT image analysis accuracy. This model not only shows potential for assisting postoperative ICL evaluations, but also for improving OCT automation when data paucity is an issue.</p><p><strong>[<i>J Refract Surg</i>. 2024;40(4):e199–e207.]</strong></p></section>\",\"PeriodicalId\":16951,\"journal\":{\"name\":\"Journal of refractive surgery\",\"volume\":\"50 1\",\"pages\":\"\"},\"PeriodicalIF\":2.9000,\"publicationDate\":\"2024-04-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Journal of refractive surgery\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.3928/1081597x-20240214-01\",\"RegionNum\":3,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"OPHTHALMOLOGY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of refractive surgery","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.3928/1081597x-20240214-01","RegionNum":3,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"OPHTHALMOLOGY","Score":null,"Total":0}
Enhancing the Automated Detection of Implantable Collamer Lens Vault Using Generative Adversarial Networks and Synthetic Data on Optical Coherence Tomography
Purpose:
To investigate the efficacy of incorporating Generative Adversarial Network (GAN) and synthetic images in enhancing the performance of a convolutional neural network (CNN) for automated estimation of Implantable Collamer Lens (ICL) vault using anterior segment optical coherence tomography (AS-OCT).
Methods:
This study was a retrospective evaluation using synthetic data and real patient images in a deep learning framework. Synthetic ICL AS-OCT scans were generated using GANs and a secondary image editing algorithm, creating approximately 100,000 synthetic images. These were used alongside real patient scans to train a CNN for estimating ICL vault distance. The model's performance was evaluated using statistical metrics such as mean absolute percentage error (MAPE), mean absolute error (MAE), root mean squared error (RMSE), and coefficient of determination (R2) for the estimation of ICL vault distance.
Results:
The study analyzed 4,557 AS-OCT B-scans from 138 eyes of 103 patients for training. An independent, retrospectively collected dataset of 2,454 AS-OCT images from 88 eyes of 56 patients, used prospectively for evaluation, served as the test set. When trained solely on real images, the CNN achieved a MAPE of 15.31%, MAE of 44.68 µm, and RMSE of 63.3 µm. However, with the inclusion of GAN-generated and algorithmically edited synthetic images, the performance significantly improved, achieving a MAPE of 8.09%, MAE of 24.83 µm, and RMSE of 32.26 µm. The R2 value was +0.98, indicating a strong positive correlation between actual and predicted ICL vault distances (P < .01). No statistically significant difference was observed between measured and predicted vault values (P = .58).
Conclusions:
The integration of GAN-generated and edited synthetic images substantially enhanced ICL vault estimation, demonstrating the efficacy of GANs and synthetic data in enhancing OCT image analysis accuracy. This model not only shows potential for assisting postoperative ICL evaluations, but also for improving OCT automation when data paucity is an issue.
期刊介绍:
The Journal of Refractive Surgery, the official journal of the International Society of Refractive Surgery, a partner of the American Academy of Ophthalmology, has been a monthly peer-reviewed forum for original research, review, and evaluation of refractive and lens-based surgical procedures for more than 30 years. Practical, clinically valuable articles provide readers with the most up-to-date information regarding advances in the field of refractive surgery. Begin to explore the Journal and all of its great benefits such as:
• Columns including “Translational Science,” “Surgical Techniques,” and “Biomechanics”
• Supplemental videos and materials available for many articles
• Access to current articles, as well as several years of archived content
• Articles posted online just 2 months after acceptance.