Richul Oh, Joo Youn Oh, Hyuk Jin Choi, Mee Kum Kim, Chang Ho Yoon
{"title":"Evaluation of prediction errors in nine intraocular lens calculation formulas using an explainable machine learning model.","authors":"Richul Oh, Joo Youn Oh, Hyuk Jin Choi, Mee Kum Kim, Chang Ho Yoon","doi":"10.1186/s12886-024-03801-2","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>The purpose of the study was to evaluate the relationship between prediction errors (PEs) and ocular biometric variables in cataract surgery using nine intraocular lens (IOL) formulas with an explainable machine learning model.</p><p><strong>Methods: </strong>We retrospectively analyzed the medical records of consecutive patients who underwent standard cataract surgery with a Tecnis 1-piece IOL (ZCB00) at a single center. We calculated predicted refraction using the following IOL formulas: Barrett Universal II (BUII), Cooke K6, EVO V2.0, Haigis, Hoffer QST, Holladay 1, Kane, SRK/T, and PEARL-DGS. We used a LightGBM-based machine learning model to evaluate the explanatory power of ocular biometric variables for PEs and assessed the relationship between PEs and ocular biometric variables using Shapley additive explanation (SHAP) values.</p><p><strong>Results: </strong>We included 1,430 eyes of 1,430 patients in the analysis. The SRK/T formula exhibited the highest R<sup>2</sup> value (0.231) in the test set among the machine-learning models. In contrast, the Kane formula exhibited the lowest R<sup>2</sup> value (0.021) in the test set, indicating that the model could explain only 2.1% of the PEs using ocular biometric variables. BUII, Cooke K6, EVO V2.0, Haigis, Hoffer QST, Holladay 1, PEARL-DGS formulas exhibited R<sup>2</sup> values of 0.046, 0.025, 0.037, 0.194, 0.106, 0.191, and 0.058, respectively. Lower R<sup>2</sup> values for the IOL formulas corresponded to smaller SHAP values.</p><p><strong>Conclusion: </strong>The explanatory power of currently used ocular biometric variables for PEs in new-generation formulas such as BUII, Cooke K6, EVO V2.0 and Kane is low, implying that these formulas are already optimized. Therefore, the introduction of new ocular biometric variables into IOL calculation formulas could potentially reduce PEs, enhancing the accuracy of surgical outcomes.</p>","PeriodicalId":9058,"journal":{"name":"BMC Ophthalmology","volume":"24 1","pages":"531"},"PeriodicalIF":1.7000,"publicationDate":"2024-12-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"BMC Ophthalmology","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1186/s12886-024-03801-2","RegionNum":4,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"OPHTHALMOLOGY","Score":null,"Total":0}
引用次数: 0
Abstract
Background: The purpose of the study was to evaluate the relationship between prediction errors (PEs) and ocular biometric variables in cataract surgery using nine intraocular lens (IOL) formulas with an explainable machine learning model.
Methods: We retrospectively analyzed the medical records of consecutive patients who underwent standard cataract surgery with a Tecnis 1-piece IOL (ZCB00) at a single center. We calculated predicted refraction using the following IOL formulas: Barrett Universal II (BUII), Cooke K6, EVO V2.0, Haigis, Hoffer QST, Holladay 1, Kane, SRK/T, and PEARL-DGS. We used a LightGBM-based machine learning model to evaluate the explanatory power of ocular biometric variables for PEs and assessed the relationship between PEs and ocular biometric variables using Shapley additive explanation (SHAP) values.
Results: We included 1,430 eyes of 1,430 patients in the analysis. The SRK/T formula exhibited the highest R2 value (0.231) in the test set among the machine-learning models. In contrast, the Kane formula exhibited the lowest R2 value (0.021) in the test set, indicating that the model could explain only 2.1% of the PEs using ocular biometric variables. BUII, Cooke K6, EVO V2.0, Haigis, Hoffer QST, Holladay 1, PEARL-DGS formulas exhibited R2 values of 0.046, 0.025, 0.037, 0.194, 0.106, 0.191, and 0.058, respectively. Lower R2 values for the IOL formulas corresponded to smaller SHAP values.
Conclusion: The explanatory power of currently used ocular biometric variables for PEs in new-generation formulas such as BUII, Cooke K6, EVO V2.0 and Kane is low, implying that these formulas are already optimized. Therefore, the introduction of new ocular biometric variables into IOL calculation formulas could potentially reduce PEs, enhancing the accuracy of surgical outcomes.
期刊介绍:
BMC Ophthalmology is an open access, peer-reviewed journal that considers articles on all aspects of the prevention, diagnosis and management of eye disorders, as well as related molecular genetics, pathophysiology, and epidemiology.