A Combination of Artificial Intelligence with Genetic Algorithms on Static Time-Lapse Images Improves Consistency in Blastocyst Assessment, An Interpretable Tool to Automate Human Embryo Evaluation: A Retrospective Cohort Study.
Marco Toschi, Lorena Bori, Jose Celso Rocha, Cristina Hickman, Marcelo Fabio Gouveia Nogueira, Andre Satoshi Ferreira, Murilo Costa Maffeis, Jonas Malmsten, Qiansheng Zhan, Nikica Zaninovic, Marcos Meseguer
{"title":"A Combination of Artificial Intelligence with Genetic Algorithms on Static Time-Lapse Images Improves Consistency in Blastocyst Assessment, An Interpretable Tool to Automate Human Embryo Evaluation: A Retrospective Cohort Study.","authors":"Marco Toschi, Lorena Bori, Jose Celso Rocha, Cristina Hickman, Marcelo Fabio Gouveia Nogueira, Andre Satoshi Ferreira, Murilo Costa Maffeis, Jonas Malmsten, Qiansheng Zhan, Nikica Zaninovic, Marcos Meseguer","doi":"10.22074/ijfs.2024.2008339.1510","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>In recent times, various algorithms have been developed to assist in the selection of embryos for transfer based on artificial intelligence (AI). Nevertheless, the majority of AI models employed in this context were characterized by a lack of transparency. To address these concerns, we aim to design an interpretable tool to automate human embryo evaluation by combining artificial neural networks (ANNs) and genetic algorithms (GA).</p><p><strong>Materials and methods: </strong>This retrospective cohort study included 223 human blastocyst time-lapse (TL) images taken at 110 hours post-injection. All the images were evaluated by five embryologists from different clinics in terms of blastocyst expansion (BE), quality of the inner cell mass (ICM), and trophectoderm (TE). The embryo database was used to develop an AI system (70% training, 15% validation, and 15% test) for automate blastocyst assessment. The entire set of images underwent a standardization process, followed by processing and segmentation using Matlab software. The resulting quantified variables were utilized in AI techniques (ANN and GA). Finally, the accuracy and performance of the automation tool was assessed with the area under the receiver operating characteristic (ROC) curve (AUC). Then, the level of agreement among embryologists and between embryologists and the AI system was compared with Kappa Index.</p><p><strong>Results: </strong>The overall agreement among embryologists was low (Kappa: 0.4 for BE; and 0.3 for TE and ICM). The AI tool achieved higher consistency (Kappa 0.7 for BE and ICM; and 0.4 for TE). The AI exhibited high accuracy in classifying BE (test 81.5%), ICM (test 78.8%), and TE (test 78.3%) and better performance for BE (AUC 0.888-0.956) than for ICM (AUC 0.605-0.854) and TE (AUC 0.726-0.769) assessment.</p><p><strong>Conclusion: </strong>Our AI tool highlighted the superior consistency of AI compared to human operators in grading blastocyst morphology. This research represents an important step towards fully automating objective embryo evaluation.</p>","PeriodicalId":14080,"journal":{"name":"International Journal of Fertility & Sterility","volume":"18 4","pages":"378-383"},"PeriodicalIF":2.3000,"publicationDate":"2024-10-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"International Journal of Fertility & Sterility","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.22074/ijfs.2024.2008339.1510","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"OBSTETRICS & GYNECOLOGY","Score":null,"Total":0}
引用次数: 0
Abstract
Background: In recent times, various algorithms have been developed to assist in the selection of embryos for transfer based on artificial intelligence (AI). Nevertheless, the majority of AI models employed in this context were characterized by a lack of transparency. To address these concerns, we aim to design an interpretable tool to automate human embryo evaluation by combining artificial neural networks (ANNs) and genetic algorithms (GA).
Materials and methods: This retrospective cohort study included 223 human blastocyst time-lapse (TL) images taken at 110 hours post-injection. All the images were evaluated by five embryologists from different clinics in terms of blastocyst expansion (BE), quality of the inner cell mass (ICM), and trophectoderm (TE). The embryo database was used to develop an AI system (70% training, 15% validation, and 15% test) for automate blastocyst assessment. The entire set of images underwent a standardization process, followed by processing and segmentation using Matlab software. The resulting quantified variables were utilized in AI techniques (ANN and GA). Finally, the accuracy and performance of the automation tool was assessed with the area under the receiver operating characteristic (ROC) curve (AUC). Then, the level of agreement among embryologists and between embryologists and the AI system was compared with Kappa Index.
Results: The overall agreement among embryologists was low (Kappa: 0.4 for BE; and 0.3 for TE and ICM). The AI tool achieved higher consistency (Kappa 0.7 for BE and ICM; and 0.4 for TE). The AI exhibited high accuracy in classifying BE (test 81.5%), ICM (test 78.8%), and TE (test 78.3%) and better performance for BE (AUC 0.888-0.956) than for ICM (AUC 0.605-0.854) and TE (AUC 0.726-0.769) assessment.
Conclusion: Our AI tool highlighted the superior consistency of AI compared to human operators in grading blastocyst morphology. This research represents an important step towards fully automating objective embryo evaluation.
期刊介绍:
International Journal of Fertility & Sterility is a quarterly English publication of Royan Institute . The aim of the journal is to disseminate information through publishing the most recent scientific research studies on Fertility and Sterility and other related topics. Int J Fertil Steril has been certified by Ministry of Culture and Islamic Guidance in 2007 and was accredited as a scientific and research journal by HBI (Health and Biomedical Information) Journal Accreditation Commission in 2008. Int J Fertil Steril is an Open Access journal.