{"title":"利用基于 SAM 的双分支管道进行分裂期胚胎分割:利用 CleavageEmbryo 数据集进行开发和评估。","authors":"Chensheng Zhang, Xintong Shi, Xinyue Yin, Jiayi Sun, Jianhui Zhao, Yi Zhang","doi":"10.1093/bioinformatics/btae617","DOIUrl":null,"url":null,"abstract":"<p><strong>Motivation: </strong>Embryo selection is one of the critical factors in determining the success of pregnancy in in vitro fertilization (IVF) procedures. Using artificial intelligence to aid in embryo selection could effectively address the current time-consuming, expensive, subjectively influenced process of embryo assessment by trained embryologists. However, current deep learning-based methods often focus on blastocyst segmentation, grading, or predicting cell development via time-lapse videos, often overlooking morphokinetic parameters or lacking interpretability. Given the significance of both morphokinetic and morphological evaluation in predicting the implantation potential of cleavage-stage embryos, as emphasized by previous research, there is a necessity for an automated method to segment cleavage-stage embryos to improve this process.</p><p><strong>Results: </strong>In this article, we introduce the SAM-based Dual Branch Segmentation Pipeline for automated segmentation of blastomeres in cleavage-stage embryos. Leveraging the powerful segmentation capability of SAM, the instance branch conducts instance segmentation of blastomeres, while the semantic branch performs semantic segmentation of fragments. Due to the lack of publicly available datasets, we construct the CleavageEmbryo dataset, the first dataset of human cleavage-stage embryos with pixel-level annotations containing fragment information. We train and test a series of state-of-the-art segmentation algorithms on CleavageEmbryo. Our experiments demonstrate that our method outperforms existing algorithms in terms of objective metrics (mAP 0.748 on blastomeres, Dice 0.694 on fragments) and visual quality, enabling more accurate segmentation of cleavage-stage embryos.</p><p><strong>Availability and implementation: </strong>The code and sample data in this study can be found at: Https://github.com/12austincc/Cleavage-StageEmbryoSegmentation.</p><p><strong>Supplementary information: </strong>Supplementary data are available at Bioinformatics online.</p>","PeriodicalId":93899,"journal":{"name":"Bioinformatics (Oxford, England)","volume":" ","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-10-18","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Cleavage-Stage Embryo Segmentation Using SAM-Based Dual Branch Pipeline: Development and Evaluation with the CleavageEmbryo Dataset.\",\"authors\":\"Chensheng Zhang, Xintong Shi, Xinyue Yin, Jiayi Sun, Jianhui Zhao, Yi Zhang\",\"doi\":\"10.1093/bioinformatics/btae617\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Motivation: </strong>Embryo selection is one of the critical factors in determining the success of pregnancy in in vitro fertilization (IVF) procedures. Using artificial intelligence to aid in embryo selection could effectively address the current time-consuming, expensive, subjectively influenced process of embryo assessment by trained embryologists. However, current deep learning-based methods often focus on blastocyst segmentation, grading, or predicting cell development via time-lapse videos, often overlooking morphokinetic parameters or lacking interpretability. Given the significance of both morphokinetic and morphological evaluation in predicting the implantation potential of cleavage-stage embryos, as emphasized by previous research, there is a necessity for an automated method to segment cleavage-stage embryos to improve this process.</p><p><strong>Results: </strong>In this article, we introduce the SAM-based Dual Branch Segmentation Pipeline for automated segmentation of blastomeres in cleavage-stage embryos. Leveraging the powerful segmentation capability of SAM, the instance branch conducts instance segmentation of blastomeres, while the semantic branch performs semantic segmentation of fragments. Due to the lack of publicly available datasets, we construct the CleavageEmbryo dataset, the first dataset of human cleavage-stage embryos with pixel-level annotations containing fragment information. We train and test a series of state-of-the-art segmentation algorithms on CleavageEmbryo. Our experiments demonstrate that our method outperforms existing algorithms in terms of objective metrics (mAP 0.748 on blastomeres, Dice 0.694 on fragments) and visual quality, enabling more accurate segmentation of cleavage-stage embryos.</p><p><strong>Availability and implementation: </strong>The code and sample data in this study can be found at: Https://github.com/12austincc/Cleavage-StageEmbryoSegmentation.</p><p><strong>Supplementary information: </strong>Supplementary data are available at Bioinformatics online.</p>\",\"PeriodicalId\":93899,\"journal\":{\"name\":\"Bioinformatics (Oxford, England)\",\"volume\":\" \",\"pages\":\"\"},\"PeriodicalIF\":0.0000,\"publicationDate\":\"2024-10-18\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Bioinformatics (Oxford, England)\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1093/bioinformatics/btae617\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"\",\"JCRName\":\"\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Bioinformatics (Oxford, England)","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1093/bioinformatics/btae617","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
Cleavage-Stage Embryo Segmentation Using SAM-Based Dual Branch Pipeline: Development and Evaluation with the CleavageEmbryo Dataset.
Motivation: Embryo selection is one of the critical factors in determining the success of pregnancy in in vitro fertilization (IVF) procedures. Using artificial intelligence to aid in embryo selection could effectively address the current time-consuming, expensive, subjectively influenced process of embryo assessment by trained embryologists. However, current deep learning-based methods often focus on blastocyst segmentation, grading, or predicting cell development via time-lapse videos, often overlooking morphokinetic parameters or lacking interpretability. Given the significance of both morphokinetic and morphological evaluation in predicting the implantation potential of cleavage-stage embryos, as emphasized by previous research, there is a necessity for an automated method to segment cleavage-stage embryos to improve this process.
Results: In this article, we introduce the SAM-based Dual Branch Segmentation Pipeline for automated segmentation of blastomeres in cleavage-stage embryos. Leveraging the powerful segmentation capability of SAM, the instance branch conducts instance segmentation of blastomeres, while the semantic branch performs semantic segmentation of fragments. Due to the lack of publicly available datasets, we construct the CleavageEmbryo dataset, the first dataset of human cleavage-stage embryos with pixel-level annotations containing fragment information. We train and test a series of state-of-the-art segmentation algorithms on CleavageEmbryo. Our experiments demonstrate that our method outperforms existing algorithms in terms of objective metrics (mAP 0.748 on blastomeres, Dice 0.694 on fragments) and visual quality, enabling more accurate segmentation of cleavage-stage embryos.
Availability and implementation: The code and sample data in this study can be found at: Https://github.com/12austincc/Cleavage-StageEmbryoSegmentation.
Supplementary information: Supplementary data are available at Bioinformatics online.