Training and Comparison of nnU-Net and DeepMedic Methods for Autosegmentation of Pediatric Brain Tumors.

Arastoo Vossough, Nastaran Khalili, Ariana M Familiar, Deep Gandhi, Karthik Viswanathan, Wenxin Tu, Debanjan Haldar, Sina Bagheri, Hannah Anderson, Shuvanjan Haldar, Phillip B Storm, Adam Resnick, Jeffrey B Ware, Ali Nabavizadeh, Anahita Fathi Kazerooni
{"title":"Training and Comparison of nnU-Net and DeepMedic Methods for Autosegmentation of Pediatric Brain Tumors.","authors":"Arastoo Vossough, Nastaran Khalili, Ariana M Familiar, Deep Gandhi, Karthik Viswanathan, Wenxin Tu, Debanjan Haldar, Sina Bagheri, Hannah Anderson, Shuvanjan Haldar, Phillip B Storm, Adam Resnick, Jeffrey B Ware, Ali Nabavizadeh, Anahita Fathi Kazerooni","doi":"10.3174/ajnr.A8293","DOIUrl":null,"url":null,"abstract":"<p><strong>Background and purpose: </strong>Tumor segmentation is essential in surgical and treatment planning and response assessment and monitoring in pediatric brain tumors, the leading cause of cancer-related death among children. However, manual segmentation is time-consuming and has high interoperator variability, underscoring the need for more efficient methods. After training, we compared 2 deep-learning-based 3D segmentation models, DeepMedic and nnU-Net, with pediatric-specific multi-institutional brain tumor data based on multiparametric MR images.</p><p><strong>Materials and methods: </strong>Multiparametric preoperative MR imaging scans of 339 pediatric patients (<i>n</i> = 293 internal and <i>n</i> = 46 external cohorts) with a variety of tumor subtypes were preprocessed and manually segmented into 4 tumor subregions, ie, enhancing tumor, nonenhancing tumor, cystic components, and peritumoral edema. After training, performances of the 2 models on internal and external test sets were evaluated with reference to ground truth manual segmentations. Additionally, concordance was assessed by comparing the volume of the subregions as a percentage of the whole tumor between model predictions and ground truth segmentations using the Pearson or Spearman correlation coefficients and the Bland-Altman method.</p><p><strong>Results: </strong>The mean Dice score for nnU-Net internal test set was 0.9 (SD, 0.07) (median, 0.94) for whole tumor; 0.77 (SD, 0.29) for enhancing tumor; 0.66 (SD, 0.32) for nonenhancing tumor; 0.71 (SD, 0.33) for cystic components, and 0.71 (SD, 0.40) for peritumoral edema, respectively. For DeepMedic, the mean Dice scores were 0.82 (SD, 0.16) for whole tumor; 0.66 (SD, 0.32) for enhancing tumor; 0.48 (SD, 0.27) for nonenhancing tumor; 0.48 (SD, 0.36) for cystic components, and 0.19 (SD, 0.33) for peritumoral edema, respectively. Dice scores were significantly higher for nnU-Net (<i>P </i>≤ .01). Correlation coefficients for tumor subregion percentage volumes were higher (0.98 versus 0.91 for enhancing tumor, 0.97 versus 0.75 for nonenhancing tumor, 0.98 versus 0.80 for cystic components, 0.95 versus 0.33 for peritumoral edema in the internal test set). Bland-Altman plots were better for nnU-Net compared with DeepMedic. External validation of the trained nnU-Net model on the multi-institutional Brain Tumor Segmentation Challenge in Pediatrics (BraTS-PEDs) 2023 data set revealed high generalization capability in the segmentation of whole tumor, tumor core (a combination of enhancing tumor, nonenhancing tumor, and cystic components), and enhancing tumor with mean Dice scores of 0.87 (SD, 0.13) (median, 0.91), 0.83 (SD, 0.18) (median, 0.89), and 0.48 (SD, 0.38) (median, 0.58), respectively.</p><p><strong>Conclusions: </strong>The pediatric-specific data-trained nnU-Net model is superior to DeepMedic for whole tumor and subregion segmentation of pediatric brain tumors.</p>","PeriodicalId":93863,"journal":{"name":"AJNR. American journal of neuroradiology","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2024-08-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11383404/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"AJNR. American journal of neuroradiology","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.3174/ajnr.A8293","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

Background and purpose: Tumor segmentation is essential in surgical and treatment planning and response assessment and monitoring in pediatric brain tumors, the leading cause of cancer-related death among children. However, manual segmentation is time-consuming and has high interoperator variability, underscoring the need for more efficient methods. After training, we compared 2 deep-learning-based 3D segmentation models, DeepMedic and nnU-Net, with pediatric-specific multi-institutional brain tumor data based on multiparametric MR images.

Materials and methods: Multiparametric preoperative MR imaging scans of 339 pediatric patients (n = 293 internal and n = 46 external cohorts) with a variety of tumor subtypes were preprocessed and manually segmented into 4 tumor subregions, ie, enhancing tumor, nonenhancing tumor, cystic components, and peritumoral edema. After training, performances of the 2 models on internal and external test sets were evaluated with reference to ground truth manual segmentations. Additionally, concordance was assessed by comparing the volume of the subregions as a percentage of the whole tumor between model predictions and ground truth segmentations using the Pearson or Spearman correlation coefficients and the Bland-Altman method.

Results: The mean Dice score for nnU-Net internal test set was 0.9 (SD, 0.07) (median, 0.94) for whole tumor; 0.77 (SD, 0.29) for enhancing tumor; 0.66 (SD, 0.32) for nonenhancing tumor; 0.71 (SD, 0.33) for cystic components, and 0.71 (SD, 0.40) for peritumoral edema, respectively. For DeepMedic, the mean Dice scores were 0.82 (SD, 0.16) for whole tumor; 0.66 (SD, 0.32) for enhancing tumor; 0.48 (SD, 0.27) for nonenhancing tumor; 0.48 (SD, 0.36) for cystic components, and 0.19 (SD, 0.33) for peritumoral edema, respectively. Dice scores were significantly higher for nnU-Net (P ≤ .01). Correlation coefficients for tumor subregion percentage volumes were higher (0.98 versus 0.91 for enhancing tumor, 0.97 versus 0.75 for nonenhancing tumor, 0.98 versus 0.80 for cystic components, 0.95 versus 0.33 for peritumoral edema in the internal test set). Bland-Altman plots were better for nnU-Net compared with DeepMedic. External validation of the trained nnU-Net model on the multi-institutional Brain Tumor Segmentation Challenge in Pediatrics (BraTS-PEDs) 2023 data set revealed high generalization capability in the segmentation of whole tumor, tumor core (a combination of enhancing tumor, nonenhancing tumor, and cystic components), and enhancing tumor with mean Dice scores of 0.87 (SD, 0.13) (median, 0.91), 0.83 (SD, 0.18) (median, 0.89), and 0.48 (SD, 0.38) (median, 0.58), respectively.

Conclusions: The pediatric-specific data-trained nnU-Net model is superior to DeepMedic for whole tumor and subregion segmentation of pediatric brain tumors.

用于小儿脑肿瘤自动分割的 nnU-Net 和 DeepMedic 方法的训练和比较。
背景和目的:小儿脑肿瘤是导致儿童癌症相关死亡的主要原因,在小儿脑肿瘤的手术和治疗计划、反应评估和监测中,肿瘤分割至关重要。然而,人工分割不仅耗时,而且操作者之间的差异也很大,因此需要更高效的方法。经过训练后,我们用基于多参数磁共振图像的儿科特定多机构脑肿瘤数据比较了 DeepMedic 和 nnU-Net 这两种基于深度学习的三维分割模型:对 339 例儿科患者(n = 293 例体内患者和 n = 46 例体外患者)的多参数术前 MR 成像扫描进行预处理,并将其手动分割为 4 个肿瘤亚区,即增强肿瘤、非增强肿瘤、囊性成分和瘤周水肿。训练完成后,参照地面实况人工分割结果,评估两个模型在内部和外部测试集上的表现。此外,还使用皮尔逊或斯皮尔曼相关系数和布兰德-阿尔特曼法比较了模型预测与地面实况分割之间的亚区域体积占整个肿瘤的百分比,从而评估了一致性:nnU-Net 内部测试集的平均 Dice 分数分别为:整个肿瘤 0.9(标清,0.07)(中位数,0.94);增强肿瘤 0.77(标清,0.29);非增强肿瘤 0.66(标清,0.32);囊性成分 0.71(标清,0.33);瘤周水肿 0.71(标清,0.40)。对于 DeepMedic,整个肿瘤的平均 Dice 分数分别为 0.82(标度,0.16);增强肿瘤为 0.66(标度,0.32);非增强肿瘤为 0.48(标度,0.27);囊性成分为 0.48(标度,0.36),瘤周水肿为 0.19(标度,0.33)。nnU-Net 的 Dice 评分明显更高(P ≤ .01)。在内部测试集中,肿瘤亚区百分比体积的相关系数更高(增强肿瘤的相关系数为 0.98,而非增强肿瘤的相关系数为 0.91;囊性成分的相关系数为 0.97,而非增强肿瘤的相关系数为 0.75;囊性成分的相关系数为 0.98,而非增强肿瘤的相关系数为 0.80;瘤周水肿的相关系数为 0.95,而非增强肿瘤的相关系数为 0.33)。与 DeepMedic 相比,nnU-Net 的 Bland-Altman 图更好。在 2023 年多机构儿科脑肿瘤分割挑战赛(BraTS-PEDs)数据集上对训练好的 nnU-Net 模型进行外部验证后发现,该模型在分割整个肿瘤、肿瘤核心(增强肿瘤、非增强肿瘤和囊性成分的组合)和增强肿瘤方面具有很高的泛化能力,平均 Dice 分数为 0.87(标清,0.13)(中位数,0.91)、0.83(标清,0.18)(中位数,0.89)和 0.48(标清,0.38)(中位数,0.58):儿科特定数据训练的 nnU-Net 模型在儿科脑肿瘤的全肿瘤和亚区域分割方面优于 DeepMedic。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信