Iulian Emil Tampu, Tamara Bianchessi, Ida Blystad, Peter Lundberg, Per Nyman, Anders Eklund, Neda Haj-Hosseini
{"title":"基于年龄融合的磁共振图像深度学习儿童脑肿瘤分类。","authors":"Iulian Emil Tampu, Tamara Bianchessi, Ida Blystad, Peter Lundberg, Per Nyman, Anders Eklund, Neda Haj-Hosseini","doi":"10.1093/noajnl/vdae205","DOIUrl":null,"url":null,"abstract":"<p><strong>Purpose: </strong>To implement and evaluate deep learning-based methods for the classification of pediatric brain tumors (PBT) in magnetic resonance (MR) data.</p><p><strong>Methods: </strong>A subset of the \"Children's Brain Tumor Network\" dataset was retrospectively used (<i>n</i> = 178 subjects, female = 72, male = 102, NA = 4, age range [0.01, 36.49] years) with tumor types being low-grade astrocytoma (<i>n</i> = 84), ependymoma (<i>n</i> = 32), and medulloblastoma (<i>n</i> = 62). T1w post-contrast (<i>n</i> = 94 subjects), T2w (<i>n</i> = 160 subjects), and apparent diffusion coefficient (ADC: <i>n</i> = 66 subjects) MR sequences were used separately. Two deep learning models were trained on transversal slices showing tumor. Joint fusion was implemented to combine image and age data, and 2 pre-training paradigms were utilized. Model explainability was investigated using gradient-weighted class-activation mapping (Grad-CAM), and the learned feature space was visualized using principal component analysis (PCA).</p><p><strong>Results: </strong>The highest tumor-type classification performance was achieved when using a vision transformer model pre-trained on ImageNet and fine-tuned on ADC images with age fusion (Matthews correlation coefficient [MCC]: 0.77 ± 0.14, Accuracy: 0.87 ± 0.08), followed by models trained on T2w (MCC: 0.58 ± 0.11, Accuracy: 0.73 ± 0.08) and T1w post-contrast (MCC: 0.41 ± 0.11, Accuracy: 0.62 ± 0.08) data. Age fusion marginally improved the model's performance. Both model architectures performed similarly across the experiments, with no differences between the pre-training strategies. Grad-CAMs showed that the models' attention focused on the brain region. PCA of the feature space showed greater separation of the tumor-type clusters when using contrastive pre-training.</p><p><strong>Conclusion: </strong>Classification of PBT on MR images could be accomplished using deep learning, with the top-performing model being trained on ADC data, which radiologists use for the clinical classification of these tumors.</p>","PeriodicalId":94157,"journal":{"name":"Neuro-oncology advances","volume":"7 1","pages":"vdae205"},"PeriodicalIF":3.7000,"publicationDate":"2024-12-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11701748/pdf/","citationCount":"0","resultStr":"{\"title\":\"Pediatric brain tumor classification using deep learning on MR images with age fusion.\",\"authors\":\"Iulian Emil Tampu, Tamara Bianchessi, Ida Blystad, Peter Lundberg, Per Nyman, Anders Eklund, Neda Haj-Hosseini\",\"doi\":\"10.1093/noajnl/vdae205\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Purpose: </strong>To implement and evaluate deep learning-based methods for the classification of pediatric brain tumors (PBT) in magnetic resonance (MR) data.</p><p><strong>Methods: </strong>A subset of the \\\"Children's Brain Tumor Network\\\" dataset was retrospectively used (<i>n</i> = 178 subjects, female = 72, male = 102, NA = 4, age range [0.01, 36.49] years) with tumor types being low-grade astrocytoma (<i>n</i> = 84), ependymoma (<i>n</i> = 32), and medulloblastoma (<i>n</i> = 62). T1w post-contrast (<i>n</i> = 94 subjects), T2w (<i>n</i> = 160 subjects), and apparent diffusion coefficient (ADC: <i>n</i> = 66 subjects) MR sequences were used separately. Two deep learning models were trained on transversal slices showing tumor. Joint fusion was implemented to combine image and age data, and 2 pre-training paradigms were utilized. Model explainability was investigated using gradient-weighted class-activation mapping (Grad-CAM), and the learned feature space was visualized using principal component analysis (PCA).</p><p><strong>Results: </strong>The highest tumor-type classification performance was achieved when using a vision transformer model pre-trained on ImageNet and fine-tuned on ADC images with age fusion (Matthews correlation coefficient [MCC]: 0.77 ± 0.14, Accuracy: 0.87 ± 0.08), followed by models trained on T2w (MCC: 0.58 ± 0.11, Accuracy: 0.73 ± 0.08) and T1w post-contrast (MCC: 0.41 ± 0.11, Accuracy: 0.62 ± 0.08) data. Age fusion marginally improved the model's performance. Both model architectures performed similarly across the experiments, with no differences between the pre-training strategies. Grad-CAMs showed that the models' attention focused on the brain region. PCA of the feature space showed greater separation of the tumor-type clusters when using contrastive pre-training.</p><p><strong>Conclusion: </strong>Classification of PBT on MR images could be accomplished using deep learning, with the top-performing model being trained on ADC data, which radiologists use for the clinical classification of these tumors.</p>\",\"PeriodicalId\":94157,\"journal\":{\"name\":\"Neuro-oncology advances\",\"volume\":\"7 1\",\"pages\":\"vdae205\"},\"PeriodicalIF\":3.7000,\"publicationDate\":\"2024-12-02\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11701748/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Neuro-oncology advances\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1093/noajnl/vdae205\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"2025/1/1 0:00:00\",\"PubModel\":\"eCollection\",\"JCR\":\"Q1\",\"JCRName\":\"CLINICAL NEUROLOGY\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Neuro-oncology advances","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1093/noajnl/vdae205","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2025/1/1 0:00:00","PubModel":"eCollection","JCR":"Q1","JCRName":"CLINICAL NEUROLOGY","Score":null,"Total":0}
Pediatric brain tumor classification using deep learning on MR images with age fusion.
Purpose: To implement and evaluate deep learning-based methods for the classification of pediatric brain tumors (PBT) in magnetic resonance (MR) data.
Methods: A subset of the "Children's Brain Tumor Network" dataset was retrospectively used (n = 178 subjects, female = 72, male = 102, NA = 4, age range [0.01, 36.49] years) with tumor types being low-grade astrocytoma (n = 84), ependymoma (n = 32), and medulloblastoma (n = 62). T1w post-contrast (n = 94 subjects), T2w (n = 160 subjects), and apparent diffusion coefficient (ADC: n = 66 subjects) MR sequences were used separately. Two deep learning models were trained on transversal slices showing tumor. Joint fusion was implemented to combine image and age data, and 2 pre-training paradigms were utilized. Model explainability was investigated using gradient-weighted class-activation mapping (Grad-CAM), and the learned feature space was visualized using principal component analysis (PCA).
Results: The highest tumor-type classification performance was achieved when using a vision transformer model pre-trained on ImageNet and fine-tuned on ADC images with age fusion (Matthews correlation coefficient [MCC]: 0.77 ± 0.14, Accuracy: 0.87 ± 0.08), followed by models trained on T2w (MCC: 0.58 ± 0.11, Accuracy: 0.73 ± 0.08) and T1w post-contrast (MCC: 0.41 ± 0.11, Accuracy: 0.62 ± 0.08) data. Age fusion marginally improved the model's performance. Both model architectures performed similarly across the experiments, with no differences between the pre-training strategies. Grad-CAMs showed that the models' attention focused on the brain region. PCA of the feature space showed greater separation of the tumor-type clusters when using contrastive pre-training.
Conclusion: Classification of PBT on MR images could be accomplished using deep learning, with the top-performing model being trained on ADC data, which radiologists use for the clinical classification of these tumors.