Divyanshu Tak, Zezhong Ye, Anna Zapaischykova, Yining Zha, Aidan Boyd, Sridhar Vajapeyam, Rishi Chopra, Hasaan Hayat, Sanjay P Prabhu, Kevin X Liu, Hesham Elhalawani, Ali Nabavizadeh, Ariana Familiar, Adam C Resnick, Sabine Mueller, Hugo J W L Aerts, Pratiti Bandopadhayay, Keith L Ligon, Daphne A Haas-Kogan, Tina Y Poussaint, Benjamin H Kann
下载PDF
{"title":"利用自我监督转移学习对小儿低级别胶质瘤进行无创分子亚型分析","authors":"Divyanshu Tak, Zezhong Ye, Anna Zapaischykova, Yining Zha, Aidan Boyd, Sridhar Vajapeyam, Rishi Chopra, Hasaan Hayat, Sanjay P Prabhu, Kevin X Liu, Hesham Elhalawani, Ali Nabavizadeh, Ariana Familiar, Adam C Resnick, Sabine Mueller, Hugo J W L Aerts, Pratiti Bandopadhayay, Keith L Ligon, Daphne A Haas-Kogan, Tina Y Poussaint, Benjamin H Kann","doi":"10.1148/ryai.230333","DOIUrl":null,"url":null,"abstract":"<p><p>Purpose To develop and externally test a scan-to-prediction deep learning pipeline for noninvasive, MRI-based <i>BRAF</i> mutational status classification for pediatric low-grade glioma. Materials and Methods This retrospective study included two pediatric low-grade glioma datasets with linked genomic and diagnostic T2-weighted MRI data of patients: Dana-Farber/Boston Children's Hospital (development dataset, <i>n</i> = 214 [113 (52.8%) male; 104 (48.6%) <i>BRAF</i> wild type, 60 (28.0%) <i>BRAF</i> fusion, and 50 (23.4%) <i>BRAF</i> V600E]) and the Children's Brain Tumor Network (external testing, <i>n</i> = 112 [55 (49.1%) male; 35 (31.2%) <i>BRAF</i> wild type, 60 (53.6%) <i>BRAF</i> fusion, and 17 (15.2%) <i>BRAF</i> V600E]). A deep learning pipeline was developed to classify <i>BRAF</i> mutational status (<i>BRAF</i> wild type vs <i>BRAF</i> fusion vs <i>BRAF</i> V600E) via a two-stage process: <i>(a)</i> three-dimensional tumor segmentation and extraction of axial tumor images and <i>(b)</i> section-wise, deep learning-based classification of mutational status. Knowledge-transfer and self-supervised approaches were investigated to prevent model overfitting, with a primary end point of the area under the receiver operating characteristic curve (AUC). To enhance model interpretability, a novel metric, center of mass distance, was developed to quantify the model attention around the tumor. Results A combination of transfer learning from a pretrained medical imaging-specific network and self-supervised label cross-training (TransferX) coupled with consensus logic yielded the highest classification performance with an AUC of 0.82 (95% CI: 0.72, 0.91), 0.87 (95% CI: 0.61, 0.97), and 0.85 (95% CI: 0.66, 0.95) for <i>BRAF</i> wild type, <i>BRAF</i> fusion, and <i>BRAF</i> V600E, respectively, on internal testing. On external testing, the pipeline yielded an AUC of 0.72 (95% CI: 0.64, 0.86), 0.78 (95% CI: 0.61, 0.89), and 0.72 (95% CI: 0.64, 0.88) for <i>BRAF</i> wild type, <i>BRAF</i> fusion, and <i>BRAF</i> V600E, respectively. Conclusion Transfer learning and self-supervised cross-training improved classification performance and generalizability for noninvasive pediatric low-grade glioma mutational status prediction in a limited data scenario. <b>Keywords:</b> Pediatrics, MRI, CNS, Brain/Brain Stem, Oncology, Feature Detection, Diagnosis, Supervised Learning, Transfer Learning, Convolutional Neural Network (CNN) <i>Supplemental material is available for this article.</i> © RSNA, 2024.</p>","PeriodicalId":29787,"journal":{"name":"Radiology-Artificial Intelligence","volume":null,"pages":null},"PeriodicalIF":8.1000,"publicationDate":"2024-05-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11140508/pdf/","citationCount":"0","resultStr":"{\"title\":\"Noninvasive Molecular Subtyping of Pediatric Low-Grade Glioma with Self-Supervised Transfer Learning.\",\"authors\":\"Divyanshu Tak, Zezhong Ye, Anna Zapaischykova, Yining Zha, Aidan Boyd, Sridhar Vajapeyam, Rishi Chopra, Hasaan Hayat, Sanjay P Prabhu, Kevin X Liu, Hesham Elhalawani, Ali Nabavizadeh, Ariana Familiar, Adam C Resnick, Sabine Mueller, Hugo J W L Aerts, Pratiti Bandopadhayay, Keith L Ligon, Daphne A Haas-Kogan, Tina Y Poussaint, Benjamin H Kann\",\"doi\":\"10.1148/ryai.230333\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><p>Purpose To develop and externally test a scan-to-prediction deep learning pipeline for noninvasive, MRI-based <i>BRAF</i> mutational status classification for pediatric low-grade glioma. Materials and Methods This retrospective study included two pediatric low-grade glioma datasets with linked genomic and diagnostic T2-weighted MRI data of patients: Dana-Farber/Boston Children's Hospital (development dataset, <i>n</i> = 214 [113 (52.8%) male; 104 (48.6%) <i>BRAF</i> wild type, 60 (28.0%) <i>BRAF</i> fusion, and 50 (23.4%) <i>BRAF</i> V600E]) and the Children's Brain Tumor Network (external testing, <i>n</i> = 112 [55 (49.1%) male; 35 (31.2%) <i>BRAF</i> wild type, 60 (53.6%) <i>BRAF</i> fusion, and 17 (15.2%) <i>BRAF</i> V600E]). A deep learning pipeline was developed to classify <i>BRAF</i> mutational status (<i>BRAF</i> wild type vs <i>BRAF</i> fusion vs <i>BRAF</i> V600E) via a two-stage process: <i>(a)</i> three-dimensional tumor segmentation and extraction of axial tumor images and <i>(b)</i> section-wise, deep learning-based classification of mutational status. Knowledge-transfer and self-supervised approaches were investigated to prevent model overfitting, with a primary end point of the area under the receiver operating characteristic curve (AUC). To enhance model interpretability, a novel metric, center of mass distance, was developed to quantify the model attention around the tumor. Results A combination of transfer learning from a pretrained medical imaging-specific network and self-supervised label cross-training (TransferX) coupled with consensus logic yielded the highest classification performance with an AUC of 0.82 (95% CI: 0.72, 0.91), 0.87 (95% CI: 0.61, 0.97), and 0.85 (95% CI: 0.66, 0.95) for <i>BRAF</i> wild type, <i>BRAF</i> fusion, and <i>BRAF</i> V600E, respectively, on internal testing. On external testing, the pipeline yielded an AUC of 0.72 (95% CI: 0.64, 0.86), 0.78 (95% CI: 0.61, 0.89), and 0.72 (95% CI: 0.64, 0.88) for <i>BRAF</i> wild type, <i>BRAF</i> fusion, and <i>BRAF</i> V600E, respectively. Conclusion Transfer learning and self-supervised cross-training improved classification performance and generalizability for noninvasive pediatric low-grade glioma mutational status prediction in a limited data scenario. <b>Keywords:</b> Pediatrics, MRI, CNS, Brain/Brain Stem, Oncology, Feature Detection, Diagnosis, Supervised Learning, Transfer Learning, Convolutional Neural Network (CNN) <i>Supplemental material is available for this article.</i> © RSNA, 2024.</p>\",\"PeriodicalId\":29787,\"journal\":{\"name\":\"Radiology-Artificial Intelligence\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":8.1000,\"publicationDate\":\"2024-05-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11140508/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Radiology-Artificial Intelligence\",\"FirstCategoryId\":\"1085\",\"ListUrlMain\":\"https://doi.org/10.1148/ryai.230333\",\"RegionNum\":0,\"RegionCategory\":null,\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Radiology-Artificial Intelligence","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1148/ryai.230333","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0
引用
批量引用