Eric Suero Molina, Mehnaz Tabassum, Ghasem Azemi, Zeynep Özdemir, Wolfgang Roll, Philipp Backhaus, Philipp Schindler, Alex Valls Chavarria, Carlo Russo, Sidong Liu, Walter Stummer, Antonio Di Ieva
{"title":"Synthetic O-(2-<sup>18</sup>F-fluoroethyl)-l-tyrosine-positron emission tomography generation and hotspot prediction via preoperative MRI fusion of gliomas lacking radiographic high-grade characteristics.","authors":"Eric Suero Molina, Mehnaz Tabassum, Ghasem Azemi, Zeynep Özdemir, Wolfgang Roll, Philipp Backhaus, Philipp Schindler, Alex Valls Chavarria, Carlo Russo, Sidong Liu, Walter Stummer, Antonio Di Ieva","doi":"10.1093/noajnl/vdaf001","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Limited amino acid availability for positron emission tomography (PET) imaging hinders therapeutic decision-making for gliomas without typical high-grade imaging features. To address this gap, we evaluated a generative artificial intelligence (AI) approach for creating synthetic O-(2-<sup>18</sup>F-fluoroethyl)-l-tyrosine ([<sup>18</sup>F]FET)-PET and predicting high [<sup>18</sup>F]FET uptake from magnetic resonance imaging (MRI).</p><p><strong>Methods: </strong>We trained a deep learning (DL)-based model to segment tumors in MRI, extracted radiomic features using the Python PyRadiomics package, and utilized a Random Forest classifier to predict high [<sup>18</sup>F]FET uptake. To generate [<sup>18</sup>F]FET-PET images, we employed a generative adversarial network framework and utilized a split-input fusion module for processing different MRI sequences through feature extraction, concatenation, and self-attention.</p><p><strong>Results: </strong>We included magnetic resonance imaging (MRI) and PET images from 215 studies for the hotspot classification and 211 studies for the synthetic PET generation task. The top-performing radiomic features achieved 80% accuracy for hotspot prediction. From the synthetic [<sup>18</sup>F]FET-PET, 85% were classified as clinically useful by senior physicians. Peak signal-to-noise ratio analysis indicated high signal fidelity with a peak at 40 dB, while structural similarity index values showed structural congruence. Root mean square error analysis demonstrated lower values below 5.6. Most visual information fidelity scores ranged between 0.6 and 0.7. This indicates that synthetic PET images retain the essential information required for clinical assessment and diagnosis.</p><p><strong>Conclusion: </strong>For the first time, we demonstrate that predicting high [<sup>18</sup>F]FET uptake and generating synthetic PET images from preoperative MRI in lower-grade and high-grade glioma are feasible. Advanced MRI modalities and other generative AI models will be used to improve the algorithm further in future studies.</p>","PeriodicalId":94157,"journal":{"name":"Neuro-oncology advances","volume":"7 1","pages":"vdaf001"},"PeriodicalIF":3.7000,"publicationDate":"2025-01-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC12012690/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Neuro-oncology advances","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1093/noajnl/vdaf001","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"2025/1/1 0:00:00","PubModel":"eCollection","JCR":"Q1","JCRName":"CLINICAL NEUROLOGY","Score":null,"Total":0}
引用次数: 0
Abstract
Background: Limited amino acid availability for positron emission tomography (PET) imaging hinders therapeutic decision-making for gliomas without typical high-grade imaging features. To address this gap, we evaluated a generative artificial intelligence (AI) approach for creating synthetic O-(2-18F-fluoroethyl)-l-tyrosine ([18F]FET)-PET and predicting high [18F]FET uptake from magnetic resonance imaging (MRI).
Methods: We trained a deep learning (DL)-based model to segment tumors in MRI, extracted radiomic features using the Python PyRadiomics package, and utilized a Random Forest classifier to predict high [18F]FET uptake. To generate [18F]FET-PET images, we employed a generative adversarial network framework and utilized a split-input fusion module for processing different MRI sequences through feature extraction, concatenation, and self-attention.
Results: We included magnetic resonance imaging (MRI) and PET images from 215 studies for the hotspot classification and 211 studies for the synthetic PET generation task. The top-performing radiomic features achieved 80% accuracy for hotspot prediction. From the synthetic [18F]FET-PET, 85% were classified as clinically useful by senior physicians. Peak signal-to-noise ratio analysis indicated high signal fidelity with a peak at 40 dB, while structural similarity index values showed structural congruence. Root mean square error analysis demonstrated lower values below 5.6. Most visual information fidelity scores ranged between 0.6 and 0.7. This indicates that synthetic PET images retain the essential information required for clinical assessment and diagnosis.
Conclusion: For the first time, we demonstrate that predicting high [18F]FET uptake and generating synthetic PET images from preoperative MRI in lower-grade and high-grade glioma are feasible. Advanced MRI modalities and other generative AI models will be used to improve the algorithm further in future studies.