Leveraging Physics-Based Synthetic MR Images and Deep Transfer Learning for Artifact Reduction in Echo-Planar Imaging.

Catalina Raymond, Jingwen Yao, Bryan Clifford, Thorsten Feiweier, Sonoko Oshima, Donatello Telesca, Xiaodong Zhong, Heiko Meyer, Richard G Everson, Noriko Salamon, Timothy F Cloughesy, Benjamin M Ellingson
{"title":"Leveraging Physics-Based Synthetic MR Images and Deep Transfer Learning for Artifact Reduction in Echo-Planar Imaging.","authors":"Catalina Raymond, Jingwen Yao, Bryan Clifford, Thorsten Feiweier, Sonoko Oshima, Donatello Telesca, Xiaodong Zhong, Heiko Meyer, Richard G Everson, Noriko Salamon, Timothy F Cloughesy, Benjamin M Ellingson","doi":"10.3174/ajnr.A8566","DOIUrl":null,"url":null,"abstract":"<p><strong>Backgound and purpose: </strong>This study utilizes a physics-based approach to synthesize realistic MR artifacts and train a deep learning generative adversarial network (GAN) for use in artifact reduction on EPI, a crucial neuroimaging sequence with high acceleration that is notoriously susceptible to artifacts.</p><p><strong>Materials and methods: </strong>A total of 4,573 anatomical MR sequences from 1,392 patients undergoing clinically indicated MRI of the brain were used to create a synthetic data set using physics-based, simulated artifacts commonly found in EPI. By using multiple MRI contrasts, we hypothesized the GAN would learn to correct common artifacts while preserving the inherent contrast information, even for contrasts the network has not been trained on. A modified <i>Pix2PixGAN</i> architecture with an <i>Attention-R2UNet</i> generator was used for the model. Three training strategies were employed: (1) An \"all-in-one\" model trained on all the artifacts at once; (2) a set of \"single models\", one for each artifact; and a (3) \"stacked transfer learning\" approach where a model is first trained on one artifact set, then this learning is transferred to a new model and the process is repeated for the next artifact set. Lastly, the \"Stacked Transfer Learning\" model was tested on ADC maps from single-shot diffusion MRI data in <i>N</i> = 49 patients diagnosed with recurrent glioblastoma to compare visual quality and lesion measurements between the natively acquired images and AI-corrected images.</p><p><strong>Results: </strong>The \"stacked transfer learning\" approach had superior artifact reduction performance compared to the other approaches as measured by Mean Squared Error (MSE = 0.0016), Structural Similarity Index (SSIM = 0.92), multiscale SSIM (MS-SSIM = 0.92), peak signal-to-noise ratio (PSNR = 28.10), and Hausdorff distance (HAUS = 4.08mm), suggesting that leveraging pre-trained knowledge and sequentially training on each artifact is the best approach this application. In recurrent glioblastoma, significantly higher visual quality was observed in model predicted images compared to native images, while quantitative measurements within the tumor regions remained consistent with non-corrected images.</p><p><strong>Conclusions: </strong>The current study demonstrates the feasibility of using a physics-based method for synthesizing a large data set of images with realistic artifacts and the effectiveness of utilizing this synthetic data set in a \"stacked transfer learning\" approach to training a GAN for reduction of EPI-based artifacts.</p>","PeriodicalId":93863,"journal":{"name":"AJNR. American journal of neuroradiology","volume":" ","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2025-02-13","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"AJNR. American journal of neuroradiology","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.3174/ajnr.A8566","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

Backgound and purpose: This study utilizes a physics-based approach to synthesize realistic MR artifacts and train a deep learning generative adversarial network (GAN) for use in artifact reduction on EPI, a crucial neuroimaging sequence with high acceleration that is notoriously susceptible to artifacts.

Materials and methods: A total of 4,573 anatomical MR sequences from 1,392 patients undergoing clinically indicated MRI of the brain were used to create a synthetic data set using physics-based, simulated artifacts commonly found in EPI. By using multiple MRI contrasts, we hypothesized the GAN would learn to correct common artifacts while preserving the inherent contrast information, even for contrasts the network has not been trained on. A modified Pix2PixGAN architecture with an Attention-R2UNet generator was used for the model. Three training strategies were employed: (1) An "all-in-one" model trained on all the artifacts at once; (2) a set of "single models", one for each artifact; and a (3) "stacked transfer learning" approach where a model is first trained on one artifact set, then this learning is transferred to a new model and the process is repeated for the next artifact set. Lastly, the "Stacked Transfer Learning" model was tested on ADC maps from single-shot diffusion MRI data in N = 49 patients diagnosed with recurrent glioblastoma to compare visual quality and lesion measurements between the natively acquired images and AI-corrected images.

Results: The "stacked transfer learning" approach had superior artifact reduction performance compared to the other approaches as measured by Mean Squared Error (MSE = 0.0016), Structural Similarity Index (SSIM = 0.92), multiscale SSIM (MS-SSIM = 0.92), peak signal-to-noise ratio (PSNR = 28.10), and Hausdorff distance (HAUS = 4.08mm), suggesting that leveraging pre-trained knowledge and sequentially training on each artifact is the best approach this application. In recurrent glioblastoma, significantly higher visual quality was observed in model predicted images compared to native images, while quantitative measurements within the tumor regions remained consistent with non-corrected images.

Conclusions: The current study demonstrates the feasibility of using a physics-based method for synthesizing a large data set of images with realistic artifacts and the effectiveness of utilizing this synthetic data set in a "stacked transfer learning" approach to training a GAN for reduction of EPI-based artifacts.

求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信