MRI Super-Resolution using Implicit Neural Representation with Frequency Domain Enhancement

Shuangming Mao, Sei-ichiro Kamata
{"title":"MRI Super-Resolution using Implicit Neural Representation with Frequency Domain Enhancement","authors":"Shuangming Mao, Sei-ichiro Kamata","doi":"10.1145/3563737.3563759","DOIUrl":null,"url":null,"abstract":"High resolution (HR) Magnetic Resonance Imaging (MRI) is a popular diagnostic tool, which provides detail structural information and rich textures, benefiting accurate diagnosis and disease detection. However, obtaining HR MRI remains a challenge due to longer scan time and lower peak signal-to-noise ratio (PSNR). Recently, Single Image Super-Resolution (SISR) has generated interest, which shows promising ability for recovering an HR image only relies on a Low Resolution (LR) image. MR images have some characteristics different with natural images: derived from frequency domain, simpler textures and structural information. However, Most of previous methods treat MR images as same as natural images, they only apply SR methods on natural images to MR images and fail to preserve low-frequency information and capture high-frequency details. In this paper, we mimic the process of an MRI machine produces an MRI in practice and propose an Implicit Neural Representation based module, which enable reconstruct high frequency contents effectively while preserving low frequency contents unchanged. Moreover, vanilla L1 loss cannot reflect the differences for each frequency, to address this problem, we design a frequency loss to disentangle each frequency and calculate the differences respectively. Finally, to further capture high frequency contents, we propose High-Frequency Pixel Loss, which can decouples the HF contents from pixel domain and emphasize the HF differences between SR and HR images. Extensive experiments show the effectiveness of our proposed method in terms of visual quality and PSNR score, which produces sharper edges and clearer details compared to previous works.","PeriodicalId":127021,"journal":{"name":"Proceedings of the 7th International Conference on Biomedical Signal and Image Processing","volume":null,"pages":null},"PeriodicalIF":0.0000,"publicationDate":"2022-08-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"2","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Proceedings of the 7th International Conference on Biomedical Signal and Image Processing","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.1145/3563737.3563759","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 2

Abstract

High resolution (HR) Magnetic Resonance Imaging (MRI) is a popular diagnostic tool, which provides detail structural information and rich textures, benefiting accurate diagnosis and disease detection. However, obtaining HR MRI remains a challenge due to longer scan time and lower peak signal-to-noise ratio (PSNR). Recently, Single Image Super-Resolution (SISR) has generated interest, which shows promising ability for recovering an HR image only relies on a Low Resolution (LR) image. MR images have some characteristics different with natural images: derived from frequency domain, simpler textures and structural information. However, Most of previous methods treat MR images as same as natural images, they only apply SR methods on natural images to MR images and fail to preserve low-frequency information and capture high-frequency details. In this paper, we mimic the process of an MRI machine produces an MRI in practice and propose an Implicit Neural Representation based module, which enable reconstruct high frequency contents effectively while preserving low frequency contents unchanged. Moreover, vanilla L1 loss cannot reflect the differences for each frequency, to address this problem, we design a frequency loss to disentangle each frequency and calculate the differences respectively. Finally, to further capture high frequency contents, we propose High-Frequency Pixel Loss, which can decouples the HF contents from pixel domain and emphasize the HF differences between SR and HR images. Extensive experiments show the effectiveness of our proposed method in terms of visual quality and PSNR score, which produces sharper edges and clearer details compared to previous works.
基于频域增强的隐式神经表征的MRI超分辨率
高分辨率(HR)磁共振成像(MRI)是一种流行的诊断工具,它提供了详细的结构信息和丰富的纹理,有利于准确诊断和疾病检测。然而,由于较长的扫描时间和较低的峰值信噪比(PSNR),获得HR MRI仍然是一个挑战。近年来,单图像超分辨率(SISR)技术引起了人们的兴趣,它显示了仅依靠低分辨率(LR)图像就能恢复HR图像的良好能力。磁共振图像具有与自然图像不同的特点:源自频域,纹理和结构信息更简单。然而,以往的方法大多将MR图像与自然图像等同对待,仅将自然图像上的SR方法应用于MR图像,未能保留低频信息和捕获高频细节。在本文中,我们模拟了MRI机器在实际中产生MRI的过程,并提出了一个基于隐式神经表征的模块,该模块可以有效地重建高频内容,同时保持低频内容不变。此外,普通L1损耗不能反映每个频率的差异,为了解决这个问题,我们设计了一个频率损耗来分解每个频率并分别计算差异。最后,为了进一步捕获高频内容,我们提出了高频像素损失,它可以将高频内容从像素域解耦,并强调SR和HR图像之间的高频差异。大量的实验表明,我们提出的方法在视觉质量和PSNR评分方面是有效的,与以前的作品相比,它产生了更清晰的边缘和更清晰的细节。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
自引率
0.00%
发文量
0
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信