An unsupervised deep learning-based image translation method for retrospective motion correction of high resolution kidney MRI

Shahrzad Moinian , Nyoman D. Kurniawan , Shekhar S. Chandra , Viktor Vegh , David C. Reutens
{"title":"An unsupervised deep learning-based image translation method for retrospective motion correction of high resolution kidney MRI","authors":"Shahrzad Moinian ,&nbsp;Nyoman D. Kurniawan ,&nbsp;Shekhar S. Chandra ,&nbsp;Viktor Vegh ,&nbsp;David C. Reutens","doi":"10.1016/j.ibmed.2023.100108","DOIUrl":null,"url":null,"abstract":"<div><p>A primary challenge for <em>in vivo</em> kidney magnetic resonance imaging (MRI) is the presence of different types of involuntary physiological motion, affecting the diagnostic utility of acquired images due to severe motion artifacts. Existing prospective and retrospective motion correction methods remain ineffective when dealing with complex large amplitude nonrigid motion artifacts. Here, we introduce an unsupervised deep learning-based image to image translation method between motion-affected and motion-free image domains, for correction of rigid-body, respiratory and nonrigid motion artifacts in <em>vivo</em> kidney MRI.</p><p>High resolution (i.e., 156 × 156 × 370 μm) <em>ex vivo</em> 3 Tesla MRI scans of 13 porcine kidneys (because of their anatomical homology to human kidney) were conducted using a 3D T2-weighted turbo spin echo sequence. Rigid-body, respiratory and nonrigid motion-affected images were then simulated using the magnitude-only <em>ex vivo</em> motion-free image set. Each 2D coronal slice of motion-affected and motion-free image volume was then divided into patches of 128 × 128 for training the model. We proposed to add normalised cross-correlation loss to cycle consistency generative adversarial network structure (NCC-CycleGAN), to enforce edge alignment between motion-corrected and motion-free image domains.</p><p>Our NCC-CycleGAN motion correction model demonstrated high performance with an in-tissue structural similarity index measure of 0.77 ± 0.08, peak signal-to-noise ratio of 26.67 ± 3.44 and learned perceptual image patch similarity of 0.173 ± 0.05 between the reconstructed motion-corrected and ground truth motion-free images. This corresponds to a significant respective average improvement of 34%, 23% and 39% (p &lt; 0.05; paired <em>t</em>-test) for the three metrics to correct the three different types of simulated motion artifacts.</p><p>We demonstrated the feasibility of developing an unsupervised deep learning-based method for efficient automated retrospective kidney MRI motion correction, while preserving microscopic tissue structures in high resolution imaging.</p></div>","PeriodicalId":73399,"journal":{"name":"Intelligence-based medicine","volume":"8 ","pages":"Article 100108"},"PeriodicalIF":0.0000,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Intelligence-based medicine","FirstCategoryId":"1085","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S2666521223000224","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0

Abstract

A primary challenge for in vivo kidney magnetic resonance imaging (MRI) is the presence of different types of involuntary physiological motion, affecting the diagnostic utility of acquired images due to severe motion artifacts. Existing prospective and retrospective motion correction methods remain ineffective when dealing with complex large amplitude nonrigid motion artifacts. Here, we introduce an unsupervised deep learning-based image to image translation method between motion-affected and motion-free image domains, for correction of rigid-body, respiratory and nonrigid motion artifacts in vivo kidney MRI.

High resolution (i.e., 156 × 156 × 370 μm) ex vivo 3 Tesla MRI scans of 13 porcine kidneys (because of their anatomical homology to human kidney) were conducted using a 3D T2-weighted turbo spin echo sequence. Rigid-body, respiratory and nonrigid motion-affected images were then simulated using the magnitude-only ex vivo motion-free image set. Each 2D coronal slice of motion-affected and motion-free image volume was then divided into patches of 128 × 128 for training the model. We proposed to add normalised cross-correlation loss to cycle consistency generative adversarial network structure (NCC-CycleGAN), to enforce edge alignment between motion-corrected and motion-free image domains.

Our NCC-CycleGAN motion correction model demonstrated high performance with an in-tissue structural similarity index measure of 0.77 ± 0.08, peak signal-to-noise ratio of 26.67 ± 3.44 and learned perceptual image patch similarity of 0.173 ± 0.05 between the reconstructed motion-corrected and ground truth motion-free images. This corresponds to a significant respective average improvement of 34%, 23% and 39% (p < 0.05; paired t-test) for the three metrics to correct the three different types of simulated motion artifacts.

We demonstrated the feasibility of developing an unsupervised deep learning-based method for efficient automated retrospective kidney MRI motion correction, while preserving microscopic tissue structures in high resolution imaging.

基于无监督深度学习的高分辨率肾脏MRI回顾性运动校正图像翻译方法
体内肾脏磁共振成像(MRI)的主要挑战是存在不同类型的非自愿生理运动,由于严重的运动伪影,影响了采集图像的诊断效用。现有的前瞻性和回顾性运动校正方法在处理复杂的大振幅非刚性运动伪影时仍然无效。在这里,我们介绍了一种基于无监督深度学习的图像到图像在受运动影响和无运动图像域之间的转换方法,用于刚体的校正,活体肾脏MRI中的呼吸和非刚性运动伪影。使用3D T2加权turbo自旋回波序列对13个猪肾脏(由于其与人类肾脏的解剖同源性)进行了高分辨率(即156×156×370μm)的离体3特斯拉MRI扫描。然后使用仅幅值的离体无运动图像集模拟刚体、呼吸和非刚体运动影响的图像。然后,将受运动影响和无运动图像体积的每个2D冠状切片划分为128×128的块,用于训练模型。我们提出将归一化互相关损失添加到循环一致性生成对抗性网络结构(NCC CycleGAN)中,以加强运动校正和无运动图像域之间的边缘对齐。我们的NCC CycleGAN运动校正模型表现出高性能,组织内结构相似性指数为0.77±0.08,峰值信噪比为26.67±3.44,在重建的运动校正图像和无地面实况运动图像之间,学习感知图像块相似性为0.173±0.05。这对应于用于校正三种不同类型的模拟运动伪影的三个度量的34%、23%和39%的显著的各自平均改进(p<0.05;配对t检验)。我们证明了开发一种基于无监督深度学习的方法的可行性,该方法用于有效的自动回顾性肾脏MRI运动校正,同时在高分辨率成像中保留微观组织结构。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Intelligence-based medicine
Intelligence-based medicine Health Informatics
CiteScore
5.00
自引率
0.00%
发文量
0
审稿时长
187 days
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信