Robust deep MRI contrast synthesis using a prior-based and task-oriented 3D network.

Abstract

Magnetic resonance imaging (MRI) is one of the most widely used tools for clinical diagnosis. Depending on the acquisition parameters, different image contrasts can be obtained, providing complementary information about the patient's anatomy and potential pathological findings. However, multiplying such acquisitions requires more time, additional resources, and increases patient discomfort. Consequently, not all image modalities are typically acquired. One solution to obtain the missing modalities is to use contrast synthesis methods. Most existing synthesis methods work with 2D slices due to memory limitations, which produces inconsistencies and artifacts when reconstructing the 3D volume. In this work, we present a 3D deep learning-based approach for synthesizing T2-weighted MR volumes from T1-weighted ones. To preserve anatomical details and enhance image quality, we propose a segmentation-oriented loss function combined with a frequency space information loss. To make the proposed method more robust and applicable to a wider range of image scenarios, we also incorporate a priori information in the form of a multi-atlas. Additionally, we employ a semi-supervised learning framework that improves the model's generalizability across diverse datasets, potentially improving its performance in clinical settings with varying patient demographics and imaging protocols. By integrating prior anatomical knowledge with frequency domain and segmentation loss functions, our approach outperforms state-of-the-art methods, particularly in segmentation tasks. The method demonstrates significant improvements, especially in challenging cases, compared with state-of-the-art approaches.