A network-assisted joint image and motion estimation approach for robust 3D MRI motion correction across severity levels.

Purpose: The purpose of this work was to develop and evaluate a novel method that leverages neural networks and physical modeling for 3D motion correction at different levels of corruption.

Methods: The novel method ("UNet+JE") combines an existing neural network ("UNet_mag") with a physics-informed algorithm for jointly estimating motion parameters and the motion-compensated image ("JE"). UNet_mag and UNet+JE were trained on two training datasets separately with different distributions of motion corruption severity and compared to JE as a benchmark. All five resulting methods were tested on T₁w 3D MPRAGE scans of healthy participants with simulated (n = 40) and in vivo (n = 10) motion corruption ranging from mild to severe motion.

Results: UNet+JE provided better motion correction than UNet_mag ( for all metrics for both simulated and in vivo data), under both training datasets. UNet_mag exhibited residual image artifacts and blurring, as well as greater susceptibility to data distribution shifts than UNet+JE. UNet+JE and JE did not significantly differ in image correction quality ( $p>0.05$ for all metrics), even under strong distribution shifts for UNet+JE. However, UNet+JE reduced runtimes by a median reduction factor of between 2.00 to 3.80 as well as 4.05 for the simulation and in vivo studies, respectively.

Conclusions: UNet+JE benefitted from the robustness of joint estimation and the fast image improvement provided by the neural network, enabling the method to provide high quality 3D image correction under a wide range of motion corruption within shorter runtimes.