CRNN-Refined Spatiotemporal Transformer for Dynamic MRI reconstruction

Abstract

Magnetic Resonance Imaging (MRI) plays a pivotal role in modern clinical practice, providing detailed anatomical visualization with exceptional spatial resolution and soft tissue contrast. Dynamic MRI, aiming to capture both spatial and temporal characteristics, faces challenges related to prolonged acquisition times and susceptibility to motion artifacts. Balancing spatial and temporal resolutions becomes crucial in real-world clinical scenarios. In the realm of dynamic MRI reconstruction, while Convolutional Recurrent Neural Networks (CRNNs) struggle with long-range dependencies, CRNNs require extensive iterations, impacting efficiency. Transformers, known for their effectiveness in high-dimensional imaging, are underexplored in dynamic MRI reconstruction. Additionally, prevailing algorithms fall short of achieving superior results in demanding generative reconstructions at high acceleration rates. This research proposes a novel approach for dynamic MRI reconstruction, named CRNN-Refined Spatiotemporal Transformer Network (CST-Net). The spatiotemporal Transformer initiates reconstruction, modeling temporal and spatial correlations, followed by refinement using the CRNN. This integration mitigates inaccuracies caused by damaged frames and reduces CRNN iterations, enhancing computational efficiency without compromising reconstruction quality. Our study compares the performance of the proposed CST-Net at 6 × and 12 × undersampling rates, showcasing its superiority over existing algorithms. Particularly, in challenging 25× generative reconstructions, the CST-Net outperforms current methods. The comparison includes experiments under both radial and Cartesian undersampling patterns. In conclusion, CST-Net successfully addresses the limitations inherent in existing generative reconstruction algorithms, thereby paving the way for further exploration and optimization of Transformer-based approaches in dynamic MRI reconstruction. Code and Datasets can be available: https://github.com/XWangBin/CST-Net.