{"title":"利用运动特征整合和傅立叶神经注意的动态心脏 MRI 重构深度网络级联","authors":"Jingshuai Liu;Chen Qin;Mehrdad Yaghoobi","doi":"10.1109/TCI.2024.3402335","DOIUrl":null,"url":null,"abstract":"Magnetic resonance imaging (MRI) provides a radiation-free and non-invasive tool for clinical diagnosis. However, it suffers from a prohibitively long acquisition process for many applications. Compressed sensing (CS) methods have been used for reconstruction from under-sampled data in accelerated acquisitions. Although effective in practice, the image quality can be limited by the expressiveness of handcrafted signal priors such as sparsity. Dynamic MRI requires high spatial and temporal resolution, which makes CS to be more difficult to recover the data taken within a short scanning time. In this paper, we explore to solve the challenging inverse problem by introducing an optimization-inspired deep leaning framework to recover dynamic MRI images. A novel mask-guided motion feature incorporation (Mask-MFI) scheme is proposed to benefit the recovery of the dynamic content, and a spatio-temporal Fourier neural block (ST-FNB) is designed to improve the reconstruction performance by leveraging the redundancies in spatial and temporal domains in a computation and parameter efficient manner. The comparative experiments demonstrate that the proposed framework outperforms other state-of-the-art methods at a range of accelerations both qualitatively and quantitatively. Ablation studies confirm the effectiveness of model components. Moreover, the adaptability and generalization capacity of the introduced method are also validated, which demonstrates the potential of the application of our proposed approach to other reconstruction models to boost their performance.","PeriodicalId":56022,"journal":{"name":"IEEE Transactions on Computational Imaging","volume":"10 ","pages":"774-789"},"PeriodicalIF":4.2000,"publicationDate":"2024-03-17","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Deep Network Cascade for Dynamic Cardiac MRI Reconstruction With Motion Feature Incorporation and the Fourier Neural Attention\",\"authors\":\"Jingshuai Liu;Chen Qin;Mehrdad Yaghoobi\",\"doi\":\"10.1109/TCI.2024.3402335\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Magnetic resonance imaging (MRI) provides a radiation-free and non-invasive tool for clinical diagnosis. However, it suffers from a prohibitively long acquisition process for many applications. Compressed sensing (CS) methods have been used for reconstruction from under-sampled data in accelerated acquisitions. Although effective in practice, the image quality can be limited by the expressiveness of handcrafted signal priors such as sparsity. Dynamic MRI requires high spatial and temporal resolution, which makes CS to be more difficult to recover the data taken within a short scanning time. In this paper, we explore to solve the challenging inverse problem by introducing an optimization-inspired deep leaning framework to recover dynamic MRI images. A novel mask-guided motion feature incorporation (Mask-MFI) scheme is proposed to benefit the recovery of the dynamic content, and a spatio-temporal Fourier neural block (ST-FNB) is designed to improve the reconstruction performance by leveraging the redundancies in spatial and temporal domains in a computation and parameter efficient manner. The comparative experiments demonstrate that the proposed framework outperforms other state-of-the-art methods at a range of accelerations both qualitatively and quantitatively. Ablation studies confirm the effectiveness of model components. Moreover, the adaptability and generalization capacity of the introduced method are also validated, which demonstrates the potential of the application of our proposed approach to other reconstruction models to boost their performance.\",\"PeriodicalId\":56022,\"journal\":{\"name\":\"IEEE Transactions on Computational Imaging\",\"volume\":\"10 \",\"pages\":\"774-789\"},\"PeriodicalIF\":4.2000,\"publicationDate\":\"2024-03-17\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Transactions on Computational Imaging\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10533659/\",\"RegionNum\":2,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Computational Imaging","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10533659/","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
Deep Network Cascade for Dynamic Cardiac MRI Reconstruction With Motion Feature Incorporation and the Fourier Neural Attention
Magnetic resonance imaging (MRI) provides a radiation-free and non-invasive tool for clinical diagnosis. However, it suffers from a prohibitively long acquisition process for many applications. Compressed sensing (CS) methods have been used for reconstruction from under-sampled data in accelerated acquisitions. Although effective in practice, the image quality can be limited by the expressiveness of handcrafted signal priors such as sparsity. Dynamic MRI requires high spatial and temporal resolution, which makes CS to be more difficult to recover the data taken within a short scanning time. In this paper, we explore to solve the challenging inverse problem by introducing an optimization-inspired deep leaning framework to recover dynamic MRI images. A novel mask-guided motion feature incorporation (Mask-MFI) scheme is proposed to benefit the recovery of the dynamic content, and a spatio-temporal Fourier neural block (ST-FNB) is designed to improve the reconstruction performance by leveraging the redundancies in spatial and temporal domains in a computation and parameter efficient manner. The comparative experiments demonstrate that the proposed framework outperforms other state-of-the-art methods at a range of accelerations both qualitatively and quantitatively. Ablation studies confirm the effectiveness of model components. Moreover, the adaptability and generalization capacity of the introduced method are also validated, which demonstrates the potential of the application of our proposed approach to other reconstruction models to boost their performance.
期刊介绍:
The IEEE Transactions on Computational Imaging will publish articles where computation plays an integral role in the image formation process. Papers will cover all areas of computational imaging ranging from fundamental theoretical methods to the latest innovative computational imaging system designs. Topics of interest will include advanced algorithms and mathematical techniques, model-based data inversion, methods for image and signal recovery from sparse and incomplete data, techniques for non-traditional sensing of image data, methods for dynamic information acquisition and extraction from imaging sensors, software and hardware for efficient computation in imaging systems, and highly novel imaging system design.