Shuangchen Li;Lizhi Zhang;Hongbo Guo;Jintao Li;Jingjing Yu;Xuelei He;Yizhe Zhao;Xiaowei He
{"title":"基于通道和空间门控注意机制的全复值神经网络在磁颗粒成像系统矩阵标定中的应用","authors":"Shuangchen Li;Lizhi Zhang;Hongbo Guo;Jintao Li;Jingjing Yu;Xuelei He;Yizhe Zhao;Xiaowei He","doi":"10.1109/TCI.2025.3525948","DOIUrl":null,"url":null,"abstract":"Magnetic particle imaging (MPI) is an emerging medical imaging technique that visualizes the spatial distribution of magnetic nanoparticles (MNPs). The system matrix (SM)-based reconstruction is enable to sensitively account for various system imperfections and offers high-fidelity volume images. Yet, the re-calibration of SMs is time-consuming when the imaging mode changes. Here, through adequately analyzing the properties of SMs, a channel- and spatial- gated attention mechanism based fully complex-valued neural network (CSA-FCN) was introduced for SM calibration in MPI. Specifically, a complex-valued constraint model for SM calibration is designed to focus on the complex-valued property of SM samples. Firstly, complex-valued convolution neural network (C-CNN) is leveraged to coarsely extract complex-valued features of the SMs. Additionally, in complex-valued domain, the channel- and spatial-based gated attention mechanisms are constructed to enhance features with lightweight advantage, named C-SEM and C-SAM respectively. C-SEM induces the network to suppress the noise expression at channel-level. C-SAM improves the network context sensitivity at spatial-level. Ultimately, aggregate the features at each level as global embedding representation, and calibrating the SM form local- to full-size through a pre-constructed consistency reconstruction layer. Analysis and experiments indicate that CSA-FCN significantly improves the efficiency of SM calibration and has excellent robustness against to different imaging modes.","PeriodicalId":56022,"journal":{"name":"IEEE Transactions on Computational Imaging","volume":"11 ","pages":"65-76"},"PeriodicalIF":4.2000,"publicationDate":"2025-01-06","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"CSA-FCN: Channel- and Spatial-Gated Attention Mechanism Based Fully Complex-Valued Neural Network for System Matrix Calibration in Magnetic Particle Imaging\",\"authors\":\"Shuangchen Li;Lizhi Zhang;Hongbo Guo;Jintao Li;Jingjing Yu;Xuelei He;Yizhe Zhao;Xiaowei He\",\"doi\":\"10.1109/TCI.2025.3525948\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Magnetic particle imaging (MPI) is an emerging medical imaging technique that visualizes the spatial distribution of magnetic nanoparticles (MNPs). The system matrix (SM)-based reconstruction is enable to sensitively account for various system imperfections and offers high-fidelity volume images. Yet, the re-calibration of SMs is time-consuming when the imaging mode changes. Here, through adequately analyzing the properties of SMs, a channel- and spatial- gated attention mechanism based fully complex-valued neural network (CSA-FCN) was introduced for SM calibration in MPI. Specifically, a complex-valued constraint model for SM calibration is designed to focus on the complex-valued property of SM samples. Firstly, complex-valued convolution neural network (C-CNN) is leveraged to coarsely extract complex-valued features of the SMs. Additionally, in complex-valued domain, the channel- and spatial-based gated attention mechanisms are constructed to enhance features with lightweight advantage, named C-SEM and C-SAM respectively. C-SEM induces the network to suppress the noise expression at channel-level. C-SAM improves the network context sensitivity at spatial-level. Ultimately, aggregate the features at each level as global embedding representation, and calibrating the SM form local- to full-size through a pre-constructed consistency reconstruction layer. Analysis and experiments indicate that CSA-FCN significantly improves the efficiency of SM calibration and has excellent robustness against to different imaging modes.\",\"PeriodicalId\":56022,\"journal\":{\"name\":\"IEEE Transactions on Computational Imaging\",\"volume\":\"11 \",\"pages\":\"65-76\"},\"PeriodicalIF\":4.2000,\"publicationDate\":\"2025-01-06\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"IEEE Transactions on Computational Imaging\",\"FirstCategoryId\":\"94\",\"ListUrlMain\":\"https://ieeexplore.ieee.org/document/10824964/\",\"RegionNum\":2,\"RegionCategory\":\"计算机科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"ENGINEERING, ELECTRICAL & ELECTRONIC\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"IEEE Transactions on Computational Imaging","FirstCategoryId":"94","ListUrlMain":"https://ieeexplore.ieee.org/document/10824964/","RegionNum":2,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"ENGINEERING, ELECTRICAL & ELECTRONIC","Score":null,"Total":0}
CSA-FCN: Channel- and Spatial-Gated Attention Mechanism Based Fully Complex-Valued Neural Network for System Matrix Calibration in Magnetic Particle Imaging
Magnetic particle imaging (MPI) is an emerging medical imaging technique that visualizes the spatial distribution of magnetic nanoparticles (MNPs). The system matrix (SM)-based reconstruction is enable to sensitively account for various system imperfections and offers high-fidelity volume images. Yet, the re-calibration of SMs is time-consuming when the imaging mode changes. Here, through adequately analyzing the properties of SMs, a channel- and spatial- gated attention mechanism based fully complex-valued neural network (CSA-FCN) was introduced for SM calibration in MPI. Specifically, a complex-valued constraint model for SM calibration is designed to focus on the complex-valued property of SM samples. Firstly, complex-valued convolution neural network (C-CNN) is leveraged to coarsely extract complex-valued features of the SMs. Additionally, in complex-valued domain, the channel- and spatial-based gated attention mechanisms are constructed to enhance features with lightweight advantage, named C-SEM and C-SAM respectively. C-SEM induces the network to suppress the noise expression at channel-level. C-SAM improves the network context sensitivity at spatial-level. Ultimately, aggregate the features at each level as global embedding representation, and calibrating the SM form local- to full-size through a pre-constructed consistency reconstruction layer. Analysis and experiments indicate that CSA-FCN significantly improves the efficiency of SM calibration and has excellent robustness against to different imaging modes.
期刊介绍:
The IEEE Transactions on Computational Imaging will publish articles where computation plays an integral role in the image formation process. Papers will cover all areas of computational imaging ranging from fundamental theoretical methods to the latest innovative computational imaging system designs. Topics of interest will include advanced algorithms and mathematical techniques, model-based data inversion, methods for image and signal recovery from sparse and incomplete data, techniques for non-traditional sensing of image data, methods for dynamic information acquisition and extraction from imaging sensors, software and hardware for efficient computation in imaging systems, and highly novel imaging system design.