IEEE Transactions on Radiation and Plasma Medical Sciences最新文献

{"title":"A Multiscale Spatial Transformer U-Net for Simultaneously Automatic Reorientation and Segmentation of 3-D Nuclear Cardiac Images","authors":"Yangfan Ni;Duo Zhang;Gege Ma;Fan Rao;Yuanfeng Wu;Lijun Lu;Zhongke Huang;Wentao Zhu","doi":"10.1109/TRPMS.2024.3382318","DOIUrl":"https://doi.org/10.1109/TRPMS.2024.3382318","url":null,"abstract":"Accurate reorientation and segmentation of the left ventricular (LV) is essential for the quantitative analysis of myocardial perfusion imaging (MPI). This study proposes an end-to-end model, named as multiscale spatial transformer UNet (MS-ST-UNet), which involves the multiscale spatial transformer network (MSSTN) and multiscale UNet (MSUNet) modules to perform simultaneous reorientation and segmentation of LV region from nuclear cardiac images. The multiscale sampler produces images with varying resolutions, while scale transformer (ST) blocks are employed to align the scales of features. The proposed method is trained and tested using two different nuclear cardiac image modalities: \u0000<inline-formula> <tex-math>$^{13}text{N}$ </tex-math></inline-formula>\u0000-ammonia positron emission tomography (PET) and \u0000<inline-formula> <tex-math>$^{99m}$ </tex-math></inline-formula>\u0000Tc-sestamibi single-photon emission computed tomography (SPECT). MS-ST-UNet attains dice similarity coefficient (DSC) scores of 91.48% and 94.81% for PET LV myocardium (LV-MY) and SPECT LV-MY, respectively. Additionally, the mean-square error (MSE) between predicted rigid registration parameters and ground truth decreases to below \u0000<inline-formula> <tex-math>$1.4 times 10^{-2}$ </tex-math></inline-formula>\u0000. The experimental findings indicate that the MS-ST-UNet yields notably reduced registration errors and more precise boundary detection for the LV structure compared to existing methods. This joint learning framework promotes mutual enhancement between reorientation and segmentation tasks, leading to cutting edge performance and an efficient image processing workflow.","PeriodicalId":46807,"journal":{"name":"IEEE Transactions on Radiation and Plasma Medical Sciences","volume":null,"pages":null},"PeriodicalIF":4.6,"publicationDate":"2024-04-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141500375","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Experimental Uses of Positronium and Potential for Biological Applications","authors":"A. Hourlier;F. Boisson;D. Brasse","doi":"10.1109/TRPMS.2024.3407981","DOIUrl":"https://doi.org/10.1109/TRPMS.2024.3407981","url":null,"abstract":"Positrons are widely used in molecular imaging through the positron emission tomography (PET) imaging technique. However PET only reconstruct the distribution of the positron emitting radioisotopes, and because the \u0000<inline-formula> <tex-math>$beta ^{+}$ </tex-math></inline-formula>\u0000 isotopes are linked to a vector molecule, the distribution of \u0000<inline-formula> <tex-math>$beta ^{+}$ </tex-math></inline-formula>\u0000 isotopes is correlated to the distribution of a given biological function. Positron-electron annihilation can transit through a meta-stable called positronium, which can exist in two spin states: 1) the single state—parapositronium and 2) the triplet state—orthopositronium. The orthopositronium lifetime \u0000<inline-formula> <tex-math>$(tau _{mathrm {oPs}})$ </tex-math></inline-formula>\u0000, formation probabilities and decay modes are sensitive to the physical and chemical state of the neighboring medium and could therefore provide information on the tissues themselves during a PET acquisition. However, traditional PET only relies on the detection of the two annihilation photons, therefore the lifetime and annihilation higher-multiplicity annihilations are not accessible to such PET paradigm. This review will present some of the use cases of positronium as a specific signature for event selection in astrophysics and particle physics, and as a probe for the microscopic state of materials and tissues. These usages of positronium highlight the interest for positronium for diagnostic in medical science, the projects for using positronium in upcoming PET tomographs are then presented.","PeriodicalId":46807,"journal":{"name":"IEEE Transactions on Radiation and Plasma Medical Sciences","volume":null,"pages":null},"PeriodicalIF":4.6,"publicationDate":"2024-03-31","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10543075","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141500180","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Temporal Image Sequence Separation in Dual-Tracer Dynamic PET With an Invertible Network","authors":"Chuanfu Sun;Bin Huang;Jie Sun;Yangfan Ni;Huafeng Liu;Qian Xia;Qiegen Liu;Wentao Zhu","doi":"10.1109/TRPMS.2024.3407120","DOIUrl":"https://doi.org/10.1109/TRPMS.2024.3407120","url":null,"abstract":"Positron emission tomography (PET) is a widely used functional imaging technique in clinic. Compared to single-tracer PET, dual-tracer dynamic PET allows two sequences of different nuclear pharmaceuticals in one scan, revealing richer physiological information. However, dynamically separating the mixed signals in dual-tracer PET is challenging due to identical energy ~511 keV in gamma photon pairs from both tracers. We propose a method for dynamic PET dual-tracer separation based on invertible neural networks (DTS-INNs). This network enables the forward and backward process simultaneously. Therefore, producing the mixed image sequences from the separation results through backward process may impose extra constraints for optimizing the network. The loss is composed of two components corresponding to the forward and backward propagation processes, which results in more accurate gradient computations and more stable gradient propagation with cycle consistency. We assess our model’s performance using simulated and real data, comparing it with several reputable dual-tracer separation methods. The results of DTS-INN outperform counterparts with lower-mean square error, higher-structural similarity, and peak signal to noise ratio. Additionally, it exhibits robustness against noise levels, phantoms, tracer combinations, and scanning protocols, offering a dependable solution for dual-tracer PET image separation.","PeriodicalId":46807,"journal":{"name":"IEEE Transactions on Radiation and Plasma Medical Sciences","volume":null,"pages":null},"PeriodicalIF":4.6,"publicationDate":"2024-03-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10542421","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"142143785","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Comparison of Timing Measurement Methods of Dual-Ended Readout Scintillator Array PET Detectors","authors":"Ming Niu;Zhonghua Kuang;Xiaohui Wang;Ning Ren;Ziru Sang;Tao Sun;Zheng Liu;Zhanli Hu;Zheng Gu;Yongfeng Yang","doi":"10.1109/TRPMS.2024.3382990","DOIUrl":"https://doi.org/10.1109/TRPMS.2024.3382990","url":null,"abstract":"The main focus of this work is to compare different timing measurement methods of individual silicon photomultiplier (SiPM) arrays and dual-ended readout PET detectors. Two lutetium yttrium oxyorthosilicate (LYSO) crystal arrays with \u0000<inline-formula> <tex-math>$3.10times 3.10times 20$ </tex-math></inline-formula>\u0000-\u0000<inline-formula> <tex-math>${mathrm { mm}}^{3}$ </tex-math></inline-formula>\u0000 crystals, enhanced specular reflector (ESR), and barium sulfate (BaSO4) reflector and one LYSO crystal array with \u0000<inline-formula> <tex-math>$1.88times 1.88times 20$ </tex-math></inline-formula>\u0000-\u0000<inline-formula> <tex-math>${mathrm { mm}}^{3}$ </tex-math></inline-formula>\u0000 crystals and \u0000<inline-formula> <tex-math>$rm BaSO_{4}$ </tex-math></inline-formula>\u0000 reflector with dual-ended read out by \u0000<inline-formula> <tex-math>$8times 8$ </tex-math></inline-formula>\u0000 SiPM arrays of \u0000<inline-formula> <tex-math>$3times 3$ </tex-math></inline-formula>\u0000-\u0000<inline-formula> <tex-math>${mathrm { mm}}^{2}$ </tex-math></inline-formula>\u0000 active pixel area were measured. Signals of the SiPM arrays were processed individually using 64 channel PETsys TOFPET2 application specific integrated circuits designed for time-of-flight PET applications. For the SiPM arrays, an energy square-weighted average timing method using the timings of the fastest 2 SiPM pixels was found to provide the best-coincidence timing resolutions (CTRs). For the dual-ended readout detectors, the method of using the energy-weighted average timings of the two SiPM arrays provided the best CTR of 234 ps for the detector using \u0000<inline-formula> <tex-math>$3.10times 3.10times 20$ </tex-math></inline-formula>\u0000-\u0000<inline-formula> <tex-math>${mathrm { mm}}^{3}$ </tex-math></inline-formula>\u0000 crystals and ESR reflector, 239 ps for the detector using \u0000<inline-formula> <tex-math>$3.10times 3.10times 20$ </tex-math></inline-formula>\u0000-\u0000<inline-formula> <tex-math>${mathrm { mm}}^{3}$ </tex-math></inline-formula>\u0000 crystals and \u0000<inline-formula> <tex-math>$rm BaSO_{4}$ </tex-math></inline-formula>\u0000 reflector, and 275 ps for the detector using \u0000<inline-formula> <tex-math>$1.88times 1.88times 20$ </tex-math></inline-formula>\u0000-\u0000<inline-formula> <tex-math>${mathrm { mm}}^{3}$ </tex-math></inline-formula>\u0000 crystals and \u0000<inline-formula> <tex-math>$rm BaSO_{4}$ </tex-math></inline-formula>\u0000 reflector for an energy window of 410–610 keV. The dual-ended readout detectors developed in this work provide better CTRs than those of single-ended readout detectors and a high-3-D position resolution which can be used in the future to develop whole-body PET scanners to simultaneously achieve uniform high-spatial resolution, high sensitivity and high-timing resolution.","PeriodicalId":46807,"journal":{"name":"IEEE Transactions on Radiation and Plasma Medical Sciences","volume":null,"pages":null},"PeriodicalIF":4.6,"publicationDate":"2024-03-29","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10485386","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141500325","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"PBPK-Adapted Deep Learning for Pretherapy Prediction of Voxelwise Dosimetry: In-Silico Proof of Concept","authors":"Mohamed Kassar;Milos Drobnjakovic;Gabriele Birindelli;Song Xue;Andrei Gafita;Thomas Wendler;Ali Afshar-Oromieh;Nassir Navab;Wolfgang A. Weber;Matthias Eiber;Sibylle Ziegler;Axel Rominger;Kuangyu Shi","doi":"10.1109/TRPMS.2024.3381849","DOIUrl":"https://doi.org/10.1109/TRPMS.2024.3381849","url":null,"abstract":"Pretherapy dosimetry prediction is a prerequisite for treatment planning and personalized optimization of the emerging radiopharmaceutical therapy (RPT). Physiologically based pharmacokinetic (PBPK) model, describing the intrinsic pharmacokinetics of radiopharmaceuticals, have been proposed for pretherapy prediction of dosimetry. However, it is restricted with organwise prediction and the customization based on pretherapy measurements is still challenging. On the other side, artificial intelligence (AI) has demonstrated the potential in pretherapy dosimetry prediction. Nevertheless, it is still challenging for pure data-driven model to achieve voxelwise prediction due to huge gap between the pretherapy imaging and post-therapy dosimetry. This study aims to integrate the PBPK model into deep learning for voxelwise pretherapy dosimetry prediction. A conditional generative adversarial network (cGAN) integrated with the PBPK model as regularization was developed. For proof of concept, 120 virtual patients with 68Ga-PSMA-11 PET imaging and 177Lu-PSMA-I&T dosimetry were generated using realistic in silico simulations. In kidneys, spleen, liver and salivary glands, the proposed method achieved better accuracy and dose volume histogram than pure deep learning. The preliminary results confirmed that the proposed PBPK-adapted deep learning can improve the pretherapy voxelwise dosimetry prediction and may provide a practical solution to support treatment planning of heterogeneous dose distribution for personalized RPT.","PeriodicalId":46807,"journal":{"name":"IEEE Transactions on Radiation and Plasma Medical Sciences","volume":null,"pages":null},"PeriodicalIF":4.6,"publicationDate":"2024-03-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10481675","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141500252","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"PET Detectors Based on Multi-Resolution SiPM Arrays","authors":"Jiahao Xie;Haibo Wang;Simon R. Cherry;Junwei Du","doi":"10.1109/TRPMS.2024.3381865","DOIUrl":"https://doi.org/10.1109/TRPMS.2024.3381865","url":null,"abstract":"Almost all high spatial resolution positron emission tomography (PET) detectors based on pixelated scintillator arrays utilize crystal arrays with smaller pitches than photodetector arrays, leading to challenges in resolving edge crystals. To address this issue, this article introduces a novel multi-resolution silicon photomultiplier (SiPM) array design aimed at decreasing the number of readout channels required while maintaining the crystal resolvability of the detector, especially for edge crystals. The performance of a pseudo \u0000<inline-formula> <tex-math>$9times9$ </tex-math></inline-formula>\u0000 multi-resolution SiPM array, consisting of \u0000<inline-formula> <tex-math>$6.47times6.47$ </tex-math></inline-formula>\u0000 mm 2, \u0000<inline-formula> <tex-math>$6.47times3.07$ </tex-math></inline-formula>\u0000 mm 2, and \u0000<inline-formula> <tex-math>$3.07times3.07$ </tex-math></inline-formula>\u0000 mm2 SiPMs, was compared to those of a pseudo \u0000<inline-formula> <tex-math>$8times8$ </tex-math></inline-formula>\u0000 SiPM array with a 6.8-mm pitch, and a \u0000<inline-formula> <tex-math>$16times16$ </tex-math></inline-formula>\u0000 SiPM array with a 3.4-mm pitch using a \u0000<inline-formula> <tex-math>$36times36$ </tex-math></inline-formula>\u0000 LYSO array with a pitch of 1.5 mm. The large-size pseudo SiPMs were implemented by digitally grouping multiple \u0000<inline-formula> <tex-math>$3.07times3.07$ </tex-math></inline-formula>\u0000 mm2 SiPMs. The flood histograms show that the edge crystal resolvability of the pseudo \u0000<inline-formula> <tex-math>$9times9$ </tex-math></inline-formula>\u0000 multi-resolution SiPM array is comparable to that of the \u0000<inline-formula> <tex-math>$16times16$ </tex-math></inline-formula>\u0000 SiPM array and is significantly better than that of the \u0000<inline-formula> <tex-math>$8times8$ </tex-math></inline-formula>\u0000 SiPM array.","PeriodicalId":46807,"journal":{"name":"IEEE Transactions on Radiation and Plasma Medical Sciences","volume":null,"pages":null},"PeriodicalIF":4.4,"publicationDate":"2024-03-26","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140820283","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"DEMIST: A Deep-Learning-Based Detection-Task-Specific Denoising Approach for Myocardial Perfusion SPECT","authors":"Md Ashequr Rahman;Zitong Yu;Richard Laforest;Craig K. Abbey;Barry A. Siegel;Abhinav K. Jha","doi":"10.1109/TRPMS.2024.3379215","DOIUrl":"https://doi.org/10.1109/TRPMS.2024.3379215","url":null,"abstract":"There is an important need for methods to process myocardial perfusion imaging (MPI) single-photon emission computed tomography (SPECT) images acquired at lower-radiation dose and/or acquisition time such that the processed images improve observer performance on the clinical task of detecting perfusion defects compared to low-dose images. To address this need, we build upon concepts from model-observer theory and our understanding of the human visual system to propose a detection task-specific deep-learning-based approach for denoising MPI SPECT images (DEMIST). The approach, while performing denoising, is designed to preserve features that influence observer performance on detection tasks. We objectively evaluated DEMIST on the task of detecting perfusion defects using a retrospective study with anonymized clinical data in patients who underwent MPI studies across two scanners (\u0000<inline-formula> <tex-math>$N,,=$ </tex-math></inline-formula>\u0000 338). The evaluation was performed at low-dose levels of 6.25%, 12.5%, and 25% and using an anthropomorphic channelized Hotelling observer. Performance was quantified using area under the receiver operating characteristics curve (AUC). Images denoised with DEMIST yielded significantly higher AUC compared to corresponding low-dose images and images denoised with a commonly used task-agnostic deep learning-based denoising method. Similar results were observed with stratified analysis based on patient sex and defect type. Additionally, DEMIST improved visual fidelity of the low-dose images as quantified using root mean squared error and structural similarity index metric. A mathematical analysis revealed that DEMIST preserved features that assist in detection tasks while improving the noise properties, resulting in improved observer performance. The results provide strong evidence for further clinical evaluation of DEMIST to denoise low-count images in MPI SPECT.","PeriodicalId":46807,"journal":{"name":"IEEE Transactions on Radiation and Plasma Medical Sciences","volume":null,"pages":null},"PeriodicalIF":4.4,"publicationDate":"2024-03-25","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10477616","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140342755","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"OA","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Emphasizing Cherenkov Photons From Bismuth Germanate by Single Photon Response Deconvolution","authors":"Ryosuke Ota;Kibo Ote","doi":"10.1109/TRPMS.2024.3403959","DOIUrl":"https://doi.org/10.1109/TRPMS.2024.3403959","url":null,"abstract":"Bismuth germanate (BGO) has been receiving attention again because it is a potential scintillator for future time-of-flight positron emission tomography. Owing to its optical properties, BGO emits a relatively large number of Cherenkov photons after 511-keV gamma-ray interactions, which can enable good coincidence time resolution (CTR). Nonetheless, optimally exploiting the Cherenkov emissions can be confounded by scintillation emissions. Thus, we propose a method efficiently emphasizing Cherenkov photon from a detector waveform by deconvolving a single photon response of photodetector. As a proof-of-concept, we perform the deconvolution, and a probability density function (PDF) of BGO was obtained, which is compared to a conventional time correlated single photon counting (TCSPC) method. Furthermore, we investigate if the proposed deconvolution can emphasize a faint Cherenkov signal. Consequently, the PDF obtained by the proposed deconvolution shows a good agreement with that obtained using a conventional TCSPC methods. A CTR obtained using the proposed deconvolution is improved by 12% and 43% in full width at half maximum compared to a voltage-based leading edge discriminator for with and without high-frequency readout electronics, respectively. Thus, the proposed deconvolution method can efficiently emphasize Cherenkov photon by lowering the threshold level and improve the timing performance of BGO-based detectors.","PeriodicalId":46807,"journal":{"name":"IEEE Transactions on Radiation and Plasma Medical Sciences","volume":null,"pages":null},"PeriodicalIF":4.6,"publicationDate":"2024-03-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"141500389","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Two-Stage Deep Denoising With Self-Guided Noise Attention for Multimodal Medical Images","authors":"S. M. A. Sharif;Rizwan Ali Naqvi;Woong-Kee Loh","doi":"10.1109/TRPMS.2024.3380090","DOIUrl":"https://doi.org/10.1109/TRPMS.2024.3380090","url":null,"abstract":"Medical image denoising is considered among the most challenging vision tasks. Despite the real-world implications, existing denoising methods have notable drawbacks as they often generate visual artifacts when applied to heterogeneous medical images. This study addresses the limitation of the contemporary denoising methods with an artificial intelligence (AI)-driven two-stage learning strategy. The proposed method learns to estimate the residual noise from the noisy images. Later, it incorporates a novel noise attention mechanism to correlate estimated residual noise with noisy inputs to perform denoising in a course-to-refine manner. This study also proposes to leverage a multimodal learning strategy to generalize the denoising among medical image modalities and multiple noise patterns for widespread applications. The practicability of the proposed method has been evaluated with dense experiments. The experimental results demonstrated that the proposed method achieved state-of-the-art performance by significantly outperforming the existing medical image denoising methods in quantitative and qualitative comparisons. Overall, it illustrates a performance gain of 7.64 in peak signal-to-noise ratio (PSNR), 0.1021 in structural similarity index (SSIM), 0.80 in DeltaE \u0000<inline-formula> <tex-math>$(Delta E)$ </tex-math></inline-formula>\u0000, 0.1855 in visual information fidelity pixelwise (VIFP), and 18.54 in mean squared error (MSE) metrics.","PeriodicalId":46807,"journal":{"name":"IEEE Transactions on Radiation and Plasma Medical Sciences","volume":null,"pages":null},"PeriodicalIF":4.4,"publicationDate":"2024-03-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140820221","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}

{"title":"Medical Multimodal Image Transformation With Modality Code Awareness","authors":"Zhihua Li;Yuxi Jin;Qingneng Li;Zhenxing Huang;Zixiang Chen;Chao Zhou;Na Zhang;Xu Zhang;Wei Fan;Jianmin Yuan;Qiang He;Weiguang Zhang;Dong Liang;Zhanli Hu","doi":"10.1109/TRPMS.2024.3379580","DOIUrl":"https://doi.org/10.1109/TRPMS.2024.3379580","url":null,"abstract":"In the planning phase of radiation therapy, positron emission tomography (PET) images are frequently integrated with computed tomography (CT) and MRI to accurately delineate the target region for treatment. However, obtaining additional CT or magnetic resonance (MR) images solely for localization purposes proves to be financially burdensome, time-intensive, and may increase patient radiation exposure. To alleviate these issues, a deep learning model with dynamic modality translation capabilities is introduced. This approach is achieved through the incorporation of adaptive modality translation layers within the decoder module. The adaptive modality translation layer effectively governs modality transformation by reshaping the data distribution of features extracted by the encoder using switch codes. The model’s performance is assessed on images with reference images using evaluation metrics, such as peak signal-to-noise ratio, structural similarity index measure, and normalized mean square error. For results without reference images, subjective assessments are provided by six nuclear medicine physicians based on clinical interpretations. The proposed model demonstrates impressive performance in transforming nonattenuation corrected PET images into user-specified modalities (attenuation corrected PET, MR, or CT), effectively streamlining the acquisition of supplemental modality images in radiation therapy scenarios.","PeriodicalId":46807,"journal":{"name":"IEEE Transactions on Radiation and Plasma Medical Sciences","volume":null,"pages":null},"PeriodicalIF":4.4,"publicationDate":"2024-03-20","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":null,"resultStr":null,"platform":"Semanticscholar","paperid":"140820224","PeriodicalName":null,"FirstCategoryId":null,"ListUrlMain":null,"RegionNum":0,"RegionCategory":"","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":"","EPubDate":null,"PubModel":null,"JCR":null,"JCRName":null,"Score":null,"Total":0}