{"title":"用于多路复用 PET 图像分离的动力学模型深度学习。","authors":"Bolin Pan, Paul K Marsden, Andrew J Reader","doi":"10.1186/s40658-024-00660-0","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Multiplexed positron emission tomography (mPET) imaging can measure physiological and pathological information from different tracers simultaneously in a single scan. Separation of the multiplexed PET signals within a single PET scan is challenging due to the fact that each tracer gives rise to indistinguishable 511 keV photon pairs, and thus no unique energy information for differentiating the source of each photon pair.</p><p><strong>Methods: </strong>Recently, many applications of deep learning for mPET image separation have been concentrated on pure data-driven methods, e.g., training a neural network to separate mPET images into single-tracer dynamic/static images. These methods use over-parameterized networks with only a very weak inductive prior. In this work, we improve the inductive prior of the deep network by incorporating a general kinetic model based on spectral analysis. The model is incorporated, along with deep networks, into an unrolled image-space version of an iterative fully 4D PET reconstruction algorithm.</p><p><strong>Results: </strong>The performance of the proposed method was evaluated on a simulated brain image dataset for dual-tracer [ <math><msup><mrow></mrow> <mn>18</mn></msup> </math> F]FDG+[ <math><msup><mrow></mrow> <mn>11</mn></msup> </math> C]MET PET image separation. The results demonstrate that the proposed method can achieve separation performance comparable to that obtained with single-tracer imaging. In addition, the proposed method outperformed the model-based separation methods (the conventional voxel-wise multi-tracer compartment modeling method (v-MTCM) and the image-space dual-tracer version of the fully 4D PET image reconstruction algorithm (IS-F4D)), as well as a pure data-driven separation [using a convolutional encoder-decoder (CED)], with fewer training examples.</p><p><strong>Conclusions: </strong>This work proposes a kinetic model-informed unrolled deep learning method for mPET image separation. In simulation studies, the method proved able to outperform both the conventional v-MTCM method and a pure data-driven CED with less training data.</p>","PeriodicalId":11559,"journal":{"name":"EJNMMI Physics","volume":"11 1","pages":"56"},"PeriodicalIF":3.0000,"publicationDate":"2024-07-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11555001/pdf/","citationCount":"0","resultStr":"{\"title\":\"Kinetic model-informed deep learning for multiplexed PET image separation.\",\"authors\":\"Bolin Pan, Paul K Marsden, Andrew J Reader\",\"doi\":\"10.1186/s40658-024-00660-0\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p><strong>Background: </strong>Multiplexed positron emission tomography (mPET) imaging can measure physiological and pathological information from different tracers simultaneously in a single scan. Separation of the multiplexed PET signals within a single PET scan is challenging due to the fact that each tracer gives rise to indistinguishable 511 keV photon pairs, and thus no unique energy information for differentiating the source of each photon pair.</p><p><strong>Methods: </strong>Recently, many applications of deep learning for mPET image separation have been concentrated on pure data-driven methods, e.g., training a neural network to separate mPET images into single-tracer dynamic/static images. These methods use over-parameterized networks with only a very weak inductive prior. In this work, we improve the inductive prior of the deep network by incorporating a general kinetic model based on spectral analysis. The model is incorporated, along with deep networks, into an unrolled image-space version of an iterative fully 4D PET reconstruction algorithm.</p><p><strong>Results: </strong>The performance of the proposed method was evaluated on a simulated brain image dataset for dual-tracer [ <math><msup><mrow></mrow> <mn>18</mn></msup> </math> F]FDG+[ <math><msup><mrow></mrow> <mn>11</mn></msup> </math> C]MET PET image separation. The results demonstrate that the proposed method can achieve separation performance comparable to that obtained with single-tracer imaging. In addition, the proposed method outperformed the model-based separation methods (the conventional voxel-wise multi-tracer compartment modeling method (v-MTCM) and the image-space dual-tracer version of the fully 4D PET image reconstruction algorithm (IS-F4D)), as well as a pure data-driven separation [using a convolutional encoder-decoder (CED)], with fewer training examples.</p><p><strong>Conclusions: </strong>This work proposes a kinetic model-informed unrolled deep learning method for mPET image separation. In simulation studies, the method proved able to outperform both the conventional v-MTCM method and a pure data-driven CED with less training data.</p>\",\"PeriodicalId\":11559,\"journal\":{\"name\":\"EJNMMI Physics\",\"volume\":\"11 1\",\"pages\":\"56\"},\"PeriodicalIF\":3.0000,\"publicationDate\":\"2024-07-01\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11555001/pdf/\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"EJNMMI Physics\",\"FirstCategoryId\":\"3\",\"ListUrlMain\":\"https://doi.org/10.1186/s40658-024-00660-0\",\"RegionNum\":2,\"RegionCategory\":\"医学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"RADIOLOGY, NUCLEAR MEDICINE & MEDICAL IMAGING\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"EJNMMI Physics","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1186/s40658-024-00660-0","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"RADIOLOGY, NUCLEAR MEDICINE & MEDICAL IMAGING","Score":null,"Total":0}
引用次数: 0
摘要
背景:多重正电子发射断层扫描(mPET)成像可在一次扫描中同时测量不同示踪剂的生理和病理信息。由于每种示踪剂都会产生不可区分的 511 keV 光子对,因此没有独特的能量信息来区分每种光子对的来源,因此在一次正电子发射断层扫描中分离多重正电子发射断层扫描信号具有挑战性:最近,深度学习在 mPET 图像分离方面的许多应用都集中在纯数据驱动方法上,例如,训练神经网络将 mPET 图像分离成单示踪剂动态/静态图像。这些方法使用了参数过高的网络,只有非常弱的归纳先验。在这项工作中,我们通过纳入基于光谱分析的通用动力学模型,改进了深度网络的归纳先验。该模型与深度网络一起被纳入迭代式全四维 PET 重建算法的未卷积图像空间版本中:在模拟脑图像数据集上评估了所提方法在双示踪 [ 18 F]FDG+[ 11 C]MET PET 图像分离中的性能。结果表明,所提出的方法可实现与单示踪剂成像相当的分离性能。此外,所提出的方法还优于基于模型的分离方法(传统的体素多示踪剂区室建模方法(v-MTCM)和全四维 PET 图像重建算法的图像空间双示踪剂版本(IS-F4D)),以及纯数据驱动的分离方法[使用卷积编码器-解码器(CED)],但训练实例较少:结论:本研究提出了一种用于 mPET 图像分离的动力学模型启发的非卷积深度学习方法。在模拟研究中,该方法被证明能够以较少的训练数据超越传统的 v-MTCM 方法和纯数据驱动的 CED。
Kinetic model-informed deep learning for multiplexed PET image separation.
Background: Multiplexed positron emission tomography (mPET) imaging can measure physiological and pathological information from different tracers simultaneously in a single scan. Separation of the multiplexed PET signals within a single PET scan is challenging due to the fact that each tracer gives rise to indistinguishable 511 keV photon pairs, and thus no unique energy information for differentiating the source of each photon pair.
Methods: Recently, many applications of deep learning for mPET image separation have been concentrated on pure data-driven methods, e.g., training a neural network to separate mPET images into single-tracer dynamic/static images. These methods use over-parameterized networks with only a very weak inductive prior. In this work, we improve the inductive prior of the deep network by incorporating a general kinetic model based on spectral analysis. The model is incorporated, along with deep networks, into an unrolled image-space version of an iterative fully 4D PET reconstruction algorithm.
Results: The performance of the proposed method was evaluated on a simulated brain image dataset for dual-tracer [ F]FDG+[ C]MET PET image separation. The results demonstrate that the proposed method can achieve separation performance comparable to that obtained with single-tracer imaging. In addition, the proposed method outperformed the model-based separation methods (the conventional voxel-wise multi-tracer compartment modeling method (v-MTCM) and the image-space dual-tracer version of the fully 4D PET image reconstruction algorithm (IS-F4D)), as well as a pure data-driven separation [using a convolutional encoder-decoder (CED)], with fewer training examples.
Conclusions: This work proposes a kinetic model-informed unrolled deep learning method for mPET image separation. In simulation studies, the method proved able to outperform both the conventional v-MTCM method and a pure data-driven CED with less training data.
期刊介绍:
EJNMMI Physics is an international platform for scientists, users and adopters of nuclear medicine with a particular interest in physics matters. As a companion journal to the European Journal of Nuclear Medicine and Molecular Imaging, this journal has a multi-disciplinary approach and welcomes original materials and studies with a focus on applied physics and mathematics as well as imaging systems engineering and prototyping in nuclear medicine. This includes physics-driven approaches or algorithms supported by physics that foster early clinical adoption of nuclear medicine imaging and therapy.