Jens Maus, Pavel Nikulin, Frank Hofheinz, Jan Petr, Anja Braune, Jörg Kotzerke, Jörg van den Hoff
{"title":"Deep learning based bilateral filtering for edge-preserving denoising of respiratory-gated PET.","authors":"Jens Maus, Pavel Nikulin, Frank Hofheinz, Jan Petr, Anja Braune, Jörg Kotzerke, Jörg van den Hoff","doi":"10.1186/s40658-024-00661-z","DOIUrl":null,"url":null,"abstract":"<p><strong>Background: </strong>Residual image noise is substantial in positron emission tomography (PET) and one of the factors limiting lesion detection, quantification, and overall image quality. Thus, improving noise reduction remains of considerable interest. This is especially true for respiratory-gated PET investigations. The only broadly used approach for noise reduction in PET imaging has been the application of low-pass filters, usually Gaussians, which however leads to loss of spatial resolution and increased partial volume effects affecting detectability of small lesions and quantitative data evaluation. The bilateral filter (BF) - a locally adaptive image filter - allows to reduce image noise while preserving well defined object edges but manual optimization of the filter parameters for a given PET scan can be tedious and time-consuming, hampering its clinical use. In this work we have investigated to what extent a suitable deep learning based approach can resolve this issue by training a suitable network with the target of reproducing the results of manually adjusted case-specific bilateral filtering.</p><p><strong>Methods: </strong>Altogether, 69 respiratory-gated clinical PET/CT scans with three different tracers ( <math> <mrow><msup><mo>[</mo> <mn>18</mn></msup> <mtext>F</mtext> <mo>]</mo></mrow> </math> FDG, <math> <mrow><msup><mo>[</mo> <mn>18</mn></msup> <mtext>F</mtext> <mo>]</mo></mrow> </math> L-DOPA, <math> <mrow><msup><mo>[</mo> <mn>68</mn></msup> <mtext>Ga</mtext> <mo>]</mo></mrow> </math> DOTATATE) were used for the present investigation. Prior to data processing, the gated data sets were split, resulting in a total of 552 single-gate image volumes. For each of these image volumes, four 3D ROIs were delineated: one ROI for image noise assessment and three ROIs for focal uptake (e.g. tumor lesions) measurements at different target/background contrast levels. An automated procedure was used to perform a brute force search of the two-dimensional BF parameter space for each data set to identify the \"optimal\" filter parameters to generate user-approved ground truth input data consisting of pairs of original and optimally BF filtered images. For reproducing the optimal BF filtering, we employed a modified 3D U-Net CNN incorporating residual learning principle. The network training and evaluation was performed using a 5-fold cross-validation scheme. The influence of filtering on lesion SUV quantification and image noise level was assessed by calculating absolute and fractional differences between the CNN, manual BF, or original (STD) data sets in the previously defined ROIs.</p><p><strong>Results: </strong>The automated procedure used for filter parameter determination chose adequate filter parameters for the majority of the data sets with only 19 patient data sets requiring manual tuning. Evaluation of the focal uptake ROIs revealed that CNN as well as BF based filtering essentially maintain the focal <math><msub><mtext>SUV</mtext> <mtext>max</mtext></msub> </math> values of the unfiltered images with a low mean ± SD difference of <math><mrow><mi>δ</mi> <msubsup><mtext>SUV</mtext> <mtext>max</mtext> <mrow><mtext>CNN</mtext> <mo>,</mo> <mtext>STD</mtext></mrow> </msubsup> </mrow> </math> = (-3.9 ± 5.2)% and <math><mrow><mi>δ</mi> <msubsup><mtext>SUV</mtext> <mtext>max</mtext> <mrow><mtext>BF</mtext> <mo>,</mo> <mtext>STD</mtext></mrow> </msubsup> </mrow> </math> = (-4.4 ± 5.3)%. Regarding relative performance of CNN versus BF, both methods lead to very similar <math><msub><mtext>SUV</mtext> <mtext>max</mtext></msub> </math> values in the vast majority of cases with an overall average difference of <math><mrow><mi>δ</mi> <msubsup><mtext>SUV</mtext> <mtext>max</mtext> <mrow><mtext>CNN</mtext> <mo>,</mo> <mtext>BF</mtext></mrow> </msubsup> </mrow> </math> = (0.5 ± 4.8)%. Evaluation of the noise properties showed that CNN filtering mostly satisfactorily reproduces the noise level and characteristics of BF with <math><mrow><mi>δ</mi> <msup><mtext>Noise</mtext> <mrow><mtext>CNN</mtext> <mo>,</mo> <mtext>BF</mtext></mrow> </msup> </mrow> </math> = (5.6 ± 10.5)%. No significant tracer dependent differences between CNN and BF were observed.</p><p><strong>Conclusions: </strong>Our results show that a neural network based denoising can reproduce the results of a case by case optimized BF in a fully automated way. Apart from rare cases it led to images of practically identical quality regarding noise level, edge preservation, and signal recovery. We believe such a network might proof especially useful in the context of improved motion correction of respiratory-gated PET studies but could also help to establish BF-equivalent edge-preserving CNN filtering in clinical PET since it obviates time consuming manual BF parameter tuning.</p>","PeriodicalId":11559,"journal":{"name":"EJNMMI Physics","volume":"11 1","pages":"58"},"PeriodicalIF":3.0000,"publicationDate":"2024-07-09","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"https://www.ncbi.nlm.nih.gov/pmc/articles/PMC11231129/pdf/","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"EJNMMI Physics","FirstCategoryId":"3","ListUrlMain":"https://doi.org/10.1186/s40658-024-00661-z","RegionNum":2,"RegionCategory":"医学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"RADIOLOGY, NUCLEAR MEDICINE & MEDICAL IMAGING","Score":null,"Total":0}
引用次数: 0
Abstract
Background: Residual image noise is substantial in positron emission tomography (PET) and one of the factors limiting lesion detection, quantification, and overall image quality. Thus, improving noise reduction remains of considerable interest. This is especially true for respiratory-gated PET investigations. The only broadly used approach for noise reduction in PET imaging has been the application of low-pass filters, usually Gaussians, which however leads to loss of spatial resolution and increased partial volume effects affecting detectability of small lesions and quantitative data evaluation. The bilateral filter (BF) - a locally adaptive image filter - allows to reduce image noise while preserving well defined object edges but manual optimization of the filter parameters for a given PET scan can be tedious and time-consuming, hampering its clinical use. In this work we have investigated to what extent a suitable deep learning based approach can resolve this issue by training a suitable network with the target of reproducing the results of manually adjusted case-specific bilateral filtering.
Methods: Altogether, 69 respiratory-gated clinical PET/CT scans with three different tracers ( FDG, L-DOPA, DOTATATE) were used for the present investigation. Prior to data processing, the gated data sets were split, resulting in a total of 552 single-gate image volumes. For each of these image volumes, four 3D ROIs were delineated: one ROI for image noise assessment and three ROIs for focal uptake (e.g. tumor lesions) measurements at different target/background contrast levels. An automated procedure was used to perform a brute force search of the two-dimensional BF parameter space for each data set to identify the "optimal" filter parameters to generate user-approved ground truth input data consisting of pairs of original and optimally BF filtered images. For reproducing the optimal BF filtering, we employed a modified 3D U-Net CNN incorporating residual learning principle. The network training and evaluation was performed using a 5-fold cross-validation scheme. The influence of filtering on lesion SUV quantification and image noise level was assessed by calculating absolute and fractional differences between the CNN, manual BF, or original (STD) data sets in the previously defined ROIs.
Results: The automated procedure used for filter parameter determination chose adequate filter parameters for the majority of the data sets with only 19 patient data sets requiring manual tuning. Evaluation of the focal uptake ROIs revealed that CNN as well as BF based filtering essentially maintain the focal values of the unfiltered images with a low mean ± SD difference of = (-3.9 ± 5.2)% and = (-4.4 ± 5.3)%. Regarding relative performance of CNN versus BF, both methods lead to very similar values in the vast majority of cases with an overall average difference of = (0.5 ± 4.8)%. Evaluation of the noise properties showed that CNN filtering mostly satisfactorily reproduces the noise level and characteristics of BF with = (5.6 ± 10.5)%. No significant tracer dependent differences between CNN and BF were observed.
Conclusions: Our results show that a neural network based denoising can reproduce the results of a case by case optimized BF in a fully automated way. Apart from rare cases it led to images of practically identical quality regarding noise level, edge preservation, and signal recovery. We believe such a network might proof especially useful in the context of improved motion correction of respiratory-gated PET studies but could also help to establish BF-equivalent edge-preserving CNN filtering in clinical PET since it obviates time consuming manual BF parameter tuning.
期刊介绍:
EJNMMI Physics is an international platform for scientists, users and adopters of nuclear medicine with a particular interest in physics matters. As a companion journal to the European Journal of Nuclear Medicine and Molecular Imaging, this journal has a multi-disciplinary approach and welcomes original materials and studies with a focus on applied physics and mathematics as well as imaging systems engineering and prototyping in nuclear medicine. This includes physics-driven approaches or algorithms supported by physics that foster early clinical adoption of nuclear medicine imaging and therapy.