Zeng Qingwang, Dong Zhangyu, Yang Xuezhi, Chong Fating
{"title":"Interferometric phase denoising combining global context and fused attention","authors":"Zeng Qingwang, Dong Zhangyu, Yang Xuezhi, Chong Fating","doi":"10.11834/jig.220562","DOIUrl":null,"url":null,"abstract":"目的 干涉相位去噪是合成孔径雷达干涉测量(interferometric synthetic aperture radar,InSAR)技术中的关键环节,其效果对测量精度具有重要影响。针对现有的干涉相位去噪方法大多关注局部特征以及在特征提取方面的局限性,同时为了平衡去噪和结构保持两者之间的关系,提出了一种结合全局上下文与融合注意力的相位去噪网络 GCFA-PDNet (global context and fused attention phase denoising network)。方法 将干涉相位分离为实部和虚部依次输入到网络,先从噪声相位中提取浅层特征,再将其映射到由全局上下文提取模块和融合注意力模块组成的特征增强模块,最后通过全局残差学习生成去噪图像。全局上下文提取模块能提取全局上下文信息,具有非局部方法的优势;融合注意力模块既强调关键特征,又能高效提取隐藏在复杂背景中的噪声信息。结果 所提出的方法与对比方法中性能最优者相比,在模拟数据结果的平均峰值信噪比(peak signal to noise ratio,PSNR)和结构相似性(struc-tural similarity,SSIM)指标分别提高了 5.72% 和 2.94%,在真实数据结果的平均残差点减少百分比(percentage ofresidual point reduction,PRR)和相位标准偏差(phase standard deviation,PSD)指标分别提高了 2.01% 和 3.57%。结合定性与定量分析,所提出的方法优于其他 5 种不同类型的相位去噪方法。结论 提出的去噪网络较其他方法具有更强大的特征提取能力,此外由于关注全局上下文信息和强调关键特征,网络能够在增强去噪能力的同时保持原始相位细节。;Objective Interferometric phase noise is introduced by three types of inherent factors:1)system noise, such as thermal noise and synthetic aperture radar(SAR)speckle noise;2)decoherence problems, including baseline, temporal, and spatial decoherence;3)signal processing errors, such as misregistration.The existence of noise increases the difficulty of phase unwrapping and even causes the process to fail, thereby seriously interfering with the final interferometric result.Therefore, interferometric phase denoising is a key link in interferometric SAR(InSAR)technology.Its effect has an important influence on the accuracy of measurement results.The existing interferometric phase denoising algorithms still have many defects.First is the insufficient ability to capture global contextual information.Some algorithms ignore global context information or only focus on local context information derived from a few pixels.They also lack global context information.This feature is manifested as unstable detail preservation ability in denoising results.Second, many researchers only pay attention to the influence of the spatial dimension or channel dimension of the image on the denoising result to improve the performance of denoising networks.However, they do not use spatial and channel dimensions in combination.Third, the high-level features extracted from the deep layers of the convolutional neural network have rich semantic information and ambiguous spatial details.In comparison, the low-level features extracted from the shallow layers of the network contain considerable pixel-level noise information.However, these features are isolated from one another;thus, they cannot be fully used.Method Most of the existing interferometric phase denoising methods focus on local features, and they have many limitations in feature extraction.A phase denoising network called GCFA-PDNet is proposed to solve these problems while balancing the relationship between denoising and structure preservation.This proposed phase denoising network combines global context and fused attention.The method separates the interference phase into real and imaginary parts and inputs them into the network.First, the shallow features are extracted from the noise phase.Then, they are mapped to the feature enhancement module composed of the global context extraction module and the fused attention module.The shallow features extracted by the network are fused with the deep features concurrently.Finally, a denoised image is generated through global residual learning.Four global context extraction modules and four fused attention modules are used in the whole network.The core module of the global context extraction module is the global context block, which can extract the global context information and has the advantages of nonlocal methods.The fused attention module fuses the features extracted by its two submodules:the channel attention block and the spatial attention block.It emphasizes key features and efficiently extracts noise information hidden in complex backgrounds.Result We present six experimental results:Goldstein, nonlocal interferogram estimator(NL-InSAR), block-matching 3D(InSAR-BM3D), a deep learning framework for SAR interferometric phase restoration and coherence estimation (DeepInSAR), phase filtering network, and GCFAPDNet.Different evaluation indicators are selected for different datasets to evaluate the advantages and disadvantages of various algorithms objectively.For the experiments of simulated images, peak signal-to-noise ratio(PSNR)and structural similarity(SSIM)are selected as evaluation indicators.A large PSNR indicates a little difference between the filtered phase and the clean phase.However, it does not consider the correlation between pixels in the image.Therefore, SSIM is employed to assess the SSIM of the filtered images to evaluate the overall denoising quality of the denoised images.Compared with the comparative methods, the proposed method improves the average PSNR and SSIM indicators of the simulated data results by 5.72% and 2.94%, respectively.For the real interference phase, the above two indicators cannot be used for evaluating the denoising performance because no noise-free image is used as a reference.The number of residues (NOR)and phase standard deviation(PSD)can also be used as objective evaluation indicators to judge subjectively the denoising performance of real interferometric phase images.NOR can reflect the ability of the filtering method to suppress noise.The smaller the NOR of the filtered interference phase is, the stronger the ability to suppress noise is.PSD can be used to measure the discrete degree of noise distribution.The smaller the PSD value is, the more concentrated the noise distribution is and the better the quality of the interferogram is.In the real data results, compared with the comparative methods, the proposed method increases the average percentage of residual point reduction and PSD indicators by 2.01% and 3.57%, respectively.The visual observation of the experimental results of various algorithms shows that the proposed method achieves the best denoising results.The qualitative and quantitative analyses also indicate that the proposed method outperforms the five other types of phase denoising methods.Conclusion The phase denoising network designed in the present study combines the global context and fused attention.Thus, it has certain advantages compared with other related algorithms.It also has a more powerful feature extraction ability than other methods.The network focuses on global context information and emphasizes key features.Thus, it can maintain the original phase details while enhancing the denoising ability, thereby achieving the best denoising results.","PeriodicalId":36336,"journal":{"name":"中国图象图形学报","volume":"55 1","pages":"0"},"PeriodicalIF":0.0000,"publicationDate":"2023-01-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"中国图象图形学报","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/10.11834/jig.220562","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"Computer Science","Score":null,"Total":0}
引用次数: 0
Abstract
目的 干涉相位去噪是合成孔径雷达干涉测量(interferometric synthetic aperture radar,InSAR)技术中的关键环节,其效果对测量精度具有重要影响。针对现有的干涉相位去噪方法大多关注局部特征以及在特征提取方面的局限性,同时为了平衡去噪和结构保持两者之间的关系,提出了一种结合全局上下文与融合注意力的相位去噪网络 GCFA-PDNet (global context and fused attention phase denoising network)。方法 将干涉相位分离为实部和虚部依次输入到网络,先从噪声相位中提取浅层特征,再将其映射到由全局上下文提取模块和融合注意力模块组成的特征增强模块,最后通过全局残差学习生成去噪图像。全局上下文提取模块能提取全局上下文信息,具有非局部方法的优势;融合注意力模块既强调关键特征,又能高效提取隐藏在复杂背景中的噪声信息。结果 所提出的方法与对比方法中性能最优者相比,在模拟数据结果的平均峰值信噪比(peak signal to noise ratio,PSNR)和结构相似性(struc-tural similarity,SSIM)指标分别提高了 5.72% 和 2.94%,在真实数据结果的平均残差点减少百分比(percentage ofresidual point reduction,PRR)和相位标准偏差(phase standard deviation,PSD)指标分别提高了 2.01% 和 3.57%。结合定性与定量分析,所提出的方法优于其他 5 种不同类型的相位去噪方法。结论 提出的去噪网络较其他方法具有更强大的特征提取能力,此外由于关注全局上下文信息和强调关键特征,网络能够在增强去噪能力的同时保持原始相位细节。;Objective Interferometric phase noise is introduced by three types of inherent factors:1)system noise, such as thermal noise and synthetic aperture radar(SAR)speckle noise;2)decoherence problems, including baseline, temporal, and spatial decoherence;3)signal processing errors, such as misregistration.The existence of noise increases the difficulty of phase unwrapping and even causes the process to fail, thereby seriously interfering with the final interferometric result.Therefore, interferometric phase denoising is a key link in interferometric SAR(InSAR)technology.Its effect has an important influence on the accuracy of measurement results.The existing interferometric phase denoising algorithms still have many defects.First is the insufficient ability to capture global contextual information.Some algorithms ignore global context information or only focus on local context information derived from a few pixels.They also lack global context information.This feature is manifested as unstable detail preservation ability in denoising results.Second, many researchers only pay attention to the influence of the spatial dimension or channel dimension of the image on the denoising result to improve the performance of denoising networks.However, they do not use spatial and channel dimensions in combination.Third, the high-level features extracted from the deep layers of the convolutional neural network have rich semantic information and ambiguous spatial details.In comparison, the low-level features extracted from the shallow layers of the network contain considerable pixel-level noise information.However, these features are isolated from one another;thus, they cannot be fully used.Method Most of the existing interferometric phase denoising methods focus on local features, and they have many limitations in feature extraction.A phase denoising network called GCFA-PDNet is proposed to solve these problems while balancing the relationship between denoising and structure preservation.This proposed phase denoising network combines global context and fused attention.The method separates the interference phase into real and imaginary parts and inputs them into the network.First, the shallow features are extracted from the noise phase.Then, they are mapped to the feature enhancement module composed of the global context extraction module and the fused attention module.The shallow features extracted by the network are fused with the deep features concurrently.Finally, a denoised image is generated through global residual learning.Four global context extraction modules and four fused attention modules are used in the whole network.The core module of the global context extraction module is the global context block, which can extract the global context information and has the advantages of nonlocal methods.The fused attention module fuses the features extracted by its two submodules:the channel attention block and the spatial attention block.It emphasizes key features and efficiently extracts noise information hidden in complex backgrounds.Result We present six experimental results:Goldstein, nonlocal interferogram estimator(NL-InSAR), block-matching 3D(InSAR-BM3D), a deep learning framework for SAR interferometric phase restoration and coherence estimation (DeepInSAR), phase filtering network, and GCFAPDNet.Different evaluation indicators are selected for different datasets to evaluate the advantages and disadvantages of various algorithms objectively.For the experiments of simulated images, peak signal-to-noise ratio(PSNR)and structural similarity(SSIM)are selected as evaluation indicators.A large PSNR indicates a little difference between the filtered phase and the clean phase.However, it does not consider the correlation between pixels in the image.Therefore, SSIM is employed to assess the SSIM of the filtered images to evaluate the overall denoising quality of the denoised images.Compared with the comparative methods, the proposed method improves the average PSNR and SSIM indicators of the simulated data results by 5.72% and 2.94%, respectively.For the real interference phase, the above two indicators cannot be used for evaluating the denoising performance because no noise-free image is used as a reference.The number of residues (NOR)and phase standard deviation(PSD)can also be used as objective evaluation indicators to judge subjectively the denoising performance of real interferometric phase images.NOR can reflect the ability of the filtering method to suppress noise.The smaller the NOR of the filtered interference phase is, the stronger the ability to suppress noise is.PSD can be used to measure the discrete degree of noise distribution.The smaller the PSD value is, the more concentrated the noise distribution is and the better the quality of the interferogram is.In the real data results, compared with the comparative methods, the proposed method increases the average percentage of residual point reduction and PSD indicators by 2.01% and 3.57%, respectively.The visual observation of the experimental results of various algorithms shows that the proposed method achieves the best denoising results.The qualitative and quantitative analyses also indicate that the proposed method outperforms the five other types of phase denoising methods.Conclusion The phase denoising network designed in the present study combines the global context and fused attention.Thus, it has certain advantages compared with other related algorithms.It also has a more powerful feature extraction ability than other methods.The network focuses on global context information and emphasizes key features.Thus, it can maintain the original phase details while enhancing the denoising ability, thereby achieving the best denoising results.
目的 干涉相位去噪是合成孔径雷达干涉测量(interferometric synthetic aperture radar,InSAR)技术中的关键环节,其效果对测量精度具有重要影响。针对现有的干涉相位去噪方法大多关注局部特征以及在特征提取方面的局限性,同时为了平衡去噪和结构保持两者之间的关系,提出了一种结合全局上下文与融合注意力的相位去噪网络 GCFA-PDNet (global context and fused attention phase denoising network)。方法 将干涉相位分离为实部和虚部依次输入到网络,先从噪声相位中提取浅层特征,再将其映射到由全局上下文提取模块和融合注意力模块组成的特征增强模块,最后通过全局残差学习生成去噪图像。全局上下文提取模块能提取全局上下文信息,具有非局部方法的优势;融合注意力模块既强调关键特征,又能高效提取隐藏在复杂背景中的噪声信息。结果 所提出的方法与对比方法中性能最优者相比,在模拟数据结果的平均峰值信噪比(peak signal to noise ratio,PSNR)和结构相似性(struc-tural similarity,SSIM)指标分别提高了 5.72% 和 2.94%,在真实数据结果的平均残差点减少百分比(percentage ofresidual point reduction,PRR)和相位标准偏差(phase standard deviation,PSD)指标分别提高了 2.01% 和 3.57%。结合定性与定量分析,所提出的方法优于其他 5 种不同类型的相位去噪方法。结论 提出的去噪网络较其他方法具有更强大的特征提取能力,此外由于关注全局上下文信息和强调关键特征,网络能够在增强去噪能力的同时保持原始相位细节。;Objective Interferometric phase noise is introduced by three types of inherent factors:1)system noise, such as thermal noise and synthetic aperture radar(SAR)speckle noise;2)decoherence problems, including baseline, temporal, and spatial decoherence;3)signal processing errors, such as misregistration.The existence of noise increases the difficulty of phase unwrapping and even causes the process to fail, thereby seriously interfering with the final interferometric result.Therefore, interferometric phase denoising is a key link in interferometric SAR(InSAR)technology.Its effect has an important influence on the accuracy of measurement results.The existing interferometric phase denoising algorithms still have many defects.First is the insufficient ability to capture global contextual information.Some algorithms ignore global context information or only focus on local context information derived from a few pixels.They also lack global context information.This feature is manifested as unstable detail preservation ability in denoising results.Second, many researchers only pay attention to the influence of the spatial dimension or channel dimension of the image on the denoising result to improve the performance of denoising networks.However, they do not use spatial and channel dimensions in combination.Third, the high-level features extracted from the deep layers of the convolutional neural network have rich semantic information and ambiguous spatial details.In comparison, the low-level features extracted from the shallow layers of the network contain considerable pixel-level noise information.However, these features are isolated from one another;thus, they cannot be fully used.Method Most of the existing interferometric phase denoising methods focus on local features, and they have many limitations in feature extraction.A phase denoising network called GCFA-PDNet is proposed to solve these problems while balancing the relationship between denoising and structure preservation.This proposed phase denoising network combines global context and fused attention.The method separates the interference phase into real and imaginary parts and inputs them into the network.First, the shallow features are extracted from the noise phase.Then, they are mapped to the feature enhancement module composed of the global context extraction module and the fused attention module.The shallow features extracted by the network are fused with the deep features concurrently.Finally, a denoised image is generated through global residual learning.Four global context extraction modules and four fused attention modules are used in the whole network.The core module of the global context extraction module is the global context block, which can extract the global context information and has the advantages of nonlocal methods.The fused attention module fuses the features extracted by its two submodules:the channel attention block and the spatial attention block.It emphasizes key features and efficiently extracts noise information hidden in complex backgrounds.Result We present six experimental results:Goldstein, nonlocal interferogram estimator(NL-InSAR), block-matching 3D(InSAR-BM3D), a deep learning framework for SAR interferometric phase restoration and coherence estimation (DeepInSAR), phase filtering network, and GCFAPDNet.Different evaluation indicators are selected for different datasets to evaluate the advantages and disadvantages of various algorithms objectively.For the experiments of simulated images, peak signal-to-noise ratio(PSNR)and structural similarity(SSIM)are selected as evaluation indicators.A large PSNR indicates a little difference between the filtered phase and the clean phase.However, it does not consider the correlation between pixels in the image.Therefore, SSIM is employed to assess the SSIM of the filtered images to evaluate the overall denoising quality of the denoised images.Compared with the comparative methods, the proposed method improves the average PSNR and SSIM indicators of the simulated data results by 5.72% and 2.94%, respectively. 对于真实干涉相位,由于没有无噪声图像作为参考,上述两个指标无法用于评价去噪性能。残差数(NOR)和相位标准差(PSD)也可以作为客观评价指标,主观上判断实际干涉相位图像的去噪性能。NOR可以反映滤波方法抑制噪声的能力。滤波后干涉相位的NOR越小,抑制噪声的能力越强,psd可以用来测量噪声分布的离散程度。PSD值越小,噪声分布越集中,干涉图质量越好。在实际数据结果中,与对比方法相比,本文方法将残差点消减率和PSD指标的平均百分比分别提高了2.01%和3.57%。对各种算法的实验结果进行了目视观察,结果表明本文方法达到了最好的去噪效果。定性和定量分析也表明,该方法优于其他五种相位去噪方法。结论本研究设计的相位去噪网络结合了全局背景和融合注意。因此,与其他相关算法相比,它具有一定的优势。它还具有比其他方法更强大的特征提取能力。网络关注全局上下文信息,强调关键特征。因此,在保持原始相位细节的同时,增强去噪能力,从而达到最佳去噪效果。
中国图象图形学报Computer Science-Computer Graphics and Computer-Aided Design
CiteScore
1.20
自引率
0.00%
发文量
6776
期刊介绍:
Journal of Image and Graphics (ISSN 1006-8961, CN 11-3758/TB, CODEN ZTTXFZ) is an authoritative academic journal supervised by the Chinese Academy of Sciences and co-sponsored by the Institute of Space and Astronautical Information Innovation of the Chinese Academy of Sciences (ISIAS), the Chinese Society of Image and Graphics (CSIG), and the Beijing Institute of Applied Physics and Computational Mathematics (BIAPM). The journal integrates high-tech theories, technical methods and industrialisation of applied research results in computer image graphics, and mainly publishes innovative and high-level scientific research papers on basic and applied research in image graphics science and its closely related fields. The form of papers includes reviews, technical reports, project progress, academic news, new technology reviews, new product introduction and industrialisation research. The content covers a wide range of fields such as image analysis and recognition, image understanding and computer vision, computer graphics, virtual reality and augmented reality, system simulation, animation, etc., and theme columns are opened according to the research hotspots and cutting-edge topics.
Journal of Image and Graphics reaches a wide range of readers, including scientific and technical personnel, enterprise supervisors, and postgraduates and college students of colleges and universities engaged in the fields of national defence, military, aviation, aerospace, communications, electronics, automotive, agriculture, meteorology, environmental protection, remote sensing, mapping, oil field, construction, transportation, finance, telecommunications, education, medical care, film and television, and art.
Journal of Image and Graphics is included in many important domestic and international scientific literature database systems, including EBSCO database in the United States, JST database in Japan, Scopus database in the Netherlands, China Science and Technology Thesis Statistics and Analysis (Annual Research Report), China Science Citation Database (CSCD), China Academic Journal Network Publishing Database (CAJD), and China Academic Journal Network Publishing Database (CAJD). China Science Citation Database (CSCD), China Academic Journals Network Publishing Database (CAJD), China Academic Journal Abstracts, Chinese Science Abstracts (Series A), China Electronic Science Abstracts, Chinese Core Journals Abstracts, Chinese Academic Journals on CD-ROM, and China Academic Journals Comprehensive Evaluation Database.