Ji Zhao , Yingying Yuan , Yuting Dong , Yaozu Li , Changliang Shao , Haixia Yang
{"title":"基于地形特征引导扩散模型的数字高程模型空隙填充","authors":"Ji Zhao , Yingying Yuan , Yuting Dong , Yaozu Li , Changliang Shao , Haixia Yang","doi":"10.1016/j.rse.2024.114432","DOIUrl":null,"url":null,"abstract":"<div><p>Digital Elevation Models (DEMs) are pivotal in scientific research and engineering because they provide essential topographic and geomorphological information. Voids in DEM data result in the loss of terrain information, significantly impacting its broad applicability. Although spatial interpolation methods are frequently employed to address these voids, they suffer from accuracy degradation and struggle to reconstruct intricate terrain features. Generative Adversarial Network (GAN)-based approaches have emerged as promising solutions to enhance elevation accuracy and facilitate the reconstruction of partial terrain features. Nonetheless, GAN-based methods exhibit limitations with specific void shapes, and their performance is susceptible to artifacts and elevation jumps around the void boundaries. To address shortcomings mentioned above, we propose a terrain feature-guided diffusion model (TFDM) to fill the DEM data voids. The training and inference processes of the diffusion model were constrained by terrain feature lines to ensure the stability of the generated DEM surface. The TFDM is distinguished by its ability to generate seamless DEM surfaces and maintain stable terrain contours in response to varying terrain conditions. Experiments were conducted to validate the applicability of TFDM using different DEMs, including Advanced Spaceborne Thermal Emission and Reflection Radiometer Global Digital Elevation Models (ASTER GDEMv3) and the TanDEM-X global DEM. The proposed TFDM algorithm and comparison methods such as DDPM, GAN, and Kriging were applied to a full test set of 271 DEM images covering different terrain environments. The mean absolute error (MAE) and root mean square error (RMSE) of the DEM restored by TFDM were 28.91 ± 9.45 m and 38.16 ± 13.00 m, respectively, while the MAE and RMSE of the comparison algorithms were no less than 60.87 ± 26.24 m and 82.80 ± 36.51 m or even higher, validating the effectiveness of the TFDM algorithm in filling DEM voids. Profile analysis in partial details indicates that the TFDM outperforms alternative methods in reconstructing terrain features, as confirmed through visual inspection and quantitative comparison. TFDM exhibits versatility when applied to DEM data with diverse resolutions and produced using various measurement techniques.</p></div>","PeriodicalId":417,"journal":{"name":"Remote Sensing of Environment","volume":"315 ","pages":"Article 114432"},"PeriodicalIF":11.1000,"publicationDate":"2024-09-21","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Void filling of digital elevation models based on terrain feature-guided diffusion model\",\"authors\":\"Ji Zhao , Yingying Yuan , Yuting Dong , Yaozu Li , Changliang Shao , Haixia Yang\",\"doi\":\"10.1016/j.rse.2024.114432\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>Digital Elevation Models (DEMs) are pivotal in scientific research and engineering because they provide essential topographic and geomorphological information. Voids in DEM data result in the loss of terrain information, significantly impacting its broad applicability. Although spatial interpolation methods are frequently employed to address these voids, they suffer from accuracy degradation and struggle to reconstruct intricate terrain features. Generative Adversarial Network (GAN)-based approaches have emerged as promising solutions to enhance elevation accuracy and facilitate the reconstruction of partial terrain features. Nonetheless, GAN-based methods exhibit limitations with specific void shapes, and their performance is susceptible to artifacts and elevation jumps around the void boundaries. To address shortcomings mentioned above, we propose a terrain feature-guided diffusion model (TFDM) to fill the DEM data voids. The training and inference processes of the diffusion model were constrained by terrain feature lines to ensure the stability of the generated DEM surface. The TFDM is distinguished by its ability to generate seamless DEM surfaces and maintain stable terrain contours in response to varying terrain conditions. Experiments were conducted to validate the applicability of TFDM using different DEMs, including Advanced Spaceborne Thermal Emission and Reflection Radiometer Global Digital Elevation Models (ASTER GDEMv3) and the TanDEM-X global DEM. The proposed TFDM algorithm and comparison methods such as DDPM, GAN, and Kriging were applied to a full test set of 271 DEM images covering different terrain environments. The mean absolute error (MAE) and root mean square error (RMSE) of the DEM restored by TFDM were 28.91 ± 9.45 m and 38.16 ± 13.00 m, respectively, while the MAE and RMSE of the comparison algorithms were no less than 60.87 ± 26.24 m and 82.80 ± 36.51 m or even higher, validating the effectiveness of the TFDM algorithm in filling DEM voids. Profile analysis in partial details indicates that the TFDM outperforms alternative methods in reconstructing terrain features, as confirmed through visual inspection and quantitative comparison. TFDM exhibits versatility when applied to DEM data with diverse resolutions and produced using various measurement techniques.</p></div>\",\"PeriodicalId\":417,\"journal\":{\"name\":\"Remote Sensing of Environment\",\"volume\":\"315 \",\"pages\":\"Article 114432\"},\"PeriodicalIF\":11.1000,\"publicationDate\":\"2024-09-21\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Remote Sensing of Environment\",\"FirstCategoryId\":\"5\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S0034425724004589\",\"RegionNum\":1,\"RegionCategory\":\"地球科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"ENVIRONMENTAL SCIENCES\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Remote Sensing of Environment","FirstCategoryId":"5","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0034425724004589","RegionNum":1,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"ENVIRONMENTAL SCIENCES","Score":null,"Total":0}
引用次数: 0
摘要
数字高程模型(DEM)在科学研究和工程设计中举足轻重,因为它们提供了重要的地形和地貌信息。DEM 数据中的空洞会导致地形信息的丢失,严重影响其广泛的适用性。虽然空间插值方法经常被用来解决这些空洞问题,但它们会导致精度下降,难以重建复杂的地形特征。基于生成对抗网络(GAN)的方法已成为提高高程精度和促进部分地形特征重建的有前途的解决方案。然而,基于生成对抗网络的方法在特定空洞形状下表现出局限性,其性能容易受到空洞边界周围的伪影和高程跳跃的影响。针对上述不足,我们提出了一种地形特征引导的扩散模型(TFDM)来填补 DEM 数据空洞。扩散模型的训练和推理过程受到地形特征线的限制,以确保生成的 DEM 表面的稳定性。TFDM 的显著特点是能够生成无缝的 DEM 表面,并在地形条件变化时保持稳定的地形轮廓。为了验证 TFDM 的适用性,我们使用了不同的 DEM 进行了实验,包括高级空间热发射和反射辐射计全球数字高程模型(ASTER GDEMv3)和 TanDEM-X 全球 DEM。建议的 TFDM 算法和 DDPM、GAN 和 Kriging 等比较方法被应用于涵盖不同地形环境的 271 幅 DEM 图像的完整测试集。TFDM 算法修复的 DEM 平均绝对误差(MAE)和均方根误差(RMSE)分别为 28.91 ± 9.45 m 和 38.16 ± 13.00 m,而对比算法的 MAE 和 RMSE 不低于 60.87 ± 26.24 m 和 82.80 ± 36.51 m,甚至更高,验证了 TFDM 算法在填补 DEM 空洞方面的有效性。局部细节的剖面分析表明,通过目测和定量比较,TFDM 在重建地形特征方面优于其他方法。TFDM 在应用于不同分辨率的 DEM 数据和使用各种测量技术生成的 DEM 数据时表现出多功能性。
Void filling of digital elevation models based on terrain feature-guided diffusion model
Digital Elevation Models (DEMs) are pivotal in scientific research and engineering because they provide essential topographic and geomorphological information. Voids in DEM data result in the loss of terrain information, significantly impacting its broad applicability. Although spatial interpolation methods are frequently employed to address these voids, they suffer from accuracy degradation and struggle to reconstruct intricate terrain features. Generative Adversarial Network (GAN)-based approaches have emerged as promising solutions to enhance elevation accuracy and facilitate the reconstruction of partial terrain features. Nonetheless, GAN-based methods exhibit limitations with specific void shapes, and their performance is susceptible to artifacts and elevation jumps around the void boundaries. To address shortcomings mentioned above, we propose a terrain feature-guided diffusion model (TFDM) to fill the DEM data voids. The training and inference processes of the diffusion model were constrained by terrain feature lines to ensure the stability of the generated DEM surface. The TFDM is distinguished by its ability to generate seamless DEM surfaces and maintain stable terrain contours in response to varying terrain conditions. Experiments were conducted to validate the applicability of TFDM using different DEMs, including Advanced Spaceborne Thermal Emission and Reflection Radiometer Global Digital Elevation Models (ASTER GDEMv3) and the TanDEM-X global DEM. The proposed TFDM algorithm and comparison methods such as DDPM, GAN, and Kriging were applied to a full test set of 271 DEM images covering different terrain environments. The mean absolute error (MAE) and root mean square error (RMSE) of the DEM restored by TFDM were 28.91 ± 9.45 m and 38.16 ± 13.00 m, respectively, while the MAE and RMSE of the comparison algorithms were no less than 60.87 ± 26.24 m and 82.80 ± 36.51 m or even higher, validating the effectiveness of the TFDM algorithm in filling DEM voids. Profile analysis in partial details indicates that the TFDM outperforms alternative methods in reconstructing terrain features, as confirmed through visual inspection and quantitative comparison. TFDM exhibits versatility when applied to DEM data with diverse resolutions and produced using various measurement techniques.
期刊介绍:
Remote Sensing of Environment (RSE) serves the Earth observation community by disseminating results on the theory, science, applications, and technology that contribute to advancing the field of remote sensing. With a thoroughly interdisciplinary approach, RSE encompasses terrestrial, oceanic, and atmospheric sensing.
The journal emphasizes biophysical and quantitative approaches to remote sensing at local to global scales, covering a diverse range of applications and techniques.
RSE serves as a vital platform for the exchange of knowledge and advancements in the dynamic field of remote sensing.