RNDiff: Rainfall nowcasting with Condition Diffusion Model

IF 7.5 1区 计算机科学 Q1 COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE
Xudong Ling , Chaorong Li , Fengqing Qin , Peng Yang , Yuanyuan Huang
{"title":"RNDiff: Rainfall nowcasting with Condition Diffusion Model","authors":"Xudong Ling ,&nbsp;Chaorong Li ,&nbsp;Fengqing Qin ,&nbsp;Peng Yang ,&nbsp;Yuanyuan Huang","doi":"10.1016/j.patcog.2024.111193","DOIUrl":null,"url":null,"abstract":"<div><div>The Diffusion Models are widely used in image generation because they can generate high-quality and realistic samples. In contrast, generative adversarial networks (GANs) and variational autoencoders (VAEs) have some limitations in terms of image quality. We introduce a diffusion model to the precipitation forecasting task and propose a short-term precipitation nowcasting with condition diffusion model based on historical observational data, which is referred to as Rainfall nowcasting with Condition Diffusion Model(RNDiff). By incorporating an additional conditional decoder module in the denoising process, RNDiff achieves end-to-end conditional rainfall prediction. RNDiff is composed of two networks: a denoising network and a conditional encoder network. The conditional network is composed of multiple independent UNet networks. These networks extract conditional feature maps at different resolutions, providing accurate conditional information that guides the diffusion model for conditional generation. RNDiff surpasses GANs in terms of prediction accuracy, although it requires more computational resources. The RNDiff model exhibits higher stability and efficiency during training than GANs-based approaches, and generates high-quality precipitation distribution samples that better reflect future actual precipitation conditions. Compared to the current state-of-the-art GAN-based methods, our proposed approach achieves significant improvements on key evaluation metrics. Specifically, our method leads to improvements in the CSI, HSS, and FSS, which are increased by around 8%, 5%, and 6%, respectively. The experiment fully verified the advantages and potential of RNdiff in precipitation forecasting and provided new insights for improving rainfall forecasting. Our project is open source and available on GitHub at: <span><span>https://github.com/ybu-lxd/RNDiff</span><svg><path></path></svg></span>.</div></div>","PeriodicalId":49713,"journal":{"name":"Pattern Recognition","volume":"160 ","pages":"Article 111193"},"PeriodicalIF":7.5000,"publicationDate":"2024-11-19","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Pattern Recognition","FirstCategoryId":"94","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S0031320324009440","RegionNum":1,"RegionCategory":"计算机科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"COMPUTER SCIENCE, ARTIFICIAL INTELLIGENCE","Score":null,"Total":0}
引用次数: 0

Abstract

The Diffusion Models are widely used in image generation because they can generate high-quality and realistic samples. In contrast, generative adversarial networks (GANs) and variational autoencoders (VAEs) have some limitations in terms of image quality. We introduce a diffusion model to the precipitation forecasting task and propose a short-term precipitation nowcasting with condition diffusion model based on historical observational data, which is referred to as Rainfall nowcasting with Condition Diffusion Model(RNDiff). By incorporating an additional conditional decoder module in the denoising process, RNDiff achieves end-to-end conditional rainfall prediction. RNDiff is composed of two networks: a denoising network and a conditional encoder network. The conditional network is composed of multiple independent UNet networks. These networks extract conditional feature maps at different resolutions, providing accurate conditional information that guides the diffusion model for conditional generation. RNDiff surpasses GANs in terms of prediction accuracy, although it requires more computational resources. The RNDiff model exhibits higher stability and efficiency during training than GANs-based approaches, and generates high-quality precipitation distribution samples that better reflect future actual precipitation conditions. Compared to the current state-of-the-art GAN-based methods, our proposed approach achieves significant improvements on key evaluation metrics. Specifically, our method leads to improvements in the CSI, HSS, and FSS, which are increased by around 8%, 5%, and 6%, respectively. The experiment fully verified the advantages and potential of RNdiff in precipitation forecasting and provided new insights for improving rainfall forecasting. Our project is open source and available on GitHub at: https://github.com/ybu-lxd/RNDiff.
RNDiff:利用条件扩散模型进行降雨预报
扩散模型能生成高质量的真实样本,因此被广泛应用于图像生成。相比之下,生成式对抗网络(GAN)和变异自动编码器(VAE)在图像质量方面有一定的局限性。我们在降水预报任务中引入了扩散模型,并提出了一种基于历史观测数据的短期降水预报条件扩散模型,即降水预报条件扩散模型(Rainfall Nowcasting with Condition Diffusion Model,RNDiff)。通过在去噪过程中加入额外的条件解码器模块,RNDiff 实现了端到端的条件降雨预测。RNDiff 由两个网络组成:去噪网络和条件编码器网络。条件网络由多个独立的 UNet 网络组成。这些网络提取不同分辨率的条件特征图,提供精确的条件信息,指导扩散模型进行条件生成。RNDiff 虽然需要更多的计算资源,但在预测精度方面超过了 GAN。与基于 GANs 的方法相比,RNDiff 模型在训练过程中表现出更高的稳定性和效率,并能生成高质量的降水分布样本,更好地反映未来的实际降水情况。与目前最先进的基于 GAN 的方法相比,我们提出的方法在关键评估指标上实现了显著改善。具体来说,我们的方法使 CSI、HSS 和 FSS 分别提高了约 8%、5% 和 6%。实验充分验证了 RNdiff 在降水预报中的优势和潜力,并为改进降水预报提供了新的见解。我们的项目是开源的,可在 GitHub 上查阅:https://github.com/ybu-lxd/RNDiff。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
求助全文
约1分钟内获得全文 求助全文
来源期刊
Pattern Recognition
Pattern Recognition 工程技术-工程:电子与电气
CiteScore
14.40
自引率
16.20%
发文量
683
审稿时长
5.6 months
期刊介绍: The field of Pattern Recognition is both mature and rapidly evolving, playing a crucial role in various related fields such as computer vision, image processing, text analysis, and neural networks. It closely intersects with machine learning and is being applied in emerging areas like biometrics, bioinformatics, multimedia data analysis, and data science. The journal Pattern Recognition, established half a century ago during the early days of computer science, has since grown significantly in scope and influence.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信