ResoNet:利用混合卷积和变压器网络进行稳健且可解释的厄尔尼诺/南方涛动预测

IF 6.5 2区 地球科学 Q1 METEOROLOGY & ATMOSPHERIC SCIENCES
Pumeng Lyu, Tao Tang, Fenghua Ling, Jing-Jia Luo, Niklas Boers, Wanli Ouyang, Lei Bai
{"title":"ResoNet:利用混合卷积和变压器网络进行稳健且可解释的厄尔尼诺/南方涛动预测","authors":"Pumeng Lyu, Tao Tang, Fenghua Ling, Jing-Jia Luo, Niklas Boers, Wanli Ouyang, Lei Bai","doi":"10.1007/s00376-024-3316-6","DOIUrl":null,"url":null,"abstract":"<p>Recent studies have shown that deep learning (DL) models can skillfully forecast El Niño–Southern Oscillation (ENSO) events more than 1.5 years in advance. However, concerns regarding the reliability of predictions made by DL methods persist, including potential overfitting issues and lack of interpretability. Here, we propose ResoNet, a DL model that combines CNN (convolutional neural network) and transformer architectures. This hybrid architecture enables our model to adequately capture local sea surface temperature anomalies as well as long-range inter-basin interactions across oceans. We show that ResoNet can robustly predict ENSO at lead times of 19 months, thus outperforming existing approaches in terms of the forecast horizon. According to an explainability method applied to ResoNet predictions of El Niño and La Niña from 1- to 18-month leads, we find that it predicts the Niño-3.4 index based on multiple physically reasonable mechanisms, such as the recharge oscillator concept, seasonal footprint mechanism, and Indian Ocean capacitor effect. Moreover, we demonstrate for the first time that the asymmetry between El Niño and La Niña development can be captured by ResoNet. Our results could help to alleviate skepticism about applying DL models for ENSO prediction and encourage more attempts to discover and predict climate phenomena using AI methods.</p>","PeriodicalId":7249,"journal":{"name":"Advances in Atmospheric Sciences","volume":"17 1","pages":""},"PeriodicalIF":6.5000,"publicationDate":"2024-06-22","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"ResoNet: Robust and Explainable ENSO Forecasts with Hybrid Convolution and Transformer Networks\",\"authors\":\"Pumeng Lyu, Tao Tang, Fenghua Ling, Jing-Jia Luo, Niklas Boers, Wanli Ouyang, Lei Bai\",\"doi\":\"10.1007/s00376-024-3316-6\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<p>Recent studies have shown that deep learning (DL) models can skillfully forecast El Niño–Southern Oscillation (ENSO) events more than 1.5 years in advance. However, concerns regarding the reliability of predictions made by DL methods persist, including potential overfitting issues and lack of interpretability. Here, we propose ResoNet, a DL model that combines CNN (convolutional neural network) and transformer architectures. This hybrid architecture enables our model to adequately capture local sea surface temperature anomalies as well as long-range inter-basin interactions across oceans. We show that ResoNet can robustly predict ENSO at lead times of 19 months, thus outperforming existing approaches in terms of the forecast horizon. According to an explainability method applied to ResoNet predictions of El Niño and La Niña from 1- to 18-month leads, we find that it predicts the Niño-3.4 index based on multiple physically reasonable mechanisms, such as the recharge oscillator concept, seasonal footprint mechanism, and Indian Ocean capacitor effect. Moreover, we demonstrate for the first time that the asymmetry between El Niño and La Niña development can be captured by ResoNet. Our results could help to alleviate skepticism about applying DL models for ENSO prediction and encourage more attempts to discover and predict climate phenomena using AI methods.</p>\",\"PeriodicalId\":7249,\"journal\":{\"name\":\"Advances in Atmospheric Sciences\",\"volume\":\"17 1\",\"pages\":\"\"},\"PeriodicalIF\":6.5000,\"publicationDate\":\"2024-06-22\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Advances in Atmospheric Sciences\",\"FirstCategoryId\":\"89\",\"ListUrlMain\":\"https://doi.org/10.1007/s00376-024-3316-6\",\"RegionNum\":2,\"RegionCategory\":\"地球科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q1\",\"JCRName\":\"METEOROLOGY & ATMOSPHERIC SCIENCES\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Advances in Atmospheric Sciences","FirstCategoryId":"89","ListUrlMain":"https://doi.org/10.1007/s00376-024-3316-6","RegionNum":2,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"METEOROLOGY & ATMOSPHERIC SCIENCES","Score":null,"Total":0}
引用次数: 0

摘要

最近的研究表明,深度学习(DL)模型可以提前 1.5 年以上熟练预测厄尔尼诺-南方涛动(ENSO)事件。然而,人们对深度学习方法所做预测的可靠性仍然存在担忧,包括潜在的过拟合问题和缺乏可解释性。在此,我们提出了一种结合了 CNN(卷积神经网络)和变压器架构的 DL 模型 ResoNet。这种混合架构使我们的模型能够充分捕捉局部海表温度异常以及跨大洋的远距离流域间相互作用。我们的研究表明,ResoNet 可以在 19 个月的提前期稳健预测厄尔尼诺/南方涛动,因此在预测范围方面优于现有方法。根据一种应用于 ResoNet 预测厄尔尼诺和拉尼娜的 1 至 18 个月提前期的可解释性方法,我们发现 ResoNet 基于多种物理上合理的机制预测了尼诺-3.4 指数,例如补给振荡器概念、季节足迹机制和印度洋电容器效应。此外,我们首次证明了 ResoNet 可以捕捉厄尔尼诺和拉尼娜发展之间的不对称性。我们的研究结果有助于减轻人们对应用 DL 模型预测厄尔尼诺/南方涛动的怀疑,并鼓励人们更多地尝试利用人工智能方法发现和预测气候现象。
本文章由计算机程序翻译,如有差异,请以英文原文为准。
ResoNet: Robust and Explainable ENSO Forecasts with Hybrid Convolution and Transformer Networks

Recent studies have shown that deep learning (DL) models can skillfully forecast El Niño–Southern Oscillation (ENSO) events more than 1.5 years in advance. However, concerns regarding the reliability of predictions made by DL methods persist, including potential overfitting issues and lack of interpretability. Here, we propose ResoNet, a DL model that combines CNN (convolutional neural network) and transformer architectures. This hybrid architecture enables our model to adequately capture local sea surface temperature anomalies as well as long-range inter-basin interactions across oceans. We show that ResoNet can robustly predict ENSO at lead times of 19 months, thus outperforming existing approaches in terms of the forecast horizon. According to an explainability method applied to ResoNet predictions of El Niño and La Niña from 1- to 18-month leads, we find that it predicts the Niño-3.4 index based on multiple physically reasonable mechanisms, such as the recharge oscillator concept, seasonal footprint mechanism, and Indian Ocean capacitor effect. Moreover, we demonstrate for the first time that the asymmetry between El Niño and La Niña development can be captured by ResoNet. Our results could help to alleviate skepticism about applying DL models for ENSO prediction and encourage more attempts to discover and predict climate phenomena using AI methods.

求助全文
通过发布文献求助,成功后即可免费获取论文全文。 去求助
来源期刊
Advances in Atmospheric Sciences
Advances in Atmospheric Sciences 地学-气象与大气科学
CiteScore
9.30
自引率
5.20%
发文量
154
审稿时长
6 months
期刊介绍: Advances in Atmospheric Sciences, launched in 1984, aims to rapidly publish original scientific papers on the dynamics, physics and chemistry of the atmosphere and ocean. It covers the latest achievements and developments in the atmospheric sciences, including marine meteorology and meteorology-associated geophysics, as well as the theoretical and practical aspects of these disciplines. Papers on weather systems, numerical weather prediction, climate dynamics and variability, satellite meteorology, remote sensing, air chemistry and the boundary layer, clouds and weather modification, can be found in the journal. Papers describing the application of new mathematics or new instruments are also collected here.
×
引用
GB/T 7714-2015
复制
MLA
复制
APA
复制
导出至
BibTeX EndNote RefMan NoteFirst NoteExpress
×
提示
您的信息不完整,为了账户安全,请先补充。
现在去补充
×
提示
您因"违规操作"
具体请查看互助需知
我知道了
×
提示
确定
请完成安全验证×
copy
已复制链接
快去分享给好友吧!
我知道了
右上角分享
点击右上角分享
0
联系我们:info@booksci.cn Book学术提供免费学术资源搜索服务,方便国内外学者检索中英文文献。致力于提供最便捷和优质的服务体验。 Copyright © 2023 布克学术 All rights reserved.
京ICP备2023020795号-1
ghs 京公网安备 11010802042870号
Book学术文献互助
Book学术文献互助群
群 号:481959085
Book学术官方微信