Yuxin Zhao, Dequan Yang, Jianxin He, Kexin Zhu, Xiong Deng
{"title":"用于海面温度预报的分层堆叠时空自关注网络","authors":"Yuxin Zhao, Dequan Yang, Jianxin He, Kexin Zhu, Xiong Deng","doi":"10.1016/j.ocemod.2024.102427","DOIUrl":null,"url":null,"abstract":"<div><p>Sea surface temperature (SST) is a highly complex spatiotemporal variable, which stems from its susceptibility to non-linear dynamical processes and substantial spatiotemporal variability. In particular, accurately forecasting small-scale SST is a formidable challenge due to the compounded effects of diverse physical processes spanning across various scales. In this study, we employ deep learning methods to mine the ocean’s evolutionary patterns, as the ocean’s dynamic mechanisms are inherently embedded in spatiotemporal data. We propose a hierarchical stacked spatiotemporal self-attention mechanism (HSSSA) network architecture. The hierarchical stacked encoder–decoder architecture provides the capability for feature fusion and extraction at different scales. The spatial self-attention and temporal self-attention modules simultaneously focus on information from different spatial locations and time steps, allowing the exploration of spatiotemporal patterns in the complex dynamics of the ocean. The experiments are conducted on a high-resolution East China Sea dataset (<span><math><mrow><mn>1</mn><mo>/</mo><mn>10</mn><mo>°</mo><mo>×</mo><mn>1</mn><mo>/</mo><mn>10</mn><mo>°</mo></mrow></math></span>) to demonstrate the forecast performance of the proposed model for refined ocean variables. The 15-day forecasts indicate that the HSSSA method outperforms the EOF-ARIMA and CNN-Transformer methods.</p></div>","PeriodicalId":19457,"journal":{"name":"Ocean Modelling","volume":"191 ","pages":"Article 102427"},"PeriodicalIF":3.1000,"publicationDate":"2024-08-30","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"Hierarchical stacked spatiotemporal self-attention network for sea surface temperature forecasting\",\"authors\":\"Yuxin Zhao, Dequan Yang, Jianxin He, Kexin Zhu, Xiong Deng\",\"doi\":\"10.1016/j.ocemod.2024.102427\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"<div><p>Sea surface temperature (SST) is a highly complex spatiotemporal variable, which stems from its susceptibility to non-linear dynamical processes and substantial spatiotemporal variability. In particular, accurately forecasting small-scale SST is a formidable challenge due to the compounded effects of diverse physical processes spanning across various scales. In this study, we employ deep learning methods to mine the ocean’s evolutionary patterns, as the ocean’s dynamic mechanisms are inherently embedded in spatiotemporal data. We propose a hierarchical stacked spatiotemporal self-attention mechanism (HSSSA) network architecture. The hierarchical stacked encoder–decoder architecture provides the capability for feature fusion and extraction at different scales. The spatial self-attention and temporal self-attention modules simultaneously focus on information from different spatial locations and time steps, allowing the exploration of spatiotemporal patterns in the complex dynamics of the ocean. The experiments are conducted on a high-resolution East China Sea dataset (<span><math><mrow><mn>1</mn><mo>/</mo><mn>10</mn><mo>°</mo><mo>×</mo><mn>1</mn><mo>/</mo><mn>10</mn><mo>°</mo></mrow></math></span>) to demonstrate the forecast performance of the proposed model for refined ocean variables. The 15-day forecasts indicate that the HSSSA method outperforms the EOF-ARIMA and CNN-Transformer methods.</p></div>\",\"PeriodicalId\":19457,\"journal\":{\"name\":\"Ocean Modelling\",\"volume\":\"191 \",\"pages\":\"Article 102427\"},\"PeriodicalIF\":3.1000,\"publicationDate\":\"2024-08-30\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Ocean Modelling\",\"FirstCategoryId\":\"89\",\"ListUrlMain\":\"https://www.sciencedirect.com/science/article/pii/S1463500324001148\",\"RegionNum\":3,\"RegionCategory\":\"地球科学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q2\",\"JCRName\":\"METEOROLOGY & ATMOSPHERIC SCIENCES\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Ocean Modelling","FirstCategoryId":"89","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1463500324001148","RegionNum":3,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"METEOROLOGY & ATMOSPHERIC SCIENCES","Score":null,"Total":0}
Hierarchical stacked spatiotemporal self-attention network for sea surface temperature forecasting
Sea surface temperature (SST) is a highly complex spatiotemporal variable, which stems from its susceptibility to non-linear dynamical processes and substantial spatiotemporal variability. In particular, accurately forecasting small-scale SST is a formidable challenge due to the compounded effects of diverse physical processes spanning across various scales. In this study, we employ deep learning methods to mine the ocean’s evolutionary patterns, as the ocean’s dynamic mechanisms are inherently embedded in spatiotemporal data. We propose a hierarchical stacked spatiotemporal self-attention mechanism (HSSSA) network architecture. The hierarchical stacked encoder–decoder architecture provides the capability for feature fusion and extraction at different scales. The spatial self-attention and temporal self-attention modules simultaneously focus on information from different spatial locations and time steps, allowing the exploration of spatiotemporal patterns in the complex dynamics of the ocean. The experiments are conducted on a high-resolution East China Sea dataset () to demonstrate the forecast performance of the proposed model for refined ocean variables. The 15-day forecasts indicate that the HSSSA method outperforms the EOF-ARIMA and CNN-Transformer methods.
期刊介绍:
The main objective of Ocean Modelling is to provide rapid communication between those interested in ocean modelling, whether through direct observation, or through analytical, numerical or laboratory models, and including interactions between physical and biogeochemical or biological phenomena. Because of the intimate links between ocean and atmosphere, involvement of scientists interested in influences of either medium on the other is welcome. The journal has a wide scope and includes ocean-atmosphere interaction in various forms as well as pure ocean results. In addition to primary peer-reviewed papers, the journal provides review papers, preliminary communications, and discussions.