Pengchao Yan, Xuebao Li, Yanfang Zheng, Liang Dong, Shuainan Yan, Shunhuang Zhang, Hongwei Ye, Xuefeng Li, Yongshang Lü, Yi Ling, Xusheng Huang, Yexin Pan
{"title":"A real-time solar flare forecasting system with deep learning methods","authors":"Pengchao Yan, Xuebao Li, Yanfang Zheng, Liang Dong, Shuainan Yan, Shunhuang Zhang, Hongwei Ye, Xuefeng Li, Yongshang Lü, Yi Ling, Xusheng Huang, Yexin Pan","doi":"10.1007/s10509-024-04374-8","DOIUrl":null,"url":null,"abstract":"<div><p>In this study, we develop five deep learning models, a Convolutional Neural Network (CNN) model, a CNN model with Squeeze-and-Excitation Attention(CNN-SE), a CNN model with Convolutional Block Attention Module (CNN-CBAM), a CNN model with Efficient Channel Attention (CNN-ECA), and a Vision Transformer (ViT) model, for predicting whether ≥C or ≥M-class solar flares occurring within 24 hours. We build a real-time forecasting system using these five models, which can achieve classification and probability forecasting. The 10-fold cross-validation sets are generated in chronological order using the full-disk magnetograms provided by the <i>Solar Dynamics Observatory</i>/<i>Helioseismic and Magnetic Imager</i> at 00:00 UT from May 1, 2010, to March 31, 2023. Then after training, validation, and testing our models, we compare the results with the true skill statistic (TSS) and Brier Skill Score (BSS) as assessment metrics. The major results are as follows: (1) There are no statistically significant differences in TSS and BSS performance between models with attention mechanisms and the CNN model. (2) For ≥C-class flare prediction, the Recall of the ViT model reaches 0.833, significantly better than that of the CNN model. For ≥M-class flare prediction, the Recall of the CNN-ECA and ViT models are 0.799 and 0.855, respectively, which are significantly higher than those of the CNN model. (3) We develop a full-disk solar flare prediction system that has been running since May 1, 2023. By December 31, all five models achieve a TSS of 0.984 for predicting ≥C-class flares, with the CNN-SE model demonstrating a BSS of 0.939. For ≥M-class flares, the CNN-SE model achieves a TSS of 0.304, while the BSS values for the CNN and CNN-SE models are 0.019 and 0.018, respectively. Additionally, the prediction performance for ≥M-class flares on the testing set without No-flare class samples, is similar to that of real-time predictions, validating the good generation performance of the model in real-time forecasting.</p></div>","PeriodicalId":8644,"journal":{"name":"Astrophysics and Space Science","volume":"369 10","pages":""},"PeriodicalIF":1.8000,"publicationDate":"2024-10-28","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Astrophysics and Space Science","FirstCategoryId":"101","ListUrlMain":"https://link.springer.com/article/10.1007/s10509-024-04374-8","RegionNum":4,"RegionCategory":"物理与天体物理","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"ASTRONOMY & ASTROPHYSICS","Score":null,"Total":0}
引用次数: 0
Abstract
In this study, we develop five deep learning models, a Convolutional Neural Network (CNN) model, a CNN model with Squeeze-and-Excitation Attention(CNN-SE), a CNN model with Convolutional Block Attention Module (CNN-CBAM), a CNN model with Efficient Channel Attention (CNN-ECA), and a Vision Transformer (ViT) model, for predicting whether ≥C or ≥M-class solar flares occurring within 24 hours. We build a real-time forecasting system using these five models, which can achieve classification and probability forecasting. The 10-fold cross-validation sets are generated in chronological order using the full-disk magnetograms provided by the Solar Dynamics Observatory/Helioseismic and Magnetic Imager at 00:00 UT from May 1, 2010, to March 31, 2023. Then after training, validation, and testing our models, we compare the results with the true skill statistic (TSS) and Brier Skill Score (BSS) as assessment metrics. The major results are as follows: (1) There are no statistically significant differences in TSS and BSS performance between models with attention mechanisms and the CNN model. (2) For ≥C-class flare prediction, the Recall of the ViT model reaches 0.833, significantly better than that of the CNN model. For ≥M-class flare prediction, the Recall of the CNN-ECA and ViT models are 0.799 and 0.855, respectively, which are significantly higher than those of the CNN model. (3) We develop a full-disk solar flare prediction system that has been running since May 1, 2023. By December 31, all five models achieve a TSS of 0.984 for predicting ≥C-class flares, with the CNN-SE model demonstrating a BSS of 0.939. For ≥M-class flares, the CNN-SE model achieves a TSS of 0.304, while the BSS values for the CNN and CNN-SE models are 0.019 and 0.018, respectively. Additionally, the prediction performance for ≥M-class flares on the testing set without No-flare class samples, is similar to that of real-time predictions, validating the good generation performance of the model in real-time forecasting.
期刊介绍:
Astrophysics and Space Science publishes original contributions and invited reviews covering the entire range of astronomy, astrophysics, astrophysical cosmology, planetary and space science and the astrophysical aspects of astrobiology. This includes both observational and theoretical research, the techniques of astronomical instrumentation and data analysis and astronomical space instrumentation. We particularly welcome papers in the general fields of high-energy astrophysics, astrophysical and astrochemical studies of the interstellar medium including star formation, planetary astrophysics, the formation and evolution of galaxies and the evolution of large scale structure in the Universe. Papers in mathematical physics or in general relativity which do not establish clear astrophysical applications will no longer be considered.
The journal also publishes topically selected special issues in research fields of particular scientific interest. These consist of both invited reviews and original research papers. Conference proceedings will not be considered. All papers published in the journal are subject to thorough and strict peer-reviewing.
Astrophysics and Space Science features short publication times after acceptance and colour printing free of charge.