Ionospheric TEC prediction in low-latitude Indian region during geomagnetic storm periods based on XGBoost with optuna framework and comparison with IRI-Plas 2020
T. Muthukumaran , R. Mukesh , S. Kishore Kumar , Andrew F. Jude , J. Kenisha , G. Cynthia , S. Logesh , Sarat C. Dass , S. Kiruthiga
{"title":"Ionospheric TEC prediction in low-latitude Indian region during geomagnetic storm periods based on XGBoost with optuna framework and comparison with IRI-Plas 2020","authors":"T. Muthukumaran , R. Mukesh , S. Kishore Kumar , Andrew F. Jude , J. Kenisha , G. Cynthia , S. Logesh , Sarat C. Dass , S. Kiruthiga","doi":"10.1016/j.jastp.2025.106606","DOIUrl":null,"url":null,"abstract":"<div><div>This paper introduces a strong 24-h TEC forecast model based on the Extreme Gradient Boosting (XGBoost) algorithm, implemented for GPS-based TEC data at both the IISC and Chum stations. For a better tuning of the model's performance, two hyperparameter tuning approaches—Optuna and Hyperopt—were utilized. The assessment pertains to five primary GS events: the Halloween Storm (2003), St. Patrick's Day Storm (2015), the February 2022 Mother's Day Storm (2024), and yet another GS in 2024. The AI model forecasts were compared against the IRI-PLAS 2020 empirical model on the basis of standard performance measures such as Root Mean Square Error (RMSE), Mean Absolute Percentage Error (MAPE), and Mean Squared Logarithmic Error (MSLE). Results show that the Optuna-tuned XGBoost model always performed better than the IRI-PLAS 2020 model for all GS events. RMSE values for Optuna were considerably lower: 4.7254 for the Halloween Storm versus 8.7335 using IRI-PLAS, 2.8389 versus 17.4692 for St. Patrick's Day, 4.4167 versus 9.9611 for the 2022 storm, 10.8861 versus 16.4781 for the Mother's Day event, and 12.8778 versus 29.8309 for the second 2024 storm. For comparison, the XGBoost model optimized using Hyperopt, tested over the same events, had RMSEs of 14.52, 7.01, 5.19, 6.80 and 14.97, respectively. While Hyperopt outperformed the IRI-PLAS model in each scenario, Optuna produced the best results overall. These results confirm the effectiveness of machine learning, specifically the XGBoost model optimized using Optuna tuning, in observing intricate TEC dynamics during geomagnetic disturbances. The research points out how AI-driven forecasting can dramatically enhance space weather resilience by limiting error in prediction and providing more trustworthy GNSS and communication system functionality under high-impact solar activity.</div></div>","PeriodicalId":15096,"journal":{"name":"Journal of Atmospheric and Solar-Terrestrial Physics","volume":"275 ","pages":"Article 106606"},"PeriodicalIF":1.9000,"publicationDate":"2025-08-14","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Journal of Atmospheric and Solar-Terrestrial Physics","FirstCategoryId":"89","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S1364682625001907","RegionNum":4,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"GEOCHEMISTRY & GEOPHYSICS","Score":null,"Total":0}
引用次数: 0
Abstract
This paper introduces a strong 24-h TEC forecast model based on the Extreme Gradient Boosting (XGBoost) algorithm, implemented for GPS-based TEC data at both the IISC and Chum stations. For a better tuning of the model's performance, two hyperparameter tuning approaches—Optuna and Hyperopt—were utilized. The assessment pertains to five primary GS events: the Halloween Storm (2003), St. Patrick's Day Storm (2015), the February 2022 Mother's Day Storm (2024), and yet another GS in 2024. The AI model forecasts were compared against the IRI-PLAS 2020 empirical model on the basis of standard performance measures such as Root Mean Square Error (RMSE), Mean Absolute Percentage Error (MAPE), and Mean Squared Logarithmic Error (MSLE). Results show that the Optuna-tuned XGBoost model always performed better than the IRI-PLAS 2020 model for all GS events. RMSE values for Optuna were considerably lower: 4.7254 for the Halloween Storm versus 8.7335 using IRI-PLAS, 2.8389 versus 17.4692 for St. Patrick's Day, 4.4167 versus 9.9611 for the 2022 storm, 10.8861 versus 16.4781 for the Mother's Day event, and 12.8778 versus 29.8309 for the second 2024 storm. For comparison, the XGBoost model optimized using Hyperopt, tested over the same events, had RMSEs of 14.52, 7.01, 5.19, 6.80 and 14.97, respectively. While Hyperopt outperformed the IRI-PLAS model in each scenario, Optuna produced the best results overall. These results confirm the effectiveness of machine learning, specifically the XGBoost model optimized using Optuna tuning, in observing intricate TEC dynamics during geomagnetic disturbances. The research points out how AI-driven forecasting can dramatically enhance space weather resilience by limiting error in prediction and providing more trustworthy GNSS and communication system functionality under high-impact solar activity.
期刊介绍:
The Journal of Atmospheric and Solar-Terrestrial Physics (JASTP) is an international journal concerned with the inter-disciplinary science of the Earth''s atmospheric and space environment, especially the highly varied and highly variable physical phenomena that occur in this natural laboratory and the processes that couple them.
The journal covers the physical processes operating in the troposphere, stratosphere, mesosphere, thermosphere, ionosphere, magnetosphere, the Sun, interplanetary medium, and heliosphere. Phenomena occurring in other "spheres", solar influences on climate, and supporting laboratory measurements are also considered. The journal deals especially with the coupling between the different regions.
Solar flares, coronal mass ejections, and other energetic events on the Sun create interesting and important perturbations in the near-Earth space environment. The physics of such "space weather" is central to the Journal of Atmospheric and Solar-Terrestrial Physics and the journal welcomes papers that lead in the direction of a predictive understanding of the coupled system. Regarding the upper atmosphere, the subjects of aeronomy, geomagnetism and geoelectricity, auroral phenomena, radio wave propagation, and plasma instabilities, are examples within the broad field of solar-terrestrial physics which emphasise the energy exchange between the solar wind, the magnetospheric and ionospheric plasmas, and the neutral gas. In the lower atmosphere, topics covered range from mesoscale to global scale dynamics, to atmospheric electricity, lightning and its effects, and to anthropogenic changes.