{"title":"Ensemble versus deterministic lightning forecast performance at a convective scale over Indian region","authors":"S. Kiran Prasad, Kumarjit Saha, Gauri Shanker, Ashish Routray, Abhijit Sarkar, V.S. Prasad","doi":"10.1016/j.atmosres.2024.107727","DOIUrl":null,"url":null,"abstract":"<div><div>The present study quantifies the improvement achieved in lightning forecast skill of the NCMRWF regional ensemble prediction system (NEPS-R) compared to its deterministic counterpart (CNTL). The lightning forecasts over study regions of East and Northeast India (ENEI) and Peninsular India (PI) during the pre-monsoon season and Central-East and Northeast India (CENEI) during the monsoon season have been verified using lightning observations from the Indian Institute of Tropical Meteorology (IITM) Lightning Detection Network (LDN). The persisting systematic negative bias in deterministic and EPS-based forecasts of the ensemble mean (EnsMean) and ensemble maximum (EnsMax) indicate the lack of spread among the members, supported by the low values of ensemble spread over all the study regions. EnsMean has the lowest RMSE, with a decrease in error ranging from 0.8 % to 2.18 % compared to CNTL. Categorical skill scores indicate that the EPS-based forecasts (EnsMean and EnsMax) are more skillful than the deterministic forecast at all thresholds and lead times. Further, Fractions Skill Score (FSS) establishes the superiority of the ensemble forecasts over the deterministic forecasts, where for threshold >1, EnsMean is skillful at comparatively smaller neighborhood sizes (ENEI and PI ∼68 km; CENEI ∼36 km for day-1) than CNTL (ENEI-116 km; PI-196 km; CENEI-68 km). EnsMax at higher thresholds (>5 and >10) is skillful at lesser neighborhood sizes ranging from 116 to 276 km compared to CNTL (>401 km) for day-1. Hence, skillful re-scaled EPS forecasts based on FSS could provide better guidance for the forecasters. The Continuous Ranked Probability Score of EPS forecasts is lower by around 9 % than the Mean Absolute Error of CNTL forecasts, and the ROC of EPS shows better discrimination of events and non-events compared to CNTL. These highlight the merits of using an EPS over a deterministic system for forecasting a field of high spatial variability, like lightning, and thereby, the use of vast computational resources to run a convective scale EPS is justified.</div></div>","PeriodicalId":8600,"journal":{"name":"Atmospheric Research","volume":"312 ","pages":"Article 107727"},"PeriodicalIF":4.5000,"publicationDate":"2024-10-16","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Atmospheric Research","FirstCategoryId":"89","ListUrlMain":"https://www.sciencedirect.com/science/article/pii/S016980952400509X","RegionNum":2,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q1","JCRName":"METEOROLOGY & ATMOSPHERIC SCIENCES","Score":null,"Total":0}
引用次数: 0
Abstract
The present study quantifies the improvement achieved in lightning forecast skill of the NCMRWF regional ensemble prediction system (NEPS-R) compared to its deterministic counterpart (CNTL). The lightning forecasts over study regions of East and Northeast India (ENEI) and Peninsular India (PI) during the pre-monsoon season and Central-East and Northeast India (CENEI) during the monsoon season have been verified using lightning observations from the Indian Institute of Tropical Meteorology (IITM) Lightning Detection Network (LDN). The persisting systematic negative bias in deterministic and EPS-based forecasts of the ensemble mean (EnsMean) and ensemble maximum (EnsMax) indicate the lack of spread among the members, supported by the low values of ensemble spread over all the study regions. EnsMean has the lowest RMSE, with a decrease in error ranging from 0.8 % to 2.18 % compared to CNTL. Categorical skill scores indicate that the EPS-based forecasts (EnsMean and EnsMax) are more skillful than the deterministic forecast at all thresholds and lead times. Further, Fractions Skill Score (FSS) establishes the superiority of the ensemble forecasts over the deterministic forecasts, where for threshold >1, EnsMean is skillful at comparatively smaller neighborhood sizes (ENEI and PI ∼68 km; CENEI ∼36 km for day-1) than CNTL (ENEI-116 km; PI-196 km; CENEI-68 km). EnsMax at higher thresholds (>5 and >10) is skillful at lesser neighborhood sizes ranging from 116 to 276 km compared to CNTL (>401 km) for day-1. Hence, skillful re-scaled EPS forecasts based on FSS could provide better guidance for the forecasters. The Continuous Ranked Probability Score of EPS forecasts is lower by around 9 % than the Mean Absolute Error of CNTL forecasts, and the ROC of EPS shows better discrimination of events and non-events compared to CNTL. These highlight the merits of using an EPS over a deterministic system for forecasting a field of high spatial variability, like lightning, and thereby, the use of vast computational resources to run a convective scale EPS is justified.
期刊介绍:
The journal publishes scientific papers (research papers, review articles, letters and notes) dealing with the part of the atmosphere where meteorological events occur. Attention is given to all processes extending from the earth surface to the tropopause, but special emphasis continues to be devoted to the physics of clouds, mesoscale meteorology and air pollution, i.e. atmospheric aerosols; microphysical processes; cloud dynamics and thermodynamics; numerical simulation, climatology, climate change and weather modification.