On the Importance of Regime-Specific Evaluations for Numerical Weather Prediction Models as Demonstrated using the High Resolution Rapid Refresh (HRRR) Model
Temple R. Lee, Sandip Pal, Ronald D. Leeper, Tim Wilson, Howard J. Diamond, Tilden P. Meyers, David D. Turner
{"title":"On the Importance of Regime-Specific Evaluations for Numerical Weather Prediction Models as Demonstrated using the High Resolution Rapid Refresh (HRRR) Model","authors":"Temple R. Lee, Sandip Pal, Ronald D. Leeper, Tim Wilson, Howard J. Diamond, Tilden P. Meyers, David D. Turner","doi":"10.1175/waf-d-23-0177.1","DOIUrl":null,"url":null,"abstract":"\nThe scientific literature has many studies evaluating numerical weather prediction (NWP) models. However, many of those studies averaged across a myriad of different atmospheric conditions and surface forcings which can obfuscate the atmospheric conditions when NWP models perform well versus when they perform inadequately. To help isolate these different scenarios, we used observations from the U.S. Climate Reference Network (USCRN) obtained between 1 January and 31 December 2021 to distinguish among different near-surface atmospheric conditions (i.e., different near-surface heating rates (), incoming shortwave radiation (SWd) regimes, and 5-cm soil moisture (SM05)) to evaluate the High-Resolution Rapid Refresh (HRRR) model, which is a 3-km model used for operational weather forecasting in the U.S. On days with small (large) , we found afternoon T biases of about 2°C (−1°C) and afternoon SWd biases of up to 170 W m−2 (100 W m−2), but negligible impacts on SM05 biases. On days with small (large) SWd, we found daytime temperature biases of about 3°C (−2.5°C) and daytime SWd biases of up to 190 W m−2 (80 W m−2). Whereas different SM05 had little impact on T and SWd biases, dry (wet) conditions had positive (negative) SM05 biases. We argue that the proper evaluation of weather forecasting models requires careful consideration of different near-surface atmospheric conditions and is critical to better identifying model deficiencies which supports improvements to the parameterization schemes used therein. A similar, regime-specific model verification approach may also be used to help evaluate other geophysical models.","PeriodicalId":49369,"journal":{"name":"Weather and Forecasting","volume":null,"pages":null},"PeriodicalIF":3.0000,"publicationDate":"2024-03-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"Weather and Forecasting","FirstCategoryId":"89","ListUrlMain":"https://doi.org/10.1175/waf-d-23-0177.1","RegionNum":3,"RegionCategory":"地球科学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q2","JCRName":"METEOROLOGY & ATMOSPHERIC SCIENCES","Score":null,"Total":0}
引用次数: 0
Abstract
The scientific literature has many studies evaluating numerical weather prediction (NWP) models. However, many of those studies averaged across a myriad of different atmospheric conditions and surface forcings which can obfuscate the atmospheric conditions when NWP models perform well versus when they perform inadequately. To help isolate these different scenarios, we used observations from the U.S. Climate Reference Network (USCRN) obtained between 1 January and 31 December 2021 to distinguish among different near-surface atmospheric conditions (i.e., different near-surface heating rates (), incoming shortwave radiation (SWd) regimes, and 5-cm soil moisture (SM05)) to evaluate the High-Resolution Rapid Refresh (HRRR) model, which is a 3-km model used for operational weather forecasting in the U.S. On days with small (large) , we found afternoon T biases of about 2°C (−1°C) and afternoon SWd biases of up to 170 W m−2 (100 W m−2), but negligible impacts on SM05 biases. On days with small (large) SWd, we found daytime temperature biases of about 3°C (−2.5°C) and daytime SWd biases of up to 190 W m−2 (80 W m−2). Whereas different SM05 had little impact on T and SWd biases, dry (wet) conditions had positive (negative) SM05 biases. We argue that the proper evaluation of weather forecasting models requires careful consideration of different near-surface atmospheric conditions and is critical to better identifying model deficiencies which supports improvements to the parameterization schemes used therein. A similar, regime-specific model verification approach may also be used to help evaluate other geophysical models.
期刊介绍:
Weather and Forecasting (WAF) (ISSN: 0882-8156; eISSN: 1520-0434) publishes research that is relevant to operational forecasting. This includes papers on significant weather events, forecasting techniques, forecast verification, model parameterizations, data assimilation, model ensembles, statistical postprocessing techniques, the transfer of research results to the forecasting community, and the societal use and value of forecasts. The scope of WAF includes research relevant to forecast lead times ranging from short-term “nowcasts” through seasonal time scales out to approximately two years.