{"title":"观测范围调整法:在模型评估中考虑观测不确定性的新方法","authors":"J P Evans and H M Imran","doi":"10.1088/2515-7620/ad5ad8","DOIUrl":null,"url":null,"abstract":"Model evaluations are performed by comparing a modelled quantity with an observation of that quantity and any deviation from this observed quantity is considered an error. We know that all observing systems have uncertainties, and multiple observational products for the same quantity can provide equally plausible ‘truths’. Thus, model errors depend on the choice of observation used in the evaluation exercise. We propose a method that considers models to be indistinguishable from observations when they lie within the range of observations, and hence are not assigned any error. Errors are assigned when models are outside the observational range. Errors calculated in this way can be used within traditional statistics to calculate the Observation Range Adjusted (ORA) version of that statistic. The ORA statistics highlight the measurable errors of models, provide more robust model performance rankings, and identify areas of the model where further model development is likely to lead to consistent model improvements.","PeriodicalId":48496,"journal":{"name":"Environmental Research Communications","volume":null,"pages":null},"PeriodicalIF":2.5000,"publicationDate":"2024-07-02","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":"{\"title\":\"The observation range adjusted method: a novel approach to accounting for observation uncertainty in model evaluation\",\"authors\":\"J P Evans and H M Imran\",\"doi\":\"10.1088/2515-7620/ad5ad8\",\"DOIUrl\":null,\"url\":null,\"abstract\":\"Model evaluations are performed by comparing a modelled quantity with an observation of that quantity and any deviation from this observed quantity is considered an error. We know that all observing systems have uncertainties, and multiple observational products for the same quantity can provide equally plausible ‘truths’. Thus, model errors depend on the choice of observation used in the evaluation exercise. We propose a method that considers models to be indistinguishable from observations when they lie within the range of observations, and hence are not assigned any error. Errors are assigned when models are outside the observational range. Errors calculated in this way can be used within traditional statistics to calculate the Observation Range Adjusted (ORA) version of that statistic. The ORA statistics highlight the measurable errors of models, provide more robust model performance rankings, and identify areas of the model where further model development is likely to lead to consistent model improvements.\",\"PeriodicalId\":48496,\"journal\":{\"name\":\"Environmental Research Communications\",\"volume\":null,\"pages\":null},\"PeriodicalIF\":2.5000,\"publicationDate\":\"2024-07-02\",\"publicationTypes\":\"Journal Article\",\"fieldsOfStudy\":null,\"isOpenAccess\":false,\"openAccessPdf\":\"\",\"citationCount\":\"0\",\"resultStr\":null,\"platform\":\"Semanticscholar\",\"paperid\":null,\"PeriodicalName\":\"Environmental Research Communications\",\"FirstCategoryId\":\"93\",\"ListUrlMain\":\"https://doi.org/10.1088/2515-7620/ad5ad8\",\"RegionNum\":4,\"RegionCategory\":\"环境科学与生态学\",\"ArticlePicture\":[],\"TitleCN\":null,\"AbstractTextCN\":null,\"PMCID\":null,\"EPubDate\":\"\",\"PubModel\":\"\",\"JCR\":\"Q3\",\"JCRName\":\"ENVIRONMENTAL SCIENCES\",\"Score\":null,\"Total\":0}","platform":"Semanticscholar","paperid":null,"PeriodicalName":"Environmental Research Communications","FirstCategoryId":"93","ListUrlMain":"https://doi.org/10.1088/2515-7620/ad5ad8","RegionNum":4,"RegionCategory":"环境科学与生态学","ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"Q3","JCRName":"ENVIRONMENTAL SCIENCES","Score":null,"Total":0}
The observation range adjusted method: a novel approach to accounting for observation uncertainty in model evaluation
Model evaluations are performed by comparing a modelled quantity with an observation of that quantity and any deviation from this observed quantity is considered an error. We know that all observing systems have uncertainties, and multiple observational products for the same quantity can provide equally plausible ‘truths’. Thus, model errors depend on the choice of observation used in the evaluation exercise. We propose a method that considers models to be indistinguishable from observations when they lie within the range of observations, and hence are not assigned any error. Errors are assigned when models are outside the observational range. Errors calculated in this way can be used within traditional statistics to calculate the Observation Range Adjusted (ORA) version of that statistic. The ORA statistics highlight the measurable errors of models, provide more robust model performance rankings, and identify areas of the model where further model development is likely to lead to consistent model improvements.