{"title":"Evaluation of Performance Measures for Qualifying Flood Models with Satellite Observations","authors":"Jean-Paul Travert, Sébastien Boyaval, Cédric Goeury, Vito Bacchi, Fabrice Zaoui","doi":"arxiv-2408.00571","DOIUrl":null,"url":null,"abstract":"This work discusses how to choose performance measures to compare numerical\nsimulations of a flood event with one satellite image, e.g., in a model\ncalibration or validation procedure. A series of criterion are proposed to\nevaluate the sensitivity of performance measures with respect to the flood\nextent, satellite characteristics (position, orientation), and\nmeasurements/processing errors (satellite raw values or extraction of the flood\nmaps). Their relevance is discussed numerically in the case of one flooding\nevent (on the Garonne River in France in February 2021), using a distribution\nof water depths simulated from a shallow-water model parameterized by an\nuncertain friction field. After identifying the performance measures respecting\nthe most criteria, a correlation analysis is carried out to identify how\nvarious performance measures are similar. Then, a methodology is proposed to\nrank performance measures and select the most robust to observation errors. The\nmethodology is shown useful at identifying four performance measures out of 28\nin the study case. Note that the various top-ranked performance measures do not\nlead to the same calibration result as regards the friction field of the\nshallow-water model. The methodology can be applied to the comparison of any\nflood model with any flood event.","PeriodicalId":501270,"journal":{"name":"arXiv - PHYS - Geophysics","volume":"105 1","pages":""},"PeriodicalIF":0.0000,"publicationDate":"2024-08-01","publicationTypes":"Journal Article","fieldsOfStudy":null,"isOpenAccess":false,"openAccessPdf":"","citationCount":"0","resultStr":null,"platform":"Semanticscholar","paperid":null,"PeriodicalName":"arXiv - PHYS - Geophysics","FirstCategoryId":"1085","ListUrlMain":"https://doi.org/arxiv-2408.00571","RegionNum":0,"RegionCategory":null,"ArticlePicture":[],"TitleCN":null,"AbstractTextCN":null,"PMCID":null,"EPubDate":"","PubModel":"","JCR":"","JCRName":"","Score":null,"Total":0}
引用次数: 0
Abstract
This work discusses how to choose performance measures to compare numerical
simulations of a flood event with one satellite image, e.g., in a model
calibration or validation procedure. A series of criterion are proposed to
evaluate the sensitivity of performance measures with respect to the flood
extent, satellite characteristics (position, orientation), and
measurements/processing errors (satellite raw values or extraction of the flood
maps). Their relevance is discussed numerically in the case of one flooding
event (on the Garonne River in France in February 2021), using a distribution
of water depths simulated from a shallow-water model parameterized by an
uncertain friction field. After identifying the performance measures respecting
the most criteria, a correlation analysis is carried out to identify how
various performance measures are similar. Then, a methodology is proposed to
rank performance measures and select the most robust to observation errors. The
methodology is shown useful at identifying four performance measures out of 28
in the study case. Note that the various top-ranked performance measures do not
lead to the same calibration result as regards the friction field of the
shallow-water model. The methodology can be applied to the comparison of any
flood model with any flood event.