TY - JOUR
T1 - Application-based evaluation of multi-basin hydrological models
AU - Du, Yiheng
AU - Olsson, Jonas
AU - Isberg, Kristina
AU - Strömqvist, Johan
AU - Hundecha, Yeshewatesfa
AU - Silva, Benedito Cláudio da
AU - Rafee, Sameh Adib Abou
AU - Fragoso, Carlos Ruberto
AU - Beldring, Stein
AU - Hansen, Anna
AU - Uvo, Cintia Bertacchi
AU - Sörensen, Johanna
PY - 2024
Y1 - 2024
N2 - Hydrological models are generally calibrated and validated using a suite of well-known statistical metrics, which sometimes lack clear connection and tailoring to the local users’ need and therefore limits the evaluation, especially in the case of global climate services. Therefore, in this study, two types of application-based evaluation metrics are introduced, addressing (i) temporal matching of quantile extremes and (ii) relative bias in flow signatures, which supplements commonly used model performance assessment metrics. The introduced metrics are compared to conventional statistical metrics, at seven case study areas across the world, with three model settings representing different datasets and calibrations, generated from the global hydrological model World-Wide HYPE (WW HYPE). The results suggest that different performance results can occur when comparing application-based metrics to conventional ones. This implies that different evaluation metrics reveal models’ capability in various aspects, supporting their application under the corresponding circumstances. Finally, these metrics enable us to propose two model applicability scenarios: generally applicable models and conditionally applicable models. For instance, the WW HYPE with global dataset and local calibration can yield optimal estimates concerning the timing of quantile extremes and temporal variations in flow signatures, despite its suboptimal performance in conventional evaluation metrics. Therefore, it may be considered as a conditionally applicable model which can be used in regions with limited local datasets, supplying reliable information for decision-makers in formulating strategic plans for water resources management.
AB - Hydrological models are generally calibrated and validated using a suite of well-known statistical metrics, which sometimes lack clear connection and tailoring to the local users’ need and therefore limits the evaluation, especially in the case of global climate services. Therefore, in this study, two types of application-based evaluation metrics are introduced, addressing (i) temporal matching of quantile extremes and (ii) relative bias in flow signatures, which supplements commonly used model performance assessment metrics. The introduced metrics are compared to conventional statistical metrics, at seven case study areas across the world, with three model settings representing different datasets and calibrations, generated from the global hydrological model World-Wide HYPE (WW HYPE). The results suggest that different performance results can occur when comparing application-based metrics to conventional ones. This implies that different evaluation metrics reveal models’ capability in various aspects, supporting their application under the corresponding circumstances. Finally, these metrics enable us to propose two model applicability scenarios: generally applicable models and conditionally applicable models. For instance, the WW HYPE with global dataset and local calibration can yield optimal estimates concerning the timing of quantile extremes and temporal variations in flow signatures, despite its suboptimal performance in conventional evaluation metrics. Therefore, it may be considered as a conditionally applicable model which can be used in regions with limited local datasets, supplying reliable information for decision-makers in formulating strategic plans for water resources management.
KW - Application-based metrics
KW - Model evaluation
KW - Quantile extremes
KW - Relative change
U2 - 10.1016/j.jhydrol.2024.131727
DO - 10.1016/j.jhydrol.2024.131727
M3 - Article
AN - SCOPUS:85200753542
SN - 0022-1694
VL - 641
JO - Journal of Hydrology
JF - Journal of Hydrology
M1 - 131727
ER -