Decomposition of the mean squared error and NSE performance criteria: Implications for improving hydrological modelling

By Hoshin V. Gupta, H. Kling, Koray K. Yilmaz, G. Martinez. 2009

5,372 citations recorded by the source corpus.

The mean squared error (MSE) and the related normalization, the Nash-Sutcliffe efficiency (NSE), are the two criteria most widely used for calibration and evaluation of hydrological models with observed data. Here, we present a diagnostically interesting decomposition of NSE (and hence MSE), which facilitates analysis of the relative importance of its different components in the context of hydrological modelling, and show how model calibration problems can arise due to interactions among these components. The analysis is illustrated by calibrating a simple conceptual precipitation-runoff model to daily data for a number of Austrian basins having a broad range of hydro-meteorological characteristics. Evaluation of the results clearly demonstrates the problems that can be associated with any calibration based on the NSE (or MSE) criterion. While we propose and test an alternative criterion that can help to reduce model calibration problems, the primary purpose of this study is not to present an improved measure of model performance. Instead, we seek to show that there are systematic problems inherent with any optimization based on formulations related to the MSE. The analysis and results have implications to the manner in which we calibrate and evaluate environmental models; we discuss these and suggest possible ways forward that may move us towards an improved and diagnostically meaningful approach to model performance evaluation and identification.

Subfields: Global and Planetary Change, Water Science and Technology

View Paper: https://www.semanticscholar.org/paper/3bed3d2ae40f4b771a3b3da8498803031a49637e

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Global and Planetary Change

  1. Hoshin V. Gupta
  2. Jasper A. Vrugt
  3. M. Clark
  4. William H. Farmer
  5. Dedi Liu
  6. Chaopeng Shen
  7. Hilary K. McMillan
  8. C. Onyutha

In Water Science and Technology

  1. Hoshin V. Gupta
  2. Jasper A. Vrugt
  3. M. Clark
  4. William H. Farmer
  5. Dedi Liu
  6. Chaopeng Shen
  7. Hilary K. McMillan
  8. Richard M. Vogel

Citations in the corpus