Articles | Volume 15, issue 14
https://doi.org/10.5194/gmd-15-5481-2022
https://doi.org/10.5194/gmd-15-5481-2022
Review and perspective paper
 | Highlight paper
 | 
19 Jul 2022
Review and perspective paper | Highlight paper |  | 19 Jul 2022

Root-mean-square error (RMSE) or mean absolute error (MAE): when to use them or not

Timothy O. Hodson

Related subject area

Climate and Earth system modeling
Comparing the Performance of Julia on CPUs versus GPUs and Julia-MPI versus Fortran-MPI: a case study with MPAS-Ocean (Version 7.1)
Siddhartha Bishnu, Robert R. Strauss, and Mark R. Petersen
Geosci. Model Dev., 16, 5539–5559, https://doi.org/10.5194/gmd-16-5539-2023,https://doi.org/10.5194/gmd-16-5539-2023, 2023
Short summary
All aboard! Earth system investigations with the CH2O-CHOO TRAIN v1.0
Tyler Kukla, Daniel E. Ibarra, Kimberly V. Lau, and Jeremy K. C. Rugenstein
Geosci. Model Dev., 16, 5515–5538, https://doi.org/10.5194/gmd-16-5515-2023,https://doi.org/10.5194/gmd-16-5515-2023, 2023
Short summary
The Canadian Atmospheric Model version 5 (CanAM5.0.3)
Jason Neil Steven Cole, Knut von Salzen, Jiangnan Li, John Scinocca, David Plummer, Vivek Arora, Norman McFarlane, Michael Lazare, Murray MacKay, and Diana Verseghy
Geosci. Model Dev., 16, 5427–5448, https://doi.org/10.5194/gmd-16-5427-2023,https://doi.org/10.5194/gmd-16-5427-2023, 2023
Short summary
The Teddy tool v1.1: temporal disaggregation of daily climate model data for climate impact analysis
Florian Zabel and Benjamin Poschlod
Geosci. Model Dev., 16, 5383–5399, https://doi.org/10.5194/gmd-16-5383-2023,https://doi.org/10.5194/gmd-16-5383-2023, 2023
Short summary
Assimilation of the AMSU-A radiances using the CESM (v2.1.0) and the DART (v9.11.13)–RTTOV (v12.3)
Young-Chan Noh, Yonghan Choi, Hyo-Jong Song, Kevin Raeder, Joo-Hong Kim, and Youngchae Kwon
Geosci. Model Dev., 16, 5365–5382, https://doi.org/10.5194/gmd-16-5365-2023,https://doi.org/10.5194/gmd-16-5365-2023, 2023
Short summary

Cited articles

Bernoulli, J.: Ars conjectandi: Usum & applicationem praecedentis doctrinae in civilibus, Moralibus & Oeconomicis, 4, 1713, 1713. a
Boscovich, R. J.: De litteraria expeditione per pontificiam ditionem, et synopsis amplioris operis, ac habentur plura ejus ex exemplaria etiam sensorum impessa, Bononiensi Scientiarum et Artum Instuto Atque Academia Commentarii, 4, 353–396, 1757. a
Box, G. E. and Cox, D. R.: An analysis of transformations, J. Roy. Stat. Soc. B Met., 26, 211–243, 1964. a
Burnham, K. P. and Anderson, D. R.: Kullback–Leibler information as a basis for strong inference in ecological studies, Wildlife Res., 28, 111, https://doi.org/10.1071/wr99107, 2001. a, b, c, d, e
Chai, T. and Draxler, R. R.: Root mean square error (RMSE) or mean absolute error (MAE)? – Arguments against avoiding RMSE in the literature, Geosci. Model Dev., 7, 1247–1250, https://doi.org/10.5194/gmd-7-1247-2014, 2014. a, b, c, d, e, f, g
Executive editor
This is a beautifully written exposition of the properties of two key statistics used in the evalution of models. Everyone working with models should read this paper.
Short summary
The task of evaluating competing models is fundamental to science. Models are evaluated based on an objective function, the choice of which ultimately influences what scientists learn from their observations. The mean absolute error (MAE) and root-mean-squared error (RMSE) are two such functions. Both are widely used, yet there remains enduring confusion over their use. This article reviews the theoretical justification behind their usage, as well as alternatives for when they are not suitable.