Articles | Volume 15, issue 14
https://doi.org/10.5194/gmd-15-5481-2022
https://doi.org/10.5194/gmd-15-5481-2022
Review and perspective paper
 | Highlight paper
 | 
19 Jul 2022
Review and perspective paper | Highlight paper |  | 19 Jul 2022

Root-mean-square error (RMSE) or mean absolute error (MAE): when to use them or not

Timothy O. Hodson

Related subject area

Climate and Earth system modeling
Development of a plant carbon–nitrogen interface coupling framework in a coupled biophysical-ecosystem–biogeochemical model (SSiB5/TRIFFID/DayCent-SOM v1.0)
Zheng Xiang, Yongkang Xue, Weidong Guo, Melannie D. Hartman, Ye Liu, and William J. Parton
Geosci. Model Dev., 17, 6437–6464, https://doi.org/10.5194/gmd-17-6437-2024,https://doi.org/10.5194/gmd-17-6437-2024, 2024
Short summary
Dynamical Madden–Julian Oscillation forecasts using an ensemble subseasonal-to-seasonal forecast system of the IAP-CAS model
Yangke Liu, Qing Bao, Bian He, Xiaofei Wu, Jing Yang, Yimin Liu, Guoxiong Wu, Tao Zhu, Siyuan Zhou, Yao Tang, Ankang Qu, Yalan Fan, Anling Liu, Dandan Chen, Zhaoming Luo, Xing Hu, and Tongwen Wu
Geosci. Model Dev., 17, 6249–6275, https://doi.org/10.5194/gmd-17-6249-2024,https://doi.org/10.5194/gmd-17-6249-2024, 2024
Short summary
Implementation of a brittle sea ice rheology in an Eulerian, finite-difference, C-grid modeling framework: impact on the simulated deformation of sea ice in the Arctic
Laurent Brodeau, Pierre Rampal, Einar Ólason, and Véronique Dansereau
Geosci. Model Dev., 17, 6051–6082, https://doi.org/10.5194/gmd-17-6051-2024,https://doi.org/10.5194/gmd-17-6051-2024, 2024
Short summary
HSW-V v1.0: localized injections of interactive volcanic aerosols and their climate impacts in a simple general circulation model
Joseph P. Hollowed, Christiane Jablonowski, Hunter Y. Brown, Benjamin R. Hillman, Diana L. Bull, and Joseph L. Hart
Geosci. Model Dev., 17, 5913–5938, https://doi.org/10.5194/gmd-17-5913-2024,https://doi.org/10.5194/gmd-17-5913-2024, 2024
Short summary
A 3D-Var assimilation scheme for vertical velocity with CMA-MESO v5.0
Hong Li, Yi Yang, Jian Sun, Yuan Jiang, Ruhui Gan, and Qian Xie
Geosci. Model Dev., 17, 5883–5896, https://doi.org/10.5194/gmd-17-5883-2024,https://doi.org/10.5194/gmd-17-5883-2024, 2024
Short summary

Cited articles

Bernoulli, J.: Ars conjectandi: Usum & applicationem praecedentis doctrinae in civilibus, Moralibus & Oeconomicis, 4, 1713, 1713. a
Boscovich, R. J.: De litteraria expeditione per pontificiam ditionem, et synopsis amplioris operis, ac habentur plura ejus ex exemplaria etiam sensorum impessa, Bononiensi Scientiarum et Artum Instuto Atque Academia Commentarii, 4, 353–396, 1757. a
Box, G. E. and Cox, D. R.: An analysis of transformations, J. Roy. Stat. Soc. B Met., 26, 211–243, 1964. a
Burnham, K. P. and Anderson, D. R.: Kullback–Leibler information as a basis for strong inference in ecological studies, Wildlife Res., 28, 111, https://doi.org/10.1071/wr99107, 2001. a, b, c, d, e
Chai, T. and Draxler, R. R.: Root mean square error (RMSE) or mean absolute error (MAE)? – Arguments against avoiding RMSE in the literature, Geosci. Model Dev., 7, 1247–1250, https://doi.org/10.5194/gmd-7-1247-2014, 2014. a, b, c, d, e, f, g
Executive editor
This is a beautifully written exposition of the properties of two key statistics used in the evalution of models. Everyone working with models should read this paper.
Short summary
The task of evaluating competing models is fundamental to science. Models are evaluated based on an objective function, the choice of which ultimately influences what scientists learn from their observations. The mean absolute error (MAE) and root-mean-squared error (RMSE) are two such functions. Both are widely used, yet there remains enduring confusion over their use. This article reviews the theoretical justification behind their usage, as well as alternatives for when they are not suitable.