Journal cover Journal topic
Geoscientific Model Development An interactive open-access journal of the European Geosciences Union
Journal topic

Journal metrics

IF value: 5.240
IF5.240
IF 5-year value: 5.768
IF 5-year
5.768
CiteScore value: 8.9
CiteScore
8.9
SNIP value: 1.713
SNIP1.713
IPP value: 5.53
IPP5.53
SJR value: 3.18
SJR3.18
Scimago H <br class='widget-line-break'>index value: 71
Scimago H
index
71
h5-index value: 51
h5-index51
Volume 6, issue 4
Geosci. Model Dev., 6, 1157–1171, 2013
https://doi.org/10.5194/gmd-6-1157-2013
© Author(s) 2013. This work is distributed under
the Creative Commons Attribution 3.0 License.
Geosci. Model Dev., 6, 1157–1171, 2013
https://doi.org/10.5194/gmd-6-1157-2013
© Author(s) 2013. This work is distributed under
the Creative Commons Attribution 3.0 License.

Methods for assessment of models 07 Aug 2013

Methods for assessment of models | 07 Aug 2013

Failure analysis of parameter-induced simulation crashes in climate models

D. D. Lucas1, R. Klein1,2, J. Tannahill1, D. Ivanova1, S. Brandon1, D. Domyancic1, and Y. Zhang1 D. D. Lucas et al.
  • 1Lawrence Livermore National Laboratory, Livermore, CA, USA
  • 2Department of Astronomy, University of California, Berkeley, CA 94720, USA

Abstract. Simulations using IPCC (Intergovernmental Panel on Climate Change)-class climate models are subject to fail or crash for a variety of reasons. Quantitative analysis of the failures can yield useful insights to better understand and improve the models. During the course of uncertainty quantification (UQ) ensemble simulations to assess the effects of ocean model parameter uncertainties on climate simulations, we experienced a series of simulation crashes within the Parallel Ocean Program (POP2) component of the Community Climate System Model (CCSM4). About 8.5% of our CCSM4 simulations failed for numerical reasons at combinations of POP2 parameter values. We applied support vector machine (SVM) classification from machine learning to quantify and predict the probability of failure as a function of the values of 18 POP2 parameters. A committee of SVM classifiers readily predicted model failures in an independent validation ensemble, as assessed by the area under the receiver operating characteristic (ROC) curve metric (AUC > 0.96). The causes of the simulation failures were determined through a global sensitivity analysis. Combinations of 8 parameters related to ocean mixing and viscosity from three different POP2 parameterizations were the major sources of the failures. This information can be used to improve POP2 and CCSM4 by incorporating correlations across the relevant parameters. Our method can also be used to quantify, predict, and understand simulation crashes in other complex geoscientific models.

Publications Copernicus
Download
Citation