Articles | Volume 12, issue 10
https://doi.org/10.5194/gmd-12-4275-2019
https://doi.org/10.5194/gmd-12-4275-2019
Methods for assessment of models
 | 
10 Oct 2019
Methods for assessment of models |  | 10 Oct 2019

What should we do when a model crashes? Recommendations for global sensitivity analysis of Earth and environmental systems models

Razi Sheikholeslami, Saman Razavi, and Amin Haghnegahdar

Related authors

A global assessment of nitrogen concentrations using spatiotemporal random forests
Razi Sheikholeslami and Jim W. Hall
Hydrol. Earth Syst. Sci. Discuss., https://doi.org/10.5194/hess-2021-618,https://doi.org/10.5194/hess-2021-618, 2022
Manuscript not accepted for further review
Short summary

Related subject area

Climate and Earth system modeling
INFERNO-peat v1.0.0: a representation of northern high-latitude peat fires in the JULES-INFERNO global fire model
Katie R. Blackford, Matthew Kasoar, Chantelle Burton, Eleanor Burke, Iain Colin Prentice, and Apostolos Voulgarakis
Geosci. Model Dev., 17, 3063–3079, https://doi.org/10.5194/gmd-17-3063-2024,https://doi.org/10.5194/gmd-17-3063-2024, 2024
Short summary
The 4DEnVar-based weakly coupled land data assimilation system for E3SM version 2
Pengfei Shi, L. Ruby Leung, Bin Wang, Kai Zhang, Samson M. Hagos, and Shixuan Zhang
Geosci. Model Dev., 17, 3025–3040, https://doi.org/10.5194/gmd-17-3025-2024,https://doi.org/10.5194/gmd-17-3025-2024, 2024
Short summary
Continental-scale bias-corrected climate and hydrological projections for Australia
Justin Peter, Elisabeth Vogel, Wendy Sharples, Ulrike Bende-Michl, Louise Wilson, Pandora Hope, Andrew Dowdy, Greg Kociuba, Sri Srikanthan, Vi Co Duong, Jake Roussis, Vjekoslav Matic, Zaved Khan, Alison Oke, Margot Turner, Stuart Baron-Hay, Fiona Johnson, Raj Mehrotra, Ashish Sharma, Marcus Thatcher, Ali Azarvinand, Steven Thomas, Ghyslaine Boschat, Chantal Donnelly, and Robert Argent
Geosci. Model Dev., 17, 2755–2781, https://doi.org/10.5194/gmd-17-2755-2024,https://doi.org/10.5194/gmd-17-2755-2024, 2024
Short summary
G6-1.5K-SAI: a new Geoengineering Model Intercomparison Project (GeoMIP) experiment integrating recent advances in solar radiation modification studies
Daniele Visioni, Alan Robock, Jim Haywood, Matthew Henry, Simone Tilmes, Douglas G. MacMartin, Ben Kravitz, Sarah J. Doherty, John Moore, Chris Lennard, Shingo Watanabe, Helene Muri, Ulrike Niemeier, Olivier Boucher, Abu Syed, Temitope S. Egbebiyi, Roland Séférian, and Ilaria Quaglia
Geosci. Model Dev., 17, 2583–2596, https://doi.org/10.5194/gmd-17-2583-2024,https://doi.org/10.5194/gmd-17-2583-2024, 2024
Short summary
Modeling the effects of tropospheric ozone on the growth and yield of global staple crops with DSSAT v4.8.0
Jose Rafael Guarin, Jonas Jägermeyr, Elizabeth A. Ainsworth, Fabio A. A. Oliveira, Senthold Asseng, Kenneth Boote, Joshua Elliott, Lisa Emberson, Ian Foster, Gerrit Hoogenboom, David Kelly, Alex C. Ruane, and Katrina Sharps
Geosci. Model Dev., 17, 2547–2567, https://doi.org/10.5194/gmd-17-2547-2024,https://doi.org/10.5194/gmd-17-2547-2024, 2024
Short summary

Cited articles

Annan, J. D., Hargreaves, J. C., Edwards, N. R., and Marsh, R.: Parameter estimation in an intermediate complexity earth system model using an ensemble Kalman filter, Ocean. Model., 8, 135–154, https://doi.org/10.1016/j.ocemod.2003.12.004, 2005. 
Asadzadeh, M., Razavi, S., Tolson, B. A., and Fay, D.: Pre-emption strategies for efficient multi-objective optimization: Application to the development of Lake Superior regulation plan, Environ. Modell. Softw., 54, 128–141, https://doi.org/10.1016/j.envsoft.2014.01.005, 2014. 
Beretta, L. and Santaniello, A.: Nearest neighbor imputation algorithms: a critical evaluation, BMC Med. Inform. Decis., 16, 74, https://doi.org/10.1186/s12911-016-0318-z, 2016. 
Burnash, R. J. C.: The NWS River forecast system-catchment modeling, in: Computer Models of Watershed Hydrology, edited by: Singh, V. P., Water Resources Publication, Highlands Ranch, Colorado, USA, 311–366, 1995. 
Choudhury, B. J. and Idso, S. B.: An empirical model for stomatal resistance of field-grown wheat, Agr. Forest. Meteorol., 36, 65–82, https://doi.org/10.1016/0168-1923(85)90066-8, 1985. 
Download
Short summary
The ever-growing complexity of Earth and environmental system models can pose many types of software development and implementation issues such as parameter-induced simulation crashes, which are mainly caused by the violation of numerical stability conditions. Here, we introduce a new approach to handle crashed simulations when performing sensitivity analysis. Our results show that this approach can comply well with the dimensionality of the model, sample size, and the number of crashes.