Articles | Volume 6, issue 4
https://doi.org/10.5194/gmd-6-1157-2013
© Author(s) 2013. This work is distributed under
the Creative Commons Attribution 3.0 License.
the Creative Commons Attribution 3.0 License.
https://doi.org/10.5194/gmd-6-1157-2013
© Author(s) 2013. This work is distributed under
the Creative Commons Attribution 3.0 License.
the Creative Commons Attribution 3.0 License.
Methods for assessment of models
| 
07 Aug 2013
Methods for assessment of models |
| 07 Aug 2013
Failure analysis of parameter-induced simulation crashes in climate models
D. D. Lucas
Lawrence Livermore National Laboratory, Livermore, CA, USA
R. Klein
Lawrence Livermore National Laboratory, Livermore, CA, USA
Department of Astronomy, University of California, Berkeley, CA 94720, USA
J. Tannahill
Lawrence Livermore National Laboratory, Livermore, CA, USA
D. Ivanova
Lawrence Livermore National Laboratory, Livermore, CA, USA
S. Brandon
Lawrence Livermore National Laboratory, Livermore, CA, USA
D. Domyancic
Lawrence Livermore National Laboratory, Livermore, CA, USA
Y. Zhang
Lawrence Livermore National Laboratory, Livermore, CA, USA
Related authors
Donald D. Lucas, Matthew Simpson, Philip Cameron-Smith, and Ronald L. Baskett
Atmos. Chem. Phys., 17, 13521–13543, https://doi.org/10.5194/acp-17-13521-2017, https://doi.org/10.5194/acp-17-13521-2017, 2017
Short summary
Short summary
Monte Carlo ensemble simulations, Bayesian inversion, and machine learning are used to quantify uncertainty in the atmospheric transport and emissions of a controlled tracer released from a nuclear power plant. Uncertainty of different settings in a weather model and source terms in a dispersion model are jointly estimated. The algorithm is validated using model-generated output and field observations and can benefit atmospheric researchers who need to estimate tracer transport uncertainty.
D. D. Lucas, C. Yver Kwok, P. Cameron-Smith, H. Graven, D. Bergmann, T. P. Guilderson, R. Weiss, and R. Keeling
Geosci. Instrum. Method. Data Syst., 4, 121–137, https://doi.org/10.5194/gi-4-121-2015, https://doi.org/10.5194/gi-4-121-2015, 2015
Short summary
Short summary
Multiobjective optimization is used to design Pareto optimal greenhouse gas (GHG) observing networks. A prototype GHG network is designed to optimize scientific performance and measurement costs. The Pareto frontier is convex, showing the trade-offs between performance and cost and the diminishing returns in trading one for the other. Other objectives and constraints that are important in the design of practical GHG monitoring networks can be incorporated into our method.
C. E. Yver, H. D. Graven, D. D. Lucas, P. J. Cameron-Smith, R. F. Keeling, and R. F. Weiss
Atmos. Chem. Phys., 13, 1837–1852, https://doi.org/10.5194/acp-13-1837-2013, https://doi.org/10.5194/acp-13-1837-2013, 2013
Donald D. Lucas, Matthew Simpson, Philip Cameron-Smith, and Ronald L. Baskett
Atmos. Chem. Phys., 17, 13521–13543, https://doi.org/10.5194/acp-17-13521-2017, https://doi.org/10.5194/acp-17-13521-2017, 2017
Short summary
Short summary
Monte Carlo ensemble simulations, Bayesian inversion, and machine learning are used to quantify uncertainty in the atmospheric transport and emissions of a controlled tracer released from a nuclear power plant. Uncertainty of different settings in a weather model and source terms in a dispersion model are jointly estimated. The algorithm is validated using model-generated output and field observations and can benefit atmospheric researchers who need to estimate tracer transport uncertainty.
D. D. Lucas, C. Yver Kwok, P. Cameron-Smith, H. Graven, D. Bergmann, T. P. Guilderson, R. Weiss, and R. Keeling
Geosci. Instrum. Method. Data Syst., 4, 121–137, https://doi.org/10.5194/gi-4-121-2015, https://doi.org/10.5194/gi-4-121-2015, 2015
Short summary
Short summary
Multiobjective optimization is used to design Pareto optimal greenhouse gas (GHG) observing networks. A prototype GHG network is designed to optimize scientific performance and measurement costs. The Pareto frontier is convex, showing the trade-offs between performance and cost and the diminishing returns in trading one for the other. Other objectives and constraints that are important in the design of practical GHG monitoring networks can be incorporated into our method.
C. E. Yver, H. D. Graven, D. D. Lucas, P. J. Cameron-Smith, R. F. Keeling, and R. F. Weiss
Atmos. Chem. Phys., 13, 1837–1852, https://doi.org/10.5194/acp-13-1837-2013, https://doi.org/10.5194/acp-13-1837-2013, 2013
Related subject area
Climate and Earth system modeling
Porting the WAVEWATCH III (v6.07) wave action source terms to GPU
Yeti 1.0: a generalized framework for constructing bottom-up emission inventories from traffic sources at road-link resolutions
Analysis of systematic biases in tropospheric hydrostatic delay models and construction of a correction model
A new precipitation emulator (PREMU v1.0) for lower-complexity models
Simulating marine neodymium isotope distributions using Nd v1.0 coupled to the ocean component of the FAMOUS–MOSES1 climate model: sensitivities to reversible scavenging efficiency and benthic source distributions
CMIP6 simulations with the compact Earth system model OSCAR v3.1
Application of a satellite-retrieved sheltering parameterization (v1.0) for dust event simulation with WRF-Chem v4.1
The pseudo-global-warming (PGW) approach: methodology, software package PGW4ERA5 v1.1, validation, and sensitivity analyses
AttentionFire_v1.0: interpretable machine learning fire model for burned-area predictions over tropics
Cell tracking of convective rainfall: sensitivity of climate-change signal to tracking algorithm and cell definition (Cell-TAO v1.0)
ICON-Sapphire: simulating the components of the Earth system and their interactions at kilometer and subkilometer scales
Ocean Modeling with Adaptive REsolution (OMARE; version 1.0) – refactoring the NEMO model (version 4.0.1) with the parallel computing framework of JASMIN – Part 1: Adaptive grid refinement in an idealized double-gyre case
Monthly-scale extended predictions using the atmospheric model coupled with a slab ocean
stoPET v1.0: a stochastic potential evapotranspiration generator for simulation of climate change impacts
URANOS v1.0 – the Ultra Rapid Adaptable Neutron-Only Simulation for Environmental Research
Combining regional mesh refinement with vertically enhanced physics to target marine stratocumulus biases as demonstrated in the Energy Exascale Earth System Model version 1
Evaluation of native Earth system model output with ESMValTool v2.6.0
WRF–ML v1.0: a bridge between WRF v4.3 and machine learning parameterizations and its application to atmospheric radiative transfer
The Euro-Mediterranean Center on Climate Change (CMCC) decadal prediction system
Climate impacts of parameterizing subgrid variation and partitioning of land surface heat fluxes to the atmosphere with the NCAR CESM1.2
Accelerated photosynthesis routine in LPJmL4
Improving scalability of Earth system models through coarse-grained component concurrency – a case study with the ICON v2.6.5 modelling system
Temperature forecasting by deep learning methods
Pathfinder v1.0.1: a Bayesian-inferred simple carbon–climate model to explore climate change scenarios
Inclusion of a cold hardening scheme to represent frost tolerance is essential to model realistic plant hydraulics in the Arctic–boreal zone in CLM5.0-FATES-Hydro
Climate change projections of wet and dry extreme events in the Upper Jhelum Basin using a multivariate drought index: Evaluation of bias correction
Implementation and evaluation of the GEOS-Chem chemistry module version 13.1.2 within the Community Earth System Model v2.1
Understanding AMOC stability: the North Atlantic Hosing Model Intercomparison Project
Assessment of JSBACHv4.30 as a land component of ICON-ESM-V1 in comparison to its predecessor JSBACHv3.2 of MPI-ESM1.2
Importance of Ice Nucleation and Precipitation on Climate with the Parameterization of Unified Microphysics Across Scales version 1 (PUMASv1)
Global biomass burning fuel consumption and emissions at 500 m spatial resolution based on the Global Fire Emissions Database (GFED)
Impact of increased resolution on the representation of the Canary upwelling system in climate models
Assessing Responses and Impacts of Solar climate intervention on the Earth system with stratospheric aerosol injection (ARISE-SAI): protocol and initial results from the first simulations
Introducing the VIIRS-based Fire Emission Inventory version 0 (VFEIv0)
Impact of physical parameterizations on wind simulation with WRF V3.9.1.1 under stable conditions at planetary boundary layer gray-zone resolution: a case study over the coastal regions of North China
Advancing precipitation prediction using a new-generation storm-resolving model framework – SIMA-MPAS (V1.0): a case study over the western United States
SURFER v2.0: a flexible and simple model linking anthropogenic CO2 emissions and solar radiation modification to ocean acidification and sea level rise
A new bootstrap technique to quantify uncertainty in estimates of ground surface temperature and ground heat flux histories from geothermal data
Modeling the topographic influence on aboveground biomass using a coupled model of hillslope hydrology and ecosystem dynamics
Impacts of the ice-particle size distribution shape parameter on climate simulations with the Community Atmosphere Model Version 6 (CAM6)
A modeling framework to understand historical and projected ocean climate change in large coupled ensembles
TriCCo v1.1.0 – a cubulation-based method for computing connected components on triangular grids
Estimation of missing building height in OpenStreetMap data: a French case study using GeoClimate 0.0.1
The Moist Quasi-Geostrophic Coupled Model: MQ-GCM 2.0
Pace v0.1: A Python-based Performance-Portable Implementation of the FV3 Dynamical Core
Transport parameterization of the Polar SWIFT model (version 2)
Effects of complex terrain on the shortwave radiative balance: A sub–grid scale parameterization for the GFDL Land Model version 4.2
Analog data assimilation for the selection of suitable general circulation models
Uncertainty and sensitivity analysis for probabilistic weather and climate-risk modelling: an implementation in CLIMADA v.3.1.0
Grid refinement in ICON v2.6.4
Olawale James Ikuyajolu, Luke Van Roekel, Steven R. Brus, Erin E. Thomas, Yi Deng, and Sarat Sreepathi
Geosci. Model Dev., 16, 1445–1458, https://doi.org/10.5194/gmd-16-1445-2023, https://doi.org/10.5194/gmd-16-1445-2023, 2023
Short summary
Short summary
Wind-generated waves play an important role in modifying physical processes at the air–sea interface, but they have been traditionally excluded from climate models due to the high computational cost of running spectral wave models for climate simulations. To address this, our work identified and accelerated the computationally intensive section of WAVEWATCH III on GPU using OpenACC. This allows for high-resolution modeling of atmosphere–wave–ocean feedbacks in century-scale climate integrations.
Edward C. Chan, Joana Leitão, Andreas Kerschbaumer, and Timothy M. Butler
Geosci. Model Dev., 16, 1427–1444, https://doi.org/10.5194/gmd-16-1427-2023, https://doi.org/10.5194/gmd-16-1427-2023, 2023
Short summary
Short summary
Yeti is a Handbook Emission Factors for Road Transport-based traffic emission inventory written in the Python 3 scripting language, which adopts a generalized treatment for activity data using traffic information of varying levels of detail introduced in a systematic and consistent manner, with the ability to maximize reusability. Thus, Yeti has been conceived and implemented with a high degree of data and process symmetry, allowing scalable and flexible execution while affording ease of use.
Haopeng Fan, Siran Li, Zhongmiao Sun, Guorui Xiao, Xinxing Li, and Xiaogang Liu
Geosci. Model Dev., 16, 1345–1358, https://doi.org/10.5194/gmd-16-1345-2023, https://doi.org/10.5194/gmd-16-1345-2023, 2023
Short summary
Short summary
The traditional tropospheric zenith hydrostatic delay (ZHD) model's bias is usually thought negligible, yet it still reaches 10 mm sometimes and would lead to millimeter-level position errors for space geodetic observations. Therefore, we analyzed the bias’ characteristics and present a grid model to correct the traditional ZHD formula. When verifying the efficiency based on data from the ECMWF (European Centre for Medium-Range Weather Forecasts), ZHD biases were rectified by ~50 %.
Gang Liu, Shushi Peng, Chris Huntingford, and Yi Xi
Geosci. Model Dev., 16, 1277–1296, https://doi.org/10.5194/gmd-16-1277-2023, https://doi.org/10.5194/gmd-16-1277-2023, 2023
Short summary
Short summary
Due to computational limits, lower-complexity models (LCMs) were developed as a complementary tool for accelerating comprehensive Earth system models (ESMs) but still lack a good precipitation emulator for LCMs. Here, we developed a data-calibrated precipitation emulator (PREMU), a computationally effective way to better estimate historical and simulated precipitation by current ESMs. PREMU has potential applications related to land surface processes and their interactions with climate change.
Suzanne Robinson, Ruza F. Ivanovic, Lauren J. Gregoire, Julia Tindall, Tina van de Flierdt, Yves Plancherel, Frerk Pöppelmeier, Kazuyo Tachikawa, and Paul J. Valdes
Geosci. Model Dev., 16, 1231–1264, https://doi.org/10.5194/gmd-16-1231-2023, https://doi.org/10.5194/gmd-16-1231-2023, 2023
Short summary
Short summary
We present the implementation of neodymium (Nd) isotopes into the ocean model of FAMOUS (Nd v1.0). Nd fluxes from seafloor sediment and incorporation of Nd onto sinking particles represent the major global sources and sinks, respectively. However, model–data mismatch in the North Pacific and northern North Atlantic suggest that certain reactive components of the sediment interact the most with seawater. Our results are important for interpreting Nd isotopes in terms of ocean circulation.
Yann Quilcaille, Thomas Gasser, Philippe Ciais, and Olivier Boucher
Geosci. Model Dev., 16, 1129–1161, https://doi.org/10.5194/gmd-16-1129-2023, https://doi.org/10.5194/gmd-16-1129-2023, 2023
Short summary
Short summary
The model OSCAR is a simple climate model, meaning its representation of the Earth system is simplified but calibrated on models of higher complexity. Here, we diagnose its latest version using a total of 99 experiments in a probabilistic framework and under observational constraints. OSCAR v3.1 shows good agreement with observations, complex Earth system models and emerging properties. Some points for improvements are identified, such as the ocean carbon cycle.
Sandra L. LeGrand, Theodore W. Letcher, Gregory S. Okin, Nicholas P. Webb, Alex R. Gallagher, Saroj Dhital, Taylor S. Hodgdon, Nancy P. Ziegler, and Michelle L. Michaels
Geosci. Model Dev., 16, 1009–1038, https://doi.org/10.5194/gmd-16-1009-2023, https://doi.org/10.5194/gmd-16-1009-2023, 2023
Short summary
Short summary
Ground cover affects dust emissions by reducing wind flow over the immediate soil surface. This study reviews a method for estimating ground cover effects on wind erosion from satellite-detected terrain shadows. We conducted a case study for a US dust event using the Weather Research and Forecasting with Chemistry (WRF-Chem) model. Adding the shadow-based method for ground cover effects markedly improved simulated results and may lead to better dust modeling outcomes in vegetated drylands.
Roman Brogli, Christoph Heim, Jonas Mensch, Silje Lund Sørland, and Christoph Schär
Geosci. Model Dev., 16, 907–926, https://doi.org/10.5194/gmd-16-907-2023, https://doi.org/10.5194/gmd-16-907-2023, 2023
Short summary
Short summary
The pseudo-global-warming (PGW) approach is a downscaling methodology that imposes the large-scale GCM-based climate change signal on the boundary conditions of a regional climate simulation. It offers several benefits in comparison to conventional downscaling. We present a detailed description of the methodology, provide companion software to facilitate the preparation of PGW simulations, and present validation and sensitivity studies.
Fa Li, Qing Zhu, William J. Riley, Lei Zhao, Li Xu, Kunxiaojia Yuan, Min Chen, Huayi Wu, Zhipeng Gui, Jianya Gong, and James T. Randerson
Geosci. Model Dev., 16, 869–884, https://doi.org/10.5194/gmd-16-869-2023, https://doi.org/10.5194/gmd-16-869-2023, 2023
Short summary
Short summary
We developed an interpretable machine learning model to predict sub-seasonal and near-future wildfire-burned area over African and South American regions. We found strong time-lagged controls (up to 6–8 months) of local climate wetness on burned areas. A skillful use of such time-lagged controls in machine learning models results in highly accurate predictions of wildfire-burned areas; this will also help develop relevant early-warning and management systems for tropical wildfires.
Edmund P. Meredith, Uwe Ulbrich, and Henning W. Rust
Geosci. Model Dev., 16, 851–867, https://doi.org/10.5194/gmd-16-851-2023, https://doi.org/10.5194/gmd-16-851-2023, 2023
Short summary
Short summary
Cell-tracking algorithms allow for the study of properties of a convective cell across its lifetime and, in particular, how these respond to climate change. We investigated whether the design of the algorithm can affect the magnitude of the climate-change signal. The algorithm's criteria for identifying a cell were found to have a strong impact on the warming response. The sensitivity of the warming response to different algorithm settings and cell types should thus be fully explored.
Cathy Hohenegger, Peter Korn, Leonidas Linardakis, René Redler, Reiner Schnur, Panagiotis Adamidis, Jiawei Bao, Swantje Bastin, Milad Behravesh, Martin Bergemann, Joachim Biercamp, Hendryk Bockelmann, Renate Brokopf, Nils Brüggemann, Lucas Casaroli, Fatemeh Chegini, George Datseris, Monika Esch, Geet George, Marco Giorgetta, Oliver Gutjahr, Helmuth Haak, Moritz Hanke, Tatiana Ilyina, Thomas Jahns, Johann Jungclaus, Marcel Kern, Daniel Klocke, Lukas Kluft, Tobias Kölling, Luis Kornblueh, Sergey Kosukhin, Clarissa Kroll, Junhong Lee, Thorsten Mauritsen, Carolin Mehlmann, Theresa Mieslinger, Ann Kristin Naumann, Laura Paccini, Angel Peinado, Divya Sri Praturi, Dian Putrasahan, Sebastian Rast, Thomas Riddick, Niklas Roeber, Hauke Schmidt, Uwe Schulzweida, Florian Schütte, Hans Segura, Radomyra Shevchenko, Vikram Singh, Mia Specht, Claudia Christine Stephan, Jin-Song von Storch, Raphaela Vogel, Christian Wengel, Marius Winkler, Florian Ziemen, Jochem Marotzke, and Bjorn Stevens
Geosci. Model Dev., 16, 779–811, https://doi.org/10.5194/gmd-16-779-2023, https://doi.org/10.5194/gmd-16-779-2023, 2023
Short summary
Short summary
Models of the Earth system used to understand climate and predict its change typically employ a grid spacing of about 100 km. Yet, many atmospheric and oceanic processes occur on much smaller scales. In this study, we present a new model configuration designed for the simulation of the components of the Earth system and their interactions at kilometer and smaller scales, allowing an explicit representation of the main drivers of the flow of energy and matter by solving the underlying equations.
Yan Zhang, Xuantong Wang, Yuhao Sun, Chenhui Ning, Shiming Xu, Hengbin An, Dehong Tang, Hong Guo, Hao Yang, Ye Pu, Bo Jiang, and Bin Wang
Geosci. Model Dev., 16, 679–704, https://doi.org/10.5194/gmd-16-679-2023, https://doi.org/10.5194/gmd-16-679-2023, 2023
Short summary
Short summary
We construct a new ocean model, OMARE, that can carry out multi-scale ocean simulation with adaptive mesh refinement. OMARE is based on the refactorization of NEMO with a third-party, high-performance piece of middleware. We report the porting process and experiments of an idealized western-boundary current system. The new model simulates turbulent and temporally varying mesoscale and submesoscale processes via adaptive refinement. Related topics and future work with OMARE are also discussed.
Zhenming Wang, Shaoqing Zhang, Yishuai Jin, Yinglai Jia, Yangyang Yu, Yang Gao, Xiaolin Yu, Mingkui Li, Xiaopei Lin, and Lixin Wu
Geosci. Model Dev., 16, 705–717, https://doi.org/10.5194/gmd-16-705-2023, https://doi.org/10.5194/gmd-16-705-2023, 2023
Short summary
Short summary
To improve the numerical model predictability of monthly extended-range scales, we use the simplified slab ocean model (SOM) to restrict the complicated sea surface temperature (SST) bias from a 3-D dynamical ocean model. As for SST prediction, whether in space or time, the WRF-SOM is verified to have better performance than the WRF-ROMS, which has a significant impact on the atmosphere. For extreme weather events such as typhoons, the predictions of WRF-SOM are in good agreement with WRF-ROMS.
Dagmawi Teklu Asfaw, Michael Bliss Singer, Rafael Rosolem, David MacLeod, Mark Cuthbert, Edisson Quichimbo Miguitama, Manuel F. Rios Gaona, and Katerina Michaelides
Geosci. Model Dev., 16, 557–571, https://doi.org/10.5194/gmd-16-557-2023, https://doi.org/10.5194/gmd-16-557-2023, 2023
Short summary
Short summary
stoPET is a new stochastic potential evapotranspiration (PET) generator for the globe at hourly resolution. Many stochastic weather generators are used to generate stochastic rainfall time series; however, no such model exists for stochastically generating plausible PET time series. As such, stoPET represents a significant methodological advance. stoPET generate many realizations of PET to conduct climate studies related to the water balance, agriculture, water resources, and ecology.
Markus Köhli, Martin Schrön, Steffen Zacharias, and Ulrich Schmidt
Geosci. Model Dev., 16, 449–477, https://doi.org/10.5194/gmd-16-449-2023, https://doi.org/10.5194/gmd-16-449-2023, 2023
Short summary
Short summary
In the last decades, Monte Carlo codes were often consulted to study neutrons near the surface. As an alternative for the growing community of CRNS, we developed URANOS. The main model features are tracking of particle histories from creation to detection, detector representations as layers or geometric shapes, a voxel-based geometry model, and material setup based on color codes in ASCII matrices or bitmap images. The entire software is developed in C++ and features a graphical user interface.
Peter A. Bogenschutz, Hsiang-He Lee, Qi Tang, and Takanobu Yamaguchi
Geosci. Model Dev., 16, 335–352, https://doi.org/10.5194/gmd-16-335-2023, https://doi.org/10.5194/gmd-16-335-2023, 2023
Short summary
Short summary
Models that are used to simulate and predict climate often have trouble representing specific cloud types, such as stratocumulus, that are particularly thin in the vertical direction. It has been found that increasing the model resolution can help improve this problem. In this paper, we develop a novel framework that increases the horizontal and vertical resolutions only for areas of the globe that contain stratocumulus, hence reducing the model runtime while providing better results.
Manuel Schlund, Birgit Hassler, Axel Lauer, Bouwe Andela, Patrick Jöckel, Rémi Kazeroni, Saskia Loosveldt Tomas, Brian Medeiros, Valeriu Predoi, Stéphane Sénési, Jérôme Servonnat, Tobias Stacke, Javier Vegas-Regidor, Klaus Zimmermann, and Veronika Eyring
Geosci. Model Dev., 16, 315–333, https://doi.org/10.5194/gmd-16-315-2023, https://doi.org/10.5194/gmd-16-315-2023, 2023
Short summary
Short summary
The Earth System Model Evaluation Tool (ESMValTool) is a community diagnostics and performance metrics tool for routine evaluation of Earth system models. Originally, ESMValTool was designed to process reformatted output provided by large model intercomparison projects like the Coupled Model Intercomparison Project (CMIP). Here, we describe a new extension of ESMValTool that allows for reading and processing native climate model output, i.e., data that have not been reformatted before.
Xiaohui Zhong, Zhijian Ma, Yichen Yao, Lifei Xu, Yuan Wu, and Zhibin Wang
Geosci. Model Dev., 16, 199–209, https://doi.org/10.5194/gmd-16-199-2023, https://doi.org/10.5194/gmd-16-199-2023, 2023
Short summary
Short summary
More and more researchers use deep learning models to replace physics-based parameterizations to accelerate weather simulations. However, embedding the ML models within the weather models is difficult as they are implemented in different languages. This work proposes a coupling framework to allow ML-based parameterizations to be coupled with the Weather Research and Forecasting (WRF) model. We also demonstrate using the coupler to couple the ML-based radiation schemes with the WRF model.
Dario Nicolì, Alessio Bellucci, Paolo Ruggieri, Panos J. Athanasiadis, Stefano Materia, Daniele Peano, Giusy Fedele, Riccardo Hénin, and Silvio Gualdi
Geosci. Model Dev., 16, 179–197, https://doi.org/10.5194/gmd-16-179-2023, https://doi.org/10.5194/gmd-16-179-2023, 2023
Short summary
Short summary
Decadal climate predictions, obtained by constraining the initial condition of a dynamical model through a truthful estimate of the observed climate state, provide an accurate assessment of the near-term climate and are useful for informing decision-makers on future climate-related risks. The predictive skill for key variables is assessed from the operational decadal prediction system compared with non-initialized historical simulations so as to quantify the added value of initialization.
Ming Yin, Yilun Han, Yong Wang, Wenqi Sun, Jianbo Deng, Daoming Wei, Ying Kong, and Bin Wang
Geosci. Model Dev., 16, 135–156, https://doi.org/10.5194/gmd-16-135-2023, https://doi.org/10.5194/gmd-16-135-2023, 2023
Short summary
Short summary
All global climate models (GCMs) use the grid-averaged surface heat fluxes to drive the atmosphere, and thus their horizontal variations within the grid cell are averaged out. In this regard, a novel scheme considering the variation and partitioning of the surface heat fluxes within the grid cell is developed. The scheme reduces the long-standing rainfall biases on the southern and eastern margins of the Tibetan Plateau. The performance of key variables at the global scale is also evaluated.
Jenny Niebsch, Werner von Bloh, Kirsten Thonicke, and Ronny Ramlau
Geosci. Model Dev., 16, 17–33, https://doi.org/10.5194/gmd-16-17-2023, https://doi.org/10.5194/gmd-16-17-2023, 2023
Short summary
Short summary
The impacts of climate change require strategies for climate adaptation. Dynamic global vegetation models (DGVMs) are used to study the effects of multiple processes in the biosphere under climate change. There is a demand for a better computational performance of the models. In this paper, the photosynthesis model in the Lund–Potsdam–Jena managed Land DGVM (4.0.002) was examined. We found a better numerical solution of a nonlinear equation. A significant run time reduction was possible.
Leonidas Linardakis, Irene Stemmler, Moritz Hanke, Lennart Ramme, Fatemeh Chegini, Tatiana Ilyina, and Peter Korn
Geosci. Model Dev., 15, 9157–9176, https://doi.org/10.5194/gmd-15-9157-2022, https://doi.org/10.5194/gmd-15-9157-2022, 2022
Short summary
Short summary
In Earth system modelling, we are facing the challenge of making efficient use of very large machines, with millions of cores. To meet this challenge we will need to employ multi-level and multi-dimensional parallelism. Component concurrency, being a function parallel technique, offers an additional dimension to the traditional data-parallel approaches. In this paper we examine the behaviour of component concurrency and identify the conditions for its optimal application.
Bing Gong, Michael Langguth, Yan Ji, Amirpasha Mozaffari, Scarlet Stadtler, Karim Mache, and Martin G. Schultz
Geosci. Model Dev., 15, 8931–8956, https://doi.org/10.5194/gmd-15-8931-2022, https://doi.org/10.5194/gmd-15-8931-2022, 2022
Short summary
Short summary
Inspired by the success of deep learning in various domains, we test the applicability of video prediction methods by generative adversarial network (GAN)-based deep learning to predict the 2 m temperature over Europe. Our video prediction models have skill in predicting the diurnal cycle of 2 m temperature up to 12 h ahead. Complemented by probing the relevance of several model parameters, this study confirms the potential of deep learning in meteorological forecasting applications.
Thomas Bossy, Thomas Gasser, and Philippe Ciais
Geosci. Model Dev., 15, 8831–8868, https://doi.org/10.5194/gmd-15-8831-2022, https://doi.org/10.5194/gmd-15-8831-2022, 2022
Short summary
Short summary
We developed a new simple climate model designed to fill a perceived gap within the existing simple climate models by fulfilling three key requirements: calibration using Bayesian inference, the possibility of coupling with integrated assessment models, and the capacity to explore climate scenarios compatible with limiting climate impacts. Here, we describe the model and its calibration using the latest data from complex CMIP6 models and the IPCC AR6, and we assess its performance.
Marius S. A. Lambert, Hui Tang, Kjetil S. Aas, Frode Stordal, Rosie A. Fisher, Yilin Fang, Junyan Ding, and Frans-Jan W. Parmentier
Geosci. Model Dev., 15, 8809–8829, https://doi.org/10.5194/gmd-15-8809-2022, https://doi.org/10.5194/gmd-15-8809-2022, 2022
Short summary
Short summary
In this study, we implement a hardening mortality scheme into CTSM5.0-FATES-Hydro and evaluate how it impacts plant hydraulics and vegetation growth. Our work shows that the hydraulic modifications prescribed by the hardening scheme are necessary to model realistic vegetation growth in cold climates, in contrast to the default model that simulates almost nonexistent and declining vegetation due to abnormally large water loss through the roots.
Rubina Ansari, Ana Casanueva, Muhammad Usman Liaqat, and Giovanna Grossi
Geosci. Model Dev. Discuss., https://doi.org/10.5194/gmd-2022-237, https://doi.org/10.5194/gmd-2022-237, 2022
Revised manuscript accepted for GMD
Short summary
Short summary
Bias correction has become indispensable to climate model output as a post-processing step to render climate model output more useful for impact assessment studies. The current work presents a comparison of different state-of-the-art BC methods (univariate and multivariate) and BC approaches (direct and component-wise) for climate model simulations from three initiatives (CMIP6, CORDEX and CORDEX-CORE) for a multivariate drought index (i.e., Standardized Precipitation Evapotranspiration Index).
Thibaud M. Fritz, Sebastian D. Eastham, Louisa K. Emmons, Haipeng Lin, Elizabeth W. Lundgren, Steve Goldhaber, Steven R. H. Barrett, and Daniel J. Jacob
Geosci. Model Dev., 15, 8669–8704, https://doi.org/10.5194/gmd-15-8669-2022, https://doi.org/10.5194/gmd-15-8669-2022, 2022
Short summary
Short summary
We bring the state-of-the-science chemistry module GEOS-Chem into the Community Earth System Model (CESM). We show that some known differences between results from GEOS-Chem and CESM's CAM-chem chemistry module may be due to the configuration of model meteorology rather than inherent differences in the model chemistry. This is a significant step towards a truly modular Earth system model and allows two strong but currently separate research communities to benefit from each other's advances.
Laura Claire Jackson, Eduardo Alastrué de Asenjo, Katinka Bellomo, Gokhan Danabasoglu, Helmuth Haak, Aixue Hu, Johann Jungclaus, Warren Lee, Virna L. Meccia, Oleg Saenko, Andrew Shao, and Didier Swingedouw
Geosci. Model Dev. Discuss., https://doi.org/10.5194/gmd-2022-277, https://doi.org/10.5194/gmd-2022-277, 2022
Revised manuscript accepted for GMD
Short summary
Short summary
The Atlantic meridional overturning circulation (AMOC) has an important impact on the climate. There are theories that freshening of the ocean might cause the AMOC to cross a tipping point (TP) beyond which recovery is difficult, however it is unclear whether TP exist in global climate models. Here we outline a set of experiments designed to explore AMOC tipping points and sensitivity to additional freshwater input as part of the North Atlantic hosing model intercomparison project (NAHosMIP).
Rainer Schneck, Veronika Gayler, Julia E. M. S. Nabel, Thomas Raddatz, Christian H. Reick, and Reiner Schnur
Geosci. Model Dev., 15, 8581–8611, https://doi.org/10.5194/gmd-15-8581-2022, https://doi.org/10.5194/gmd-15-8581-2022, 2022
Short summary
Short summary
The versions of ICON-A and ICON-Land/JSBACHv4 used for this study constitute the first milestone in the development of the new ICON Earth System Model ICON-ESM. JSBACHv4 is the successor of JSBACHv3, and most of the parameterizations of JSBACHv4 are re-implementations from JSBACHv3. We assess and compare the performance of JSBACHv4 and JSBACHv3. Overall, the JSBACHv4 results are as good as JSBACHv3, but both models reveal the same main shortcomings, e.g. the depiction of the leaf area index.
Andrew Gettelman, Hugh Morrison, Trude Eidhammer, Katherine Thayer-Calder, Jian Sun, Richard Forbes, Zachary McGraw, Jiang Zhu, Trude Storelvmo, and John Dennis
EGUsphere, https://doi.org/10.5194/egusphere-2022-980, https://doi.org/10.5194/egusphere-2022-980, 2022
Short summary
Short summary
Clouds are a critical part of weather and climate prediction. In this work, we document updates and corrections to the description of clouds used in several Earth System Models. These updates include the ability to run the scheme on Graphics Processing Units (GPUs) and changes to the numerical description of precipitation, as well as a correction to ice number. There are big improvements in computational performance that can be achieved with GPU acceleration.
Dave van Wees, Guido R. van der Werf, James T. Randerson, Brendan M. Rogers, Yang Chen, Sander Veraverbeke, Louis Giglio, and Douglas C. Morton
Geosci. Model Dev., 15, 8411–8437, https://doi.org/10.5194/gmd-15-8411-2022, https://doi.org/10.5194/gmd-15-8411-2022, 2022
Short summary
Short summary
We present a global fire emission model based on the GFED model framework with a spatial resolution of 500 m. The higher resolution allowed for a more detailed representation of spatial heterogeneity in fuels and emissions. Specific modules were developed to model, for example, emissions from fire-related forest loss and belowground burning. Results from the 500 m model were compared to GFED4s, showing that global emissions were relatively similar but that spatial differences were substantial.
Adama Sylla, Emilia Sanchez Gomez, Juliette Mignot, and Jorge López-Parages
Geosci. Model Dev., 15, 8245–8267, https://doi.org/10.5194/gmd-15-8245-2022, https://doi.org/10.5194/gmd-15-8245-2022, 2022
Short summary
Short summary
Increasing model resolution depends on the subdomain of the Canary upwelling considered. In the Iberian Peninsula, the high-resolution (HR) models do not seem to better simulate the upwelling indices, while in Morocco to the Senegalese coast, the HR models show a clear improvement. Thus increasing the resolution of a global climate model does not necessarily have to be the only way to better represent the climate system. There is still much work to be done in terms of physical parameterizations.
Jadwiga H. Richter, Daniele Visioni, Douglas G. MacMartin, David A. Bailey, Nan Rosenbloom, Brian Dobbins, Walker R. Lee, Mari Tye, and Jean-Francois Lamarque
Geosci. Model Dev., 15, 8221–8243, https://doi.org/10.5194/gmd-15-8221-2022, https://doi.org/10.5194/gmd-15-8221-2022, 2022
Short summary
Short summary
Solar climate intervention using stratospheric aerosol injection is a proposed method of reducing global mean temperatures to reduce the worst consequences of climate change. We present a new modeling protocol aimed at simulating a plausible deployment of stratospheric aerosol injection and reproducibility of simulations using other Earth system models: Assessing Responses and Impacts of Solar climate intervention on the Earth system with stratospheric aerosol injection (ARISE-SAI).
Gonzalo A. Ferrada, Meng Zhou, Jun Wang, Alexei Lyapustin, Yujie Wang, Saulo R. Freitas, and Gregory R. Carmichael
Geosci. Model Dev., 15, 8085–8109, https://doi.org/10.5194/gmd-15-8085-2022, https://doi.org/10.5194/gmd-15-8085-2022, 2022
Short summary
Short summary
The smoke from fires is composed of different compounds that interact with the atmosphere and can create poor air-quality episodes. Here, we present a new fire inventory based on satellite observations from the Visible Infrared Imaging Radiometer Suite (VIIRS). We named this inventory the VIIRS-based Fire Emission Inventory (VFEI). Advantages of VFEI are its high resolution (~500 m) and that it provides information for many species. VFEI is publicly available and has provided data since 2012.
Entao Yu, Rui Bai, Xia Chen, and Lifang Shao
Geosci. Model Dev., 15, 8111–8134, https://doi.org/10.5194/gmd-15-8111-2022, https://doi.org/10.5194/gmd-15-8111-2022, 2022
Short summary
Short summary
A large number of simulations are conducted to investigate how different physical parameterization schemes impact surface wind simulations under stable weather conditions over the coastal regions of North China using the Weather Research and Forecasting model with a horizontal grid spacing of 0.5 km. Results indicate that the simulated wind speed is most sensitive to the planetary boundary layer schemes, followed by short-wave/long-wave radiation schemes and microphysics schemes.
Xingying Huang, Andrew Gettelman, William C. Skamarock, Peter Hjort Lauritzen, Miles Curry, Adam Herrington, John T. Truesdale, and Michael Duda
Geosci. Model Dev., 15, 8135–8151, https://doi.org/10.5194/gmd-15-8135-2022, https://doi.org/10.5194/gmd-15-8135-2022, 2022
Short summary
Short summary
We focus on the recent development of a state-of-the-art storm-resolving global climate model and investigate how this next-generation model performs for precipitation prediction over the western USA. Results show realistic representations of precipitation with significantly enhanced snowpack over complex terrains. The model evaluation advances the unified modeling of large-scale forcing constraints and realistic fine-scale features to advance multi-scale climate predictions and changes.
Marina Martínez Montero, Michel Crucifix, Victor Couplet, Nuria Brede, and Nicola Botta
Geosci. Model Dev., 15, 8059–8084, https://doi.org/10.5194/gmd-15-8059-2022, https://doi.org/10.5194/gmd-15-8059-2022, 2022
Short summary
Short summary
We present SURFER, a lightweight model that links CO2 emissions and geoengineering to ocean acidification and sea level rise from glaciers, ocean thermal expansion and Greenland and Antarctic ice sheets. The ice sheet module adequately describes the tipping points of both Greenland and Antarctica. SURFER is understandable, fast, accurate up to several thousands of years, capable of emulating results obtained by state of the art models and well suited for policy analyses.
Francisco José Cuesta-Valero, Hugo Beltrami, Stephan Gruber, Almudena García-García, and J. Fidel González-Rouco
Geosci. Model Dev., 15, 7913–7932, https://doi.org/10.5194/gmd-15-7913-2022, https://doi.org/10.5194/gmd-15-7913-2022, 2022
Short summary
Short summary
Inversions of subsurface temperature profiles provide past long-term estimates of ground surface temperature histories and ground heat flux histories at timescales of decades to millennia. Theses estimates complement high-frequency proxy temperature reconstructions and are the basis for studying continental heat storage. We develop and release a new bootstrap method to derive meaningful confidence intervals for the average surface temperature and heat flux histories from any number of profiles.
Yilin Fang, L. Ruby Leung, Charles D. Koven, Gautam Bisht, Matteo Detto, Yanyan Cheng, Nate McDowell, Helene Muller-Landau, S. Joseph Wright, and Jeffrey Q. Chambers
Geosci. Model Dev., 15, 7879–7901, https://doi.org/10.5194/gmd-15-7879-2022, https://doi.org/10.5194/gmd-15-7879-2022, 2022
Short summary
Short summary
We develop a model that integrates an Earth system model with a three-dimensional hydrology model to explicitly resolve hillslope topography and water flow underneath the land surface to understand how local-scale hydrologic processes modulate vegetation along water availability gradients. Our coupled model can be used to improve the understanding of the diverse impact of local heterogeneity and water flux on nutrient availability and plant communities.
Wentao Zhang, Xiangjun Shi, and Chunsong Lu
Geosci. Model Dev., 15, 7751–7766, https://doi.org/10.5194/gmd-15-7751-2022, https://doi.org/10.5194/gmd-15-7751-2022, 2022
Short summary
Short summary
The two-moment bulk cloud microphysics scheme used in CAM6 was modified to consider the impacts of the ice-crystal size distribution shape parameter (μi). After that, how the μi impacts cloud microphysical processes and then climate simulations is clearly illustrated by offline tests and CAM6 model experiments. Our results and findings are useful for the further development of μi-related parameterizations.
Yona Silvy, Clément Rousset, Eric Guilyardi, Jean-Baptiste Sallée, Juliette Mignot, Christian Ethé, and Gurvan Madec
Geosci. Model Dev., 15, 7683–7713, https://doi.org/10.5194/gmd-15-7683-2022, https://doi.org/10.5194/gmd-15-7683-2022, 2022
Short summary
Short summary
A modeling framework is introduced to understand and decompose the mechanisms causing the ocean temperature, salinity and circulation to change since the pre-industrial period and into 21st century scenarios of global warming. This framework aims to look at the response to changes in the winds and in heat and freshwater exchanges at the ocean interface in global climate models, throughout the 1850–2100 period, to unravel their individual effects on the changing physical structure of the ocean.
Aiko Voigt, Petra Schwer, Noam von Rotberg, and Nicole Knopf
Geosci. Model Dev., 15, 7489–7504, https://doi.org/10.5194/gmd-15-7489-2022, https://doi.org/10.5194/gmd-15-7489-2022, 2022
Short summary
Short summary
In climate science, it is helpful to identify coherent objects, for example, those formed by clouds. However, many models now use unstructured grids, which makes it harder to identify coherent objects. We present a new method that solves this problem by moving model data from an unstructured triangular grid to a structured cubical grid. We implement the method in an open-source Python package and show that the method is ready to be applied to climate model data.
Jérémy Bernard, Erwan Bocher, Elisabeth Le Saux Wiederhold, François Leconte, and Valéry Masson
Geosci. Model Dev., 15, 7505–7532, https://doi.org/10.5194/gmd-15-7505-2022, https://doi.org/10.5194/gmd-15-7505-2022, 2022
Short summary
Short summary
OpenStreetMap is a collaborative project aimed at creaing a free dataset containing topographical information. Since these data are available worldwide, they can be used as standard data for geoscience studies. However, most buildings miss the height information that constitutes key data for numerous fields (urban climate, noise propagation, air pollution). In this work, the building height is estimated using statistical modeling using indicators that characterize the building's environment.
Sergey Kravtsov, Ilijana Mastilovic, Andrew McC. Hogg, William K. Dewar, and Jeffrey R. Blundell
Geosci. Model Dev., 15, 7449–7469, https://doi.org/10.5194/gmd-15-7449-2022, https://doi.org/10.5194/gmd-15-7449-2022, 2022
Short summary
Short summary
Climate is a complex system whose behavior is shaped by multitudes of processes operating on widely different spatial scales and timescales. In hierarchical modeling, one goes back and forth between highly idealized process models and state-of-the-art models coupling the entire range of climate subsystems to identify specific phenomena and understand their dynamics. The present contribution highlights an intermediate climate model focussing on midlatitude ocean–atmosphere interactions.
Johann Dahm, Eddie Davis, Florian Deconinck, Oliver Elbert, Rhea George, Jeremy McGibbon, Tobias Wicky, Elynn Wu, Christopher Kung, Tal Ben-Nun, Lucas Harris, Linus Groner, and Oliver Fuhrer
EGUsphere, https://doi.org/10.5194/egusphere-2022-943, https://doi.org/10.5194/egusphere-2022-943, 2022
Short summary
Short summary
It is hard for scientists to write efficient code which runs fast on all kinds of supercomputers. They like writing Python because it is easier to read and use. We re-wrote a Fortran code that simulates weather and climate into Python. The Python code re-writes itself to a much faster language to run on either normal processors or graphics cards. On one big computer system, our code is 3.5–4x faster on its graphics cards than the original code is on its processors.
Ingo Wohltmann, Daniel Kreyling, and Ralph Lehmann
Geosci. Model Dev., 15, 7243–7255, https://doi.org/10.5194/gmd-15-7243-2022, https://doi.org/10.5194/gmd-15-7243-2022, 2022
Short summary
Short summary
The study evaluates the performance of the Data Assimilation Research Testbed (DART), equipped with the recently added forward operator Radiative Transfer for TOVS (RTTOV), in assimilating FY-4A visible images into the Weather Research and Forecasting (WRF) model. The ability of the WRF-DART/RTTOV system to improve the forecasting skills for a tropical storm over East Asia and the Western Pacific is demonstrated in an Observing System Simulation Experiment framework.
Enrico Zorzetto, Sergey Malyshev, Nathaniel Chaney, David Paynter, Raymond Menzel, and Elena Shevliakova
EGUsphere, https://doi.org/10.5194/egusphere-2022-770, https://doi.org/10.5194/egusphere-2022-770, 2022
Short summary
Short summary
In this paper we develop a methodology to model the spatial distribution of solar radiation received by land over mountainous terrain. The approach is designed to be used in Earth System Models, where coarse grid cells hinder the description of fine scale land-atmosphere interactions. We adopt a clustering algorithm to partiton land domain in a set of homogeneous sub-grid “tiles”, and for each evaluate solar radiation receive by land based on terrain properties.
Juan Ruiz, Pierre Ailliot, Thi Tuyet Trang Chau, Pierre Le Bras, Valérie Monbet, Florian Sévellec, and Pierre Tandeo
Geosci. Model Dev., 15, 7203–7220, https://doi.org/10.5194/gmd-15-7203-2022, https://doi.org/10.5194/gmd-15-7203-2022, 2022
Short summary
Short summary
We present a new approach to validate numerical simulations of the current climate. The method can take advantage of existing climate simulations produced by different centers combining an analog forecasting approach with data assimilation to quantify how well a particular model reproduces a sequence of observed values. The method can be applied with different observations types and is implemented locally in space and time significantly reducing the associated computational cost.
Chahan M. Kropf, Alessio Ciullo, Laura Otth, Simona Meiler, Arun Rana, Emanuel Schmid, Jamie W. McCaughey, and David N. Bresch
Geosci. Model Dev., 15, 7177–7201, https://doi.org/10.5194/gmd-15-7177-2022, https://doi.org/10.5194/gmd-15-7177-2022, 2022
Short summary
Short summary
Mathematical models are approximations, and modellers need to understand and ideally quantify the arising uncertainties. Here, we describe and showcase the first, simple-to-use, uncertainty and sensitivity analysis module of the open-source and open-access climate-risk modelling platform CLIMADA. This may help to enhance transparency and intercomparison of studies among climate-risk modellers, help focus future research, and lead to better-informed decisions on climate adaptation.
Günther Zängl, Daniel Reinert, and Florian Prill
Geosci. Model Dev., 15, 7153–7176, https://doi.org/10.5194/gmd-15-7153-2022, https://doi.org/10.5194/gmd-15-7153-2022, 2022
Short summary
Short summary
This article describes the implementation of grid refinement in the ICOsahedral Nonhydrostatic (ICON) model, which has been jointly developed at several German institutions and constitutes a unified modeling system for global and regional numerical weather prediction and climate applications. The grid refinement allows using a higher resolution in regional domains and transferring the information back to the global domain by means of a feedback mechanism.
Cited articles
Annan, J. D., Hargreaves, J. C., Edwards, N. R., and Marsh, R.: Parameter estimation in an intermediate complexity earth system model using an ensemble Kalman filter, Ocean Model., 8, 135–154, https://doi.org/10.1016/j.ocemod.2003.12.004, 2005.
Arlot, S. and Celisse, A.: A survey of cross-validation procedures for model selection, Statistics Surveys, 4, 40–79, 2010.
Bache, K. and Lichman, M.: UCI Machine Learning Repository, available at: http://archive.ics.uci.edu/ml (last access: 30 May 2013), archived on 12 September 2012: http://www.webcitation.org/6AcuZgrsy, 2013.
Bishop, C. M.: Pattern Recognition and Machine Learning, Information Science and Statistics, 1st Edn., Springer, 2007.
Breiman, L.: Bagging predictors, Mach. Learn., 24, 123–140, 1996.
Breiman, L.: Random forests, Mach. Learn., 45, 5–32, 2001.
Breiman, L., Friedman, J. H., Olshen, R. A., and Stone, P. J.: Classification and Regression Trees, 1st Edn., Chapman and Hall/CRC, 1984.
Burges, C. J. C.: A tutorial on support vector machines for pattern recognition, Data Min. Knowl. Discov., 2, 121–167, 1998.
CCSM4: The Community Climate System Model, Version 4, available at: http://www.cesm.ucar.edu/models/ccsm4.0/ (last access: 22 January 2013), archived on 21 July 2010: http://www.webcitation.org/5rOj1F8rL, 2012.
Chang, C. C. and Lin, C. J.: LIBSVM: A library for support vector machines, ACM Trans. Intell. Syst. Technol., 2, 27, https://doi.org/10.1145/1961189.1961199, 2011.
Clune, T. and Rood, R.: Software testing and verification in climate model development, IEEE Software, 28, 49–55, 2011.
Cortes, C. and Vapnik, V.: Support-vector networks, Mach. Learn., 20, 273–297, 1995.
Danabasoglu, G., Bates, S., Briegleb, B., Jayne, S., Jochum, M., Large, W., Peacock, S., and Yeager, S.: The CCSM4 ocean component, J. Climate, 25, 1361–1389, 2012.
Dietterich, T. G.: Ensemble methods in machine learning, in: Multiple Classifier Systems, Lecture Notes in Computer Science, Springer Berlin Heidelberg, 1857, 1–15, 2000.
D'Silva, V., Kroening, D., and Weissenbacher, G.: A survey of automated techniques for formal software verification, IEEE T. Comput.-Aid. D., 27, 1165–1178, 2008.
Easterbrook, S. M.: Climate change: a grand software challenge, in: FoSER, edited by: Roman, G.-C. and Sullivan, K. J., 99–104, ACM, 2010.
Easterbrook, S. M.: Do Over or Make Do? Climate Models as a Software Development Challenge, 2012 Fall Meeting Abstracts, IN14B-01, AGU, San Francisco, Calif., 3–7 December, 2012.
Easterbrook, S. M. and Johns, T. C.: Engineering the software for understanding climate change, Comput. Sci. Eng., 11, 65–74, 2009.
Easterbrook, S. M., Edwards, P. N., Balaji, V., and Budich, R.: Guest editors' introduction: climate change – science and software, IEEE Software, 28, 32–35, 2011.
Edwards, N. R., Cameron, D., and Rougier, J.: Precalibrating an intermediate complexity climate model, Clim. Dynam., 37, 1469–1482, https://doi.org/10.1007/s00382-010-0921-0, 2011.
Farrell, P. E., Piggott, M. D., Gorman, G. J., Ham, D. A., Wilson, C. R., and Bond, T. M.: Automated continuous verification for numerical simulation, Geosci. Model Dev., 4, 435–449, https://doi.org/10.5194/gmd-4-435-2011, 2011.
Fawcett, T.: An introduction to ROC analysis, Pattern Recogn. Lett., 27, 861–874, 2006.
Forrester, A. I. J., Sobester, A., and Keane, A. J.: Engineering Design via Surrogate Modelling – A Practical Guide, Wiley, 2008.
Fox-Kemper, B., Ferrari, R., and Hallberg, R.: Parameterization of mixed layer eddies, Part I: Theory and diagnosis, J. Phys. Oceanogr., 38, 1145–1165, 2008.
Gent, P. R. and McWilliams, J. C.: Isopycnal mixing in ocean circulation models, J. Phys. Oceanogr., 20, 150–155, 1990.
Gent, P. R., Danabasoglu, G., Donner, L. J., Holland, M. M., Hunke, E. C., Jayne, S. R., Lawrence, D. M., Neale, R. B., Rasch, P. J., Vertenstein, M., Worley, P. H., Yang, Z.-L., and Zhang, M.: The Community Climate System Model Version 4, J. Climate, 24, 4973–4991, 2011.
Griffies, S.: Fundamentals of Ocean Climate Models, Princeton University Press, 2004.
Helton, J. C. and Davis, F. J.: Latin hypercube sampling and the propagation of uncertainty in analyses of complex systems, Reliab. Eng. Syst. Safe., 81, 23–69, 2003.
Helton, J., Johnson, J., Sallaberry, C., and Storlie, C.: Survey of sampling-based methods for uncertainty and sensitivity analysis, Reliab. Eng. Syst. Safe., 91, 1175–1209, 2006.
Hosmer, D. W. and Lemeshow, S.: Applied Logistic Regression, 2nd Edn., Wiley-Interscience, 2000.
Jackson, C., Sen, M., Huerta, G., Deng, Y., and Bowman, K.: Error reduction and convergence in climate prediction, J. Climate, 21, 6698–6709, 2008.
Jayne, S. R.: The impact of abyssal mixing parameterizations in an ocean general circulation model, J. Phys. Oceanogr., 39, 1756–1775, 2009.
Jochum, M., Danabasoglu, G., Holland, M., Kwon, Y.-O., and Large, W. G.: Ocean viscosity and climate, J. Geophys. Res., 113, C06017, https://doi.org/10.1029/2007JC004515, 2008.
Kotsiantis, S. B.: Supervised Machine Learning: a Review of Classification Techniques, in: Proceedings of the 2007 conference on Emerging Artificial Intelligence Applications in Computer Engineering: Real Word AI Systems with Applications in eHealth, HCI, Information Retrieval and Pervasive Technologies, IOS Press, Amsterdam, The Netherlands, The Netherlands, 3–24, 2007.
Large, W. and Yeager, S.: The global climatology of an interannually varying air–sea flux data set, Clim. Dynam., 33, 341–364, 2009.
Large, W. G., McWilliams, J. C., and Doney, S. C.: Oceanic vertical mixing: A review and a model with a nonlocal boundary layer parameterization, Rev. Geophys., 32, 363–403, 1994.
Large, W. G., Danabasoglu, G., McWilliams, J. C., Gent, P. R., and Bryan, F. O.: Equatorial circulation of a global ocean climate model with anisotropic horizontal viscosity, J. Phys. Oceanogr., 31, 518–536, 2001.
Lawrence Livermore National Laboratory Green Data Oasis, available through anonymous ftp at: ftp://gdo148.ucllnl.org/pub/ (last access: 24 June 2013), 2013.
Lucas, D. D. and Prinn, R. G.: Parametric sensitivity and uncertainty analysis of dimethylsulfide oxidation in the clear-sky remote marine boundary layer, Atmos. Chem. Phys., 5, 1505–1525, https://doi.org/10.5194/acp-5-1505-2005, 2005.
Marzban, C.: The ROC curve and the area under it as performance measures, Weather Forecast., 124, 1106–1113, 2004.
McKay, M. D., Beckman, R. J., and Conover, W. J.: A comparison of three methods for selecting values of input variables in the analysis of output from a computer code, Technometrics, 21, 239–245, 1979.
MLdata.org: Machine learning data set repository, available at: http://mldata.org/repository/data/viewslug/climate-model-simulation-crashes/ (last access: 24 June 2013), archived on 24 June 2013: http://www.webcitation.org/6HcrKQ4Lk, 2013.
Murphy, J., Sexton, D., Barnett, D., Jones, G., Webb, M., Collins, M., and Stainforth, D.: Quantification of modelling uncertainties in a large ensemble of climate change simulations, Nature, 430, 768–772, 2004.
National Research Council Report: Assessing the Reliability of Complex Models: Mathematical and Statistical Foundations of Verification, Validation, and Uncertainty Quantification, The National Academies Press, 2012.
Pipitone, J. and Easterbrook, S.: Assessing climate model software quality: a defect density analysis of three models, Geosci. Model Dev., 5, 1009–1022, https://doi.org/10.5194/gmd-5-1009-2012, 2012.
Platt, J. C.: Probabilistic outputs for support vector machines and comparisons to regularized likelihood methods, in: Advances in Large Margin Classifiers, MIT Press, 61–74, 1999.
Prati, R. C., Batista, G. E. A. P. A., and Monard, M. C.: Class imbalances versus class overlapping: an analysis of a learning system behavior, in: MICAI, edited by: Monroy, R., Arroyo-Figueroa, G., Sucar, L. E., and Azuela, J. H. S., Lecture Notes in Computer Science, vol. 2972, Springer, 312–321, 2004.
Randall, D., Wood, R., Bony, S., Colman, R., Fichefet, T., Fyfe, J., Kattsov, V., Pitman, A., Shukla, J., Srinivasan, J., Stouffer, R., Sumi, A., and Taylor, K.: Climate Models and Their Evaluation, in: Climate Change 2007: The Physical Science Basis, Contribution of Working Group I to the Fourth Assessment Report of the Intergovernmental Panel on Climate Change, edited by: Solomon, S., Qin, D., Manning, M., Chen, Z., Marquis, M., Averyt, K. B., Tignor, M., and Miller, H. L., Cambridge University Press, 2007.
Rugaber, S., Dunlap, R., Mark, L., and Ansari, S.: Managing software complexity and variability in coupled climate models, IEEE Software, 28, 43–48, 2011.
Saltelli, A., Chan, K., and Scott, E. M.: Sensitivity Analysis, Wiley, 2000.
Sanderson, B.: A multimodel study of parametric uncertainty in predictions of climate response to rising greenhouse gas concentrations, J. Climate, 24, 1362–1377, 2011.
Shiogama, H., Watanabe, M., Yoshimori, M., Yokohata, T., Ogura, T., Annan, J. D., Hargreaves, J. C., Abe, M., Kamae, Y., O'ishi, R., Nobui, R., Emori, S., Nozawa, T., Abe-Ouchi, A., and Kimoto, M.: Perturbed physics ensemble using the MIROC5 coupled atmosphere-ocean GCM without flux corrections: experimental design and results, Clim. Dynam., 39, 3041–3056, 2012.
Smith, R., Jones, P., Briegleb, B., Bryan, F., Danabasoglu, G., Dennis, J., Dukowicz, J., Eden, C., Fox-Kemper, B., Gent, P., Hecht, M., Jayne, S., Jochum, M., Large, W., Lindsay, K., Maltrud, M., Norton, N., Peacock, S., Vertenstein, M., and Yeager, S.: The Parallel Ocean Program (POP) reference manual, ocean component of the Community Climate System Model (CCSM), Tech. Rep. LAUR-10-01853, Los Alamos National Laboratory, 141 pp., 2010.
Smith, R. D. and McWilliams, J. C.: Anisotropic horizontal viscosity for ocean models, Ocean Model., 5, 129–156, 2003.
Sobol, I. M.: Global sensitivity indices for nonlinear mathematical models and their Monte Carlo estimates, Math. Comput. Simulat., 55, 271–280, 2001.
Stainforth, D., Aina, T., Christensen, C., Collins, M., Faull, N., Frame, D. J., Kettleborough, J. A., Knight, S., Martin, A., Murphy, J. M., Piani, C., Sexton, D., Smith, L. A., Spicer, R. A., Thorpe, A. J., and Allen, M. R.: Uncertainty in predictions of the climate response to rising levels of greenhouse gases, Nature, 433, 403–406, 2005.
Stein, M.: Large sample properties of simulations using Latin hypercube sampling, Technometrics, 29, 143–151, 1987.
Stensrud, D. J.: Parameterization Schemes: Keys to Understanding Numerical Weather Prediction Models, Cambridge University Press, 2009.
Sudret, B.: Global sensitivity analysis using polynomial chaos expansions, Reliab. Eng. Syst. Safe., 93, 964–979, 2008.
Swets, J. A.: Measuring the accuracy of diagnostic systems, Science, 240, 1285–1293, 1988.
Tannahill, J., Lucas, D. D., Domyancic, D., Brandon, S., and Klein, R.: Data intensive uncertainty quantification: Applications to climate modeling, in: Poster Presented at Super Computing 11, November 12–18, Seattle, Washington, USA, https://doi.org/10.1145/2148600.2148610, 2011.
Tatang, M., Pan, W., Prinn, R., and McRae, G.: An efficient method for parametric uncertainty analysis of numerical geophysical models, J. Geophys. Res., 102, 21925–21932, 1997.
The HadGEM2 Development Team: G. M. Martin, Bellouin, N., Collins, W. J., Culverwell, I. D., Halloran, P. R., Hardiman, S. C., Hinton, T. J., Jones, C. D., McDonald, R. E., McLaren, A. J., O'Connor, F. M., Roberts, M. J., Rodriguez, J. M., Woodward, S., Best, M. J., Brooks, M. E., Brown, A. R., Butchart, N., Dearden, C., Derbyshire, S. H., Dharssi, I., Doutriaux-Boucher, M., Edwards, J. M., Falloon, P. D., Gedney, N., Gray, L. J., Hewitt, H. T., Hobson, M., Huddleston, M. R., Hughes, J., Ineson, S., Ingram, W. J., James, P. M., Johns, T. C., Johnson, C. E., Jones, A., Jones, C. P., Joshi, M. M., Keen, A. B., Liddicoat, S., Lock, A. P., Maidens, A. V., Manners, J. C., Milton, S. F., Rae, J. G. L., Ridley, J. K., Sellar, A., Senior, C. A., Totterdell, I. J., Verhoef, A., Vidale, P. L., and Wiltshire, A.: The HadGEM2 family of Met Office Unified Model climate configurations, Geosci. Model Dev., 4, 723–757, https://doi.org/10.5194/gmd-4-723-2011, 2011.
Vapnik, V. N.: The Nature of Statistical Learning Theory, Springer, New York, NY, USA, 1995.
Walter, K.: Narrowing Uncertainties, Science & Technology Review, available at: https://str.llnl.gov/JulAug10/klein.html (last access: 22 January 2013), archived on 22 January 2013: http://www.webcitation.org/6DsDwCRxY, 2010.
Washington, W. M. and Parkinson, C. L.: An introduction to three-dimensional climate modeling, University Science Books, 2nd Edn., 2005.
Webster, M., Scott, J., Sokolov, A., and Stone, P.: Estimating probability distributions from complex models with bifurcations: The case of ocean circulation collapse, J. Environ. Sys., 31, 1–21, https://doi.org/10.2190/A518-W844-4193-4202, 2004.
Wiener, N.: The homogeneous chaos, Am. J. Math., 60, 897–936, 1938.
Xiu, D. and Karnidakis, G. E. M.: The Wiener–Askey polynomial chaos for stochastic differential equations, SIAM J. Sci. Comput., 24, 619–644, 2002.
