Articles | Volume 6, issue 4
https://doi.org/10.5194/gmd-6-1157-2013
© Author(s) 2013. This work is distributed under
the Creative Commons Attribution 3.0 License.
the Creative Commons Attribution 3.0 License.
https://doi.org/10.5194/gmd-6-1157-2013
© Author(s) 2013. This work is distributed under
the Creative Commons Attribution 3.0 License.
the Creative Commons Attribution 3.0 License.
Methods for assessment of models
| 
07 Aug 2013
Methods for assessment of models |
| 07 Aug 2013
Failure analysis of parameter-induced simulation crashes in climate models
D. D. Lucas
Lawrence Livermore National Laboratory, Livermore, CA, USA
R. Klein
Lawrence Livermore National Laboratory, Livermore, CA, USA
Department of Astronomy, University of California, Berkeley, CA 94720, USA
J. Tannahill
Lawrence Livermore National Laboratory, Livermore, CA, USA
D. Ivanova
Lawrence Livermore National Laboratory, Livermore, CA, USA
S. Brandon
Lawrence Livermore National Laboratory, Livermore, CA, USA
D. Domyancic
Lawrence Livermore National Laboratory, Livermore, CA, USA
Y. Zhang
Lawrence Livermore National Laboratory, Livermore, CA, USA
Related authors
Donald D. Lucas, Matthew Simpson, Philip Cameron-Smith, and Ronald L. Baskett
Atmos. Chem. Phys., 17, 13521–13543, https://doi.org/10.5194/acp-17-13521-2017, https://doi.org/10.5194/acp-17-13521-2017, 2017
Short summary
Short summary
Monte Carlo ensemble simulations, Bayesian inversion, and machine learning are used to quantify uncertainty in the atmospheric transport and emissions of a controlled tracer released from a nuclear power plant. Uncertainty of different settings in a weather model and source terms in a dispersion model are jointly estimated. The algorithm is validated using model-generated output and field observations and can benefit atmospheric researchers who need to estimate tracer transport uncertainty.
D. D. Lucas, C. Yver Kwok, P. Cameron-Smith, H. Graven, D. Bergmann, T. P. Guilderson, R. Weiss, and R. Keeling
Geosci. Instrum. Method. Data Syst., 4, 121–137, https://doi.org/10.5194/gi-4-121-2015, https://doi.org/10.5194/gi-4-121-2015, 2015
Short summary
Short summary
Multiobjective optimization is used to design Pareto optimal greenhouse gas (GHG) observing networks. A prototype GHG network is designed to optimize scientific performance and measurement costs. The Pareto frontier is convex, showing the trade-offs between performance and cost and the diminishing returns in trading one for the other. Other objectives and constraints that are important in the design of practical GHG monitoring networks can be incorporated into our method.
C. E. Yver, H. D. Graven, D. D. Lucas, P. J. Cameron-Smith, R. F. Keeling, and R. F. Weiss
Atmos. Chem. Phys., 13, 1837–1852, https://doi.org/10.5194/acp-13-1837-2013, https://doi.org/10.5194/acp-13-1837-2013, 2013
Donald D. Lucas, Matthew Simpson, Philip Cameron-Smith, and Ronald L. Baskett
Atmos. Chem. Phys., 17, 13521–13543, https://doi.org/10.5194/acp-17-13521-2017, https://doi.org/10.5194/acp-17-13521-2017, 2017
Short summary
Short summary
Monte Carlo ensemble simulations, Bayesian inversion, and machine learning are used to quantify uncertainty in the atmospheric transport and emissions of a controlled tracer released from a nuclear power plant. Uncertainty of different settings in a weather model and source terms in a dispersion model are jointly estimated. The algorithm is validated using model-generated output and field observations and can benefit atmospheric researchers who need to estimate tracer transport uncertainty.
D. D. Lucas, C. Yver Kwok, P. Cameron-Smith, H. Graven, D. Bergmann, T. P. Guilderson, R. Weiss, and R. Keeling
Geosci. Instrum. Method. Data Syst., 4, 121–137, https://doi.org/10.5194/gi-4-121-2015, https://doi.org/10.5194/gi-4-121-2015, 2015
Short summary
Short summary
Multiobjective optimization is used to design Pareto optimal greenhouse gas (GHG) observing networks. A prototype GHG network is designed to optimize scientific performance and measurement costs. The Pareto frontier is convex, showing the trade-offs between performance and cost and the diminishing returns in trading one for the other. Other objectives and constraints that are important in the design of practical GHG monitoring networks can be incorporated into our method.
C. E. Yver, H. D. Graven, D. D. Lucas, P. J. Cameron-Smith, R. F. Keeling, and R. F. Weiss
Atmos. Chem. Phys., 13, 1837–1852, https://doi.org/10.5194/acp-13-1837-2013, https://doi.org/10.5194/acp-13-1837-2013, 2013
Related subject area
Climate and Earth system modeling
CICERO Simple Climate Model (CICERO-SCM v1.1.1) – an improved simple climate model with a parameter calibration tool
Development of a plant carbon–nitrogen interface coupling framework in a coupled biophysical-ecosystem–biogeochemical model (SSiB5/TRIFFID/DayCent-SOM v1.0)
Dynamical Madden–Julian Oscillation forecasts using an ensemble subseasonal-to-seasonal forecast system of the IAP-CAS model
Implementation of a brittle sea ice rheology in an Eulerian, finite-difference, C-grid modeling framework: impact on the simulated deformation of sea ice in the Arctic
HSW-V v1.0: localized injections of interactive volcanic aerosols and their climate impacts in a simple general circulation model
A 3D-Var assimilation scheme for vertical velocity with CMA-MESO v5.0
Updating the radiation infrastructure in MESSy (based on MESSy version 2.55)
An urban module coupled with the Variable Infiltration Capacity model to improve hydrothermal simulations in urban systems
Bayesian hierarchical model for bias-correcting climate models
Evaluation of the coupling of EMACv2.55 to the land surface and vegetation model JSBACHv4
Reduced floating-point precision in regional climate simulations: an ensemble-based statistical verification
TorchClim v1.0: a deep-learning plugin for climate model physics
Linking global terrestrial and ocean biogeochemistry with process-based, coupled freshwater algae–nutrient–solid dynamics in LM3-FANSY v1.0
Validating a microphysical prognostic stratospheric aerosol implementation in E3SMv2 using observations after the Mount Pinatubo eruption
Implementing detailed nucleation predictions in the Earth system model EC-Earth3.3.4: sulfuric acid–ammonia nucleation
Modeling biochar effects on soil organic carbon on croplands in a microbial decomposition model (MIMICS-BC_v1.0)
Hector V3.2.0: functionality and performance of a reduced-complexity climate model
Evaluation of CMIP6 model simulations of PM2.5 and its components over China
Assessment of a tiling energy budget approach in a land surface model, ORCHIDEE-MICT (r8205)
Multivariate adjustment of drizzle bias using machine learning in European climate projections
Development and evaluation of the interactive Model for Air Pollution and Land Ecosystems (iMAPLE) version 1.0
A perspective on the next generation of Earth system model scenarios: towards representative emission pathways (REPs)
Parallel SnowModel (v1.0): a parallel implementation of a distributed snow-evolution modeling system (SnowModel)
LB-SCAM: a learning-based method for efficient large-scale sensitivity analysis and tuning of the Single Column Atmosphere Model (SCAM)
Quantifying the impact of SST feedback frequency on Madden–Julian oscillation simulations
Systematic and objective evaluation of Earth system models: PCMDI Metrics Package (PMP) version 3
A revised model of global silicate weathering considering the influence of vegetation cover on erosion rate
A radiative–convective model computing precipitation with the maximum entropy production hypothesis
Introducing the MESMER-M-TPv0.1.0 module: Spatially Explicit Earth System Model Emulation for Monthly Precipitation and Temperature
Leveraging regional mesh refinement to simulate future climate projections for California using the Simplified Convection-Permitting E3SM Atmosphere Model Version 0
Machine learning parameterization of the multi-scale Kain–Fritsch (MSKF) convection scheme and stable simulation coupled in the Weather Research and Forecasting (WRF) model using WRF–ML v1.0
Impacts of spatial heterogeneity of anthropogenic aerosol emissions in a regionally refined global aerosol–climate model
cfr (v2024.1.26): a Python package for climate field reconstruction
NEWTS1.0: Numerical model of coastal Erosion by Waves and Transgressive Scarps
Evaluation of isoprene emissions from the coupled model SURFEX–MEGANv2.1
A comprehensive Earth system model (AWI-ESM2.1) with interactive icebergs: effects on surface and deep-ocean characteristics
The regional climate–chemistry–ecology coupling model RegCM-Chem (v4.6)–YIBs (v1.0): development and application
Coupling the regional climate model ICON-CLM v2.6.6 into the Earth system model GCOAST-AHOI v2.0 using OASIS3-MCT v4.0
An overview of cloud–radiation denial experiments for the Energy Exascale Earth System Model version 1
The computational and energy cost of simulation and storage for climate science: lessons from CMIP6
Subgrid-scale variability of cloud ice in the ICON-AES 1.3.00
INFERNO-peat v1.0.0: a representation of northern high-latitude peat fires in the JULES-INFERNO global fire model
The 4DEnVar-based weakly coupled land data assimilation system for E3SM version 2
Continental-scale bias-corrected climate and hydrological projections for Australia
G6-1.5K-SAI: a new Geoengineering Model Intercomparison Project (GeoMIP) experiment integrating recent advances in solar radiation modification studies
Bridging the gap: a new module for human water use in the Community Earth System Model version 2.2.1
Modeling the effects of tropospheric ozone on the growth and yield of global staple crops with DSSAT v4.8.0
A one-dimensional urban flow model with an eddy-diffusivity mass-flux (EDMF) scheme and refined turbulent transport (MLUCM v3.0)
DCMIP2016: the tropical cyclone test case
At-scale Model Output Statistics in mountain environments (AtsMOS v1.0)
Marit Sandstad, Borgar Aamaas, Ane Nordlie Johansen, Marianne Tronstad Lund, Glen Philip Peters, Bjørn Hallvard Samset, Benjamin Mark Sanderson, and Ragnhild Bieltvedt Skeie
Geosci. Model Dev., 17, 6589–6625, https://doi.org/10.5194/gmd-17-6589-2024, https://doi.org/10.5194/gmd-17-6589-2024, 2024
Short summary
Short summary
The CICERO-SCM has existed as a Fortran model since 1999 that calculates the radiative forcing and concentrations from emissions and is an upwelling diffusion energy balance model of the ocean that calculates temperature change. In this paper, we describe an updated version ported to Python and publicly available at https://github.com/ciceroOslo/ciceroscm (https://doi.org/10.5281/zenodo.10548720). This version contains functionality for parallel runs and automatic calibration.
Zheng Xiang, Yongkang Xue, Weidong Guo, Melannie D. Hartman, Ye Liu, and William J. Parton
Geosci. Model Dev., 17, 6437–6464, https://doi.org/10.5194/gmd-17-6437-2024, https://doi.org/10.5194/gmd-17-6437-2024, 2024
Short summary
Short summary
A process-based plant carbon (C)–nitrogen (N) interface coupling framework has been developed which mainly focuses on plant resistance and N-limitation effects on photosynthesis, plant respiration, and plant phenology. A dynamic C / N ratio is introduced to represent plant resistance and self-adjustment. The framework has been implemented in a coupled biophysical-ecosystem–biogeochemical model, and testing results show a general improvement in simulating plant properties with this framework.
Yangke Liu, Qing Bao, Bian He, Xiaofei Wu, Jing Yang, Yimin Liu, Guoxiong Wu, Tao Zhu, Siyuan Zhou, Yao Tang, Ankang Qu, Yalan Fan, Anling Liu, Dandan Chen, Zhaoming Luo, Xing Hu, and Tongwen Wu
Geosci. Model Dev., 17, 6249–6275, https://doi.org/10.5194/gmd-17-6249-2024, https://doi.org/10.5194/gmd-17-6249-2024, 2024
Short summary
Short summary
We give an overview of the Institute of Atmospheric Physics–Chinese Academy of Sciences subseasonal-to-seasonal ensemble forecasting system and Madden–Julian Oscillation forecast evaluation of the system. Compared to other S2S models, the IAP-CAS model has its benefits but also biases, i.e., underdispersive ensemble, overestimated amplitude, and faster propagation speed when forecasting MJO. We provide a reason for these biases and prospects for further improvement of this system in the future.
Laurent Brodeau, Pierre Rampal, Einar Ólason, and Véronique Dansereau
Geosci. Model Dev., 17, 6051–6082, https://doi.org/10.5194/gmd-17-6051-2024, https://doi.org/10.5194/gmd-17-6051-2024, 2024
Short summary
Short summary
A new brittle sea ice rheology, BBM, has been implemented into the sea ice component of NEMO. We describe how a new spatial discretization framework was introduced to achieve this. A set of idealized and realistic ocean and sea ice simulations of the Arctic have been performed using BBM and the standard viscous–plastic rheology of NEMO. When compared to satellite data, our simulations show that our implementation of BBM leads to a fairly good representation of sea ice deformations.
Joseph P. Hollowed, Christiane Jablonowski, Hunter Y. Brown, Benjamin R. Hillman, Diana L. Bull, and Joseph L. Hart
Geosci. Model Dev., 17, 5913–5938, https://doi.org/10.5194/gmd-17-5913-2024, https://doi.org/10.5194/gmd-17-5913-2024, 2024
Short summary
Short summary
Large volcanic eruptions deposit material in the upper atmosphere, which is capable of altering temperature and wind patterns of Earth's atmosphere for subsequent years. This research describes a new method of simulating these effects in an idealized, efficient atmospheric model. A volcanic eruption of sulfur dioxide is described with a simplified set of physical rules, which eventually cools the planetary surface. This model has been designed as a test bed for climate attribution studies.
Hong Li, Yi Yang, Jian Sun, Yuan Jiang, Ruhui Gan, and Qian Xie
Geosci. Model Dev., 17, 5883–5896, https://doi.org/10.5194/gmd-17-5883-2024, https://doi.org/10.5194/gmd-17-5883-2024, 2024
Short summary
Short summary
Vertical atmospheric motions play a vital role in convective-scale precipitation forecasts by connecting atmospheric dynamics with cloud development. A three-dimensional variational vertical velocity assimilation scheme is developed within the high-resolution CMA-MESO model, utilizing the adiabatic Richardson equation as the observation operator. A 10 d continuous run and an individual case study demonstrate improved forecasts, confirming the scheme's effectiveness.
Matthias Nützel, Laura Stecher, Patrick Jöckel, Franziska Winterstein, Martin Dameris, Michael Ponater, Phoebe Graf, and Markus Kunze
Geosci. Model Dev., 17, 5821–5849, https://doi.org/10.5194/gmd-17-5821-2024, https://doi.org/10.5194/gmd-17-5821-2024, 2024
Short summary
Short summary
We extended the infrastructure of our modelling system to enable the use of an additional radiation scheme. After calibrating the model setups to the old and the new radiation scheme, we find that the simulation with the new scheme shows considerable improvements, e.g. concerning the cold-point temperature and stratospheric water vapour. Furthermore, perturbations of radiative fluxes associated with greenhouse gas changes, e.g. of methane, tend to be improved when the new scheme is employed.
Yibing Wang, Xianhong Xie, Bowen Zhu, Arken Tursun, Fuxiao Jiang, Yao Liu, Dawei Peng, and Buyun Zheng
Geosci. Model Dev., 17, 5803–5819, https://doi.org/10.5194/gmd-17-5803-2024, https://doi.org/10.5194/gmd-17-5803-2024, 2024
Short summary
Short summary
Urban expansion intensifies challenges like urban heat and urban dry islands. To address this, we developed an urban module, VIC-urban, in the Variable Infiltration Capacity (VIC) model. Tested in Beijing, VIC-urban accurately simulated turbulent heat fluxes, runoff, and land surface temperature. We provide a reliable tool for large-scale simulations considering urban environment and a systematic urban modelling framework within VIC, offering crucial insights for urban planners and designers.
Jeremy Carter, Erick A. Chacón-Montalván, and Amber Leeson
Geosci. Model Dev., 17, 5733–5757, https://doi.org/10.5194/gmd-17-5733-2024, https://doi.org/10.5194/gmd-17-5733-2024, 2024
Short summary
Short summary
Climate models are essential tools in the study of climate change and its wide-ranging impacts on life on Earth. However, the output is often afflicted with some bias. In this paper, a novel model is developed to predict and correct bias in the output of climate models. The model captures uncertainty in the correction and explicitly models underlying spatial correlation between points. These features are of key importance for climate change impact assessments and resulting decision-making.
Anna Martin, Veronika Gayler, Benedikt Steil, Klaus Klingmüller, Patrick Jöckel, Holger Tost, Jos Lelieveld, and Andrea Pozzer
Geosci. Model Dev., 17, 5705–5732, https://doi.org/10.5194/gmd-17-5705-2024, https://doi.org/10.5194/gmd-17-5705-2024, 2024
Short summary
Short summary
The study evaluates the land surface and vegetation model JSBACHv4 as a replacement for the simplified submodel SURFACE in EMAC. JSBACH mitigates earlier problems of soil dryness, which are critical for vegetation modelling. When analysed using different datasets, the coupled model shows strong correlations of key variables, such as land surface temperature, surface albedo and radiation flux. The versatility of the model increases significantly, while the overall performance does not degrade.
Hugo Banderier, Christian Zeman, David Leutwyler, Stefan Rüdisühli, and Christoph Schär
Geosci. Model Dev., 17, 5573–5586, https://doi.org/10.5194/gmd-17-5573-2024, https://doi.org/10.5194/gmd-17-5573-2024, 2024
Short summary
Short summary
We investigate the effects of reduced-precision arithmetic in a state-of-the-art regional climate model by studying the results of 10-year-long simulations. After this time, the results of the reduced precision and the standard implementation are hardly different. This should encourage the use of reduced precision in climate models to exploit the speedup and memory savings it brings. The methodology used in this work can help researchers verify reduced-precision implementations of their model.
David Fuchs, Steven C. Sherwood, Abhnil Prasad, Kirill Trapeznikov, and Jim Gimlett
Geosci. Model Dev., 17, 5459–5475, https://doi.org/10.5194/gmd-17-5459-2024, https://doi.org/10.5194/gmd-17-5459-2024, 2024
Short summary
Short summary
Machine learning (ML) of unresolved processes offers many new possibilities for improving weather and climate models, but integrating ML into the models has been an engineering challenge, and there are performance issues. We present a new software plugin for this integration, TorchClim, that is scalable and flexible and thereby allows a new level of experimentation with the ML approach. We also provide guidance on ML training and demonstrate a skillful hybrid ML atmosphere model.
Minjin Lee, Charles A. Stock, John P. Dunne, and Elena Shevliakova
Geosci. Model Dev., 17, 5191–5224, https://doi.org/10.5194/gmd-17-5191-2024, https://doi.org/10.5194/gmd-17-5191-2024, 2024
Short summary
Short summary
Modeling global freshwater solid and nutrient loads, in both magnitude and form, is imperative for understanding emerging eutrophication problems. Such efforts, however, have been challenged by the difficulty of balancing details of freshwater biogeochemical processes with limited knowledge, input, and validation datasets. Here we develop a global freshwater model that resolves intertwined algae, solid, and nutrient dynamics and provide performance assessment against measurement-based estimates.
Hunter York Brown, Benjamin Wagman, Diana Bull, Kara Peterson, Benjamin Hillman, Xiaohong Liu, Ziming Ke, and Lin Lin
Geosci. Model Dev., 17, 5087–5121, https://doi.org/10.5194/gmd-17-5087-2024, https://doi.org/10.5194/gmd-17-5087-2024, 2024
Short summary
Short summary
Explosive volcanic eruptions lead to long-lived, microscopic particles in the upper atmosphere which act to cool the Earth's surface by reflecting the Sun's light back to space. We include and test this process in a global climate model, E3SM. E3SM is tested against satellite and balloon observations of the 1991 eruption of Mt. Pinatubo, showing that with these particles in the model we reasonably recreate Pinatubo and its global effects. We also explore how particle size leads to these effects.
Carl Svenhag, Moa K. Sporre, Tinja Olenius, Daniel Yazgi, Sara M. Blichner, Lars P. Nieradzik, and Pontus Roldin
Geosci. Model Dev., 17, 4923–4942, https://doi.org/10.5194/gmd-17-4923-2024, https://doi.org/10.5194/gmd-17-4923-2024, 2024
Short summary
Short summary
Our research shows the importance of modeling new particle formation (NPF) and growth of particles in the atmosphere on a global scale, as they influence the outcomes of clouds and our climate. With the global model EC-Earth3 we show that using a new method for NPF modeling, which includes new detailed processes with NH3 and H2SO4, significantly impacts the number of particles in the air and clouds and changes the radiation balance of the same magnitude as anthropogenic greenhouse emissions.
Mengjie Han, Qing Zhao, Xili Wang, Ying-Ping Wang, Philippe Ciais, Haicheng Zhang, Daniel S. Goll, Lei Zhu, Zhe Zhao, Zhixuan Guo, Chen Wang, Wei Zhuang, Fengchang Wu, and Wei Li
Geosci. Model Dev., 17, 4871–4890, https://doi.org/10.5194/gmd-17-4871-2024, https://doi.org/10.5194/gmd-17-4871-2024, 2024
Short summary
Short summary
The impact of biochar (BC) on soil organic carbon (SOC) dynamics is not represented in most land carbon models used for assessing land-based climate change mitigation. Our study develops a BC model that incorporates our current understanding of BC effects on SOC based on a soil carbon model (MIMICS). The BC model can reproduce the SOC changes after adding BC, providing a useful tool to couple dynamic land models to evaluate the effectiveness of BC application for CO2 removal from the atmosphere.
Kalyn Dorheim, Skylar Gering, Robert Gieseke, Corinne Hartin, Leeya Pressburger, Alexey N. Shiklomanov, Steven J. Smith, Claudia Tebaldi, Dawn L. Woodard, and Ben Bond-Lamberty
Geosci. Model Dev., 17, 4855–4869, https://doi.org/10.5194/gmd-17-4855-2024, https://doi.org/10.5194/gmd-17-4855-2024, 2024
Short summary
Short summary
Hector is an easy-to-use, global climate–carbon cycle model. With its quick run time, Hector can provide climate information from a run in a fraction of a second. Hector models on a global and annual basis. Here, we present an updated version of the model, Hector V3. In this paper, we document Hector’s new features. Hector V3 is capable of reproducing historical observations, and its future temperature projections are consistent with those of more complex models.
Fangxuan Ren, Jintai Lin, Chenghao Xu, Jamiu A. Adeniran, Jingxu Wang, Randall V. Martin, Aaron van Donkelaar, Melanie S. Hammer, Larry W. Horowitz, Steven T. Turnock, Naga Oshima, Jie Zhang, Susanne Bauer, Kostas Tsigaridis, Øyvind Seland, Pierre Nabat, David Neubauer, Gary Strand, Twan van Noije, Philippe Le Sager, and Toshihiko Takemura
Geosci. Model Dev., 17, 4821–4836, https://doi.org/10.5194/gmd-17-4821-2024, https://doi.org/10.5194/gmd-17-4821-2024, 2024
Short summary
Short summary
We evaluate the performance of 14 CMIP6 ESMs in simulating total PM2.5 and its 5 components over China during 2000–2014. PM2.5 and its components are underestimated in almost all models, except that black carbon (BC) and sulfate are overestimated in two models, respectively. The underestimation is the largest for organic carbon (OC) and the smallest for BC. Models reproduce the observed spatial pattern for OC, sulfate, nitrate and ammonium well, yet the agreement is poorer for BC.
Yi Xi, Chunjing Qiu, Yuan Zhang, Dan Zhu, Shushi Peng, Gustaf Hugelius, Jinfeng Chang, Elodie Salmon, and Philippe Ciais
Geosci. Model Dev., 17, 4727–4754, https://doi.org/10.5194/gmd-17-4727-2024, https://doi.org/10.5194/gmd-17-4727-2024, 2024
Short summary
Short summary
The ORCHIDEE-MICT model can simulate the carbon cycle and hydrology at a sub-grid scale but energy budgets only at a grid scale. This paper assessed the implementation of a multi-tiling energy budget approach in ORCHIDEE-MICT and found warmer surface and soil temperatures, higher soil moisture, and more soil organic carbon across the Northern Hemisphere compared with the original version.
Georgia Lazoglou, Theo Economou, Christina Anagnostopoulou, George Zittis, Anna Tzyrkalli, Pantelis Georgiades, and Jos Lelieveld
Geosci. Model Dev., 17, 4689–4703, https://doi.org/10.5194/gmd-17-4689-2024, https://doi.org/10.5194/gmd-17-4689-2024, 2024
Short summary
Short summary
This study focuses on the important issue of the drizzle bias effect in regional climate models, described by an over-prediction of the number of rainy days while underestimating associated precipitation amounts. For this purpose, two distinct methodologies are applied and rigorously evaluated. These results are encouraging for using the multivariate machine learning method random forest to increase the accuracy of climate models concerning the projection of the number of wet days.
Xu Yue, Hao Zhou, Chenguang Tian, Yimian Ma, Yihan Hu, Cheng Gong, Hui Zheng, and Hong Liao
Geosci. Model Dev., 17, 4621–4642, https://doi.org/10.5194/gmd-17-4621-2024, https://doi.org/10.5194/gmd-17-4621-2024, 2024
Short summary
Short summary
We develop the interactive Model for Air Pollution and Land Ecosystems (iMAPLE). The model considers the full coupling between carbon and water cycles, dynamic fire emissions, wetland methane emissions, biogenic volatile organic compound emissions, and trait-based ozone vegetation damage. Evaluations show that iMAPLE is a useful tool for the study of the interactions among climate, chemistry, and ecosystems.
Malte Meinshausen, Carl-Friedrich Schleussner, Kathleen Beyer, Greg Bodeker, Olivier Boucher, Josep G. Canadell, John S. Daniel, Aïda Diongue-Niang, Fatima Driouech, Erich Fischer, Piers Forster, Michael Grose, Gerrit Hansen, Zeke Hausfather, Tatiana Ilyina, Jarmo S. Kikstra, Joyce Kimutai, Andrew D. King, June-Yi Lee, Chris Lennard, Tabea Lissner, Alexander Nauels, Glen P. Peters, Anna Pirani, Gian-Kasper Plattner, Hans Pörtner, Joeri Rogelj, Maisa Rojas, Joyashree Roy, Bjørn H. Samset, Benjamin M. Sanderson, Roland Séférian, Sonia Seneviratne, Christopher J. Smith, Sophie Szopa, Adelle Thomas, Diana Urge-Vorsatz, Guus J. M. Velders, Tokuta Yokohata, Tilo Ziehn, and Zebedee Nicholls
Geosci. Model Dev., 17, 4533–4559, https://doi.org/10.5194/gmd-17-4533-2024, https://doi.org/10.5194/gmd-17-4533-2024, 2024
Short summary
Short summary
The scientific community is considering new scenarios to succeed RCPs and SSPs for the next generation of Earth system model runs to project future climate change. To contribute to that effort, we reflect on relevant policy and scientific research questions and suggest categories for representative emission pathways. These categories are tailored to the Paris Agreement long-term temperature goal, high-risk outcomes in the absence of further climate policy and worlds “that could have been”.
Ross Mower, Ethan D. Gutmann, Glen E. Liston, Jessica Lundquist, and Soren Rasmussen
Geosci. Model Dev., 17, 4135–4154, https://doi.org/10.5194/gmd-17-4135-2024, https://doi.org/10.5194/gmd-17-4135-2024, 2024
Short summary
Short summary
Higher-resolution model simulations are better at capturing winter snowpack changes across space and time. However, increasing resolution also increases the computational requirements. This work provides an overview of changes made to a distributed snow-evolution modeling system (SnowModel) to allow it to leverage high-performance computing resources. Continental simulations that were previously estimated to take 120 d can now be performed in 5 h.
Jiaxu Guo, Juepeng Zheng, Yidan Xu, Haohuan Fu, Wei Xue, Lanning Wang, Lin Gan, Ping Gao, Wubing Wan, Xianwei Wu, Zhitao Zhang, Liang Hu, Gaochao Xu, and Xilong Che
Geosci. Model Dev., 17, 3975–3992, https://doi.org/10.5194/gmd-17-3975-2024, https://doi.org/10.5194/gmd-17-3975-2024, 2024
Short summary
Short summary
To enhance the efficiency of experiments using SCAM, we train a learning-based surrogate model to facilitate large-scale sensitivity analysis and tuning of combinations of multiple parameters. Employing a hybrid method, we investigate the joint sensitivity of multi-parameter combinations across typical cases, identifying the most sensitive three-parameter combination out of 11. Subsequently, we conduct a tuning process aimed at reducing output errors in these cases.
Yung-Yao Lan, Huang-Hsiung Hsu, and Wan-Ling Tseng
Geosci. Model Dev., 17, 3897–3918, https://doi.org/10.5194/gmd-17-3897-2024, https://doi.org/10.5194/gmd-17-3897-2024, 2024
Short summary
Short summary
This study uses the CAM5–SIT coupled model to investigate the effects of SST feedback frequency on the MJO simulations with intervals at 30 min, 1, 3, 6, 12, 18, 24, and 30 d. The simulations become increasingly unrealistic as the frequency of the SST feedback decreases. Our results suggest that more spontaneous air--sea interaction (e.g., ocean response within 3 d in this study) with high vertical resolution in the ocean model is key to the realistic simulation of the MJO.
Jiwoo Lee, Peter J. Gleckler, Min-Seop Ahn, Ana Ordonez, Paul A. Ullrich, Kenneth R. Sperber, Karl E. Taylor, Yann Y. Planton, Eric Guilyardi, Paul Durack, Celine Bonfils, Mark D. Zelinka, Li-Wei Chao, Bo Dong, Charles Doutriaux, Chengzhu Zhang, Tom Vo, Jason Boutte, Michael F. Wehner, Angeline G. Pendergrass, Daehyun Kim, Zeyu Xue, Andrew T. Wittenberg, and John Krasting
Geosci. Model Dev., 17, 3919–3948, https://doi.org/10.5194/gmd-17-3919-2024, https://doi.org/10.5194/gmd-17-3919-2024, 2024
Short summary
Short summary
We introduce an open-source software, the PCMDI Metrics Package (PMP), developed for a comprehensive comparison of Earth system models (ESMs) with real-world observations. Using diverse metrics evaluating climatology, variability, and extremes simulated in thousands of simulations from the Coupled Model Intercomparison Project (CMIP), PMP aids in benchmarking model improvements across generations. PMP also enables efficient tracking of performance evolutions during ESM developments.
Haoyue Zuo, Yonggang Liu, Gaojun Li, Zhifang Xu, Liang Zhao, Zhengtang Guo, and Yongyun Hu
Geosci. Model Dev., 17, 3949–3974, https://doi.org/10.5194/gmd-17-3949-2024, https://doi.org/10.5194/gmd-17-3949-2024, 2024
Short summary
Short summary
Compared to the silicate weathering fluxes measured at large river basins, the current models tend to systematically overestimate the fluxes over the tropical region, which leads to an overestimation of the global total weathering flux. The most possible cause of such bias is found to be the overestimation of tropical surface erosion, which indicates that the tropical vegetation likely slows down physical erosion significantly. We propose a way of taking this effect into account in models.
Quentin Pikeroen, Didier Paillard, and Karine Watrin
Geosci. Model Dev., 17, 3801–3814, https://doi.org/10.5194/gmd-17-3801-2024, https://doi.org/10.5194/gmd-17-3801-2024, 2024
Short summary
Short summary
All accurate climate models use equations with poorly defined parameters, where knobs for the parameters are turned to fit the observations. This process is called tuning. In this article, we use another paradigm. We use a thermodynamic hypothesis, the maximum entropy production, to compute temperatures, energy fluxes, and precipitation, where tuning is impossible. For now, the 1D vertical model is used for a tropical atmosphere. The correct order of magnitude of precipitation is computed.
Sarah Schöngart, Lukas Gudmundsson, Mathias Hauser, Peter Pfleiderer, Quentin Lejeune, Shruti Nath, Sonia Isabelle Seneviratne, and Carl-Friedrich Schleußner
EGUsphere, https://doi.org/10.5194/egusphere-2024-278, https://doi.org/10.5194/egusphere-2024-278, 2024
Short summary
Short summary
Precipitation and temperature are two of the most impact-relevant climatic variables. Their joint distribution largely determines the division into climate regimes. Yet, projecting precipitation and temperature data under different emission scenarios relies on complex models that are computationally expensive. In this study, we propose a method that allows to generate monthly means of local precipitation and temperature at low computational costs.
Jishi Zhang, Peter Bogenschutz, Qi Tang, Philip Cameron-smith, and Chengzhu Zhang
Geosci. Model Dev., 17, 3687–3731, https://doi.org/10.5194/gmd-17-3687-2024, https://doi.org/10.5194/gmd-17-3687-2024, 2024
Short summary
Short summary
We developed a regionally refined climate model that allows resolved convection and performed a 20-year projection to the end of the century. The model has a resolution of 3.25 km in California, which allows us to predict climate with unprecedented accuracy, and a resolution of 100 km for the rest of the globe to achieve efficient, self-consistent simulations. The model produces superior results in reproducing climate patterns over California that typical modern climate models cannot resolve.
Xiaohui Zhong, Xing Yu, and Hao Li
Geosci. Model Dev., 17, 3667–3685, https://doi.org/10.5194/gmd-17-3667-2024, https://doi.org/10.5194/gmd-17-3667-2024, 2024
Short summary
Short summary
In order to forecast localized warm-sector rainfall in the south China region, numerical weather prediction models are being run with finer grid spacing. The conventional convection parameterization (CP) performs poorly in the gray zone, necessitating the development of a scale-aware scheme. We propose a machine learning (ML) model to replace the scale-aware CP scheme. Evaluation against the original CP scheme has shown that the ML-based CP scheme can provide accurate and reliable predictions.
Taufiq Hassan, Kai Zhang, Jianfeng Li, Balwinder Singh, Shixuan Zhang, Hailong Wang, and Po-Lun Ma
Geosci. Model Dev., 17, 3507–3532, https://doi.org/10.5194/gmd-17-3507-2024, https://doi.org/10.5194/gmd-17-3507-2024, 2024
Short summary
Short summary
Anthropogenic aerosol emissions are an essential part of global aerosol models. Significant errors can exist from the loss of emission heterogeneity. We introduced an emission treatment that significantly improved aerosol emission heterogeneity in high-resolution model simulations, with improvements in simulated aerosol surface concentrations. The emission treatment will provide a more accurate representation of aerosol emissions and their effects on climate.
Feng Zhu, Julien Emile-Geay, Gregory J. Hakim, Dominique Guillot, Deborah Khider, Robert Tardif, and Walter A. Perkins
Geosci. Model Dev., 17, 3409–3431, https://doi.org/10.5194/gmd-17-3409-2024, https://doi.org/10.5194/gmd-17-3409-2024, 2024
Short summary
Short summary
Climate field reconstruction encompasses methods that estimate the evolution of climate in space and time based on natural archives. It is useful to investigate climate variations and validate climate models, but its implementation and use can be difficult for non-experts. This paper introduces a user-friendly Python package called cfr to make these methods more accessible, thanks to the computational and visualization tools that facilitate efficient and reproducible research on past climates.
Rose V. Palermo, J. Taylor Perron, Jason M. Soderblom, Samuel P. D. Birch, Alexander G. Hayes, and Andrew D. Ashton
Geosci. Model Dev., 17, 3433–3445, https://doi.org/10.5194/gmd-17-3433-2024, https://doi.org/10.5194/gmd-17-3433-2024, 2024
Short summary
Short summary
Models of rocky coastal erosion help us understand the controls on coastal morphology and evolution. In this paper, we present a simplified model of coastline erosion driven by either uniform erosion where coastline erosion is constant or wave-driven erosion where coastline erosion is a function of the wave power. This model can be used to evaluate how coastline changes reflect climate, sea-level history, material properties, and the relative influence of different erosional processes.
Safae Oumami, Joaquim Arteta, Vincent Guidard, Pierre Tulet, and Paul David Hamer
Geosci. Model Dev., 17, 3385–3408, https://doi.org/10.5194/gmd-17-3385-2024, https://doi.org/10.5194/gmd-17-3385-2024, 2024
Short summary
Short summary
In this paper, we coupled the SURFEX and MEGAN models. The aim of this coupling is to improve the estimation of biogenic fluxes by using the SURFEX canopy environment model. The coupled model results were validated and several sensitivity tests were performed. The coupled-model total annual isoprene flux is 442 Tg; this value is within the range of other isoprene estimates reported. The ultimate aim of this coupling is to predict the impact of climate change on biogenic emissions.
Lars Ackermann, Thomas Rackow, Kai Himstedt, Paul Gierz, Gregor Knorr, and Gerrit Lohmann
Geosci. Model Dev., 17, 3279–3301, https://doi.org/10.5194/gmd-17-3279-2024, https://doi.org/10.5194/gmd-17-3279-2024, 2024
Short summary
Short summary
We present long-term simulations with interactive icebergs in the Southern Ocean. By melting, icebergs reduce the temperature and salinity of the surrounding ocean. In our simulations, we find that this cooling effect of iceberg melting is not limited to the surface ocean but also reaches the deep ocean and propagates northward into all ocean basins. Additionally, the formation of deep-water masses in the Southern Ocean is enhanced.
Nanhong Xie, Tijian Wang, Xiaodong Xie, Xu Yue, Filippo Giorgi, Qian Zhang, Danyang Ma, Rong Song, Beiyao Xu, Shu Li, Bingliang Zhuang, Mengmeng Li, Min Xie, Natalya Andreeva Kilifarska, Georgi Gadzhev, and Reneta Dimitrova
Geosci. Model Dev., 17, 3259–3277, https://doi.org/10.5194/gmd-17-3259-2024, https://doi.org/10.5194/gmd-17-3259-2024, 2024
Short summary
Short summary
For the first time, we coupled a regional climate chemistry model, RegCM-Chem, with a dynamic vegetation model, YIBs, to create a regional climate–chemistry–ecology model, RegCM-Chem–YIBs. We applied it to simulate climatic, chemical, and ecological parameters in East Asia and fully validated it on a variety of observational data. Results show that RegCM-Chem–YIBs model is a valuable tool for studying the terrestrial carbon cycle, atmospheric chemistry, and climate change on a regional scale.
Ha Thi Minh Ho-Hagemann, Vera Maurer, Stefan Poll, and Irina Fast
EGUsphere, https://doi.org/10.5194/egusphere-2024-923, https://doi.org/10.5194/egusphere-2024-923, 2024
Short summary
Short summary
The regional Earth system model GCOAST-AHOI version 2.0 including the regional climate model ICON-CLM coupled with the ocean model NEMO and the hydrological discharge model HD via the OASIS3-MCT coupler can be a useful tool for conducting long-term regional climate simulations over the EURO-CORDEX domain. The new OASIS3-MCT coupling interface implemented in the ICON-CLM model makes it more flexible to couple with an external ocean model and an external hydrological discharge model.
Bryce E. Harrop, Jian Lu, L. Ruby Leung, William K. M. Lau, Kyu-Myong Kim, Brian Medeiros, Brian J. Soden, Gabriel A. Vecchi, Bosong Zhang, and Balwinder Singh
Geosci. Model Dev., 17, 3111–3135, https://doi.org/10.5194/gmd-17-3111-2024, https://doi.org/10.5194/gmd-17-3111-2024, 2024
Short summary
Short summary
Seven new experimental setups designed to interfere with cloud radiative heating have been added to the Energy Exascale Earth System Model (E3SM). These experiments include both those that test the mean impact of cloud radiative heating and those examining its covariance with circulations. This paper documents the code changes and steps needed to run these experiments. Results corroborate prior findings for how cloud radiative heating impacts circulations and rainfall patterns.
Mario C. Acosta, Sergi Palomas, Stella V. Paronuzzi Ticco, Gladys Utrera, Joachim Biercamp, Pierre-Antoine Bretonniere, Reinhard Budich, Miguel Castrillo, Arnaud Caubel, Francisco Doblas-Reyes, Italo Epicoco, Uwe Fladrich, Sylvie Joussaume, Alok Kumar Gupta, Bryan Lawrence, Philippe Le Sager, Grenville Lister, Marie-Pierre Moine, Jean-Christophe Rioual, Sophie Valcke, Niki Zadeh, and Venkatramani Balaji
Geosci. Model Dev., 17, 3081–3098, https://doi.org/10.5194/gmd-17-3081-2024, https://doi.org/10.5194/gmd-17-3081-2024, 2024
Short summary
Short summary
We present a collection of performance metrics gathered during the Coupled Model Intercomparison Project Phase 6 (CMIP6), a worldwide initiative to study climate change. We analyse the metrics that resulted from collaboration efforts among many partners and models and describe our findings to demonstrate the utility of our study for the scientific community. The research contributes to understanding climate modelling performance on the current high-performance computing (HPC) architectures.
Sabine Doktorowski, Jan Kretzschmar, Johannes Quaas, Marc Salzmann, and Odran Sourdeval
Geosci. Model Dev., 17, 3099–3110, https://doi.org/10.5194/gmd-17-3099-2024, https://doi.org/10.5194/gmd-17-3099-2024, 2024
Short summary
Short summary
Especially over the midlatitudes, precipitation is mainly formed via the ice phase. In this study we focus on the initial snow formation process in the ICON-AES, the aggregation process. We use a stochastical approach for the aggregation parameterization and investigate the influence in the ICON-AES. Therefore, a distribution function of cloud ice is created, which is evaluated with satellite data. The new approach leads to cloud ice loss and an improvement in the process rate bias.
Katie R. Blackford, Matthew Kasoar, Chantelle Burton, Eleanor Burke, Iain Colin Prentice, and Apostolos Voulgarakis
Geosci. Model Dev., 17, 3063–3079, https://doi.org/10.5194/gmd-17-3063-2024, https://doi.org/10.5194/gmd-17-3063-2024, 2024
Short summary
Short summary
Peatlands are globally important stores of carbon which are being increasingly threatened by wildfires with knock-on effects on the climate system. Here we introduce a novel peat fire parameterization in the northern high latitudes to the INFERNO global fire model. Representing peat fires increases annual burnt area across the high latitudes, alongside improvements in how we capture year-to-year variation in burning and emissions.
Pengfei Shi, L. Ruby Leung, Bin Wang, Kai Zhang, Samson M. Hagos, and Shixuan Zhang
Geosci. Model Dev., 17, 3025–3040, https://doi.org/10.5194/gmd-17-3025-2024, https://doi.org/10.5194/gmd-17-3025-2024, 2024
Short summary
Short summary
Improving climate predictions have profound socio-economic impacts. This study introduces a new weakly coupled land data assimilation (WCLDA) system for a coupled climate model. We demonstrate improved simulation of soil moisture and temperature in many global regions and throughout the soil layers. Furthermore, significant improvements are also found in reproducing the time evolution of the 2012 US Midwest drought. The WCLDA system provides the groundwork for future predictability studies.
Justin Peter, Elisabeth Vogel, Wendy Sharples, Ulrike Bende-Michl, Louise Wilson, Pandora Hope, Andrew Dowdy, Greg Kociuba, Sri Srikanthan, Vi Co Duong, Jake Roussis, Vjekoslav Matic, Zaved Khan, Alison Oke, Margot Turner, Stuart Baron-Hay, Fiona Johnson, Raj Mehrotra, Ashish Sharma, Marcus Thatcher, Ali Azarvinand, Steven Thomas, Ghyslaine Boschat, Chantal Donnelly, and Robert Argent
Geosci. Model Dev., 17, 2755–2781, https://doi.org/10.5194/gmd-17-2755-2024, https://doi.org/10.5194/gmd-17-2755-2024, 2024
Short summary
Short summary
We detail the production of datasets and communication to end users of high-resolution projections of rainfall, runoff, and soil moisture for the entire Australian continent. This is important as previous projections for Australia were for small regions and used differing techniques for their projections, making comparisons difficult across Australia's varied climate zones. The data will be beneficial for research purposes and to aid adaptation to climate change.
Daniele Visioni, Alan Robock, Jim Haywood, Matthew Henry, Simone Tilmes, Douglas G. MacMartin, Ben Kravitz, Sarah J. Doherty, John Moore, Chris Lennard, Shingo Watanabe, Helene Muri, Ulrike Niemeier, Olivier Boucher, Abu Syed, Temitope S. Egbebiyi, Roland Séférian, and Ilaria Quaglia
Geosci. Model Dev., 17, 2583–2596, https://doi.org/10.5194/gmd-17-2583-2024, https://doi.org/10.5194/gmd-17-2583-2024, 2024
Short summary
Short summary
This paper describes a new experimental protocol for the Geoengineering Model Intercomparison Project (GeoMIP). In it, we describe the details of a new simulation of sunlight reflection using the stratospheric aerosols that climate models are supposed to run, and we explain the reasons behind each choice we made when defining the protocol.
Sabin I. Taranu, David M. Lawrence, Yoshihide Wada, Ting Tang, Erik Kluzek, Sam Rabin, Yi Yao, Steven J. De Hertog, Inne Vanderkelen, and Wim Thiery
EGUsphere, https://doi.org/10.5194/egusphere-2024-362, https://doi.org/10.5194/egusphere-2024-362, 2024
Short summary
Short summary
In this study, we improve an existing climate model to account for human water usage across domestic, industrial, and agriculture purposes. With the new capabilities, the model is now better equipped for studying questions related to water scarcity in both present and future conditions under climate change. Despite the advancements, there remains important limitations in our modelling framework which requires further work.
Jose Rafael Guarin, Jonas Jägermeyr, Elizabeth A. Ainsworth, Fabio A. A. Oliveira, Senthold Asseng, Kenneth Boote, Joshua Elliott, Lisa Emberson, Ian Foster, Gerrit Hoogenboom, David Kelly, Alex C. Ruane, and Katrina Sharps
Geosci. Model Dev., 17, 2547–2567, https://doi.org/10.5194/gmd-17-2547-2024, https://doi.org/10.5194/gmd-17-2547-2024, 2024
Short summary
Short summary
The effects of ozone (O3) stress on crop photosynthesis and leaf senescence were added to maize, rice, soybean, and wheat crop models. The modified models reproduced growth and yields under different O3 levels measured in field experiments and reported in the literature. The combined interactions between O3 and additional stresses were reproduced with the new models. These updated crop models can be used to simulate impacts of O3 stress under future climate change and air pollution scenarios.
Jiachen Lu, Negin Nazarian, Melissa Anne Hart, E. Scott Krayenhoff, and Alberto Martilli
Geosci. Model Dev., 17, 2525–2545, https://doi.org/10.5194/gmd-17-2525-2024, https://doi.org/10.5194/gmd-17-2525-2024, 2024
Short summary
Short summary
This study enhances urban canopy models by refining key assumptions. Simulations for various urban scenarios indicate discrepancies in turbulent transport efficiency for flow properties. We propose two modifications that involve characterizing diffusion coefficients for momentum and turbulent kinetic energy separately and introducing a physics-based
mass-fluxterm. These adjustments enhance the model's performance, offering more reliable temperature and surface flux estimates.
Justin L. Willson, Kevin A. Reed, Christiane Jablonowski, James Kent, Peter H. Lauritzen, Ramachandran Nair, Mark A. Taylor, Paul A. Ullrich, Colin M. Zarzycki, David M. Hall, Don Dazlich, Ross Heikes, Celal Konor, David Randall, Thomas Dubos, Yann Meurdesoif, Xi Chen, Lucas Harris, Christian Kühnlein, Vivian Lee, Abdessamad Qaddouri, Claude Girard, Marco Giorgetta, Daniel Reinert, Hiroaki Miura, Tomoki Ohno, and Ryuji Yoshida
Geosci. Model Dev., 17, 2493–2507, https://doi.org/10.5194/gmd-17-2493-2024, https://doi.org/10.5194/gmd-17-2493-2024, 2024
Short summary
Short summary
Accurate simulation of tropical cyclones (TCs) is essential to understanding their behavior in a changing climate. One way this is accomplished is through model intercomparison projects, where results from multiple climate models are analyzed to provide benchmark solutions for the wider climate modeling community. This study describes and analyzes the previously developed TC test case for nine climate models in an intercomparison project, providing solutions that aid in model development.
Maximillian Van Wyk de Vries, Tom Matthews, L. Baker Perry, Nirakar Thapa, and Rob Wilby
Geosci. Model Dev. Discuss., https://doi.org/10.5194/gmd-2024-36, https://doi.org/10.5194/gmd-2024-36, 2024
Revised manuscript accepted for GMD
Short summary
Short summary
This paper introduces the AtsMOS workflow, a new tool for improving weather forecasts in mountainous areas. By combining advanced statistical techniques with local weather data, AtsMOS can provide more accurate predictions of weather conditions. Using data from Mount Everest as an example, AtsMOS has shown promise in better forecasting hazardous weather conditions, making it a valuable tool for communities in mountainous regions and beyond.
Cited articles
Annan, J. D., Hargreaves, J. C., Edwards, N. R., and Marsh, R.: Parameter estimation in an intermediate complexity earth system model using an ensemble Kalman filter, Ocean Model., 8, 135–154, https://doi.org/10.1016/j.ocemod.2003.12.004, 2005.
Arlot, S. and Celisse, A.: A survey of cross-validation procedures for model selection, Statistics Surveys, 4, 40–79, 2010.
Bache, K. and Lichman, M.: UCI Machine Learning Repository, available at: http://archive.ics.uci.edu/ml (last access: 30 May 2013), archived on 12 September 2012: http://www.webcitation.org/6AcuZgrsy, 2013.
Bishop, C. M.: Pattern Recognition and Machine Learning, Information Science and Statistics, 1st Edn., Springer, 2007.
Breiman, L.: Bagging predictors, Mach. Learn., 24, 123–140, 1996.
Breiman, L.: Random forests, Mach. Learn., 45, 5–32, 2001.
Breiman, L., Friedman, J. H., Olshen, R. A., and Stone, P. J.: Classification and Regression Trees, 1st Edn., Chapman and Hall/CRC, 1984.
Burges, C. J. C.: A tutorial on support vector machines for pattern recognition, Data Min. Knowl. Discov., 2, 121–167, 1998.
CCSM4: The Community Climate System Model, Version 4, available at: http://www.cesm.ucar.edu/models/ccsm4.0/ (last access: 22 January 2013), archived on 21 July 2010: http://www.webcitation.org/5rOj1F8rL, 2012.
Chang, C. C. and Lin, C. J.: LIBSVM: A library for support vector machines, ACM Trans. Intell. Syst. Technol., 2, 27, https://doi.org/10.1145/1961189.1961199, 2011.
Clune, T. and Rood, R.: Software testing and verification in climate model development, IEEE Software, 28, 49–55, 2011.
Cortes, C. and Vapnik, V.: Support-vector networks, Mach. Learn., 20, 273–297, 1995.
Danabasoglu, G., Bates, S., Briegleb, B., Jayne, S., Jochum, M., Large, W., Peacock, S., and Yeager, S.: The CCSM4 ocean component, J. Climate, 25, 1361–1389, 2012.
Dietterich, T. G.: Ensemble methods in machine learning, in: Multiple Classifier Systems, Lecture Notes in Computer Science, Springer Berlin Heidelberg, 1857, 1–15, 2000.
D'Silva, V., Kroening, D., and Weissenbacher, G.: A survey of automated techniques for formal software verification, IEEE T. Comput.-Aid. D., 27, 1165–1178, 2008.
Easterbrook, S. M.: Climate change: a grand software challenge, in: FoSER, edited by: Roman, G.-C. and Sullivan, K. J., 99–104, ACM, 2010.
Easterbrook, S. M.: Do Over or Make Do? Climate Models as a Software Development Challenge, 2012 Fall Meeting Abstracts, IN14B-01, AGU, San Francisco, Calif., 3–7 December, 2012.
Easterbrook, S. M. and Johns, T. C.: Engineering the software for understanding climate change, Comput. Sci. Eng., 11, 65–74, 2009.
Easterbrook, S. M., Edwards, P. N., Balaji, V., and Budich, R.: Guest editors' introduction: climate change – science and software, IEEE Software, 28, 32–35, 2011.
Edwards, N. R., Cameron, D., and Rougier, J.: Precalibrating an intermediate complexity climate model, Clim. Dynam., 37, 1469–1482, https://doi.org/10.1007/s00382-010-0921-0, 2011.
Farrell, P. E., Piggott, M. D., Gorman, G. J., Ham, D. A., Wilson, C. R., and Bond, T. M.: Automated continuous verification for numerical simulation, Geosci. Model Dev., 4, 435–449, https://doi.org/10.5194/gmd-4-435-2011, 2011.
Fawcett, T.: An introduction to ROC analysis, Pattern Recogn. Lett., 27, 861–874, 2006.
Forrester, A. I. J., Sobester, A., and Keane, A. J.: Engineering Design via Surrogate Modelling – A Practical Guide, Wiley, 2008.
Fox-Kemper, B., Ferrari, R., and Hallberg, R.: Parameterization of mixed layer eddies, Part I: Theory and diagnosis, J. Phys. Oceanogr., 38, 1145–1165, 2008.
Gent, P. R. and McWilliams, J. C.: Isopycnal mixing in ocean circulation models, J. Phys. Oceanogr., 20, 150–155, 1990.
Gent, P. R., Danabasoglu, G., Donner, L. J., Holland, M. M., Hunke, E. C., Jayne, S. R., Lawrence, D. M., Neale, R. B., Rasch, P. J., Vertenstein, M., Worley, P. H., Yang, Z.-L., and Zhang, M.: The Community Climate System Model Version 4, J. Climate, 24, 4973–4991, 2011.
Griffies, S.: Fundamentals of Ocean Climate Models, Princeton University Press, 2004.
Helton, J. C. and Davis, F. J.: Latin hypercube sampling and the propagation of uncertainty in analyses of complex systems, Reliab. Eng. Syst. Safe., 81, 23–69, 2003.
Helton, J., Johnson, J., Sallaberry, C., and Storlie, C.: Survey of sampling-based methods for uncertainty and sensitivity analysis, Reliab. Eng. Syst. Safe., 91, 1175–1209, 2006.
Hosmer, D. W. and Lemeshow, S.: Applied Logistic Regression, 2nd Edn., Wiley-Interscience, 2000.
Jackson, C., Sen, M., Huerta, G., Deng, Y., and Bowman, K.: Error reduction and convergence in climate prediction, J. Climate, 21, 6698–6709, 2008.
Jayne, S. R.: The impact of abyssal mixing parameterizations in an ocean general circulation model, J. Phys. Oceanogr., 39, 1756–1775, 2009.
Jochum, M., Danabasoglu, G., Holland, M., Kwon, Y.-O., and Large, W. G.: Ocean viscosity and climate, J. Geophys. Res., 113, C06017, https://doi.org/10.1029/2007JC004515, 2008.
Kotsiantis, S. B.: Supervised Machine Learning: a Review of Classification Techniques, in: Proceedings of the 2007 conference on Emerging Artificial Intelligence Applications in Computer Engineering: Real Word AI Systems with Applications in eHealth, HCI, Information Retrieval and Pervasive Technologies, IOS Press, Amsterdam, The Netherlands, The Netherlands, 3–24, 2007.
Large, W. and Yeager, S.: The global climatology of an interannually varying air–sea flux data set, Clim. Dynam., 33, 341–364, 2009.
Large, W. G., McWilliams, J. C., and Doney, S. C.: Oceanic vertical mixing: A review and a model with a nonlocal boundary layer parameterization, Rev. Geophys., 32, 363–403, 1994.
Large, W. G., Danabasoglu, G., McWilliams, J. C., Gent, P. R., and Bryan, F. O.: Equatorial circulation of a global ocean climate model with anisotropic horizontal viscosity, J. Phys. Oceanogr., 31, 518–536, 2001.
Lawrence Livermore National Laboratory Green Data Oasis, available through anonymous ftp at: ftp://gdo148.ucllnl.org/pub/ (last access: 24 June 2013), 2013.
Lucas, D. D. and Prinn, R. G.: Parametric sensitivity and uncertainty analysis of dimethylsulfide oxidation in the clear-sky remote marine boundary layer, Atmos. Chem. Phys., 5, 1505–1525, https://doi.org/10.5194/acp-5-1505-2005, 2005.
Marzban, C.: The ROC curve and the area under it as performance measures, Weather Forecast., 124, 1106–1113, 2004.
McKay, M. D., Beckman, R. J., and Conover, W. J.: A comparison of three methods for selecting values of input variables in the analysis of output from a computer code, Technometrics, 21, 239–245, 1979.
MLdata.org: Machine learning data set repository, available at: http://mldata.org/repository/data/viewslug/climate-model-simulation-crashes/ (last access: 24 June 2013), archived on 24 June 2013: http://www.webcitation.org/6HcrKQ4Lk, 2013.
Murphy, J., Sexton, D., Barnett, D., Jones, G., Webb, M., Collins, M., and Stainforth, D.: Quantification of modelling uncertainties in a large ensemble of climate change simulations, Nature, 430, 768–772, 2004.
National Research Council Report: Assessing the Reliability of Complex Models: Mathematical and Statistical Foundations of Verification, Validation, and Uncertainty Quantification, The National Academies Press, 2012.
Pipitone, J. and Easterbrook, S.: Assessing climate model software quality: a defect density analysis of three models, Geosci. Model Dev., 5, 1009–1022, https://doi.org/10.5194/gmd-5-1009-2012, 2012.
Platt, J. C.: Probabilistic outputs for support vector machines and comparisons to regularized likelihood methods, in: Advances in Large Margin Classifiers, MIT Press, 61–74, 1999.
Prati, R. C., Batista, G. E. A. P. A., and Monard, M. C.: Class imbalances versus class overlapping: an analysis of a learning system behavior, in: MICAI, edited by: Monroy, R., Arroyo-Figueroa, G., Sucar, L. E., and Azuela, J. H. S., Lecture Notes in Computer Science, vol. 2972, Springer, 312–321, 2004.
Randall, D., Wood, R., Bony, S., Colman, R., Fichefet, T., Fyfe, J., Kattsov, V., Pitman, A., Shukla, J., Srinivasan, J., Stouffer, R., Sumi, A., and Taylor, K.: Climate Models and Their Evaluation, in: Climate Change 2007: The Physical Science Basis, Contribution of Working Group I to the Fourth Assessment Report of the Intergovernmental Panel on Climate Change, edited by: Solomon, S., Qin, D., Manning, M., Chen, Z., Marquis, M., Averyt, K. B., Tignor, M., and Miller, H. L., Cambridge University Press, 2007.
Rugaber, S., Dunlap, R., Mark, L., and Ansari, S.: Managing software complexity and variability in coupled climate models, IEEE Software, 28, 43–48, 2011.
Saltelli, A., Chan, K., and Scott, E. M.: Sensitivity Analysis, Wiley, 2000.
Sanderson, B.: A multimodel study of parametric uncertainty in predictions of climate response to rising greenhouse gas concentrations, J. Climate, 24, 1362–1377, 2011.
Shiogama, H., Watanabe, M., Yoshimori, M., Yokohata, T., Ogura, T., Annan, J. D., Hargreaves, J. C., Abe, M., Kamae, Y., O'ishi, R., Nobui, R., Emori, S., Nozawa, T., Abe-Ouchi, A., and Kimoto, M.: Perturbed physics ensemble using the MIROC5 coupled atmosphere-ocean GCM without flux corrections: experimental design and results, Clim. Dynam., 39, 3041–3056, 2012.
Smith, R., Jones, P., Briegleb, B., Bryan, F., Danabasoglu, G., Dennis, J., Dukowicz, J., Eden, C., Fox-Kemper, B., Gent, P., Hecht, M., Jayne, S., Jochum, M., Large, W., Lindsay, K., Maltrud, M., Norton, N., Peacock, S., Vertenstein, M., and Yeager, S.: The Parallel Ocean Program (POP) reference manual, ocean component of the Community Climate System Model (CCSM), Tech. Rep. LAUR-10-01853, Los Alamos National Laboratory, 141 pp., 2010.
Smith, R. D. and McWilliams, J. C.: Anisotropic horizontal viscosity for ocean models, Ocean Model., 5, 129–156, 2003.
Sobol, I. M.: Global sensitivity indices for nonlinear mathematical models and their Monte Carlo estimates, Math. Comput. Simulat., 55, 271–280, 2001.
Stainforth, D., Aina, T., Christensen, C., Collins, M., Faull, N., Frame, D. J., Kettleborough, J. A., Knight, S., Martin, A., Murphy, J. M., Piani, C., Sexton, D., Smith, L. A., Spicer, R. A., Thorpe, A. J., and Allen, M. R.: Uncertainty in predictions of the climate response to rising levels of greenhouse gases, Nature, 433, 403–406, 2005.
Stein, M.: Large sample properties of simulations using Latin hypercube sampling, Technometrics, 29, 143–151, 1987.
Stensrud, D. J.: Parameterization Schemes: Keys to Understanding Numerical Weather Prediction Models, Cambridge University Press, 2009.
Sudret, B.: Global sensitivity analysis using polynomial chaos expansions, Reliab. Eng. Syst. Safe., 93, 964–979, 2008.
Swets, J. A.: Measuring the accuracy of diagnostic systems, Science, 240, 1285–1293, 1988.
Tannahill, J., Lucas, D. D., Domyancic, D., Brandon, S., and Klein, R.: Data intensive uncertainty quantification: Applications to climate modeling, in: Poster Presented at Super Computing 11, November 12–18, Seattle, Washington, USA, https://doi.org/10.1145/2148600.2148610, 2011.
Tatang, M., Pan, W., Prinn, R., and McRae, G.: An efficient method for parametric uncertainty analysis of numerical geophysical models, J. Geophys. Res., 102, 21925–21932, 1997.
The HadGEM2 Development Team: G. M. Martin, Bellouin, N., Collins, W. J., Culverwell, I. D., Halloran, P. R., Hardiman, S. C., Hinton, T. J., Jones, C. D., McDonald, R. E., McLaren, A. J., O'Connor, F. M., Roberts, M. J., Rodriguez, J. M., Woodward, S., Best, M. J., Brooks, M. E., Brown, A. R., Butchart, N., Dearden, C., Derbyshire, S. H., Dharssi, I., Doutriaux-Boucher, M., Edwards, J. M., Falloon, P. D., Gedney, N., Gray, L. J., Hewitt, H. T., Hobson, M., Huddleston, M. R., Hughes, J., Ineson, S., Ingram, W. J., James, P. M., Johns, T. C., Johnson, C. E., Jones, A., Jones, C. P., Joshi, M. M., Keen, A. B., Liddicoat, S., Lock, A. P., Maidens, A. V., Manners, J. C., Milton, S. F., Rae, J. G. L., Ridley, J. K., Sellar, A., Senior, C. A., Totterdell, I. J., Verhoef, A., Vidale, P. L., and Wiltshire, A.: The HadGEM2 family of Met Office Unified Model climate configurations, Geosci. Model Dev., 4, 723–757, https://doi.org/10.5194/gmd-4-723-2011, 2011.
Vapnik, V. N.: The Nature of Statistical Learning Theory, Springer, New York, NY, USA, 1995.
Walter, K.: Narrowing Uncertainties, Science & Technology Review, available at: https://str.llnl.gov/JulAug10/klein.html (last access: 22 January 2013), archived on 22 January 2013: http://www.webcitation.org/6DsDwCRxY, 2010.
Washington, W. M. and Parkinson, C. L.: An introduction to three-dimensional climate modeling, University Science Books, 2nd Edn., 2005.
Webster, M., Scott, J., Sokolov, A., and Stone, P.: Estimating probability distributions from complex models with bifurcations: The case of ocean circulation collapse, J. Environ. Sys., 31, 1–21, https://doi.org/10.2190/A518-W844-4193-4202, 2004.
Wiener, N.: The homogeneous chaos, Am. J. Math., 60, 897–936, 1938.
Xiu, D. and Karnidakis, G. E. M.: The Wiener–Askey polynomial chaos for stochastic differential equations, SIAM J. Sci. Comput., 24, 619–644, 2002.
