Articles | Volume 13, issue 8
https://doi.org/10.5194/gmd-13-3627-2020
© Author(s) 2020. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
https://doi.org/10.5194/gmd-13-3627-2020
© Author(s) 2020. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
Methods for assessment of models
| 
21 Aug 2020
Methods for assessment of models |
| 21 Aug 2020
| 21 Aug 2020
Evaluating simulated climate patterns from the CMIP archives using satellite and reanalysis datasets using the Climate Model Assessment Tool (CMATv1)
National Center for Atmospheric Research, Boulder, CO, 80302, USA
Related authors
John T. Fasullo, Jean-Christophe Golaz, Julie M. Caron, Nan Rosenbloom, Gerald A. Meehl, Warren Strand, Sasha Glanville, Samantha Stevenson, Maria Molina, Christine A. Shields, Chengzhu Zhang, James Benedict, and Tony Bartoletti
Earth Syst. Dynam., 15, 367–386, https://doi.org/10.5194/esd-15-367-2024, https://doi.org/10.5194/esd-15-367-2024, 2024
Short summary
Short summary
Climate model large ensembles provide a unique and invaluable means for estimating the climate response to external forcing agents and quantify contrasts in model structure. Here, an overview of the Energy Exascale Earth System Model (E3SM) version 2 large ensemble is given along with comparisons to large ensembles from E3SM version 1 and versions 1 and 2 of the Community Earth System Model. The paper provides broad and important context for users of these ensembles.
Marika M. Holland, Cecile Hannay, John Fasullo, Alexandra Jahn, Jennifer E. Kay, Michael Mills, Isla R. Simpson, William Wieder, Peter Lawrence, Erik Kluzek, and David Bailey
Geosci. Model Dev., 17, 1585–1602, https://doi.org/10.5194/gmd-17-1585-2024, https://doi.org/10.5194/gmd-17-1585-2024, 2024
Short summary
Short summary
Climate evolves in response to changing forcings, as prescribed in simulations. Models and forcings are updated over time to reflect new understanding. This makes it difficult to attribute simulation differences to either model or forcing changes. Here we present new simulations which enable the separation of model structure and forcing influence between two widely used simulation sets. Results indicate a strong influence of aerosol emission uncertainty on historical climate.
John T. Fasullo and Jadwiga H. Richter
Atmos. Chem. Phys., 23, 163–182, https://doi.org/10.5194/acp-23-163-2023, https://doi.org/10.5194/acp-23-163-2023, 2023
Short summary
Short summary
The continued high levels of anthropogenic greenhouse gas emissions increase the likelihood that key climate warming thresholds will be exceeded in the coming decades. Here we examine a recently proposed geoengineering approach using two recently produced climate model experiments. We find the associated latitudinal distribution of aerosol mass to exhibit substantial uncertainty, suggesting the need for significant flexibility in the location and amount of aerosol delivery, if implemented.
John T. Fasullo, Jean-Christophe Golaz, Julie M. Caron, Nan Rosenbloom, Gerald A. Meehl, Warren Strand, Sasha Glanville, Samantha Stevenson, Maria Molina, Christine A. Shields, Chengzhu Zhang, James Benedict, and Tony Bartoletti
Earth Syst. Dynam., 15, 367–386, https://doi.org/10.5194/esd-15-367-2024, https://doi.org/10.5194/esd-15-367-2024, 2024
Short summary
Short summary
Climate model large ensembles provide a unique and invaluable means for estimating the climate response to external forcing agents and quantify contrasts in model structure. Here, an overview of the Energy Exascale Earth System Model (E3SM) version 2 large ensemble is given along with comparisons to large ensembles from E3SM version 1 and versions 1 and 2 of the Community Earth System Model. The paper provides broad and important context for users of these ensembles.
Marika M. Holland, Cecile Hannay, John Fasullo, Alexandra Jahn, Jennifer E. Kay, Michael Mills, Isla R. Simpson, William Wieder, Peter Lawrence, Erik Kluzek, and David Bailey
Geosci. Model Dev., 17, 1585–1602, https://doi.org/10.5194/gmd-17-1585-2024, https://doi.org/10.5194/gmd-17-1585-2024, 2024
Short summary
Short summary
Climate evolves in response to changing forcings, as prescribed in simulations. Models and forcings are updated over time to reflect new understanding. This makes it difficult to attribute simulation differences to either model or forcing changes. Here we present new simulations which enable the separation of model structure and forcing influence between two widely used simulation sets. Results indicate a strong influence of aerosol emission uncertainty on historical climate.
John T. Fasullo and Jadwiga H. Richter
Atmos. Chem. Phys., 23, 163–182, https://doi.org/10.5194/acp-23-163-2023, https://doi.org/10.5194/acp-23-163-2023, 2023
Short summary
Short summary
The continued high levels of anthropogenic greenhouse gas emissions increase the likelihood that key climate warming thresholds will be exceeded in the coming decades. Here we examine a recently proposed geoengineering approach using two recently produced climate model experiments. We find the associated latitudinal distribution of aerosol mass to exhibit substantial uncertainty, suggesting the need for significant flexibility in the location and amount of aerosol delivery, if implemented.
Related subject area
Climate and Earth system modeling
Modeling the effects of tropospheric ozone on the growth and yield of global staple crops with DSSAT v4.8.0
A one-dimensional urban flow model with an eddy-diffusivity mass-flux (EDMF) scheme and refined turbulent transport (MLUCM v3.0)
DCMIP2016: the tropical cyclone test case
Interactions between atmospheric composition and climate change – progress in understanding and future opportunities from AerChemMIP, PDRMIP, and RFMIP
CD-type discretization for sea ice dynamics in FESOM version 2
CSDMS Data Components: data–model integration tools for Earth surface processes modeling
A generic algorithm to automatically classify urban fabric according to the local climate zone system: implementation in GeoClimate 0.0.1 and application to French cities
Modelling water isotopologues (1H2H16O, 1H217O) in the coupled numerical climate model iLOVECLIM (version 1.1.5)
Accurate assessment of land–atmosphere coupling in climate models requires high-frequency data output
Towards variance-conserving reconstructions of climate indices with Gaussian process regression in an embedding space
A diatom extension to the cGEnIE Earth system model – EcoGEnIE 1.1
Carbon isotopes in the marine biogeochemistry model FESOM2.1-REcoM3
Flux coupling approach on an exchange grid for the IOW Earth System Model (version 1.04.00) of the Baltic Sea region
Using EUREC4A/ATOMIC field campaign data to improve trade wind regimes in the Community Atmosphere Model
New model ensemble reveals how forcing uncertainty and model structure alter climate simulated across CMIP generations of the Community Earth System Model
Quantifying wildfire drivers and predictability in boreal peatlands using a two-step error-correcting machine learning framework in TeFire v1.0
Benchmarking GOCART-2G in the Goddard Earth Observing System (GEOS)
Energy-conserving physics for nonhydrostatic dynamics in mass coordinate models
Evaluation and optimisation of the soil carbon turnover routine in the MONICA model (version 3.3.1)
Assessing the sensitivity of aerosol mass budget and effective radiative forcing to horizontal grid spacing in E3SMv1 using a regional refinement approach
Towards the definition of a solar forcing dataset for CMIP7
ibicus: a new open-source Python package and comprehensive interface for statistical bias adjustment and evaluation in climate modelling (v1.0.1)
Disentangling the hydrological and hydraulic controls on streamflow variability in Energy Exascale Earth System Model (E3SM) V2 – a case study in the Pantanal region
Constraining the carbon cycle in JULES-ES-1.0
The utility of simulated ocean chlorophyll observations: a case study with the Chlorophyll Observation Simulator Package (version 1) in CESMv2.2
GeoPDNN 1.0: a semi-supervised deep learning neural network using pseudo-labels for three-dimensional shallow strata modelling and uncertainty analysis in urban areas from borehole data
The prototype NOAA Aerosol Reanalysis version 1.0: description of the modeling system and its evaluation
Performance and process-based evaluation of the BARPA-R Australasian regional climate model version 1
Monsoon Mission Coupled Forecast System version 2.0: model description and Indian monsoon simulations
Exploring the ocean mesoscale at reduced computational cost with FESOM 2.5: efficient modeling strategies applied to the Southern Ocean
Truly conserving with conservative remapping methods
High-resolution downscaling of CMIP6 Earth system and global climate models using deep learning for Iberia
Earth system modeling on modular supercomputing architecture: coupled atmosphere–ocean simulations with ICON 2.6.6-rc
Global Downscaled Projections for Climate Impacts Research (GDPCIR): preserving quantile trends for modeling future climate impacts
Understanding changes in cloud simulations from E3SM version 1 to version 2
WRF (v4.0)–SUEWS (v2018c) coupled system: development, evaluation and application
Scenario setup and forcing data for impact model evaluation and impact attribution within the third round of the Inter-Sectoral Impact Model Intercomparison Project (ISIMIP3a)
Deep learning model based on multi-scale feature fusion for precipitation nowcasting
The Framework for Assessing Changes To Sea-level (FACTS) v1.0: a platform for characterizing parametric and structural uncertainty in future global, relative, and extreme sea-level change
Getting the leaves right matters for estimating temperature extremes
The Southern Ocean Freshwater Input from Antarctica (SOFIA) Initiative: scientific objectives and experimental design
Modeling and evaluating the effects of irrigation on land–atmosphere interaction in southwestern Europe with the regional climate model REMO2020–iMOVE using a newly developed parameterization
The Regional Climate-Chemistry-Ecology Coupling Model RegCM-Chem (v4.6)-YIBs (v1.0): Development and Application
Process-oriented models of autumn leaf phenology: ways to sound calibration and implications of uncertain projections
An evaluation of the LLC4320 global-ocean simulation based on the submesoscale structure of modeled sea surface temperature fields
An emulation-based approach for interrogating reactive transport models
NEWTS1.0: Numerical model of coastal Erosion by Waves and Transgressive Scarps
A sub-grid parameterization scheme for topographic vertical motion in CAM5-SE
Objective Evaluation of Earth System Models: PCMDI Metrics Package (PMP) version 3
A Revised Model of Global Silicate Weathering Considering the Influence of Vegetation Cover on Erosion Rate
Jose Rafael Guarin, Jonas Jägermeyr, Elizabeth A. Ainsworth, Fabio A. A. Oliveira, Senthold Asseng, Kenneth Boote, Joshua Elliott, Lisa Emberson, Ian Foster, Gerrit Hoogenboom, David Kelly, Alex C. Ruane, and Katrina Sharps
Geosci. Model Dev., 17, 2547–2567, https://doi.org/10.5194/gmd-17-2547-2024, https://doi.org/10.5194/gmd-17-2547-2024, 2024
Short summary
Short summary
The effects of ozone (O3) stress on crop photosynthesis and leaf senescence were added to maize, rice, soybean, and wheat crop models. The modified models reproduced growth and yields under different O3 levels measured in field experiments and reported in the literature. The combined interactions between O3 and additional stresses were reproduced with the new models. These updated crop models can be used to simulate impacts of O3 stress under future climate change and air pollution scenarios.
Jiachen Lu, Negin Nazarian, Melissa Anne Hart, E. Scott Krayenhoff, and Alberto Martilli
Geosci. Model Dev., 17, 2525–2545, https://doi.org/10.5194/gmd-17-2525-2024, https://doi.org/10.5194/gmd-17-2525-2024, 2024
Short summary
Short summary
This study enhances urban canopy models by refining key assumptions. Simulations for various urban scenarios indicate discrepancies in turbulent transport efficiency for flow properties. We propose two modifications that involve characterizing diffusion coefficients for momentum and turbulent kinetic energy separately and introducing a physics-based
mass-fluxterm. These adjustments enhance the model's performance, offering more reliable temperature and surface flux estimates.
Justin L. Willson, Kevin A. Reed, Christiane Jablonowski, James Kent, Peter H. Lauritzen, Ramachandran Nair, Mark A. Taylor, Paul A. Ullrich, Colin M. Zarzycki, David M. Hall, Don Dazlich, Ross Heikes, Celal Konor, David Randall, Thomas Dubos, Yann Meurdesoif, Xi Chen, Lucas Harris, Christian Kühnlein, Vivian Lee, Abdessamad Qaddouri, Claude Girard, Marco Giorgetta, Daniel Reinert, Hiroaki Miura, Tomoki Ohno, and Ryuji Yoshida
Geosci. Model Dev., 17, 2493–2507, https://doi.org/10.5194/gmd-17-2493-2024, https://doi.org/10.5194/gmd-17-2493-2024, 2024
Short summary
Short summary
Accurate simulation of tropical cyclones (TCs) is essential to understanding their behavior in a changing climate. One way this is accomplished is through model intercomparison projects, where results from multiple climate models are analyzed to provide benchmark solutions for the wider climate modeling community. This study describes and analyzes the previously developed TC test case for nine climate models in an intercomparison project, providing solutions that aid in model development.
Stephanie Fiedler, Vaishali Naik, Fiona M. O'Connor, Christopher J. Smith, Paul Griffiths, Ryan J. Kramer, Toshihiko Takemura, Robert J. Allen, Ulas Im, Matthew Kasoar, Angshuman Modak, Steven Turnock, Apostolos Voulgarakis, Duncan Watson-Parris, Daniel M. Westervelt, Laura J. Wilcox, Alcide Zhao, William J. Collins, Michael Schulz, Gunnar Myhre, and Piers M. Forster
Geosci. Model Dev., 17, 2387–2417, https://doi.org/10.5194/gmd-17-2387-2024, https://doi.org/10.5194/gmd-17-2387-2024, 2024
Short summary
Short summary
Climate scientists want to better understand modern climate change. Thus, climate model experiments are performed and compared. The results of climate model experiments differ, as assessed in the latest Intergovernmental Panel on Climate Change (IPCC) assessment report. This article gives insights into the challenges and outlines opportunities for further improving the understanding of climate change. It is based on views of a group of experts in atmospheric composition–climate interactions.
Sergey Danilov, Carolin Mehlmann, Dmitry Sidorenko, and Qiang Wang
Geosci. Model Dev., 17, 2287–2297, https://doi.org/10.5194/gmd-17-2287-2024, https://doi.org/10.5194/gmd-17-2287-2024, 2024
Short summary
Short summary
Sea ice models are a necessary component of climate models. At very high resolution they are capable of simulating linear kinematic features, such as leads, which are important for better prediction of heat exchanges between the ocean and atmosphere. Two new discretizations are described which improve the sea ice component of the Finite volumE Sea ice–Ocean Model (FESOM version 2) by allowing simulations of finer scales.
Tian Gan, Gregory E. Tucker, Eric W. H. Hutton, Mark D. Piper, Irina Overeem, Albert J. Kettner, Benjamin Campforts, Julia M. Moriarty, Brianna Undzis, Ethan Pierce, and Lynn McCready
Geosci. Model Dev., 17, 2165–2185, https://doi.org/10.5194/gmd-17-2165-2024, https://doi.org/10.5194/gmd-17-2165-2024, 2024
Short summary
Short summary
This study presents the design, implementation, and application of the CSDMS Data Components. The case studies demonstrate that the Data Components provide a consistent way to access heterogeneous datasets from multiple sources, and to seamlessly integrate them with various models for Earth surface process modeling. The Data Components support the creation of open data–model integration workflows to improve the research transparency and reproducibility.
Jérémy Bernard, Erwan Bocher, Matthieu Gousseff, François Leconte, and Elisabeth Le Saux Wiederhold
Geosci. Model Dev., 17, 2077–2116, https://doi.org/10.5194/gmd-17-2077-2024, https://doi.org/10.5194/gmd-17-2077-2024, 2024
Short summary
Short summary
Geographical features may have a considerable effect on local climate. The local climate zone (LCZ) system proposed by Stewart and Oke (2012) is seen as a standard approach for classifying any zone according to a set of geographic indicators. While many methods already exist to map the LCZ, only a few tools are openly and freely available. We present the algorithm implemented in GeoClimate software to identify the LCZ of any place in the world using OpenStreetMap data.
Thomas Extier, Thibaut Caley, and Didier M. Roche
Geosci. Model Dev., 17, 2117–2139, https://doi.org/10.5194/gmd-17-2117-2024, https://doi.org/10.5194/gmd-17-2117-2024, 2024
Short summary
Short summary
Stable water isotopes are used to infer changes in the hydrological cycle for different time periods in climatic archive and climate models. We present the implementation of the δ2H and δ17O water isotopes in the coupled climate model iLOVECLIM and calculate the d- and 17O-excess. Results of a simulation under preindustrial conditions show that the model correctly reproduces the water isotope distribution in the atmosphere and ocean in comparison to data and other global circulation models.
Kirsten L. Findell, Zun Yin, Eunkyo Seo, Paul A. Dirmeyer, Nathan P. Arnold, Nathaniel Chaney, Megan D. Fowler, Meng Huang, David M. Lawrence, Po-Lun Ma, and Joseph A. Santanello Jr.
Geosci. Model Dev., 17, 1869–1883, https://doi.org/10.5194/gmd-17-1869-2024, https://doi.org/10.5194/gmd-17-1869-2024, 2024
Short summary
Short summary
We outline a request for sub-daily data to accurately capture the process-level connections between land states, surface fluxes, and the boundary layer response. This high-frequency model output will allow for more direct comparison with observational field campaigns on process-relevant timescales, enable demonstration of inter-model spread in land–atmosphere coupling processes, and aid in targeted identification of sources of deficiencies and opportunities for improvement of the models.
Marlene Klockmann, Udo von Toussaint, and Eduardo Zorita
Geosci. Model Dev., 17, 1765–1787, https://doi.org/10.5194/gmd-17-1765-2024, https://doi.org/10.5194/gmd-17-1765-2024, 2024
Short summary
Short summary
Reconstructions of climate variability before the observational period rely on climate proxies and sophisticated statistical models to link the proxy information and climate variability. Existing models tend to underestimate the true magnitude of variability, especially if the proxies contain non-climatic noise. We present and test a promising new framework for climate-index reconstructions, based on Gaussian processes, which reconstructs robust variability estimates from noisy and sparse data.
Aaron A. Naidoo-Bagwell, Fanny M. Monteiro, Katharine R. Hendry, Scott Burgan, Jamie D. Wilson, Ben A. Ward, Andy Ridgwell, and Daniel J. Conley
Geosci. Model Dev., 17, 1729–1748, https://doi.org/10.5194/gmd-17-1729-2024, https://doi.org/10.5194/gmd-17-1729-2024, 2024
Short summary
Short summary
As an extension to the EcoGEnIE 1.0 Earth system model that features a diverse plankton community, EcoGEnIE 1.1 includes siliceous plankton diatoms and also considers their impact on biogeochemical cycles. With updates to existing nutrient cycles and the introduction of the silicon cycle, we see improved model performance relative to observational data. Through a more functionally diverse plankton community, the new model enables more comprehensive future study of ocean ecology.
Martin Butzin, Ying Ye, Christoph Völker, Özgür Gürses, Judith Hauck, and Peter Köhler
Geosci. Model Dev., 17, 1709–1727, https://doi.org/10.5194/gmd-17-1709-2024, https://doi.org/10.5194/gmd-17-1709-2024, 2024
Short summary
Short summary
In this paper we describe the implementation of the carbon isotopes 13C and 14C into the marine biogeochemistry model FESOM2.1-REcoM3 and present results of long-term test simulations. Our model results are largely consistent with marine carbon isotope reconstructions for the pre-anthropogenic period, but also exhibit some discrepancies.
Sven Karsten, Hagen Radtke, Matthias Gröger, Ha T. M. Ho-Hagemann, Hossein Mashayekh, Thomas Neumann, and H. E. Markus Meier
Geosci. Model Dev., 17, 1689–1708, https://doi.org/10.5194/gmd-17-1689-2024, https://doi.org/10.5194/gmd-17-1689-2024, 2024
Short summary
Short summary
This paper describes the development of a regional Earth System Model for the Baltic Sea region. In contrast to conventional coupling approaches, the presented model includes a flux calculator operating on a common exchange grid. This approach automatically ensures a locally consistent treatment of fluxes and simplifies the exchange of model components. The presented model can be used for various scientific questions, such as studies of natural variability and ocean–atmosphere interactions.
Skyler Graap and Colin M. Zarzycki
Geosci. Model Dev., 17, 1627–1650, https://doi.org/10.5194/gmd-17-1627-2024, https://doi.org/10.5194/gmd-17-1627-2024, 2024
Short summary
Short summary
A key target for improving climate models is how low, bright clouds are predicted over tropical oceans, since they have important consequences for the Earth's energy budget. A climate model has been updated to improve the physical realism of the treatment of how momentum is moved up and down in the atmosphere. By comparing this updated model to real-world observations from balloon launches, it can be shown to more accurately depict atmospheric structure in trade-wind areas close to the Equator.
Marika M. Holland, Cecile Hannay, John Fasullo, Alexandra Jahn, Jennifer E. Kay, Michael Mills, Isla R. Simpson, William Wieder, Peter Lawrence, Erik Kluzek, and David Bailey
Geosci. Model Dev., 17, 1585–1602, https://doi.org/10.5194/gmd-17-1585-2024, https://doi.org/10.5194/gmd-17-1585-2024, 2024
Short summary
Short summary
Climate evolves in response to changing forcings, as prescribed in simulations. Models and forcings are updated over time to reflect new understanding. This makes it difficult to attribute simulation differences to either model or forcing changes. Here we present new simulations which enable the separation of model structure and forcing influence between two widely used simulation sets. Results indicate a strong influence of aerosol emission uncertainty on historical climate.
Rongyun Tang, Mingzhou Jin, Jiafu Mao, Daniel M. Ricciuto, Anping Chen, and Yulong Zhang
Geosci. Model Dev., 17, 1525–1542, https://doi.org/10.5194/gmd-17-1525-2024, https://doi.org/10.5194/gmd-17-1525-2024, 2024
Short summary
Short summary
Carbon-rich boreal peatlands are at risk of burning. The reproducibility and predictability of rare peatland fire events are investigated by constructing a two-step error-correcting machine learning framework to tackle such complex systems. Fire occurrence and impacts are highly predictable with our approach. Factor-controlling simulations revealed that temperature, moisture, and freeze–thaw cycles control boreal peatland fires, indicating thermal impacts on causing peat fires.
Allison B. Collow, Peter R. Colarco, Arlindo M. da Silva, Virginie Buchard, Huisheng Bian, Mian Chin, Sampa Das, Ravi Govindaraju, Dongchul Kim, and Valentina Aquila
Geosci. Model Dev., 17, 1443–1468, https://doi.org/10.5194/gmd-17-1443-2024, https://doi.org/10.5194/gmd-17-1443-2024, 2024
Short summary
Short summary
The GOCART aerosol module within the Goddard Earth Observing System recently underwent a major refactoring and update to the representation of physical processes. Code changes that were included in GOCART Second Generation (GOCART-2G) are documented, and we establish a benchmark simulation that is to be used for future development of the system. The 4-year benchmark simulation was evaluated using in situ and spaceborne measurements to develop a baseline and prioritize future development.
Oksana Guba, Mark A. Taylor, Peter A. Bosler, Christopher Eldred, and Peter H. Lauritzen
Geosci. Model Dev., 17, 1429–1442, https://doi.org/10.5194/gmd-17-1429-2024, https://doi.org/10.5194/gmd-17-1429-2024, 2024
Short summary
Short summary
We want to reduce errors in the moist energy budget in numerical atmospheric models. We study a few common assumptions and mechanisms that are used for the moist physics. Some mechanisms are more consistent with the underlying equations. Separately, we study how assumptions about models' thermodynamics affect the modeled energy of precipitation. We also explain how to conserve energy in the moist physics for nonhydrostatic models.
Konstantin Aiteew, Jarno Rouhiainen, Claas Nendel, and René Dechow
Geosci. Model Dev., 17, 1349–1385, https://doi.org/10.5194/gmd-17-1349-2024, https://doi.org/10.5194/gmd-17-1349-2024, 2024
Short summary
Short summary
This study evaluated the biogeochemical model MONICA and its performance in simulating soil organic carbon changes. MONICA can reproduce plant growth, carbon and nitrogen dynamics, soil water and temperature. The model results were compared with five established carbon turnover models. With the exception of certain sites, adequate reproduction of soil organic carbon stock change rates was achieved. The MONICA model was capable of performing similar to or even better than the other models.
Jianfeng Li, Kai Zhang, Taufiq Hassan, Shixuan Zhang, Po-Lun Ma, Balwinder Singh, Qiyang Yan, and Huilin Huang
Geosci. Model Dev., 17, 1327–1347, https://doi.org/10.5194/gmd-17-1327-2024, https://doi.org/10.5194/gmd-17-1327-2024, 2024
Short summary
Short summary
By comparing E3SM simulations with and without regional refinement, we find that model horizontal grid spacing considerably affects the simulated aerosol mass budget, aerosol–cloud interactions, and the effective radiative forcing of anthropogenic aerosols. The study identifies the critical physical processes strongly influenced by model resolution. It also highlights the benefit of applying regional refinement in future modeling studies at higher or even convection-permitting resolutions.
Bernd Funke, Thierry Dudok de Wit, Ilaria Ermolli, Margit Haberreiter, Doug Kinnison, Daniel Marsh, Hilde Nesse, Annika Seppälä, Miriam Sinnhuber, and Ilya Usoskin
Geosci. Model Dev., 17, 1217–1227, https://doi.org/10.5194/gmd-17-1217-2024, https://doi.org/10.5194/gmd-17-1217-2024, 2024
Short summary
Short summary
We outline a road map for the preparation of a solar forcing dataset for the upcoming Phase 7 of the Coupled Model Intercomparison Project (CMIP7), considering the latest scientific advances made in the reconstruction of solar forcing and in the understanding of climate response while also addressing the issues that were raised during CMIP6.
Fiona Raphaela Spuler, Jakob Benjamin Wessel, Edward Comyn-Platt, James Varndell, and Chiara Cagnazzo
Geosci. Model Dev., 17, 1249–1269, https://doi.org/10.5194/gmd-17-1249-2024, https://doi.org/10.5194/gmd-17-1249-2024, 2024
Short summary
Short summary
Before using climate models to study the impacts of climate change, bias adjustment is commonly applied to the models to ensure that they correspond with observations at a local scale. However, this can introduce undesirable distortions into the climate model. In this paper, we present an open-source python package called ibicus to enable the comparison and detailed evaluation of bias adjustment methods, facilitating their transparent and rigorous application.
Donghui Xu, Gautam Bisht, Zeli Tan, Chang Liao, Tian Zhou, Hong-Yi Li, and L. Ruby Leung
Geosci. Model Dev., 17, 1197–1215, https://doi.org/10.5194/gmd-17-1197-2024, https://doi.org/10.5194/gmd-17-1197-2024, 2024
Short summary
Short summary
We aim to disentangle the hydrological and hydraulic controls on streamflow variability in a fully coupled earth system model. We found that calibrating only one process (i.e., traditional calibration procedure) will result in unrealistic parameter values and poor performance of the water cycle, while the simulated streamflow is improved. To address this issue, we further proposed a two-step calibration procedure to reconcile the impacts from hydrological and hydraulic processes on streamflow.
Douglas McNeall, Eddy Robertson, and Andy Wiltshire
Geosci. Model Dev., 17, 1059–1089, https://doi.org/10.5194/gmd-17-1059-2024, https://doi.org/10.5194/gmd-17-1059-2024, 2024
Short summary
Short summary
We can run simulations of the land surface and carbon cycle, using computer models to help us understand and predict climate change and its impacts. These simulations are not perfect reproductions of the real land surface, and that can make them less effective tools. We use new statistical and computational techniques to help us understand how different our models are from the real land surface, how to make them more realistic, and how well we can simulate past and future climate.
Genevieve L. Clow, Nicole S. Lovenduski, Michael N. Levy, Keith Lindsay, and Jennifer E. Kay
Geosci. Model Dev., 17, 975–995, https://doi.org/10.5194/gmd-17-975-2024, https://doi.org/10.5194/gmd-17-975-2024, 2024
Short summary
Short summary
Satellite observations of chlorophyll allow us to study marine phytoplankton on a global scale; yet some of these observations are missing due to clouds and other issues. To investigate the impact of missing data, we developed a satellite simulator for chlorophyll in an Earth system model. We found that missing data can impact the global mean chlorophyll by nearly 20 %. The simulated observations provide a more direct comparison to real-world data and can be used to improve model validation.
Jiateng Guo, Xuechuang Xu, Luyuan Wang, Xulei Wang, Lixin Wu, Mark Jessell, Vitaliy Ogarko, Zhibin Liu, and Yufei Zheng
Geosci. Model Dev., 17, 957–973, https://doi.org/10.5194/gmd-17-957-2024, https://doi.org/10.5194/gmd-17-957-2024, 2024
Short summary
Short summary
This study proposes a semi-supervised learning algorithm using pseudo-labels for 3D geological modelling. We establish a 3D geological model using borehole data from a complex real urban local survey area in Shenyang and make an uncertainty analysis of this model. The method effectively expands the sample space, which is suitable for geomodelling and uncertainty analysis from boreholes. The modelling results perform well in terms of spatial morphology and geological semantics.
Shih-Wei Wei, Mariusz Pagowski, Arlindo da Silva, Cheng-Hsuan Lu, and Bo Huang
Geosci. Model Dev., 17, 795–813, https://doi.org/10.5194/gmd-17-795-2024, https://doi.org/10.5194/gmd-17-795-2024, 2024
Short summary
Short summary
This study describes the modeling system and the evaluation results for the first prototype version of a global aerosol reanalysis product at NOAA, prototype NOAA Aerosol ReAnalysis version 1.0 (pNARA v1.0). We evaluated pNARA v1.0 against independent datasets and compared it with other reanalyses. We identified deficiencies in the system (both in the forecast model and in the data assimilation system) and the uncertainties that exist in our reanalysis.
Emma Howard, Chun-Hsu Su, Christian Stassen, Rajashree Naha, Harvey Ye, Acacia Pepler, Samuel S. Bell, Andrew J. Dowdy, Simon O. Tucker, and Charmaine Franklin
Geosci. Model Dev., 17, 731–757, https://doi.org/10.5194/gmd-17-731-2024, https://doi.org/10.5194/gmd-17-731-2024, 2024
Short summary
Short summary
The BARPA-R modelling configuration has been developed to produce high-resolution climate hazard projections within the Australian region. When using boundary driving data from quasi-observed historical conditions, BARPA-R shows good performance with errors generally on par with reanalysis products. BARPA-R also captures trends, known modes of climate variability, large-scale weather processes, and multivariate relationships.
Deepeshkumar Jain, Suryachandra A. Rao, Ramu A. Dandi, Prasanth A. Pillai, Ankur Srivastava, Maheswar Pradhan, and Kiran V. Gangadharan
Geosci. Model Dev., 17, 709–729, https://doi.org/10.5194/gmd-17-709-2024, https://doi.org/10.5194/gmd-17-709-2024, 2024
Short summary
Short summary
The present paper discusses and evaluates the new Monsoon Mission Coupled Forecast System model (MMCFS) version 2.0 which upgrades the currently operational MMCFS v1.0 at the Indian Meteorological Department, India. The individual model components have been substantially upgraded independently by their respective scientific groups. MMCFS v2.0 includes these upgrades in the operational coupled model. The new model shows significant skill improvement in simulating the Indian monsoon.
Nathan Beech, Thomas Rackow, Tido Semmler, and Thomas Jung
Geosci. Model Dev., 17, 529–543, https://doi.org/10.5194/gmd-17-529-2024, https://doi.org/10.5194/gmd-17-529-2024, 2024
Short summary
Short summary
Cost-reducing modeling strategies are applied to high-resolution simulations of the Southern Ocean in a changing climate. They are evaluated with respect to observations and traditional, lower-resolution modeling methods. The simulations effectively reproduce small-scale ocean flows seen in satellite data and are largely consistent with traditional model simulations after 4 °C of warming. Small-scale flows are found to intensify near bathymetric features and to become more variable.
Karl E. Taylor
Geosci. Model Dev., 17, 415–430, https://doi.org/10.5194/gmd-17-415-2024, https://doi.org/10.5194/gmd-17-415-2024, 2024
Short summary
Short summary
Remapping gridded data in a way that preserves the conservative properties of the climate system can be essential in coupling model components and for accurate assessment of the system’s energy and mass constituents. Remapping packages capable of handling a wide variety of grids can, for some common grids, calculate remapping weights that are somewhat inaccurate. Correcting for these errors, guidelines are provided to ensure conservation when the weights are used in practice.
Pedro M. M. Soares, Frederico Johannsen, Daniela C. A. Lima, Gil Lemos, Virgílio A. Bento, and Angelina Bushenkova
Geosci. Model Dev., 17, 229–259, https://doi.org/10.5194/gmd-17-229-2024, https://doi.org/10.5194/gmd-17-229-2024, 2024
Short summary
Short summary
This study uses deep learning (DL) to downscale global climate models for the Iberian Peninsula. Four DL architectures were evaluated and trained using historical climate data and then used to downscale future projections from the global models. These show agreement with the original models and reveal a warming of 2 ºC to 6 ºC, along with decreasing precipitation in western Iberia after 2040. This approach offers key regional climate change information for adaptation strategies in the region.
Abhiraj Bishnoi, Olaf Stein, Catrin I. Meyer, René Redler, Norbert Eicker, Helmuth Haak, Lars Hoffmann, Daniel Klocke, Luis Kornblueh, and Estela Suarez
Geosci. Model Dev., 17, 261–273, https://doi.org/10.5194/gmd-17-261-2024, https://doi.org/10.5194/gmd-17-261-2024, 2024
Short summary
Short summary
We enabled the weather and climate model ICON to run in a high-resolution coupled atmosphere–ocean setup on the JUWELS supercomputer, where the ocean and the model I/O runs on the CPU Cluster, while the atmosphere is running simultaneously on GPUs. Compared to a simulation performed on CPUs only, our approach reduces energy consumption by 45 % with comparable runtimes. The experiments serve as preparation for efficient computing of kilometer-scale climate models on future supercomputing systems.
Diana R. Gergel, Steven B. Malevich, Kelly E. McCusker, Emile Tenezakis, Michael T. Delgado, Meredith A. Fish, and Robert E. Kopp
Geosci. Model Dev., 17, 191–227, https://doi.org/10.5194/gmd-17-191-2024, https://doi.org/10.5194/gmd-17-191-2024, 2024
Short summary
Short summary
The freely available Global Downscaled Projections for Climate Impacts Research (GDPCIR) dataset gives researchers a new tool for studying how future climate will evolve at a local or regional level, corresponding to the latest global climate model simulations prepared as part of the UN Intergovernmental Panel on Climate Change’s Sixth Assessment Report. Those simulations represent an enormous advance in quality, detail, and scope that GDPCIR translates to the local level.
Yuying Zhang, Shaocheng Xie, Yi Qin, Wuyin Lin, Jean-Christophe Golaz, Xue Zheng, Po-Lun Ma, Yun Qian, Qi Tang, Christopher R. Terai, and Meng Zhang
Geosci. Model Dev., 17, 169–189, https://doi.org/10.5194/gmd-17-169-2024, https://doi.org/10.5194/gmd-17-169-2024, 2024
Short summary
Short summary
We performed systematic evaluation of clouds simulated in the Energy
Exascale Earth System Model (E3SMv2) to document model performance and understand what updates in E3SMv2 have caused changes in clouds from E3SMv1 to E3SMv2. We find that stratocumulus clouds along the subtropical west coast of continents are dramatically improved, primarily due to the retuning done in CLUBB. This study offers additional insights into clouds simulated in E3SMv2 and will benefit future E3SM developments.
Exascale Earth System Model (E3SMv2) to document model performance and understand what updates in E3SMv2 have caused changes in clouds from E3SMv1 to E3SMv2. We find that stratocumulus clouds along the subtropical west coast of continents are dramatically improved, primarily due to the retuning done in CLUBB. This study offers additional insights into clouds simulated in E3SMv2 and will benefit future E3SM developments.
Ting Sun, Hamidreza Omidvar, Zhenkun Li, Ning Zhang, Wenjuan Huang, Simone Kotthaus, Helen C. Ward, Zhiwen Luo, and Sue Grimmond
Geosci. Model Dev., 17, 91–116, https://doi.org/10.5194/gmd-17-91-2024, https://doi.org/10.5194/gmd-17-91-2024, 2024
Short summary
Short summary
For the first time, we coupled a state-of-the-art urban land surface model – Surface Urban Energy and Water Scheme (SUEWS) – with the widely-used Weather Research and Forecasting (WRF) model, creating an open-source tool that may benefit multiple applications. We tested our new system at two UK sites and demonstrated its potential by examining how human activities in various areas of Greater London influence local weather conditions.
Katja Frieler, Jan Volkholz, Stefan Lange, Jacob Schewe, Matthias Mengel, María del Rocío Rivas López, Christian Otto, Christopher P. O. Reyer, Dirk Nikolaus Karger, Johanna T. Malle, Simon Treu, Christoph Menz, Julia L. Blanchard, Cheryl S. Harrison, Colleen M. Petrik, Tyler D. Eddy, Kelly Ortega-Cisneros, Camilla Novaglio, Yannick Rousseau, Reg A. Watson, Charles Stock, Xiao Liu, Ryan Heneghan, Derek Tittensor, Olivier Maury, Matthias Büchner, Thomas Vogt, Tingting Wang, Fubao Sun, Inga J. Sauer, Johannes Koch, Inne Vanderkelen, Jonas Jägermeyr, Christoph Müller, Sam Rabin, Jochen Klar, Iliusi D. Vega del Valle, Gitta Lasslop, Sarah Chadburn, Eleanor Burke, Angela Gallego-Sala, Noah Smith, Jinfeng Chang, Stijn Hantson, Chantelle Burton, Anne Gädeke, Fang Li, Simon N. Gosling, Hannes Müller Schmied, Fred Hattermann, Jida Wang, Fangfang Yao, Thomas Hickler, Rafael Marcé, Don Pierson, Wim Thiery, Daniel Mercado-Bettín, Robert Ladwig, Ana Isabel Ayala-Zamora, Matthew Forrest, and Michel Bechtold
Geosci. Model Dev., 17, 1–51, https://doi.org/10.5194/gmd-17-1-2024, https://doi.org/10.5194/gmd-17-1-2024, 2024
Short summary
Short summary
Our paper provides an overview of all observational climate-related and socioeconomic forcing data used as input for the impact model evaluation and impact attribution experiments within the third round of the Inter-Sectoral Impact Model Intercomparison Project. The experiments are designed to test our understanding of observed changes in natural and human systems and to quantify to what degree these changes have already been induced by climate change.
Jinkai Tan, Qiqiao Huang, and Sheng Chen
Geosci. Model Dev., 17, 53–69, https://doi.org/10.5194/gmd-17-53-2024, https://doi.org/10.5194/gmd-17-53-2024, 2024
Short summary
Short summary
This study presents a deep learning architecture, multi-scale feature fusion (MFF), to improve the forecast skills of precipitations especially for heavy precipitations. MFF uses multi-scale receptive fields so that the movement features of precipitation systems are well captured. MFF uses the mechanism of discrete probability to reduce uncertainties and forecast errors so that heavy precipitations are produced.
Robert E. Kopp, Gregory G. Garner, Tim H. J. Hermans, Shantenu Jha, Praveen Kumar, Alexander Reedy, Aimée B. A. Slangen, Matteo Turilli, Tamsin L. Edwards, Jonathan M. Gregory, George Koubbe, Anders Levermann, Andre Merzky, Sophie Nowicki, Matthew D. Palmer, and Chris Smith
Geosci. Model Dev., 16, 7461–7489, https://doi.org/10.5194/gmd-16-7461-2023, https://doi.org/10.5194/gmd-16-7461-2023, 2023
Short summary
Short summary
Future sea-level rise projections exhibit multiple forms of uncertainty, all of which must be considered by scientific assessments intended to inform decision-making. The Framework for Assessing Changes To Sea-level (FACTS) is a new software package intended to support assessments of global mean, regional, and extreme sea-level rise. An early version of FACTS supported the development of the IPCC Sixth Assessment Report sea-level projections.
Gregory Duveiller, Mark Pickering, Joaquin Muñoz-Sabater, Luca Caporaso, Souhail Boussetta, Gianpaolo Balsamo, and Alessandro Cescatti
Geosci. Model Dev., 16, 7357–7373, https://doi.org/10.5194/gmd-16-7357-2023, https://doi.org/10.5194/gmd-16-7357-2023, 2023
Short summary
Short summary
Some of our best tools to describe the state of the land system, including the intensity of heat waves, have a problem. The model currently assumes that the number of leaves in ecosystems always follows the same cycle. By using satellite observations of when leaves are present, we show that capturing the yearly changes in this cycle is important to avoid errors in estimating surface temperature. We show that this has strong implications for our capacity to describe heat waves across Europe.
Neil C. Swart, Torge Martin, Rebecca Beadling, Jia-Jia Chen, Christopher Danek, Matthew H. England, Riccardo Farneti, Stephen M. Griffies, Tore Hattermann, Judith Hauck, F. Alexander Haumann, André Jüling, Qian Li, John Marshall, Morven Muilwijk, Andrew G. Pauling, Ariaan Purich, Inga J. Smith, and Max Thomas
Geosci. Model Dev., 16, 7289–7309, https://doi.org/10.5194/gmd-16-7289-2023, https://doi.org/10.5194/gmd-16-7289-2023, 2023
Short summary
Short summary
Current climate models typically do not include full representation of ice sheets. As the climate warms and the ice sheets melt, they add freshwater to the ocean. This freshwater can influence climate change, for example by causing more sea ice to form. In this paper we propose a set of experiments to test the influence of this missing meltwater from Antarctica using multiple different climate models.
Christina Asmus, Peter Hoffmann, Joni-Pekka Pietikäinen, Jürgen Böhner, and Diana Rechid
Geosci. Model Dev., 16, 7311–7337, https://doi.org/10.5194/gmd-16-7311-2023, https://doi.org/10.5194/gmd-16-7311-2023, 2023
Short summary
Short summary
Irrigation modifies the land surface and soil conditions. The effects can be quantified using numerical climate models. Our study introduces a new irrigation parameterization, which simulates the effects of irrigation on land, atmosphere, and vegetation. We applied the parameterization and evaluated the results in terms of their physical consistency. We found an improvement in the model results in the 2 m temperature representation in comparison with observational data for our study.
Nanhong Xie, Tijian Wang, Xiaodong Xie, Xu Yue, Filippo Giorgi, Qian Zhang, Danyang Ma, Rong Song, Baiyao Xu, Shu Li, Bingliang Zhuang, Mengmeng Li, Min Xie, Natalya Andreeva Kilifarska, Georgi Gadzhev, and Reneta Dimitrova
EGUsphere, https://doi.org/10.5194/egusphere-2023-1733, https://doi.org/10.5194/egusphere-2023-1733, 2023
Short summary
Short summary
For the first time, we coupled a regional climate chemistry model RegCM-Chem with a dynamic vegetation model YIBs to create a regional climate-chemistry-ecology model RegCM-Chem-YIBs. We applied it to simulate climatic, chemical and ecological parameters in East Asia and fully validated it on a variety of observational data. The research results show that RegCM-Chem-YIBs model is a valuable tool for studying terrestrial carbon cycle, atmospheric chemistry, and climate change in regional scale.
Michael Meier and Christof Bigler
Geosci. Model Dev., 16, 7171–7201, https://doi.org/10.5194/gmd-16-7171-2023, https://doi.org/10.5194/gmd-16-7171-2023, 2023
Short summary
Short summary
We analyzed >2.3 million calibrations and 39 million projections of leaf coloration models, considering 21 models, 5 optimization algorithms, ≥7 sampling procedures, and 26 climate scenarios. Models based on temperature, day length, and leaf unfolding performed best, especially when calibrated with generalized simulated annealing and systematically balanced or stratified samples. Projected leaf coloration shifts between −13 and +20 days by 2080–2099.
Katharina Gallmeier, J. Xavier Prochaska, Peter Cornillon, Dimitris Menemenlis, and Madolyn Kelm
Geosci. Model Dev., 16, 7143–7170, https://doi.org/10.5194/gmd-16-7143-2023, https://doi.org/10.5194/gmd-16-7143-2023, 2023
Short summary
Short summary
This paper introduces an approach to evaluate numerical models of ocean circulation. We compare the structure of satellite-derived sea surface temperature anomaly (SSTa) instances determined by a machine learning algorithm at 10–80 km scales to those output by a high-resolution MITgcm run. The simulation over much of the ocean reproduces the observed distribution of SSTa patterns well. This general agreement, alongside a few notable exceptions, highlights the potential of this approach.
Angus Fotherby, Harold J. Bradbury, Jennifer L. Druhan, and Alexandra V. Turchyn
Geosci. Model Dev., 16, 7059–7074, https://doi.org/10.5194/gmd-16-7059-2023, https://doi.org/10.5194/gmd-16-7059-2023, 2023
Short summary
Short summary
We demonstrate how, given a simulation of fluid and rock interacting, we can emulate the system using machine learning. This means that, for a given initial condition, we can predict the final state, avoiding the simulation step once the model has been trained. We present a workflow for applying this approach to any fluid–rock simulation and showcase two applications to different fluid–rock simulations. This approach has applications for improving model development and sensitivity analyses.
Rose V. Palermo, J. Taylor Perron, Jason M. Soderblom, Samuel P. D. Birch, Alexander G. Hayes, and Andrew D. Ashton
Geosci. Model Dev. Discuss., https://doi.org/10.5194/gmd-2023-223, https://doi.org/10.5194/gmd-2023-223, 2023
Revised manuscript accepted for GMD
Short summary
Short summary
Models of rocky coastal erosion help us understand the controls on coastal morphology and evolution. In this paper, we present a simplified model of coastline erosion by either uniform erosion processes where coastline erosion is constant or wave-driven erosion where coastline erosion is a function of the wave power. This model can be used to evaluate how coastline changes reflect climate, sea level history, material properties, and the relative influence of different erosional processes.
Yaqi Wang, Lanning Wang, Juan Feng, Zhenya Song, Qizhong Wu, and Huaqiong Cheng
Geosci. Model Dev., 16, 6857–6873, https://doi.org/10.5194/gmd-16-6857-2023, https://doi.org/10.5194/gmd-16-6857-2023, 2023
Short summary
Short summary
In this study, to noticeably improve precipitation simulation in steep mountains, we propose a sub-grid parameterization scheme for the topographic vertical motion in CAM5-SE to revise the original vertical velocity by adding the topographic vertical motion. The dynamic lifting effect of topography is extended from the lowest layer to multiple layers, thus improving the positive deviations of precipitation simulation in high-altitude regions and negative deviations in low-altitude regions.
Jiwoo Lee, Peter J. Gleckler, Min-Seop Ahn, Ana Ordonez, Paul A. Ullrich, Kenneth R. Sperber, Karl E. Taylor, Yann Y. Planton, Eric Guilyardi, Paul Durack, Celine Bonfils, Mark D. Zelinka, Li-Wei Chao, Bo Dong, Charles Doutriaux, Chengzhu Zhang, Tom Vo, Jason Boutte, Michael F. Wehner, Angeline G. Pendergrass, Daehyun Kim, Zeyu Xue, Andrew T. Wittenberg, and John Krasting
EGUsphere, https://doi.org/10.5194/egusphere-2023-2720, https://doi.org/10.5194/egusphere-2023-2720, 2023
Short summary
Short summary
We introduce an open-source software, the PCMDI Metrics Package (PMP), developed for a comprehensive comparison of Earth System Models (ESMs) with real-world observations. Using diverse metrics evaluating climatology, variability, and extremes simulated in thousands of simulations from the Coupled Model Intercomparison Project (CMIP), PMP aids in benchmarking model improvements across generations. PMP also enables efficient tracking of performance evolutions during ESM developments.
Haoyue Zuo, Yonggang Liu, Gaojun Li, Zhifang Xu, Liang Zhao, Zhengtang Guo, and Yongyun Hu
Geosci. Model Dev. Discuss., https://doi.org/10.5194/gmd-2023-199, https://doi.org/10.5194/gmd-2023-199, 2023
Revised manuscript accepted for GMD
Short summary
Short summary
Compared to the silicate weathering fluxes measured at large river basins, the current models tend to systematically overestimate the fluxes over the tropical region, which leads to an overestimation of the global total weathering flux. The most possible cause of such bias is found to be the overestimation of tropical surface erosion, which indicates that the tropical vegetation likely slows down physical erosion significantly. We propose a way of taking this effect into account in models.
Cited articles
Adler, R., Sapiano, M., Huffman, G., Bolvin, D., Gu, G., Wang, J., and Schneider, U.: The
new version 2.3 of the Global Precipitation Climatology Project (GPCP) monthly analysis product,
University of Maryland, April, pp. 1072–1084, 2016.
Adler, R. F., Gu, G., Huffman, G. J., Sapiano, M. R., and Wang, J. J.: GPCP and the Global Characteristics of Precipitation, in: Satellite Precipitation Measurement, pp. 677–697, Springer, Cham, 2020.
Baker, N. C. and Taylor, P. C.: A framework for evaluating climate model performance
metrics, J. Climate, 29, 1773–1782, https://doi.org/10.1175/JCLI-D-15-0114.1, 2016.
Borovikov, A., Cullather, R., Kovach, R., Marshak, J., Vernieres, G., Vikhliaev, Y., and
Li, Z.: GEOS-5 seasonal forecast system, Clim. Dynam., 53, 7335–7361,
https://doi.org/10.1007/s00382-017-3835-2, 2019.
Box, G. E. P.: Science and statistics, J. Am. Stat. Assoc., 71, 791–799,
https://doi.org/10.1080/01621459.1976.10480949, 1976.
Braverman, A., Chatterjee, S., Heyman, M., and Cressie, N.: Probabilistic evaluation of
competing climate models, Adv. Stat. Clim. Meteorol. Oceanogr., 3, 93–105,
https://doi.org/10.5194/ascmo-3-93-2017, 2017.
Burrows, S. M., Dasgupta, A., Reehl, S., Bramer, L., Ma, P. L., Rasch, P. J., and Qian,
Y.: Characterizing the relative importance assigned to physical variables by climate scientists
when assessing atmospheric climate model fidelity, Adv. Atmos. Sci., 35, 1101–1113,
https://doi.org/10.1007/s00376-018-7300-x, 2018.
Cheng, L., Trenberth, K. E., Fasullo, J. T., Mayer, M., Balmaseda, M., and Zhu, J.:
Evolution of ocean heat content related to ENSO, J. Clim., 32, 3529–3556,
https://doi.org/10.1175/JCLI-D-18-0607.1, 2019.
Dee, D. P., Uppala, S. M., Simmons, A. J., Berrisford, P., Poli, P., Kobayashi, S., and
Bechtold, P.: The ERA-Interim reanalysis: Configuration and performance of the data assimilation
system, Q. J. Roy. Meteorol. Soc., 137, 553–597, https://doi.org/10.1002/qj.828, 2011.
Eyring, V., Bony, S., Meehl, G. A., Senior, C. A., Stevens, B., Stouffer, R. J., and
Taylor, K. E.: Overview of the Coupled Model Intercomparison Project Phase 6 (CMIP6) experimental
design and organization, Geosci. Model Dev., 9, 1937–1958, https://doi.org/10.5194/gmd-9-1937-2016, 2016.
Eyring, V., Bock, L., Lauer, A., Righi, M., Schlund, M., Andela, B., Arnone, E.,
Bellprat, O., Brötz, B., Caron, L.-P., Carvalhais, N., Cionni, I., Cortesi, N., Crezee, B.,
Davin, E. L., Davini, P., Debeire, K., de Mora, L., Deser, C., Docquier, D., Earnshaw, P.,
Ehbrecht, C., Gier, B. K., Gonzalez-Reviriego, N., Goodman, P., Hagemann, S., Hardiman, S.,
Hassler, B., Hunter, A., Kadow, C., Kindermann, S., Koirala, S., Koldunov, N., Lejeune, Q., Lembo,
V., Lovato, T., Lucarini, V., Massonnet, F., Müller, B., Pandde, A., Pérez-Zanón, N.,
Phillips, A., Predoi, V., Russell, J., Sellar, A., Serva, F., Stacke, T., Swaminathan, R.,
Torralba, V., Vegas-Regidor, J., von Hardenberg, J., Weigel, K., and Zimmermann, K.: Earth System
Model Evaluation Tool (ESMValTool) v2.0 – an extended set of large-scale diagnostics for
quasi-operational and comprehensive evaluation of Earth system models in CMIP, Geosci. Model Dev.,
13, 3383–3438, https://doi.org/10.5194/gmd-13-3383-2020, 2020.
Fasullo, J.: Climate Model Analysis Tool (Version 1), Zenodo, https://doi.org/10.5281/zenodo.3922308, 2020.
Fasullo, J. T. and Trenberth, K. E.: The annual cycle of the energy budget. Part I:
Global mean and land–ocean exchanges. J. Climate, 21, 2297–2312, https://doi.org/10.1175/2007JCLI1935.1,
2008.
Fasullo, J. T. and Trenberth, K. E.: A less cloudy future: The role of subtropical
subsidence in climate sensitivity, Science, 338, 792–794, https://doi.org/10.1126/science.1227465, 2012.
Gettelman, A., Hannay, C., Bacmeister, J. T., Neale, R., Pendergrass, A. G.,
Danabasoglu, G., and Mills, M. J.: High climate sensitivity in the Community Earth System Model
Version 2 (CESM2), Geophys. Res. Lett., 46, 8329–8337, https://doi.org/10.1029/2019GL083978, 2019.
Ghil, M.: A mathematical theory of climate sensitivity or, How to deal with both
anthropogenic forcing and natural variability? In: Climate Change: Multidecadal and Beyond
(vol. 6, pp. 31–52), edited by: Chang, C.-P., Ghil, M., Latif, M., and Wallace, J., World
Scientific Publishing Co., Singapore, 2015.
Gibbs, A. L. and Su, F. E.: On Choosing and Bounding Probability Metrics,
Int. Stat. Rev., 70, 419–435, https://doi.org/10.1111/j.1751-5823.2002.tb00178.x, 2002.
Gleckler, P. J., Taylor, K. E., and Doutriaux, C.: Performance metrics for climate models, J. Geophys. Res.-Atmos., 113, 1–20, https://doi.org/10.1029/2007JD008972, 2008.
Caldwell, P. M., Van Roekel, L. P., Petersen, M. R., Tang, Q., Wolfe, J. D., Abeshu, G., Anantharaj, V., Asay‐Davis, X. S., Bader, D. C., Baldwin, S. A., Bisht, G., Bogenschutz, P. A., Branstetter, M., Brunke, M. A., Brus, S. R., Burrows, S. M., Cameron‐Smith, P. J., Donahue, A. S., Deakin, M., Easter, R. C., Evans, K. J., Feng, Y., Flanner, M., Foucar, J. G., Fyke, J. G., Griffin, B. M., Hannay, C., Harrop, B. E., Hoffman, M. J., Hunke, E. C., Jacob, R. L., Jacobsen, D. W., Jeffery, N., Jones, P. W., Keen, N. D., Klein, S. A., Larson, V. E., Leung, L. R., Li, H.‐Y., Lin, W., Lipscomb, W. H., Ma, P.‐L., Mahajan, S., Maltrud, M. E., Mametjanov, A., McClean, J. L., McCoy, R. B., Neale, R. B., Price, S. F., Qian, Y., Rasch, P. J., Reeves Eyre, J. E. J., Riley, W. J., Ringler, T. D., Roberts, A. F., Roesler, E. L., Salinger, A. G., Shaheen, Z., Shi, X., Singh, B., Tang, J., Taylor, M. A., Thornton, P. E., Turner, A. K., Veneziani, M., Wan, H., Wang, H., Wang, S., Williams, D. N., Wolfram, P. J., Worley, P. H., Xie, S., Yang, Y., Yoon, J.‐H., Zelinka, M. D., Zender, C. S., Zeng, X., Zhang, C., Zhang, K., Zhang, Y., Zheng, X., Zhou, T., and Zhu, Q.: The DOE E3SM coupled
model version 1: Overview and evaluation at standard resolution, J. Adv. Model. Earth Syst. 11,
2089–2129, https://doi.org/10.1029/2018MS001603, 2019.
Greve, P., Gudmundsson, L., and Seneviratne, S. I.: Regional scaling of annual mean
precipitation and water availability with global temperature change, Earth Syst. Dynam., 9,
227–240, https://doi.org/10.5194/esd-9-227-2018, 2018.
Hersbach, H., Bell, B., Berrisford, P., Horányi, A., Sabater, J. M., Nicolas, J., Radu, R., Schepers, D., Simmons, A., Soci, C., and Dee, D.: Global reanalysis:
goodbye ERA-Interim, hello ERA5, ECMWF, https://doi.org/10.21957/vf291hehd7, 2019.
Hourdin, F., Mauritsen, T., Gettelman, A., Golaz, J.-C., Balaji, V., Duan, Q., Folini, D., Ji, D., Klocke, D., Qian, Y., Rauser, F., Rio, C., Tomassini, L., Watanabe, M., and Williamson, D.: The Art and Science of Climate Model Tuning, B. Am. Meteorol. Soc., 98, 589–602,
https://doi.org/10.1175/BAMS-D-15-00135.1, 2017.
Hunt, B. G. and Manabe, S.: Experiments with a stratospheric general circulation model:
II. Large-scale diffusion of tracers in the stratosphere, Mon. Weather Rev., 96, 503–539,
https://doi.org/10.1175/1520-0493(1968)096<0503:EWASGC>2.0.CO;2, 2009.
Kay, J. E., Deser, C., Phillips, A., Mai, A., Hannay, C., Strand G., and Holland, M.:
The Community Earth System Model (CESM) large ensemble project: A community resource for studying
climate change in the presence of internal climate variability, B. Am. Meteorol. Soc., 96,
1333–1349, https://doi.org/10.1175/BAMS-D-13-00255.1, 2015.
Kay, J. E., Wall, C., Yettella, V., Medeiros, B., Hannay, C., Caldwell, P., and Bitz,
C.: Global climate impacts of fixing the Southern Ocean shortwave radiation bias in the Community
Earth System Model (CESM), J. Clim., 29, 4617–4636, https://doi.org/10.1175/JCLI-D-15-0358.1, 2016.
Knutti, R., Abramowitz, G., Collins, M., Eyring, V., Gleckler, P. J., Hewitson, B., and
Mearns, L.: Good Practice Guidance Paper on Assessing and Combining Multi Model Climate
Projections, in: Meeting Report of the Intergovernmental Panel on Climate Change Expert Meeting on
Assessing and Combining Multi Model Climate Projections, edited by: Stocker, T. F., Qin, D.,
Plattner, G.-K., Tignor, M., Midgley, P. M., IPCC Working Group I Technical Support Unit,
University of Bern, Bern, Switzerland, 2010.
Knutti, R., Sedláček, J., Sanderson, B. M., Lorenz, R., Fischer, E. M., and Eyring, V.: A climate model projection weighting scheme accounting for performance and interdependence, Geophys. Res. Lett., 44, 1909–1918, https://doi.org/10.1002/2016GL072012, 2017.
Lembo, V., Lunkeit, F., and Lucarini, V.: TheDiaTo (v1.0) – a new diagnostic tool for
water, energy and entropy budgets in climate models, Geosci. Model Dev., 12, 3805–3834,
https://doi.org/10.5194/gmd-12-3805-2019, 2019.
Loeb, N. G., Doelling, D. R., Wang, H., Su, W., Nguyen, C., Corbett, J. G., and Kato,
S.: Clouds and the earth's radiant energy system (CERES) energy balanced and filled (EBAF)
top-of-atmosphere (TOA) edition-4.0 data product, J. Clim., 31, 895–918,
https://doi.org/10.1175/JCLI-D-17-0208.1, 2018.
Lorenz, R., Herger, N., Sedláček, J., Eyring, V., Fischer, E. M., and Knutti,
R.: Prospects and caveats of weighting climate models for summer maximum temperature projections
over North America, J. Geophys. Res.-Atmos., 123, 4509–4526, https://doi.org/10.1029/2017JD027992, 2018.
Manabe, S., Bryan, K., and Spelman, M. J.: A global ocean-atmosphere climate
model. Part I. The atmospheric circulation, J. Phys. Ocean., 5, 3–29,
https://doi.org/10.1175/1520-0485(1975)005<0003:AGOACM>2.0.CO;2, 1975.
Meehl, G. A., Covey, C., Delworth, T., Latif, M., McAvaney, B., Mitchell, J. F. B.,
Stouffer, R. J., and Taylor, K. E.: THE WCRP CMIP3 Multimodel Dataset: A New Era in Climate Change Research, B. Am. Meteorol. Soc., 88, 1383–1394,
https://doi.org/10.1175/BAMS-88-9-1383, 2007.
Neubauer, D., Ferrachat, S., Siegenthaler-Le Drian, C., Stier, P., Partridge, D. G.,
Tegen, I., Bey, I., Stanelle, T., Kokkola, H., and Lohmann, U.: The global aerosol–climate model
ECHAM6.3–HAM2.3 – Part 2: Cloud evaluation, aerosol radiative forcing, and climate sensitivity,
Geosci. Model Dev., 12, 3609–3639, https://doi.org/10.5194/gmd-12-3609-2019, 2019.
Oueslati, B. and Bellon, G.: The double ITCZ bias in CMIP5 models: interaction between
SST, large-scale circulation and precipitation, Clim. Dynam., 44, 585–607,
https://doi.org/10.1007/s00382-015-2468-6, 2015.
Pierce, D. W., Barnett, T. P., Santer, B. D., and Gleckler, P. J.: Selecting global
climate models for regional climate change studies, P. Natl. Acad. Sci. USA, 106, 8441–8446,
https://doi.org/10.1073/pnas.0900094106, 2009.
Pincus, R., Batstone, C. P., Hofmann, R. J. P., Taylor, K. E., and Glecker, P. J.:
Evaluating the present-day simulation of clouds, precipitation, and radiation in climate models,
J. Geophys. Res.-Atmos., 113, D14209, https://doi.org/10.1029/2007JD009334, 2008.
Schmidt, G. A., Bader, D., Donner, L. J., Elsaesser, G. S., Golaz, J.-C., Hannay, C.,
Molod, A., Neale, R. B., and Saha, S.: Practice and philosophy of climate model tuning across six
US modeling centers, Geosci. Model Dev., 10, 3207–3223, https://doi.org/10.5194/gmd-10-3207-2017, 2017.
Taylor, K. E., Stouffer, R. J., and Meehl, G. A.: An overview of CMIP5 and the
experiment design, B. Am. Meteorol. Soc., 93, 485–498, https://doi.org/10.1175/BAMS-D-11-00094.1, 2012.
Trenberth, K. E. and Fasullo, J. T.: Regional energy and water cycles: Transports from
ocean to land, J. Clim., 26, 7837–7851, https://doi.org/10.1175/JCLI-D-13-00008.1, 2013.
Trenberth, K. E. and Fasullo, J. T.: Atlantic meridional heat transports computed from
balancing Earth's energy locally, Geol. Res. Lett., 44, 1919–1927, https://doi.org/10.1002/2016GL072475,
2017.
Short summary
The fidelity of climate model simulations included in the WCRP Coupled Model Intercomparison Project Versions 3 through 6 is evaluated using best estimates of fields considered by the community to be critical for climate change projections. The analysis benchmarks patterns of the mean state and variability (seasonal/interannual) both within and across model generations, highlighting progress and quantifying persisting biases across models.
The fidelity of climate model simulations included in the WCRP Coupled Model Intercomparison...
