Articles | Volume 17, issue 9
https://doi.org/10.5194/gmd-17-3919-2024
© Author(s) 2024. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
https://doi.org/10.5194/gmd-17-3919-2024
© Author(s) 2024. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
Model evaluation paper
| 
15 May 2024
Model evaluation paper |
| 15 May 2024
| 15 May 2024
Systematic and objective evaluation of Earth system models: PCMDI Metrics Package (PMP) version 3
Lawrence Livermore National Laboratory, Livermore, CA, USA
Peter J. Gleckler
Lawrence Livermore National Laboratory, Livermore, CA, USA
Min-Seop Ahn
NASA Goddard Space Flight Center, Greenbelt, MD, USA
ESSIC, University of Maryland, College Park, MD, USA
Ana Ordonez
Lawrence Livermore National Laboratory, Livermore, CA, USA
Paul A. Ullrich
Lawrence Livermore National Laboratory, Livermore, CA, USA
Department of Land, Air and Water Resources, University of California, Davis, Davis, CA, USA
Kenneth R. Sperber
Lawrence Livermore National Laboratory, Livermore, CA, USA
retired
Karl E. Taylor
Lawrence Livermore National Laboratory, Livermore, CA, USA
Yann Y. Planton
NOAA Pacific Marine Environmental Laboratory, Seattle, WA, USA
School of Earth Atmosphere and Environment, Monash University, Clayton, VIC, Australia
Eric Guilyardi
LOCEAN-IPSL, CNRS-IRD-MNHN-Sorbonne Université, Paris, France
National Centre for Atmospheric Science – Climate, University of Reading, Reading, UK
Paul Durack
Lawrence Livermore National Laboratory, Livermore, CA, USA
Celine Bonfils
Lawrence Livermore National Laboratory, Livermore, CA, USA
Mark D. Zelinka
Lawrence Livermore National Laboratory, Livermore, CA, USA
Li-Wei Chao
Lawrence Livermore National Laboratory, Livermore, CA, USA
Bo Dong
Lawrence Livermore National Laboratory, Livermore, CA, USA
Charles Doutriaux
Lawrence Livermore National Laboratory, Livermore, CA, USA
Chengzhu Zhang
Lawrence Livermore National Laboratory, Livermore, CA, USA
Tom Vo
Lawrence Livermore National Laboratory, Livermore, CA, USA
Jason Boutte
Lawrence Livermore National Laboratory, Livermore, CA, USA
Michael F. Wehner
Lawrence Berkeley National Laboratory, Berkeley, CA, USA
Angeline G. Pendergrass
Department of Earth and Atmospheric Science, Cornell University, Ithaca, NY, USA
National Center for Atmospheric Research, Boulder, CO, USA
Daehyun Kim
School of Earth and Environmental Sciences, Seoul National University, Seoul, South Korea
Pacific Northwest National Laboratory, Richland, WA, USA
Andrew T. Wittenberg
NOAA Geophysical Fluid Dynamics Laboratory, Princeton, NJ, USA
John Krasting
NOAA Geophysical Fluid Dynamics Laboratory, Princeton, NJ, USA
Related authors
Seung H. Baek, Paul A. Ullrich, Bo Dong, and Jiwoo Lee
EGUsphere, https://doi.org/10.5194/egusphere-2024-1456, https://doi.org/10.5194/egusphere-2024-1456, 2024
Short summary
Short summary
We evaluate downscaled products by examining locally relevant covariances during convective and frontal precipitation events. Common statistical downscaling techniques preserve expected covariances during convective precipitation. However, they dampen future intensification of frontal precipitation captured in global climate models and dynamical downscaling. This suggests statistical downscaling may not fully resolve non-stationary hydrologic processes as compared to dynamical downscaling.
Min-Seop Ahn, Paul A. Ullrich, Peter J. Gleckler, Jiwoo Lee, Ana C. Ordonez, and Angeline G. Pendergrass
Geosci. Model Dev., 16, 3927–3951, https://doi.org/10.5194/gmd-16-3927-2023, https://doi.org/10.5194/gmd-16-3927-2023, 2023
Short summary
Short summary
We introduce a framework for regional-scale evaluation of simulated precipitation distributions with 62 climate reference regions and 10 metrics and apply it to evaluate CMIP5 and CMIP6 models against multiple satellite-based precipitation products. The common model biases identified in this study are mainly associated with the overestimated light precipitation and underestimated heavy precipitation. These biases persist from earlier-generation models and have been slightly improved in CMIP6.
Seung H. Baek, Paul A. Ullrich, Bo Dong, and Jiwoo Lee
EGUsphere, https://doi.org/10.5194/egusphere-2024-1456, https://doi.org/10.5194/egusphere-2024-1456, 2024
Short summary
Short summary
We evaluate downscaled products by examining locally relevant covariances during convective and frontal precipitation events. Common statistical downscaling techniques preserve expected covariances during convective precipitation. However, they dampen future intensification of frontal precipitation captured in global climate models and dynamical downscaling. This suggests statistical downscaling may not fully resolve non-stationary hydrologic processes as compared to dynamical downscaling.
Jishi Zhang, Peter Bogenschutz, Qi Tang, Philip Cameron-smith, and Chengzhu Zhang
Geosci. Model Dev., 17, 3687–3731, https://doi.org/10.5194/gmd-17-3687-2024, https://doi.org/10.5194/gmd-17-3687-2024, 2024
Short summary
Short summary
We developed a regionally refined climate model that allows resolved convection and performed a 20-year projection to the end of the century. The model has a resolution of 3.25 km in California, which allows us to predict climate with unprecedented accuracy, and a resolution of 100 km for the rest of the globe to achieve efficient, self-consistent simulations. The model produces superior results in reproducing climate patterns over California that typical modern climate models cannot resolve.
John T. Fasullo, Jean-Christophe Golaz, Julie M. Caron, Nan Rosenbloom, Gerald A. Meehl, Warren Strand, Sasha Glanville, Samantha Stevenson, Maria Molina, Christine A. Shields, Chengzhu Zhang, James Benedict, Hailong Wang, and Tony Bartoletti
Earth Syst. Dynam., 15, 367–386, https://doi.org/10.5194/esd-15-367-2024, https://doi.org/10.5194/esd-15-367-2024, 2024
Short summary
Short summary
Climate model large ensembles provide a unique and invaluable means for estimating the climate response to external forcing agents and quantify contrasts in model structure. Here, an overview of the Energy Exascale Earth System Model (E3SM) version 2 large ensemble is given along with comparisons to large ensembles from E3SM version 1 and versions 1 and 2 of the Community Earth System Model. The paper provides broad and important context for users of these ensembles.
Andrew C. Ross, Charles A. Stock, Vimal Koul, Thomas L. Delworth, Feiyu Lu, Andrew Wittenberg, and Michael A. Alexander
EGUsphere, https://doi.org/10.5194/egusphere-2024-394, https://doi.org/10.5194/egusphere-2024-394, 2024
Short summary
Short summary
In this paper, we use a high resolution regional ocean model to downscale seasonal ocean forecasts from GFDL’s SPEAR model. We find that the downscaled model has significantly higher prediction skill in many cases.
Angeline G. Pendergrass, Michael P. Byrne, Oliver Watt-Meyer, Penelope Maher, and Mark J. Webb
Geosci. Model Dev. Discuss., https://doi.org/10.5194/gmd-2024-17, https://doi.org/10.5194/gmd-2024-17, 2024
Revised manuscript under review for GMD
Short summary
Short summary
The width of the tropical rain belt affects many aspects of our climate; yet we do not understand what controls it. To better understand it, we present a method to change it in numerical model experiments. We show that the method works well in four different models. The behavior of the width is unexpectedly simple in some ways, such as how strong the winds are as it changes; but in other ways, it is more complicated, especially how temperature increases with carbon dioxide.
Karl E. Taylor
Geosci. Model Dev., 17, 415–430, https://doi.org/10.5194/gmd-17-415-2024, https://doi.org/10.5194/gmd-17-415-2024, 2024
Short summary
Short summary
Remapping gridded data in a way that preserves the conservative properties of the climate system can be essential in coupling model components and for accurate assessment of the system’s energy and mass constituents. Remapping packages capable of handling a wide variety of grids can, for some common grids, calculate remapping weights that are somewhat inaccurate. Correcting for these errors, guidelines are provided to ensure conservation when the weights are used in practice.
Mark D. Zelinka, Christopher J. Smith, Yi Qin, and Karl E. Taylor
Atmos. Chem. Phys., 23, 8879–8898, https://doi.org/10.5194/acp-23-8879-2023, https://doi.org/10.5194/acp-23-8879-2023, 2023
Short summary
Short summary
The primary uncertainty in how strongly Earth's climate has been perturbed by human activities comes from the unknown radiative impact of aerosol changes. Accurately quantifying these forcings – and their sub-components – in climate models is crucial for understanding the past and future simulated climate. In this study we describe biases in previously published estimates of aerosol radiative forcing in climate models and provide corrected estimates along with code for users to compute them.
Min-Seop Ahn, Paul A. Ullrich, Peter J. Gleckler, Jiwoo Lee, Ana C. Ordonez, and Angeline G. Pendergrass
Geosci. Model Dev., 16, 3927–3951, https://doi.org/10.5194/gmd-16-3927-2023, https://doi.org/10.5194/gmd-16-3927-2023, 2023
Short summary
Short summary
We introduce a framework for regional-scale evaluation of simulated precipitation distributions with 62 climate reference regions and 10 metrics and apply it to evaluate CMIP5 and CMIP6 models against multiple satellite-based precipitation products. The common model biases identified in this study are mainly associated with the overestimated light precipitation and underestimated heavy precipitation. These biases persist from earlier-generation models and have been slightly improved in CMIP6.
Qi Tang, Jean-Christophe Golaz, Luke P. Van Roekel, Mark A. Taylor, Wuyin Lin, Benjamin R. Hillman, Paul A. Ullrich, Andrew M. Bradley, Oksana Guba, Jonathan D. Wolfe, Tian Zhou, Kai Zhang, Xue Zheng, Yunyan Zhang, Meng Zhang, Mingxuan Wu, Hailong Wang, Cheng Tao, Balwinder Singh, Alan M. Rhoades, Yi Qin, Hong-Yi Li, Yan Feng, Yuying Zhang, Chengzhu Zhang, Charles S. Zender, Shaocheng Xie, Erika L. Roesler, Andrew F. Roberts, Azamat Mametjanov, Mathew E. Maltrud, Noel D. Keen, Robert L. Jacob, Christiane Jablonowski, Owen K. Hughes, Ryan M. Forsyth, Alan V. Di Vittorio, Peter M. Caldwell, Gautam Bisht, Renata B. McCoy, L. Ruby Leung, and David C. Bader
Geosci. Model Dev., 16, 3953–3995, https://doi.org/10.5194/gmd-16-3953-2023, https://doi.org/10.5194/gmd-16-3953-2023, 2023
Short summary
Short summary
High-resolution simulations are superior to low-resolution ones in capturing regional climate changes and climate extremes. However, uniformly reducing the grid size of a global Earth system model is too computationally expensive. We provide an overview of the fully coupled regionally refined model (RRM) of E3SMv2 and document a first-of-its-kind set of climate production simulations using RRM at an economic cost. The key to this success is our innovative hybrid time step method.
Zeyu Xue, Paul Ullrich, and Lai-Yung Ruby Leung
Hydrol. Earth Syst. Sci., 27, 1909–1927, https://doi.org/10.5194/hess-27-1909-2023, https://doi.org/10.5194/hess-27-1909-2023, 2023
Short summary
Short summary
We examine the sensitivity and robustness of conclusions drawn from the PGW method over the NEUS by conducting multiple PGW experiments and varying the perturbation spatial scales and choice of perturbed meteorological variables to provide a guideline for this increasingly popular regional modeling method. Overall, we recommend PGW experiments be performed with perturbations to temperature or the combination of temperature and wind at the gridpoint scale, depending on the research question.
Iris Elisabeth de Vries, Sebastian Sippel, Angeline Greene Pendergrass, and Reto Knutti
Earth Syst. Dynam., 14, 81–100, https://doi.org/10.5194/esd-14-81-2023, https://doi.org/10.5194/esd-14-81-2023, 2023
Short summary
Short summary
Precipitation change is an important consequence of climate change, but it is hard to detect and quantify. Our intuitive method yields robust and interpretable detection of forced precipitation change in three observational datasets for global mean and extreme precipitation, but the different observational datasets show different magnitudes of forced change. Assessment and reduction of uncertainties surrounding forced precipitation change are important for future projections and adaptation.
Chengzhu Zhang, Jean-Christophe Golaz, Ryan Forsyth, Tom Vo, Shaocheng Xie, Zeshawn Shaheen, Gerald L. Potter, Xylar S. Asay-Davis, Charles S. Zender, Wuyin Lin, Chih-Chieh Chen, Chris R. Terai, Salil Mahajan, Tian Zhou, Karthik Balaguru, Qi Tang, Cheng Tao, Yuying Zhang, Todd Emmenegger, Susannah Burrows, and Paul A. Ullrich
Geosci. Model Dev., 15, 9031–9056, https://doi.org/10.5194/gmd-15-9031-2022, https://doi.org/10.5194/gmd-15-9031-2022, 2022
Short summary
Short summary
Earth system model (ESM) developers run automated analysis tools on data from candidate models to inform model development. This paper introduces a new Python package, E3SM Diags, that has been developed to support ESM development and use routinely in the development of DOE's Energy Exascale Earth System Model. This tool covers a set of essential diagnostics to evaluate the mean physical climate from simulations, as well as several process-oriented and phenomenon-based evaluation diagnostics.
Sjoukje Y. Philip, Sarah F. Kew, Geert Jan van Oldenborgh, Faron S. Anslow, Sonia I. Seneviratne, Robert Vautard, Dim Coumou, Kristie L. Ebi, Julie Arrighi, Roop Singh, Maarten van Aalst, Carolina Pereira Marghidan, Michael Wehner, Wenchang Yang, Sihan Li, Dominik L. Schumacher, Mathias Hauser, Rémy Bonnet, Linh N. Luu, Flavio Lehner, Nathan Gillett, Jordis S. Tradowsky, Gabriel A. Vecchi, Chris Rodell, Roland B. Stull, Rosie Howard, and Friederike E. L. Otto
Earth Syst. Dynam., 13, 1689–1713, https://doi.org/10.5194/esd-13-1689-2022, https://doi.org/10.5194/esd-13-1689-2022, 2022
Short summary
Short summary
In June 2021, the Pacific Northwest of the US and Canada saw record temperatures far exceeding those previously observed. This attribution study found such a severe heat wave would have been virtually impossible without human-induced climate change. Assuming no nonlinear interactions, such events have become at least 150 times more common, are about 2 °C hotter and will become even more common as warming continues. Therefore, adaptation and mitigation are urgently needed to prepare society.
Yona Silvy, Clément Rousset, Eric Guilyardi, Jean-Baptiste Sallée, Juliette Mignot, Christian Ethé, and Gurvan Madec
Geosci. Model Dev., 15, 7683–7713, https://doi.org/10.5194/gmd-15-7683-2022, https://doi.org/10.5194/gmd-15-7683-2022, 2022
Short summary
Short summary
A modeling framework is introduced to understand and decompose the mechanisms causing the ocean temperature, salinity and circulation to change since the pre-industrial period and into 21st century scenarios of global warming. This framework aims to look at the response to changes in the winds and in heat and freshwater exchanges at the ocean interface in global climate models, throughout the 1850–2100 period, to unravel their individual effects on the changing physical structure of the ocean.
Amy H. Peace, Ben B. B. Booth, Leighton A. Regayre, Ken S. Carslaw, David M. H. Sexton, Céline J. W. Bonfils, and John W. Rostron
Earth Syst. Dynam., 13, 1215–1232, https://doi.org/10.5194/esd-13-1215-2022, https://doi.org/10.5194/esd-13-1215-2022, 2022
Short summary
Short summary
Anthropogenic aerosol emissions have been linked to driving climate responses such as shifts in the location of tropical rainfall. However, the interaction of aerosols with climate remains one of the most uncertain aspects of climate modelling and limits our ability to predict future climate change. We use an ensemble of climate model simulations to investigate what impact the large uncertainty in how aerosols interact with climate has on predicting future tropical rainfall shifts.
Pradeebane Vaittinada Ayar, Laurent Bopp, Jim R. Christian, Tatiana Ilyina, John P. Krasting, Roland Séférian, Hiroyuki Tsujino, Michio Watanabe, Andrew Yool, and Jerry Tjiputra
Earth Syst. Dynam., 13, 1097–1118, https://doi.org/10.5194/esd-13-1097-2022, https://doi.org/10.5194/esd-13-1097-2022, 2022
Short summary
Short summary
The El Niño–Southern Oscillation is the main driver for the natural variability of global atmospheric CO2. It modulates the CO2 fluxes in the tropical Pacific with anomalous CO2 influx during El Niño and outflux during La Niña. This relationship is projected to reverse by half of Earth system models studied here under the business-as-usual scenario. This study shows models that simulate a positive bias in surface carbonate concentrations simulate a shift in the ENSO–CO2 flux relationship.
Po-Lun Ma, Bryce E. Harrop, Vincent E. Larson, Richard B. Neale, Andrew Gettelman, Hugh Morrison, Hailong Wang, Kai Zhang, Stephen A. Klein, Mark D. Zelinka, Yuying Zhang, Yun Qian, Jin-Ho Yoon, Christopher R. Jones, Meng Huang, Sheng-Lun Tai, Balwinder Singh, Peter A. Bogenschutz, Xue Zheng, Wuyin Lin, Johannes Quaas, Hélène Chepfer, Michael A. Brunke, Xubin Zeng, Johannes Mülmenstädt, Samson Hagos, Zhibo Zhang, Hua Song, Xiaohong Liu, Michael S. Pritchard, Hui Wan, Jingyu Wang, Qi Tang, Peter M. Caldwell, Jiwen Fan, Larry K. Berg, Jerome D. Fast, Mark A. Taylor, Jean-Christophe Golaz, Shaocheng Xie, Philip J. Rasch, and L. Ruby Leung
Geosci. Model Dev., 15, 2881–2916, https://doi.org/10.5194/gmd-15-2881-2022, https://doi.org/10.5194/gmd-15-2881-2022, 2022
Short summary
Short summary
An alternative set of parameters for E3SM Atmospheric Model version 1 has been developed based on a tuning strategy that focuses on clouds. When clouds in every regime are improved, other aspects of the model are also improved, even though they are not the direct targets for calibration. The recalibrated model shows a lower sensitivity to anthropogenic aerosols and surface warming, suggesting potential improvements to the simulated climate in the past and future.
Claudia Tebaldi, Kalyn Dorheim, Michael Wehner, and Ruby Leung
Earth Syst. Dynam., 12, 1427–1501, https://doi.org/10.5194/esd-12-1427-2021, https://doi.org/10.5194/esd-12-1427-2021, 2021
Short summary
Short summary
We address the question of how large an initial condition ensemble of climate model simulations should be if we are concerned with accurately projecting future changes in temperature and precipitation extremes. We find that for most cases (and both models considered), an ensemble of 20–25 members is sufficient for many extreme metrics, spatial scales and time horizons. This may leave computational resources to tackle other uncertainties in climate model simulations with our ensembles.
Trevor J. McDougall, Paul M. Barker, Ryan M. Holmes, Rich Pawlowicz, Stephen M. Griffies, and Paul J. Durack
Geosci. Model Dev., 14, 6445–6466, https://doi.org/10.5194/gmd-14-6445-2021, https://doi.org/10.5194/gmd-14-6445-2021, 2021
Short summary
Short summary
We show that the way that the air–sea heat flux is treated in ocean models means that the model's temperature variable should be interpreted as being Conservative Temperature, irrespective of whether the equation of state used in an ocean model is EOS-80 or TEOS-10.
Benjamin M. Sanderson, Angeline G. Pendergrass, Charles D. Koven, Florent Brient, Ben B. B. Booth, Rosie A. Fisher, and Reto Knutti
Earth Syst. Dynam., 12, 899–918, https://doi.org/10.5194/esd-12-899-2021, https://doi.org/10.5194/esd-12-899-2021, 2021
Short summary
Short summary
Emergent constraints promise a pathway to the reduction in climate projection uncertainties by exploiting ensemble relationships between observable quantities and unknown climate response parameters. This study considers the robustness of these relationships in light of biases and common simplifications that may be present in the original ensemble of climate simulations. We propose a classification scheme for constraints and a number of practical case studies.
Christina Heinze-Deml, Sebastian Sippel, Angeline G. Pendergrass, Flavio Lehner, and Nicolai Meinshausen
Geosci. Model Dev., 14, 4977–4999, https://doi.org/10.5194/gmd-14-4977-2021, https://doi.org/10.5194/gmd-14-4977-2021, 2021
Short summary
Short summary
Quantifying dynamical and thermodynamical components of regional precipitation change is a key challenge in climate science. We introduce a novel statistical model (Latent Linear Adjustment Autoencoder) that combines the flexibility of deep neural networks with the robustness advantages of linear regression. The method enables estimation of the contribution of a coarse-scale atmospheric circulation proxy to daily precipitation at high resolution and in a spatially coherent manner.
Prabhat, Karthik Kashinath, Mayur Mudigonda, Sol Kim, Lukas Kapp-Schwoerer, Andre Graubner, Ege Karaismailoglu, Leo von Kleist, Thorsten Kurth, Annette Greiner, Ankur Mahesh, Kevin Yang, Colby Lewis, Jiayi Chen, Andrew Lou, Sathyavat Chandran, Ben Toms, Will Chapman, Katherine Dagon, Christine A. Shields, Travis O'Brien, Michael Wehner, and William Collins
Geosci. Model Dev., 14, 107–124, https://doi.org/10.5194/gmd-14-107-2021, https://doi.org/10.5194/gmd-14-107-2021, 2021
Short summary
Short summary
Detecting extreme weather events is a crucial step in understanding how they change due to climate change. Deep learning (DL) is remarkable at pattern recognition; however, it works best only when labeled datasets are available. We create
ClimateNet– an expert-labeled curated dataset – to train a DL model for detecting weather events and predicting changes in extreme precipitation. This work paves the way for DL-based automated, high-fidelity, and highly precise analytics of climate data.
Hsi-Yen Ma, Chen Zhou, Yunyan Zhang, Stephen A. Klein, Mark D. Zelinka, Xue Zheng, Shaocheng Xie, Wei-Ting Chen, and Chien-Ming Wu
Geosci. Model Dev., 14, 73–90, https://doi.org/10.5194/gmd-14-73-2021, https://doi.org/10.5194/gmd-14-73-2021, 2021
Short summary
Short summary
We propose an experimental design of a suite of multi-year, short-term hindcasts and compare them with corresponding observations or measurements for periods based on different weather and climate phenomena. This atypical way of evaluating model performance is particularly useful and beneficial, as these hindcasts can give scientists a robust picture of modeled precipitation, and cloud and radiation processes from their diurnal variation to year-to-year variability.
Lukas Brunner, Angeline G. Pendergrass, Flavio Lehner, Anna L. Merrifield, Ruth Lorenz, and Reto Knutti
Earth Syst. Dynam., 11, 995–1012, https://doi.org/10.5194/esd-11-995-2020, https://doi.org/10.5194/esd-11-995-2020, 2020
Short summary
Short summary
In this study, we weight climate models by their performance with respect to simulating aspects of historical climate and their degree of interdependence. Our method is found to increase projection skill and to correct for structurally similar models. The weighted end-of-century mean warming (2081–2100 relative to 1995–2014) is 3.7 °C with a likely (66 %) range of 3.1 to 4.6 °C for the strong climate change scenario SSP5-8.5; this is a reduction of 0.4 °C compared with the unweighted mean.
Landon A. Rieger, Jason N. S. Cole, John C. Fyfe, Stephen Po-Chedley, Philip J. Cameron-Smith, Paul J. Durack, Nathan P. Gillett, and Qi Tang
Geosci. Model Dev., 13, 4831–4843, https://doi.org/10.5194/gmd-13-4831-2020, https://doi.org/10.5194/gmd-13-4831-2020, 2020
Short summary
Short summary
Recently, the stratospheric aerosol forcing dataset used as an input to the Coupled Model Intercomparison Project phase 6 was updated. This work explores the impact of those changes on the modelled historical climates in the CanESM5 and EAMv1 models. Temperature differences in the stratosphere shortly after the Pinatubo eruption are found to be significant, but surface temperatures and precipitation do not show a significant change.
Mark D. Risser and Michael F. Wehner
Adv. Stat. Clim. Meteorol. Oceanogr., 6, 115–139, https://doi.org/10.5194/ascmo-6-115-2020, https://doi.org/10.5194/ascmo-6-115-2020, 2020
Short summary
Short summary
Evaluation of modern high-resolution global climate models often does not account for the geographic location of the underlying weather station data. In this paper, we quantify the impact of geographic sampling on the relative performance of climate model representations of precipitation extremes over the United States. We find that properly accounting for the geographic sampling of weather stations can significantly change the assessment of model performance.
Vivek K. Arora, Anna Katavouta, Richard G. Williams, Chris D. Jones, Victor Brovkin, Pierre Friedlingstein, Jörg Schwinger, Laurent Bopp, Olivier Boucher, Patricia Cadule, Matthew A. Chamberlain, James R. Christian, Christine Delire, Rosie A. Fisher, Tomohiro Hajima, Tatiana Ilyina, Emilie Joetzjer, Michio Kawamiya, Charles D. Koven, John P. Krasting, Rachel M. Law, David M. Lawrence, Andrew Lenton, Keith Lindsay, Julia Pongratz, Thomas Raddatz, Roland Séférian, Kaoru Tachiiri, Jerry F. Tjiputra, Andy Wiltshire, Tongwen Wu, and Tilo Ziehn
Biogeosciences, 17, 4173–4222, https://doi.org/10.5194/bg-17-4173-2020, https://doi.org/10.5194/bg-17-4173-2020, 2020
Short summary
Short summary
Since the preindustrial period, land and ocean have taken up about half of the carbon emitted into the atmosphere by humans. Comparison of different earth system models with the carbon cycle allows us to assess how carbon uptake by land and ocean differs among models. This yields an estimate of uncertainty in our understanding of how land and ocean respond to increasing atmospheric CO2. This paper summarizes results from two such model intercomparison projects that use an idealized scenario.
Duane Waliser, Peter J. Gleckler, Robert Ferraro, Karl E. Taylor, Sasha Ames, James Biard, Michael G. Bosilovich, Otis Brown, Helene Chepfer, Luca Cinquini, Paul J. Durack, Veronika Eyring, Pierre-Philippe Mathieu, Tsengdar Lee, Simon Pinnock, Gerald L. Potter, Michel Rixen, Roger Saunders, Jörg Schulz, Jean-Noël Thépaut, and Matthias Tuma
Geosci. Model Dev., 13, 2945–2958, https://doi.org/10.5194/gmd-13-2945-2020, https://doi.org/10.5194/gmd-13-2945-2020, 2020
Short summary
Short summary
This paper provides an update to an international research activity whose objective is to facilitate access to satellite and other types of regional and global datasets for evaluating global models used to produce 21st century climate projections.
Charlotte Pascoe, Bryan N. Lawrence, Eric Guilyardi, Martin Juckes, and Karl E. Taylor
Geosci. Model Dev., 13, 2149–2167, https://doi.org/10.5194/gmd-13-2149-2020, https://doi.org/10.5194/gmd-13-2149-2020, 2020
Short summary
Short summary
We present a methodology for documenting numerical experiments in the context of an information sharing ecosystem which allows the weather, climate, and earth system modelling community to accurately document and share information about their modelling workflow. We describe how through iteration with a range of stakeholders, we rationalized multiple sources of information and improved the clarity of experimental definitions for the Coupled Model Intercomparison Project Phase 6 (CMIP6).
Martin Juckes, Karl E. Taylor, Paul J. Durack, Bryan Lawrence, Matthew S. Mizielinski, Alison Pamment, Jean-Yves Peterschmitt, Michel Rixen, and Stéphane Sénési
Geosci. Model Dev., 13, 201–224, https://doi.org/10.5194/gmd-13-201-2020, https://doi.org/10.5194/gmd-13-201-2020, 2020
Short summary
Short summary
The data request of the Coupled Model Intercomparison Project Phase 6 (CMIP6) defines all the quantities
from CMIP6 simulations that should be archived. The building blocks and structure of the CMIP6 Data Request, which has been constructed to meet these challenges, are described in this paper.
Grzegorz Muszynski, Karthik Kashinath, Vitaliy Kurlin, Michael Wehner, and Prabhat
Geosci. Model Dev., 12, 613–628, https://doi.org/10.5194/gmd-12-613-2019, https://doi.org/10.5194/gmd-12-613-2019, 2019
Short summary
Short summary
We present the automated method for recognizing atmospheric rivers in climate data, i.e., climate model output and reanalysis product. The method is based on topological data analysis and machine learning, both of which are powerful tools that the climate science community often does not use. An advantage of the proposed method is that it is free of selection of subjective threshold conditions on a physical variable. This method is also suitable for rapidly analyzing large amounts of data.
Daniel T. McCoy, Paul R. Field, Gregory S. Elsaesser, Alejandro Bodas-Salcedo, Brian H. Kahn, Mark D. Zelinka, Chihiro Kodama, Thorsten Mauritsen, Benoit Vanniere, Malcolm Roberts, Pier L. Vidale, David Saint-Martin, Aurore Voldoire, Rein Haarsma, Adrian Hill, Ben Shipway, and Jonathan Wilkinson
Atmos. Chem. Phys., 19, 1147–1172, https://doi.org/10.5194/acp-19-1147-2019, https://doi.org/10.5194/acp-19-1147-2019, 2019
Short summary
Short summary
The largest single source of uncertainty in the climate sensitivity predicted by global climate models is how much low-altitude clouds change as the climate warms. Models predict that the amount of liquid within and the brightness of low-altitude clouds increase in the extratropics with warming. We show that increased fluxes of moisture into extratropical storms in the midlatitudes explain the majority of the observed trend and the modeled increase in liquid water within these storms.
Venkatramani Balaji, Karl E. Taylor, Martin Juckes, Bryan N. Lawrence, Paul J. Durack, Michael Lautenschlager, Chris Blanton, Luca Cinquini, Sébastien Denvil, Mark Elkington, Francesca Guglielmo, Eric Guilyardi, David Hassell, Slava Kharin, Stefan Kindermann, Sergey Nikonov, Aparna Radhakrishnan, Martina Stockhause, Tobias Weigel, and Dean Williams
Geosci. Model Dev., 11, 3659–3680, https://doi.org/10.5194/gmd-11-3659-2018, https://doi.org/10.5194/gmd-11-3659-2018, 2018
Short summary
Short summary
We present recommendations for the global data infrastructure needed to support CMIP scientific design and its future growth and evolution. We follow a dataset-centric design less prone to systemic failure. Scientific publication in the digital age is evolving to make data a primary scientific output, alongside articles. We design toward that future scientific data ecosystem, informed by the need for reproducibility, data provenance, future data technologies, and measures of costs and benefits.
Christine A. Shields, Jonathan J. Rutz, Lai-Yung Leung, F. Martin Ralph, Michael Wehner, Brian Kawzenuk, Juan M. Lora, Elizabeth McClenny, Tashiana Osborne, Ashley E. Payne, Paul Ullrich, Alexander Gershunov, Naomi Goldenson, Bin Guan, Yun Qian, Alexandre M. Ramos, Chandan Sarangi, Scott Sellars, Irina Gorodetskaya, Karthik Kashinath, Vitaliy Kurlin, Kelly Mahoney, Grzegorz Muszynski, Roger Pierce, Aneesh C. Subramanian, Ricardo Tome, Duane Waliser, Daniel Walton, Gary Wick, Anna Wilson, David Lavers, Prabhat, Allison Collow, Harinarayan Krishnan, Gudrun Magnusdottir, and Phu Nguyen
Geosci. Model Dev., 11, 2455–2474, https://doi.org/10.5194/gmd-11-2455-2018, https://doi.org/10.5194/gmd-11-2455-2018, 2018
Short summary
Short summary
ARTMIP (Atmospheric River Tracking Method Intercomparison Project) is a community effort with the explicit goal of understanding the uncertainties, and the implications of those uncertainties, in atmospheric river science solely due to detection algorithm. ARTMIP strives to quantify these differences and provide guidance on appropriate algorithmic choices for the science question posed. Project goals, experimental design, and preliminary results are provided.
Monika J. Barcikowska, Scott J. Weaver, Frauke Feser, Simone Russo, Frederik Schenk, Dáithí A. Stone, Michael F. Wehner, and Matthias Zahn
Earth Syst. Dynam., 9, 679–699, https://doi.org/10.5194/esd-9-679-2018, https://doi.org/10.5194/esd-9-679-2018, 2018
Michael Wehner, Dáithí Stone, Dann Mitchell, Hideo Shiogama, Erich Fischer, Lise S. Graff, Viatcheslav V. Kharin, Ludwig Lierhammer, Benjamin Sanderson, and Harinarayan Krishnan
Earth Syst. Dynam., 9, 299–311, https://doi.org/10.5194/esd-9-299-2018, https://doi.org/10.5194/esd-9-299-2018, 2018
Short summary
Short summary
The United Nations Framework Convention on Climate Change challenged the scientific community to describe the impacts of stabilizing the global temperature at its 21st Conference of Parties. A specific target of 1.5 °C above preindustrial levels had not been seriously considered by the climate modeling community prior to the Paris Agreement. This paper analyzes heat waves in simulations designed for this target. We find there are reductions in extreme temperature compared to a 2 °C target.
Michael F. Wehner, Kevin A. Reed, Burlen Loring, Dáithí Stone, and Harinarayan Krishnan
Earth Syst. Dynam., 9, 187–195, https://doi.org/10.5194/esd-9-187-2018, https://doi.org/10.5194/esd-9-187-2018, 2018
Short summary
Short summary
The United Nations Framework Convention on Climate Change invited the scientific community to explore the impacts of a world in which anthropogenic global warming is stabilized at only 1.5 °C above preindustrial average temperatures. We present a projection of future tropical cyclone statistics for both 1.5 and 2.0 °C stabilized warming scenarios using a high-resolution global climate model. We find more frequent and intense tropical cyclones, but a reduction in weaker storms.
Angeline G. Pendergrass, Andrew Conley, and Francis M. Vitt
Earth Syst. Sci. Data, 10, 317–324, https://doi.org/10.5194/essd-10-317-2018, https://doi.org/10.5194/essd-10-317-2018, 2018
Short summary
Short summary
We document and validate radiative kernels for the surface and top-of-atmosphere calculated with NCAR's CESM1 climate model. A radiative kernel is the change in radiation in response to a small change in a property of the atmosphere or surface, essentially a partial derivative. They are used to quantify temperature, water vapor, surface albedo, and cloud feedbacks. We made these kernels because few are available for the surface. We also validate the kernels against the expected model responses.
David Hassell, Jonathan Gregory, Jon Blower, Bryan N. Lawrence, and Karl E. Taylor
Geosci. Model Dev., 10, 4619–4646, https://doi.org/10.5194/gmd-10-4619-2017, https://doi.org/10.5194/gmd-10-4619-2017, 2017
Short summary
Short summary
We present a formal data model for version 1.6 of the CF (Climate and Forecast) metadata conventions that provide a description of the physical meaning of geoscientific data and their spatial and temporal properties. We describe the CF conventions and how they lead to our CF data model, and compare it other data models for storing data and metadata. We present cf-python version 2.1: a software implementation of the CF data model capable of manipulating any CF-compliant dataset.
Yoko Tsushima, Florent Brient, Stephen A. Klein, Dimitra Konsta, Christine C. Nam, Xin Qu, Keith D. Williams, Steven C. Sherwood, Kentaroh Suzuki, and Mark D. Zelinka
Geosci. Model Dev., 10, 4285–4305, https://doi.org/10.5194/gmd-10-4285-2017, https://doi.org/10.5194/gmd-10-4285-2017, 2017
Short summary
Short summary
Cloud feedback is the largest uncertainty associated with estimates of climate sensitivity. Diagnostics have been developed to evaluate cloud processes in climate models. For this understanding to be reflected in better estimates of cloud feedbacks, it is vital to continue to develop such tools and to exploit them fully during the model development process. Code repositories have been created to store and document the programs which will allow climate modellers to compute these diagnostics.
Benjamin M. Sanderson, Yangyang Xu, Claudia Tebaldi, Michael Wehner, Brian O'Neill, Alexandra Jahn, Angeline G. Pendergrass, Flavio Lehner, Warren G. Strand, Lei Lin, Reto Knutti, and Jean Francois Lamarque
Earth Syst. Dynam., 8, 827–847, https://doi.org/10.5194/esd-8-827-2017, https://doi.org/10.5194/esd-8-827-2017, 2017
Short summary
Short summary
We present the results of a set of climate simulations designed to simulate futures in which the Earth's temperature is stabilized at the levels referred to in the 2015 Paris Agreement. We consider the necessary future emissions reductions and the aspects of extreme weather which differ significantly between the 2 and 1.5 °C climate in the simulations.
Benjamin M. Sanderson, Michael Wehner, and Reto Knutti
Geosci. Model Dev., 10, 2379–2395, https://doi.org/10.5194/gmd-10-2379-2017, https://doi.org/10.5194/gmd-10-2379-2017, 2017
Short summary
Short summary
How should climate model simulations be combined to produce an overall assessment that reflects both their performance and their interdependencies? This paper presents a strategy for weighting climate model output such that models that are replicated or models that perform poorly in a chosen set of metrics are appropriately weighted. We perform sensitivity tests to show how the method results depend on variables and parameter values.
Daniel Mitchell, Krishna AchutaRao, Myles Allen, Ingo Bethke, Urs Beyerle, Andrew Ciavarella, Piers M. Forster, Jan Fuglestvedt, Nathan Gillett, Karsten Haustein, William Ingram, Trond Iversen, Viatcheslav Kharin, Nicholas Klingaman, Neil Massey, Erich Fischer, Carl-Friedrich Schleussner, John Scinocca, Øyvind Seland, Hideo Shiogama, Emily Shuckburgh, Sarah Sparrow, Dáithí Stone, Peter Uhe, David Wallom, Michael Wehner, and Rashyd Zaaboul
Geosci. Model Dev., 10, 571–583, https://doi.org/10.5194/gmd-10-571-2017, https://doi.org/10.5194/gmd-10-571-2017, 2017
Short summary
Short summary
This paper provides an experimental design to assess impacts of a world that is 1.5 °C warmer than at pre-industrial levels. The design is a new way to approach impacts from the climate community, and aims to answer questions related to the recent Paris Agreement. In particular the paper provides a method for studying extreme events under relatively high mitigation scenarios.
Veronika Eyring, Peter J. Gleckler, Christoph Heinze, Ronald J. Stouffer, Karl E. Taylor, V. Balaji, Eric Guilyardi, Sylvie Joussaume, Stephan Kindermann, Bryan N. Lawrence, Gerald A. Meehl, Mattia Righi, and Dean N. Williams
Earth Syst. Dynam., 7, 813–830, https://doi.org/10.5194/esd-7-813-2016, https://doi.org/10.5194/esd-7-813-2016, 2016
Short summary
Short summary
We argue that the CMIP community has reached a critical juncture at which many baseline aspects of model evaluation need to be performed much more efficiently to enable a systematic and rapid performance assessment of the large number of models participating in CMIP, and we announce our intention to implement such a system for CMIP6. At the same time, continuous scientific research is required to develop innovative metrics and diagnostics that help narrowing the spread in climate projections.
George J. Boer, Douglas M. Smith, Christophe Cassou, Francisco Doblas-Reyes, Gokhan Danabasoglu, Ben Kirtman, Yochanan Kushnir, Masahide Kimoto, Gerald A. Meehl, Rym Msadek, Wolfgang A. Mueller, Karl E. Taylor, Francis Zwiers, Michel Rixen, Yohan Ruprich-Robert, and Rosie Eade
Geosci. Model Dev., 9, 3751–3777, https://doi.org/10.5194/gmd-9-3751-2016, https://doi.org/10.5194/gmd-9-3751-2016, 2016
Short summary
Short summary
The Decadal Climate Prediction Project (DCPP) investigates our ability to skilfully predict climate variations from a year to a decade ahead by means of a series of retrospective forecasts. Quasi-real-time forecasts are also produced for potential users. In addition, the DCPP investigates how perturbations such as volcanoes affect forecasts and, more broadly, what new information can be learned about the mechanisms governing climate variations by means of case studies of past climate behaviour.
Stephen M. Griffies, Gokhan Danabasoglu, Paul J. Durack, Alistair J. Adcroft, V. Balaji, Claus W. Böning, Eric P. Chassignet, Enrique Curchitser, Julie Deshayes, Helge Drange, Baylor Fox-Kemper, Peter J. Gleckler, Jonathan M. Gregory, Helmuth Haak, Robert W. Hallberg, Patrick Heimbach, Helene T. Hewitt, David M. Holland, Tatiana Ilyina, Johann H. Jungclaus, Yoshiki Komuro, John P. Krasting, William G. Large, Simon J. Marsland, Simona Masina, Trevor J. McDougall, A. J. George Nurser, James C. Orr, Anna Pirani, Fangli Qiao, Ronald J. Stouffer, Karl E. Taylor, Anne Marie Treguier, Hiroyuki Tsujino, Petteri Uotila, Maria Valdivieso, Qiang Wang, Michael Winton, and Stephen G. Yeager
Geosci. Model Dev., 9, 3231–3296, https://doi.org/10.5194/gmd-9-3231-2016, https://doi.org/10.5194/gmd-9-3231-2016, 2016
Short summary
Short summary
The Ocean Model Intercomparison Project (OMIP) aims to provide a framework for evaluating, understanding, and improving the ocean and sea-ice components of global climate and earth system models contributing to the Coupled Model Intercomparison Project Phase 6 (CMIP6). This document defines OMIP and details a protocol both for simulating global ocean/sea-ice models and for analysing their output.
Veronika Eyring, Sandrine Bony, Gerald A. Meehl, Catherine A. Senior, Bjorn Stevens, Ronald J. Stouffer, and Karl E. Taylor
Geosci. Model Dev., 9, 1937–1958, https://doi.org/10.5194/gmd-9-1937-2016, https://doi.org/10.5194/gmd-9-1937-2016, 2016
Short summary
Short summary
The objective of CMIP is to better understand past, present, and future climate change in a multi-model context. CMIP's increasing importance and scope is a tremendous success story, but the need to address an ever-expanding range of scientific questions arising from more and more research communities has made it necessary to revise the organization of CMIP. In response to these challenges, we have adopted a more federated structure for the sixth phase of CMIP (i.e. CMIP6) and subsequent phases.
Veronika Eyring, Mattia Righi, Axel Lauer, Martin Evaldsson, Sabrina Wenzel, Colin Jones, Alessandro Anav, Oliver Andrews, Irene Cionni, Edouard L. Davin, Clara Deser, Carsten Ehbrecht, Pierre Friedlingstein, Peter Gleckler, Klaus-Dirk Gottschaldt, Stefan Hagemann, Martin Juckes, Stephan Kindermann, John Krasting, Dominik Kunert, Richard Levine, Alexander Loew, Jarmo Mäkelä, Gill Martin, Erik Mason, Adam S. Phillips, Simon Read, Catherine Rio, Romain Roehrig, Daniel Senftleben, Andreas Sterl, Lambertus H. van Ulft, Jeremy Walton, Shiyu Wang, and Keith D. Williams
Geosci. Model Dev., 9, 1747–1802, https://doi.org/10.5194/gmd-9-1747-2016, https://doi.org/10.5194/gmd-9-1747-2016, 2016
Short summary
Short summary
A community diagnostics and performance metrics tool for the evaluation of Earth system models (ESMs) in CMIP has been developed that allows for routine comparison of single or multiple models, either against predecessor versions or against observations.
S. Jeon, Prabhat, S. Byna, J. Gu, W. D. Collins, and M. F. Wehner
Adv. Stat. Clim. Meteorol. Oceanogr., 1, 45–57, https://doi.org/10.5194/ascmo-1-45-2015, https://doi.org/10.5194/ascmo-1-45-2015, 2015
Short summary
Short summary
This paper investigates the influence of atmospheric rivers on spatial coherence of extreme precipitation under a changing climate. We use our TECA software developed for detecting atmospheric river events and apply statistical techniques based on extreme value theory to characterize the spatial dependence structure between precipitation extremes within the events. The results show that extreme rainfall caused by atmospheric river events is less spatially correlated under the warming scenario.
M.-P. Moine, S. Valcke, B. N. Lawrence, C. Pascoe, R. W. Ford, A. Alias, V. Balaji, P. Bentley, G. Devine, S. A. Callaghan, and E. Guilyardi
Geosci. Model Dev., 7, 479–493, https://doi.org/10.5194/gmd-7-479-2014, https://doi.org/10.5194/gmd-7-479-2014, 2014
G. A. Schmidt, J. D. Annan, P. J. Bartlein, B. I. Cook, E. Guilyardi, J. C. Hargreaves, S. P. Harrison, M. Kageyama, A. N. LeGrande, B. Konecky, S. Lovejoy, M. E. Mann, V. Masson-Delmotte, C. Risi, D. Thompson, A. Timmermann, L.-B. Tremblay, and P. Yiou
Clim. Past, 10, 221–250, https://doi.org/10.5194/cp-10-221-2014, https://doi.org/10.5194/cp-10-221-2014, 2014
M. S. Johnston, S. Eliasson, P. Eriksson, R. M. Forbes, K. Wyser, and M. D. Zelinka
Atmos. Chem. Phys., 13, 12043–12058, https://doi.org/10.5194/acp-13-12043-2013, https://doi.org/10.5194/acp-13-12043-2013, 2013
S. McGregor, A. Timmermann, M. H. England, O. Elison Timm, and A. T. Wittenberg
Clim. Past, 9, 2269–2284, https://doi.org/10.5194/cp-9-2269-2013, https://doi.org/10.5194/cp-9-2269-2013, 2013
Related subject area
Climate and Earth system modeling
Implementing detailed nucleation predictions in the Earth system model EC-Earth3.3.4: sulfuric acid–ammonia nucleation
Modeling biochar effects on soil organic carbon on croplands in a microbial decomposition model (MIMICS-BC_v1.0)
Hector V3.2.0: functionality and performance of a reduced-complexity climate model
Evaluation of CMIP6 model simulations of PM2.5 and its components over China
Assessment of a tiling energy budget approach in a land surface model, ORCHIDEE-MICT (r8205)
Multivariate adjustment of drizzle bias using machine learning in European climate projections
Development and evaluation of the interactive Model for Air Pollution and Land Ecosystems (iMAPLE) version 1.0
A perspective on the next generation of Earth system model scenarios: towards representative emission pathways (REPs)
Parallel SnowModel (v1.0): a parallel implementation of a distributed snow-evolution modeling system (SnowModel)
LB-SCAM: a learning-based method for efficient large-scale sensitivity analysis and tuning of the Single Column Atmosphere Model (SCAM)
Quantifying the impact of SST feedback frequency on Madden–Julian oscillation simulations
A revised model of global silicate weathering considering the influence of vegetation cover on erosion rate
A radiative–convective model computing precipitation with the maximum entropy production hypothesis
Leveraging regional mesh refinement to simulate future climate projections for California using the Simplified Convection-Permitting E3SM Atmosphere Model Version 0
Machine learning parameterization of the multi-scale Kain–Fritsch (MSKF) convection scheme and stable simulation coupled in the Weather Research and Forecasting (WRF) model using WRF–ML v1.0
Impacts of spatial heterogeneity of anthropogenic aerosol emissions in a regionally refined global aerosol–climate model
cfr (v2024.1.26): a Python package for climate field reconstruction
NEWTS1.0: Numerical model of coastal Erosion by Waves and Transgressive Scarps
Evaluation of isoprene emissions from the coupled model SURFEX–MEGANv2.1
A comprehensive Earth system model (AWI-ESM2.1) with interactive icebergs: effects on surface and deep-ocean characteristics
The regional climate–chemistry–ecology coupling model RegCM-Chem (v4.6)–YIBs (v1.0): development and application
An overview of cloud–radiation denial experiments for the Energy Exascale Earth System Model version 1
The computational and energy cost of simulation and storage for climate science: lessons from CMIP6
Subgrid-scale variability of cloud ice in the ICON-AES 1.3.00
INFERNO-peat v1.0.0: a representation of northern high-latitude peat fires in the JULES-INFERNO global fire model
The 4DEnVar-based weakly coupled land data assimilation system for E3SM version 2
Continental-scale bias-corrected climate and hydrological projections for Australia
G6-1.5K-SAI: a new Geoengineering Model Intercomparison Project (GeoMIP) experiment integrating recent advances in solar radiation modification studies
Modeling the effects of tropospheric ozone on the growth and yield of global staple crops with DSSAT v4.8.0
A one-dimensional urban flow model with an eddy-diffusivity mass-flux (EDMF) scheme and refined turbulent transport (MLUCM v3.0)
DCMIP2016: the tropical cyclone test case
Interactions between atmospheric composition and climate change – progress in understanding and future opportunities from AerChemMIP, PDRMIP, and RFMIP
CD-type discretization for sea ice dynamics in FESOM version 2
Dynamic MJO forecasts using an ensemble subseasonal-to-seasonal forecast system of IAP-CAS model
CSDMS Data Components: data–model integration tools for Earth surface processes modeling
A generic algorithm to automatically classify urban fabric according to the local climate zone system: implementation in GeoClimate 0.0.1 and application to French cities
Modelling water isotopologues (1H2H16O, 1H217O) in the coupled numerical climate model iLOVECLIM (version 1.1.5)
Localized injections of interactive volcanic aerosols and their climate impacts in a simple general circulation model
Accurate assessment of land–atmosphere coupling in climate models requires high-frequency data output
Towards variance-conserving reconstructions of climate indices with Gaussian process regression in an embedding space
A diatom extension to the cGEnIE Earth system model – EcoGEnIE 1.1
Carbon isotopes in the marine biogeochemistry model FESOM2.1-REcoM3
Flux coupling approach on an exchange grid for the IOW Earth System Model (version 1.04.00) of the Baltic Sea region
Using EUREC4A/ATOMIC field campaign data to improve trade wind regimes in the Community Atmosphere Model
New model ensemble reveals how forcing uncertainty and model structure alter climate simulated across CMIP generations of the Community Earth System Model
Quantifying wildfire drivers and predictability in boreal peatlands using a two-step error-correcting machine learning framework in TeFire v1.0
Benchmarking GOCART-2G in the Goddard Earth Observing System (GEOS)
Energy-conserving physics for nonhydrostatic dynamics in mass coordinate models
Evaluation and optimisation of the soil carbon turnover routine in the MONICA model (version 3.3.1)
Assessing the sensitivity of aerosol mass budget and effective radiative forcing to horizontal grid spacing in E3SMv1 using a regional refinement approach
Carl Svenhag, Moa K. Sporre, Tinja Olenius, Daniel Yazgi, Sara M. Blichner, Lars P. Nieradzik, and Pontus Roldin
Geosci. Model Dev., 17, 4923–4942, https://doi.org/10.5194/gmd-17-4923-2024, https://doi.org/10.5194/gmd-17-4923-2024, 2024
Short summary
Short summary
Our research shows the importance of modeling new particle formation (NPF) and growth of particles in the atmosphere on a global scale, as they influence the outcomes of clouds and our climate. With the global model EC-Earth3 we show that using a new method for NPF modeling, which includes new detailed processes with NH3 and H2SO4, significantly impacts the number of particles in the air and clouds and changes the radiation balance of the same magnitude as anthropogenic greenhouse emissions.
Mengjie Han, Qing Zhao, Xili Wang, Ying-Ping Wang, Philippe Ciais, Haicheng Zhang, Daniel S. Goll, Lei Zhu, Zhe Zhao, Zhixuan Guo, Chen Wang, Wei Zhuang, Fengchang Wu, and Wei Li
Geosci. Model Dev., 17, 4871–4890, https://doi.org/10.5194/gmd-17-4871-2024, https://doi.org/10.5194/gmd-17-4871-2024, 2024
Short summary
Short summary
The impact of biochar (BC) on soil organic carbon (SOC) dynamics is not represented in most land carbon models used for assessing land-based climate change mitigation. Our study develops a BC model that incorporates our current understanding of BC effects on SOC based on a soil carbon model (MIMICS). The BC model can reproduce the SOC changes after adding BC, providing a useful tool to couple dynamic land models to evaluate the effectiveness of BC application for CO2 removal from the atmosphere.
Kalyn Dorheim, Skylar Gering, Robert Gieseke, Corinne Hartin, Leeya Pressburger, Alexey N. Shiklomanov, Steven J. Smith, Claudia Tebaldi, Dawn L. Woodard, and Ben Bond-Lamberty
Geosci. Model Dev., 17, 4855–4869, https://doi.org/10.5194/gmd-17-4855-2024, https://doi.org/10.5194/gmd-17-4855-2024, 2024
Short summary
Short summary
Hector is an easy-to-use, global climate–carbon cycle model. With its quick run time, Hector can provide climate information from a run in a fraction of a second. Hector models on a global and annual basis. Here, we present an updated version of the model, Hector V3. In this paper, we document Hector’s new features. Hector V3 is capable of reproducing historical observations, and its future temperature projections are consistent with those of more complex models.
Fangxuan Ren, Jintai Lin, Chenghao Xu, Jamiu A. Adeniran, Jingxu Wang, Randall V. Martin, Aaron van Donkelaar, Melanie S. Hammer, Larry W. Horowitz, Steven T. Turnock, Naga Oshima, Jie Zhang, Susanne Bauer, Kostas Tsigaridis, Øyvind Seland, Pierre Nabat, David Neubauer, Gary Strand, Twan van Noije, Philippe Le Sager, and Toshihiko Takemura
Geosci. Model Dev., 17, 4821–4836, https://doi.org/10.5194/gmd-17-4821-2024, https://doi.org/10.5194/gmd-17-4821-2024, 2024
Short summary
Short summary
We evaluate the performance of 14 CMIP6 ESMs in simulating total PM2.5 and its 5 components over China during 2000–2014. PM2.5 and its components are underestimated in almost all models, except that black carbon (BC) and sulfate are overestimated in two models, respectively. The underestimation is the largest for organic carbon (OC) and the smallest for BC. Models reproduce the observed spatial pattern for OC, sulfate, nitrate and ammonium well, yet the agreement is poorer for BC.
Yi Xi, Chunjing Qiu, Yuan Zhang, Dan Zhu, Shushi Peng, Gustaf Hugelius, Jinfeng Chang, Elodie Salmon, and Philippe Ciais
Geosci. Model Dev., 17, 4727–4754, https://doi.org/10.5194/gmd-17-4727-2024, https://doi.org/10.5194/gmd-17-4727-2024, 2024
Short summary
Short summary
The ORCHIDEE-MICT model can simulate the carbon cycle and hydrology at a sub-grid scale but energy budgets only at a grid scale. This paper assessed the implementation of a multi-tiling energy budget approach in ORCHIDEE-MICT and found warmer surface and soil temperatures, higher soil moisture, and more soil organic carbon across the Northern Hemisphere compared with the original version.
Georgia Lazoglou, Theo Economou, Christina Anagnostopoulou, George Zittis, Anna Tzyrkalli, Pantelis Georgiades, and Jos Lelieveld
Geosci. Model Dev., 17, 4689–4703, https://doi.org/10.5194/gmd-17-4689-2024, https://doi.org/10.5194/gmd-17-4689-2024, 2024
Short summary
Short summary
This study focuses on the important issue of the drizzle bias effect in regional climate models, described by an over-prediction of the number of rainy days while underestimating associated precipitation amounts. For this purpose, two distinct methodologies are applied and rigorously evaluated. These results are encouraging for using the multivariate machine learning method random forest to increase the accuracy of climate models concerning the projection of the number of wet days.
Xu Yue, Hao Zhou, Chenguang Tian, Yimian Ma, Yihan Hu, Cheng Gong, Hui Zheng, and Hong Liao
Geosci. Model Dev., 17, 4621–4642, https://doi.org/10.5194/gmd-17-4621-2024, https://doi.org/10.5194/gmd-17-4621-2024, 2024
Short summary
Short summary
We develop the interactive Model for Air Pollution and Land Ecosystems (iMAPLE). The model considers the full coupling between carbon and water cycles, dynamic fire emissions, wetland methane emissions, biogenic volatile organic compound emissions, and trait-based ozone vegetation damage. Evaluations show that iMAPLE is a useful tool for the study of the interactions among climate, chemistry, and ecosystems.
Malte Meinshausen, Carl-Friedrich Schleussner, Kathleen Beyer, Greg Bodeker, Olivier Boucher, Josep G. Canadell, John S. Daniel, Aïda Diongue-Niang, Fatima Driouech, Erich Fischer, Piers Forster, Michael Grose, Gerrit Hansen, Zeke Hausfather, Tatiana Ilyina, Jarmo S. Kikstra, Joyce Kimutai, Andrew D. King, June-Yi Lee, Chris Lennard, Tabea Lissner, Alexander Nauels, Glen P. Peters, Anna Pirani, Gian-Kasper Plattner, Hans Pörtner, Joeri Rogelj, Maisa Rojas, Joyashree Roy, Bjørn H. Samset, Benjamin M. Sanderson, Roland Séférian, Sonia Seneviratne, Christopher J. Smith, Sophie Szopa, Adelle Thomas, Diana Urge-Vorsatz, Guus J. M. Velders, Tokuta Yokohata, Tilo Ziehn, and Zebedee Nicholls
Geosci. Model Dev., 17, 4533–4559, https://doi.org/10.5194/gmd-17-4533-2024, https://doi.org/10.5194/gmd-17-4533-2024, 2024
Short summary
Short summary
The scientific community is considering new scenarios to succeed RCPs and SSPs for the next generation of Earth system model runs to project future climate change. To contribute to that effort, we reflect on relevant policy and scientific research questions and suggest categories for representative emission pathways. These categories are tailored to the Paris Agreement long-term temperature goal, high-risk outcomes in the absence of further climate policy and worlds “that could have been”.
Ross Mower, Ethan D. Gutmann, Glen E. Liston, Jessica Lundquist, and Soren Rasmussen
Geosci. Model Dev., 17, 4135–4154, https://doi.org/10.5194/gmd-17-4135-2024, https://doi.org/10.5194/gmd-17-4135-2024, 2024
Short summary
Short summary
Higher-resolution model simulations are better at capturing winter snowpack changes across space and time. However, increasing resolution also increases the computational requirements. This work provides an overview of changes made to a distributed snow-evolution modeling system (SnowModel) to allow it to leverage high-performance computing resources. Continental simulations that were previously estimated to take 120 d can now be performed in 5 h.
Jiaxu Guo, Juepeng Zheng, Yidan Xu, Haohuan Fu, Wei Xue, Lanning Wang, Lin Gan, Ping Gao, Wubing Wan, Xianwei Wu, Zhitao Zhang, Liang Hu, Gaochao Xu, and Xilong Che
Geosci. Model Dev., 17, 3975–3992, https://doi.org/10.5194/gmd-17-3975-2024, https://doi.org/10.5194/gmd-17-3975-2024, 2024
Short summary
Short summary
To enhance the efficiency of experiments using SCAM, we train a learning-based surrogate model to facilitate large-scale sensitivity analysis and tuning of combinations of multiple parameters. Employing a hybrid method, we investigate the joint sensitivity of multi-parameter combinations across typical cases, identifying the most sensitive three-parameter combination out of 11. Subsequently, we conduct a tuning process aimed at reducing output errors in these cases.
Yung-Yao Lan, Huang-Hsiung Hsu, and Wan-Ling Tseng
Geosci. Model Dev., 17, 3897–3918, https://doi.org/10.5194/gmd-17-3897-2024, https://doi.org/10.5194/gmd-17-3897-2024, 2024
Short summary
Short summary
This study uses the CAM5–SIT coupled model to investigate the effects of SST feedback frequency on the MJO simulations with intervals at 30 min, 1, 3, 6, 12, 18, 24, and 30 d. The simulations become increasingly unrealistic as the frequency of the SST feedback decreases. Our results suggest that more spontaneous air--sea interaction (e.g., ocean response within 3 d in this study) with high vertical resolution in the ocean model is key to the realistic simulation of the MJO.
Haoyue Zuo, Yonggang Liu, Gaojun Li, Zhifang Xu, Liang Zhao, Zhengtang Guo, and Yongyun Hu
Geosci. Model Dev., 17, 3949–3974, https://doi.org/10.5194/gmd-17-3949-2024, https://doi.org/10.5194/gmd-17-3949-2024, 2024
Short summary
Short summary
Compared to the silicate weathering fluxes measured at large river basins, the current models tend to systematically overestimate the fluxes over the tropical region, which leads to an overestimation of the global total weathering flux. The most possible cause of such bias is found to be the overestimation of tropical surface erosion, which indicates that the tropical vegetation likely slows down physical erosion significantly. We propose a way of taking this effect into account in models.
Quentin Pikeroen, Didier Paillard, and Karine Watrin
Geosci. Model Dev., 17, 3801–3814, https://doi.org/10.5194/gmd-17-3801-2024, https://doi.org/10.5194/gmd-17-3801-2024, 2024
Short summary
Short summary
All accurate climate models use equations with poorly defined parameters, where knobs for the parameters are turned to fit the observations. This process is called tuning. In this article, we use another paradigm. We use a thermodynamic hypothesis, the maximum entropy production, to compute temperatures, energy fluxes, and precipitation, where tuning is impossible. For now, the 1D vertical model is used for a tropical atmosphere. The correct order of magnitude of precipitation is computed.
Jishi Zhang, Peter Bogenschutz, Qi Tang, Philip Cameron-smith, and Chengzhu Zhang
Geosci. Model Dev., 17, 3687–3731, https://doi.org/10.5194/gmd-17-3687-2024, https://doi.org/10.5194/gmd-17-3687-2024, 2024
Short summary
Short summary
We developed a regionally refined climate model that allows resolved convection and performed a 20-year projection to the end of the century. The model has a resolution of 3.25 km in California, which allows us to predict climate with unprecedented accuracy, and a resolution of 100 km for the rest of the globe to achieve efficient, self-consistent simulations. The model produces superior results in reproducing climate patterns over California that typical modern climate models cannot resolve.
Xiaohui Zhong, Xing Yu, and Hao Li
Geosci. Model Dev., 17, 3667–3685, https://doi.org/10.5194/gmd-17-3667-2024, https://doi.org/10.5194/gmd-17-3667-2024, 2024
Short summary
Short summary
In order to forecast localized warm-sector rainfall in the south China region, numerical weather prediction models are being run with finer grid spacing. The conventional convection parameterization (CP) performs poorly in the gray zone, necessitating the development of a scale-aware scheme. We propose a machine learning (ML) model to replace the scale-aware CP scheme. Evaluation against the original CP scheme has shown that the ML-based CP scheme can provide accurate and reliable predictions.
Taufiq Hassan, Kai Zhang, Jianfeng Li, Balwinder Singh, Shixuan Zhang, Hailong Wang, and Po-Lun Ma
Geosci. Model Dev., 17, 3507–3532, https://doi.org/10.5194/gmd-17-3507-2024, https://doi.org/10.5194/gmd-17-3507-2024, 2024
Short summary
Short summary
Anthropogenic aerosol emissions are an essential part of global aerosol models. Significant errors can exist from the loss of emission heterogeneity. We introduced an emission treatment that significantly improved aerosol emission heterogeneity in high-resolution model simulations, with improvements in simulated aerosol surface concentrations. The emission treatment will provide a more accurate representation of aerosol emissions and their effects on climate.
Feng Zhu, Julien Emile-Geay, Gregory J. Hakim, Dominique Guillot, Deborah Khider, Robert Tardif, and Walter A. Perkins
Geosci. Model Dev., 17, 3409–3431, https://doi.org/10.5194/gmd-17-3409-2024, https://doi.org/10.5194/gmd-17-3409-2024, 2024
Short summary
Short summary
Climate field reconstruction encompasses methods that estimate the evolution of climate in space and time based on natural archives. It is useful to investigate climate variations and validate climate models, but its implementation and use can be difficult for non-experts. This paper introduces a user-friendly Python package called cfr to make these methods more accessible, thanks to the computational and visualization tools that facilitate efficient and reproducible research on past climates.
Rose V. Palermo, J. Taylor Perron, Jason M. Soderblom, Samuel P. D. Birch, Alexander G. Hayes, and Andrew D. Ashton
Geosci. Model Dev., 17, 3433–3445, https://doi.org/10.5194/gmd-17-3433-2024, https://doi.org/10.5194/gmd-17-3433-2024, 2024
Short summary
Short summary
Models of rocky coastal erosion help us understand the controls on coastal morphology and evolution. In this paper, we present a simplified model of coastline erosion driven by either uniform erosion where coastline erosion is constant or wave-driven erosion where coastline erosion is a function of the wave power. This model can be used to evaluate how coastline changes reflect climate, sea-level history, material properties, and the relative influence of different erosional processes.
Safae Oumami, Joaquim Arteta, Vincent Guidard, Pierre Tulet, and Paul David Hamer
Geosci. Model Dev., 17, 3385–3408, https://doi.org/10.5194/gmd-17-3385-2024, https://doi.org/10.5194/gmd-17-3385-2024, 2024
Short summary
Short summary
In this paper, we coupled the SURFEX and MEGAN models. The aim of this coupling is to improve the estimation of biogenic fluxes by using the SURFEX canopy environment model. The coupled model results were validated and several sensitivity tests were performed. The coupled-model total annual isoprene flux is 442 Tg; this value is within the range of other isoprene estimates reported. The ultimate aim of this coupling is to predict the impact of climate change on biogenic emissions.
Lars Ackermann, Thomas Rackow, Kai Himstedt, Paul Gierz, Gregor Knorr, and Gerrit Lohmann
Geosci. Model Dev., 17, 3279–3301, https://doi.org/10.5194/gmd-17-3279-2024, https://doi.org/10.5194/gmd-17-3279-2024, 2024
Short summary
Short summary
We present long-term simulations with interactive icebergs in the Southern Ocean. By melting, icebergs reduce the temperature and salinity of the surrounding ocean. In our simulations, we find that this cooling effect of iceberg melting is not limited to the surface ocean but also reaches the deep ocean and propagates northward into all ocean basins. Additionally, the formation of deep-water masses in the Southern Ocean is enhanced.
Nanhong Xie, Tijian Wang, Xiaodong Xie, Xu Yue, Filippo Giorgi, Qian Zhang, Danyang Ma, Rong Song, Beiyao Xu, Shu Li, Bingliang Zhuang, Mengmeng Li, Min Xie, Natalya Andreeva Kilifarska, Georgi Gadzhev, and Reneta Dimitrova
Geosci. Model Dev., 17, 3259–3277, https://doi.org/10.5194/gmd-17-3259-2024, https://doi.org/10.5194/gmd-17-3259-2024, 2024
Short summary
Short summary
For the first time, we coupled a regional climate chemistry model, RegCM-Chem, with a dynamic vegetation model, YIBs, to create a regional climate–chemistry–ecology model, RegCM-Chem–YIBs. We applied it to simulate climatic, chemical, and ecological parameters in East Asia and fully validated it on a variety of observational data. Results show that RegCM-Chem–YIBs model is a valuable tool for studying the terrestrial carbon cycle, atmospheric chemistry, and climate change on a regional scale.
Bryce E. Harrop, Jian Lu, L. Ruby Leung, William K. M. Lau, Kyu-Myong Kim, Brian Medeiros, Brian J. Soden, Gabriel A. Vecchi, Bosong Zhang, and Balwinder Singh
Geosci. Model Dev., 17, 3111–3135, https://doi.org/10.5194/gmd-17-3111-2024, https://doi.org/10.5194/gmd-17-3111-2024, 2024
Short summary
Short summary
Seven new experimental setups designed to interfere with cloud radiative heating have been added to the Energy Exascale Earth System Model (E3SM). These experiments include both those that test the mean impact of cloud radiative heating and those examining its covariance with circulations. This paper documents the code changes and steps needed to run these experiments. Results corroborate prior findings for how cloud radiative heating impacts circulations and rainfall patterns.
Mario C. Acosta, Sergi Palomas, Stella V. Paronuzzi Ticco, Gladys Utrera, Joachim Biercamp, Pierre-Antoine Bretonniere, Reinhard Budich, Miguel Castrillo, Arnaud Caubel, Francisco Doblas-Reyes, Italo Epicoco, Uwe Fladrich, Sylvie Joussaume, Alok Kumar Gupta, Bryan Lawrence, Philippe Le Sager, Grenville Lister, Marie-Pierre Moine, Jean-Christophe Rioual, Sophie Valcke, Niki Zadeh, and Venkatramani Balaji
Geosci. Model Dev., 17, 3081–3098, https://doi.org/10.5194/gmd-17-3081-2024, https://doi.org/10.5194/gmd-17-3081-2024, 2024
Short summary
Short summary
We present a collection of performance metrics gathered during the Coupled Model Intercomparison Project Phase 6 (CMIP6), a worldwide initiative to study climate change. We analyse the metrics that resulted from collaboration efforts among many partners and models and describe our findings to demonstrate the utility of our study for the scientific community. The research contributes to understanding climate modelling performance on the current high-performance computing (HPC) architectures.
Sabine Doktorowski, Jan Kretzschmar, Johannes Quaas, Marc Salzmann, and Odran Sourdeval
Geosci. Model Dev., 17, 3099–3110, https://doi.org/10.5194/gmd-17-3099-2024, https://doi.org/10.5194/gmd-17-3099-2024, 2024
Short summary
Short summary
Especially over the midlatitudes, precipitation is mainly formed via the ice phase. In this study we focus on the initial snow formation process in the ICON-AES, the aggregation process. We use a stochastical approach for the aggregation parameterization and investigate the influence in the ICON-AES. Therefore, a distribution function of cloud ice is created, which is evaluated with satellite data. The new approach leads to cloud ice loss and an improvement in the process rate bias.
Katie R. Blackford, Matthew Kasoar, Chantelle Burton, Eleanor Burke, Iain Colin Prentice, and Apostolos Voulgarakis
Geosci. Model Dev., 17, 3063–3079, https://doi.org/10.5194/gmd-17-3063-2024, https://doi.org/10.5194/gmd-17-3063-2024, 2024
Short summary
Short summary
Peatlands are globally important stores of carbon which are being increasingly threatened by wildfires with knock-on effects on the climate system. Here we introduce a novel peat fire parameterization in the northern high latitudes to the INFERNO global fire model. Representing peat fires increases annual burnt area across the high latitudes, alongside improvements in how we capture year-to-year variation in burning and emissions.
Pengfei Shi, L. Ruby Leung, Bin Wang, Kai Zhang, Samson M. Hagos, and Shixuan Zhang
Geosci. Model Dev., 17, 3025–3040, https://doi.org/10.5194/gmd-17-3025-2024, https://doi.org/10.5194/gmd-17-3025-2024, 2024
Short summary
Short summary
Improving climate predictions have profound socio-economic impacts. This study introduces a new weakly coupled land data assimilation (WCLDA) system for a coupled climate model. We demonstrate improved simulation of soil moisture and temperature in many global regions and throughout the soil layers. Furthermore, significant improvements are also found in reproducing the time evolution of the 2012 US Midwest drought. The WCLDA system provides the groundwork for future predictability studies.
Justin Peter, Elisabeth Vogel, Wendy Sharples, Ulrike Bende-Michl, Louise Wilson, Pandora Hope, Andrew Dowdy, Greg Kociuba, Sri Srikanthan, Vi Co Duong, Jake Roussis, Vjekoslav Matic, Zaved Khan, Alison Oke, Margot Turner, Stuart Baron-Hay, Fiona Johnson, Raj Mehrotra, Ashish Sharma, Marcus Thatcher, Ali Azarvinand, Steven Thomas, Ghyslaine Boschat, Chantal Donnelly, and Robert Argent
Geosci. Model Dev., 17, 2755–2781, https://doi.org/10.5194/gmd-17-2755-2024, https://doi.org/10.5194/gmd-17-2755-2024, 2024
Short summary
Short summary
We detail the production of datasets and communication to end users of high-resolution projections of rainfall, runoff, and soil moisture for the entire Australian continent. This is important as previous projections for Australia were for small regions and used differing techniques for their projections, making comparisons difficult across Australia's varied climate zones. The data will be beneficial for research purposes and to aid adaptation to climate change.
Daniele Visioni, Alan Robock, Jim Haywood, Matthew Henry, Simone Tilmes, Douglas G. MacMartin, Ben Kravitz, Sarah J. Doherty, John Moore, Chris Lennard, Shingo Watanabe, Helene Muri, Ulrike Niemeier, Olivier Boucher, Abu Syed, Temitope S. Egbebiyi, Roland Séférian, and Ilaria Quaglia
Geosci. Model Dev., 17, 2583–2596, https://doi.org/10.5194/gmd-17-2583-2024, https://doi.org/10.5194/gmd-17-2583-2024, 2024
Short summary
Short summary
This paper describes a new experimental protocol for the Geoengineering Model Intercomparison Project (GeoMIP). In it, we describe the details of a new simulation of sunlight reflection using the stratospheric aerosols that climate models are supposed to run, and we explain the reasons behind each choice we made when defining the protocol.
Jose Rafael Guarin, Jonas Jägermeyr, Elizabeth A. Ainsworth, Fabio A. A. Oliveira, Senthold Asseng, Kenneth Boote, Joshua Elliott, Lisa Emberson, Ian Foster, Gerrit Hoogenboom, David Kelly, Alex C. Ruane, and Katrina Sharps
Geosci. Model Dev., 17, 2547–2567, https://doi.org/10.5194/gmd-17-2547-2024, https://doi.org/10.5194/gmd-17-2547-2024, 2024
Short summary
Short summary
The effects of ozone (O3) stress on crop photosynthesis and leaf senescence were added to maize, rice, soybean, and wheat crop models. The modified models reproduced growth and yields under different O3 levels measured in field experiments and reported in the literature. The combined interactions between O3 and additional stresses were reproduced with the new models. These updated crop models can be used to simulate impacts of O3 stress under future climate change and air pollution scenarios.
Jiachen Lu, Negin Nazarian, Melissa Anne Hart, E. Scott Krayenhoff, and Alberto Martilli
Geosci. Model Dev., 17, 2525–2545, https://doi.org/10.5194/gmd-17-2525-2024, https://doi.org/10.5194/gmd-17-2525-2024, 2024
Short summary
Short summary
This study enhances urban canopy models by refining key assumptions. Simulations for various urban scenarios indicate discrepancies in turbulent transport efficiency for flow properties. We propose two modifications that involve characterizing diffusion coefficients for momentum and turbulent kinetic energy separately and introducing a physics-based
mass-fluxterm. These adjustments enhance the model's performance, offering more reliable temperature and surface flux estimates.
Justin L. Willson, Kevin A. Reed, Christiane Jablonowski, James Kent, Peter H. Lauritzen, Ramachandran Nair, Mark A. Taylor, Paul A. Ullrich, Colin M. Zarzycki, David M. Hall, Don Dazlich, Ross Heikes, Celal Konor, David Randall, Thomas Dubos, Yann Meurdesoif, Xi Chen, Lucas Harris, Christian Kühnlein, Vivian Lee, Abdessamad Qaddouri, Claude Girard, Marco Giorgetta, Daniel Reinert, Hiroaki Miura, Tomoki Ohno, and Ryuji Yoshida
Geosci. Model Dev., 17, 2493–2507, https://doi.org/10.5194/gmd-17-2493-2024, https://doi.org/10.5194/gmd-17-2493-2024, 2024
Short summary
Short summary
Accurate simulation of tropical cyclones (TCs) is essential to understanding their behavior in a changing climate. One way this is accomplished is through model intercomparison projects, where results from multiple climate models are analyzed to provide benchmark solutions for the wider climate modeling community. This study describes and analyzes the previously developed TC test case for nine climate models in an intercomparison project, providing solutions that aid in model development.
Stephanie Fiedler, Vaishali Naik, Fiona M. O'Connor, Christopher J. Smith, Paul Griffiths, Ryan J. Kramer, Toshihiko Takemura, Robert J. Allen, Ulas Im, Matthew Kasoar, Angshuman Modak, Steven Turnock, Apostolos Voulgarakis, Duncan Watson-Parris, Daniel M. Westervelt, Laura J. Wilcox, Alcide Zhao, William J. Collins, Michael Schulz, Gunnar Myhre, and Piers M. Forster
Geosci. Model Dev., 17, 2387–2417, https://doi.org/10.5194/gmd-17-2387-2024, https://doi.org/10.5194/gmd-17-2387-2024, 2024
Short summary
Short summary
Climate scientists want to better understand modern climate change. Thus, climate model experiments are performed and compared. The results of climate model experiments differ, as assessed in the latest Intergovernmental Panel on Climate Change (IPCC) assessment report. This article gives insights into the challenges and outlines opportunities for further improving the understanding of climate change. It is based on views of a group of experts in atmospheric composition–climate interactions.
Sergey Danilov, Carolin Mehlmann, Dmitry Sidorenko, and Qiang Wang
Geosci. Model Dev., 17, 2287–2297, https://doi.org/10.5194/gmd-17-2287-2024, https://doi.org/10.5194/gmd-17-2287-2024, 2024
Short summary
Short summary
Sea ice models are a necessary component of climate models. At very high resolution they are capable of simulating linear kinematic features, such as leads, which are important for better prediction of heat exchanges between the ocean and atmosphere. Two new discretizations are described which improve the sea ice component of the Finite volumE Sea ice–Ocean Model (FESOM version 2) by allowing simulations of finer scales.
Yangke Liu, Qing Bao, Bian He, Xiaofei Wu, Jing Yang, Yimin Liu, Guoxiong Wu, Tao Zhu, Siyuan Zhou, Yao Tang, Ankang Qu, Yalan Fan, Anling Liu, Dandan Chen, Zhaoming Luo, Xing Hu, and Tongwen Wu
EGUsphere, https://doi.org/10.5194/egusphere-2024-1, https://doi.org/10.5194/egusphere-2024-1, 2024
Short summary
Short summary
This article gives an overview introduction of the IAP-CAS S2S (sub-seasonal to seasonal) ensemble forecasting system and MJO forecast evaluation of the system. Compared to other S2S models, the IAP-CAS model has its advantages but also exhibits some biases, including underdispersive ensemble, overestimated amplitude and faster propagation speed when forecasting MJO. We also provide the explanation towards these biases and prospects for further improvement of this system in the future.
Tian Gan, Gregory E. Tucker, Eric W. H. Hutton, Mark D. Piper, Irina Overeem, Albert J. Kettner, Benjamin Campforts, Julia M. Moriarty, Brianna Undzis, Ethan Pierce, and Lynn McCready
Geosci. Model Dev., 17, 2165–2185, https://doi.org/10.5194/gmd-17-2165-2024, https://doi.org/10.5194/gmd-17-2165-2024, 2024
Short summary
Short summary
This study presents the design, implementation, and application of the CSDMS Data Components. The case studies demonstrate that the Data Components provide a consistent way to access heterogeneous datasets from multiple sources, and to seamlessly integrate them with various models for Earth surface process modeling. The Data Components support the creation of open data–model integration workflows to improve the research transparency and reproducibility.
Jérémy Bernard, Erwan Bocher, Matthieu Gousseff, François Leconte, and Elisabeth Le Saux Wiederhold
Geosci. Model Dev., 17, 2077–2116, https://doi.org/10.5194/gmd-17-2077-2024, https://doi.org/10.5194/gmd-17-2077-2024, 2024
Short summary
Short summary
Geographical features may have a considerable effect on local climate. The local climate zone (LCZ) system proposed by Stewart and Oke (2012) is seen as a standard approach for classifying any zone according to a set of geographic indicators. While many methods already exist to map the LCZ, only a few tools are openly and freely available. We present the algorithm implemented in GeoClimate software to identify the LCZ of any place in the world using OpenStreetMap data.
Thomas Extier, Thibaut Caley, and Didier M. Roche
Geosci. Model Dev., 17, 2117–2139, https://doi.org/10.5194/gmd-17-2117-2024, https://doi.org/10.5194/gmd-17-2117-2024, 2024
Short summary
Short summary
Stable water isotopes are used to infer changes in the hydrological cycle for different time periods in climatic archive and climate models. We present the implementation of the δ2H and δ17O water isotopes in the coupled climate model iLOVECLIM and calculate the d- and 17O-excess. Results of a simulation under preindustrial conditions show that the model correctly reproduces the water isotope distribution in the atmosphere and ocean in comparison to data and other global circulation models.
Joseph P. Hollowed, Christiane Jablonowski, Hunter Y. Brown, Benjamin R. Hillman, Diana L. Bull, and Joseph L. Hart
EGUsphere, https://doi.org/10.5194/egusphere-2024-335, https://doi.org/10.5194/egusphere-2024-335, 2024
Short summary
Short summary
Large volcanic eruptions deposit material into the upper-atmosphere, which is capable of altering temperature and wind patterns of the Earth's atmosphere for years following. This research describes a new method of simulating these effects in an idealized, efficient atmospheric model. A volcanic eruption of sulfur dioxide is described with a simplified set of physical rules, which eventually cools the planetary surface. This model has been designed as a testbed for climate attribution studies.
Kirsten L. Findell, Zun Yin, Eunkyo Seo, Paul A. Dirmeyer, Nathan P. Arnold, Nathaniel Chaney, Megan D. Fowler, Meng Huang, David M. Lawrence, Po-Lun Ma, and Joseph A. Santanello Jr.
Geosci. Model Dev., 17, 1869–1883, https://doi.org/10.5194/gmd-17-1869-2024, https://doi.org/10.5194/gmd-17-1869-2024, 2024
Short summary
Short summary
We outline a request for sub-daily data to accurately capture the process-level connections between land states, surface fluxes, and the boundary layer response. This high-frequency model output will allow for more direct comparison with observational field campaigns on process-relevant timescales, enable demonstration of inter-model spread in land–atmosphere coupling processes, and aid in targeted identification of sources of deficiencies and opportunities for improvement of the models.
Marlene Klockmann, Udo von Toussaint, and Eduardo Zorita
Geosci. Model Dev., 17, 1765–1787, https://doi.org/10.5194/gmd-17-1765-2024, https://doi.org/10.5194/gmd-17-1765-2024, 2024
Short summary
Short summary
Reconstructions of climate variability before the observational period rely on climate proxies and sophisticated statistical models to link the proxy information and climate variability. Existing models tend to underestimate the true magnitude of variability, especially if the proxies contain non-climatic noise. We present and test a promising new framework for climate-index reconstructions, based on Gaussian processes, which reconstructs robust variability estimates from noisy and sparse data.
Aaron A. Naidoo-Bagwell, Fanny M. Monteiro, Katharine R. Hendry, Scott Burgan, Jamie D. Wilson, Ben A. Ward, Andy Ridgwell, and Daniel J. Conley
Geosci. Model Dev., 17, 1729–1748, https://doi.org/10.5194/gmd-17-1729-2024, https://doi.org/10.5194/gmd-17-1729-2024, 2024
Short summary
Short summary
As an extension to the EcoGEnIE 1.0 Earth system model that features a diverse plankton community, EcoGEnIE 1.1 includes siliceous plankton diatoms and also considers their impact on biogeochemical cycles. With updates to existing nutrient cycles and the introduction of the silicon cycle, we see improved model performance relative to observational data. Through a more functionally diverse plankton community, the new model enables more comprehensive future study of ocean ecology.
Martin Butzin, Ying Ye, Christoph Völker, Özgür Gürses, Judith Hauck, and Peter Köhler
Geosci. Model Dev., 17, 1709–1727, https://doi.org/10.5194/gmd-17-1709-2024, https://doi.org/10.5194/gmd-17-1709-2024, 2024
Short summary
Short summary
In this paper we describe the implementation of the carbon isotopes 13C and 14C into the marine biogeochemistry model FESOM2.1-REcoM3 and present results of long-term test simulations. Our model results are largely consistent with marine carbon isotope reconstructions for the pre-anthropogenic period, but also exhibit some discrepancies.
Sven Karsten, Hagen Radtke, Matthias Gröger, Ha T. M. Ho-Hagemann, Hossein Mashayekh, Thomas Neumann, and H. E. Markus Meier
Geosci. Model Dev., 17, 1689–1708, https://doi.org/10.5194/gmd-17-1689-2024, https://doi.org/10.5194/gmd-17-1689-2024, 2024
Short summary
Short summary
This paper describes the development of a regional Earth System Model for the Baltic Sea region. In contrast to conventional coupling approaches, the presented model includes a flux calculator operating on a common exchange grid. This approach automatically ensures a locally consistent treatment of fluxes and simplifies the exchange of model components. The presented model can be used for various scientific questions, such as studies of natural variability and ocean–atmosphere interactions.
Skyler Graap and Colin M. Zarzycki
Geosci. Model Dev., 17, 1627–1650, https://doi.org/10.5194/gmd-17-1627-2024, https://doi.org/10.5194/gmd-17-1627-2024, 2024
Short summary
Short summary
A key target for improving climate models is how low, bright clouds are predicted over tropical oceans, since they have important consequences for the Earth's energy budget. A climate model has been updated to improve the physical realism of the treatment of how momentum is moved up and down in the atmosphere. By comparing this updated model to real-world observations from balloon launches, it can be shown to more accurately depict atmospheric structure in trade-wind areas close to the Equator.
Marika M. Holland, Cecile Hannay, John Fasullo, Alexandra Jahn, Jennifer E. Kay, Michael Mills, Isla R. Simpson, William Wieder, Peter Lawrence, Erik Kluzek, and David Bailey
Geosci. Model Dev., 17, 1585–1602, https://doi.org/10.5194/gmd-17-1585-2024, https://doi.org/10.5194/gmd-17-1585-2024, 2024
Short summary
Short summary
Climate evolves in response to changing forcings, as prescribed in simulations. Models and forcings are updated over time to reflect new understanding. This makes it difficult to attribute simulation differences to either model or forcing changes. Here we present new simulations which enable the separation of model structure and forcing influence between two widely used simulation sets. Results indicate a strong influence of aerosol emission uncertainty on historical climate.
Rongyun Tang, Mingzhou Jin, Jiafu Mao, Daniel M. Ricciuto, Anping Chen, and Yulong Zhang
Geosci. Model Dev., 17, 1525–1542, https://doi.org/10.5194/gmd-17-1525-2024, https://doi.org/10.5194/gmd-17-1525-2024, 2024
Short summary
Short summary
Carbon-rich boreal peatlands are at risk of burning. The reproducibility and predictability of rare peatland fire events are investigated by constructing a two-step error-correcting machine learning framework to tackle such complex systems. Fire occurrence and impacts are highly predictable with our approach. Factor-controlling simulations revealed that temperature, moisture, and freeze–thaw cycles control boreal peatland fires, indicating thermal impacts on causing peat fires.
Allison B. Collow, Peter R. Colarco, Arlindo M. da Silva, Virginie Buchard, Huisheng Bian, Mian Chin, Sampa Das, Ravi Govindaraju, Dongchul Kim, and Valentina Aquila
Geosci. Model Dev., 17, 1443–1468, https://doi.org/10.5194/gmd-17-1443-2024, https://doi.org/10.5194/gmd-17-1443-2024, 2024
Short summary
Short summary
The GOCART aerosol module within the Goddard Earth Observing System recently underwent a major refactoring and update to the representation of physical processes. Code changes that were included in GOCART Second Generation (GOCART-2G) are documented, and we establish a benchmark simulation that is to be used for future development of the system. The 4-year benchmark simulation was evaluated using in situ and spaceborne measurements to develop a baseline and prioritize future development.
Oksana Guba, Mark A. Taylor, Peter A. Bosler, Christopher Eldred, and Peter H. Lauritzen
Geosci. Model Dev., 17, 1429–1442, https://doi.org/10.5194/gmd-17-1429-2024, https://doi.org/10.5194/gmd-17-1429-2024, 2024
Short summary
Short summary
We want to reduce errors in the moist energy budget in numerical atmospheric models. We study a few common assumptions and mechanisms that are used for the moist physics. Some mechanisms are more consistent with the underlying equations. Separately, we study how assumptions about models' thermodynamics affect the modeled energy of precipitation. We also explain how to conserve energy in the moist physics for nonhydrostatic models.
Konstantin Aiteew, Jarno Rouhiainen, Claas Nendel, and René Dechow
Geosci. Model Dev., 17, 1349–1385, https://doi.org/10.5194/gmd-17-1349-2024, https://doi.org/10.5194/gmd-17-1349-2024, 2024
Short summary
Short summary
This study evaluated the biogeochemical model MONICA and its performance in simulating soil organic carbon changes. MONICA can reproduce plant growth, carbon and nitrogen dynamics, soil water and temperature. The model results were compared with five established carbon turnover models. With the exception of certain sites, adequate reproduction of soil organic carbon stock change rates was achieved. The MONICA model was capable of performing similar to or even better than the other models.
Jianfeng Li, Kai Zhang, Taufiq Hassan, Shixuan Zhang, Po-Lun Ma, Balwinder Singh, Qiyang Yan, and Huilin Huang
Geosci. Model Dev., 17, 1327–1347, https://doi.org/10.5194/gmd-17-1327-2024, https://doi.org/10.5194/gmd-17-1327-2024, 2024
Short summary
Short summary
By comparing E3SM simulations with and without regional refinement, we find that model horizontal grid spacing considerably affects the simulated aerosol mass budget, aerosol–cloud interactions, and the effective radiative forcing of anthropogenic aerosols. The study identifies the critical physical processes strongly influenced by model resolution. It also highlights the benefit of applying regional refinement in future modeling studies at higher or even convection-permitting resolutions.
Cited articles
Adler, R. F., Sapiano, M. R., Huffman, G. J., Wang, J. J., Gu, G., Bolvin, D., Chiu, L., Schneider, U., Becker, A., Nelkin, E., Xie, P., Ferraro, R., and Shin, D.-B.: The Global Precipitation Climatology Project (GPCP) monthly analysis (new version 2.3) and a review of 2017 global precipitation. Atmosphere, 9, 138, https://doi.org/10.3390/atmos9040138, 2018.
Ahn, M.-S., Kim, D. H., Sperber, K. R., Kang, I.-S., Maloney, E. D., Waliser, D. E., and Hendon, H. H.: MJO simulation in CMIP5 climate models: MJO skill metrics and process-oriented diagnosis, Clim. Dynam., 49, 4023–4045, https://doi.org/10.1007/s00382-017-3558-4, 2017.
Ahn, M.-S., Gleckler, P. J., Lee, J., Pendergrass, A. G., and Jakob, C.: Benchmarking Simulated Precipitation Variability Amplitude across Time Scales, J. Climate, 35, 3173–3196, https://doi.org/10.1175/jcli-d-21-0542.1, 2022.
Ahn, M.-S., Ullrich, P. A., Gleckler, P. J., Lee, J., Ordonez, A. C., and Pendergrass, A. G.: Evaluating precipitation distributions at regional scales: a benchmarking framework and application to CMIP5 and 6 models, Geosci. Model Dev., 16, 3927–3951, https://doi.org/10.5194/gmd-16-3927-2023, 2023.
Anaconda pcmdi_metrics: https://anaconda.org/conda-forge/pcmdi_metrics, last access: 8 May 2024.
Arcodia, M., Barnes, E. A., Mayer, K., Lee, J., Ordonez, A., and Ahn, M.-S.: Assessing decadal variability of subseasonal forecasts of opportunity using explainable AI, Environ. Res., 2, 045002, https://doi.org/10.1088/2752-5295/aced60, 2023.
Ashfaq, M., Rastogi, D., Kitson, J., Abid, M. A., and Kao, S.-C.: Evaluation of CMIP6 GCMs over the CONUS for downscaling studies, J. Geophys. Res.-Atmos., 127, e2022JD036659, https://doi.org/10.1029/2022JD036659, 2022.
Bayr, T., Wengel, C., Latif, M., Dommenget, D., Lübbecke, J., and Park, W.: Error compensation of ENSO atmospheric feedbacks in climate models and its influence on simulated ENSO dynamics, Clim. Dynam., 53, 155–172, https://doi.org/10.1007/s00382-018-4575-7, 2019.
Biard, J. C. and Kunkel, K. E.: Automated detection of weather fronts using a deep learning neural network, Adv. Stat. Clim. Meteorol. Oceanogr., 5, 147–160, https://doi.org/10.5194/ascmo-5-147-2019, 2019.
Bellenger, H., Guilyardi, E., Leloup, J., Lengaigne, M., and Vialard, J.: ENSO representation in climate models: from CMIP3 to CMIP5, Clim. Dynam., 42, 1999–2018, https://doi.org/10.1007/s00382-013-1783-z, 2014.
Boucher, O., Servonnat, J., Albright, A. L., Aumont, O., Balkanski, Y., Bastrikov, V., Bekki, S., Bonnet, R., Bony, S., Bopp, L., Braconnot, P., Brockmann, P., Cadule, P., Caubel, A., Cheruy, F., Codron, F., Cozic, A., Cugnet, D., D'Andrea, F., Davini, P., De Lavergne, C., Denvil, S., Deshayes, J., Devilliers, M., Ducharne, A., Dufresne, J. L., Dupont, E., Ethé, C., Fairhead, L., Falletti, L., Flavoni, S., Foujols, M. A., Gardoll, S., Gastineau, G., Ghattas, J., Grandpeix, J. Y., Guenet, B., Lionel, E. G., Guilyardi, E., Guimberteau, M., Hauglustaine, D., Hourdin, F., Idelkadi, A., Joussaume, S., Kageyama, M., Khodri, M., Krinner, G., Lebas, N., Levavasseur, G., Lévy, C., Li, L., Lott, F., Lurton, T., Luyssaert, S., Madec, G., Madeleine, J.-B., Maignan, F., Marchand, M., Marti, O., Mellul, L., Meurdesoif, Y., Mignot, J., Musat, I., Ottlé, C., Peylin, P., Planton, Y., Polcher, J., Rio, C., Rochetin, N., Rousset, C., Sepulchre, P., Sima, A., Swingedouw, D., Thiéblemont, R., Traore, A. K., Vancoppenolle, M., Vial, J., Vialard, J., Viovy, N., and Vuichard, N.: Presentation and evaluation of the IPSL-CM6A-LR Climate Model, J. Adv. Model. Earth Sy., 12, e2019MS002010, https://doi.org/10.1029/2019ms002010, 2020.
Caldwell, P., Mametjanov, A., Tang, Q., Van Roekel, L., Golaz, J.-C., Lin, W., Bader, D. C., Keen, N. D., Feng, Y., Jacob, R., Maltrud, M., Roberts, A., Taylor, M. A., Veneziani, M., Wang, H., Wolfe, J. D., Balaguru, K., Cameron-Smith, P. J., Dong, L., Klein, S. A., Leung, L. R., Li, H., Li, Q., Liu, X., Neale, R., Pinheiro, M. C., Qian, Y., Ullrich, P. A., Xie, S., Yang, Y., Zhang, Y., Zhang, K., and Zhou, T.: The DOE E3SM Coupled Model Version 1: description and results at high resolution, J. Adv. Model. Earth Sy., 11, 4095–4146, https://doi.org/10.1029/2019ms001870, 2019.
Chen, H.-C., Jin, F.-F., Zhao, S., Wittenberg, A. T., and Xie, S.: ENSO dynamics in the E3SM-1-0, CESM2, and GFDL-CM4 climate models, J. Climate, 34, 9365–9384, https://doi.org/10.1175/JCLI-D-21-0355.1, 2021.
Collier, N., Hoffman, F. M., Lawrence, D. M., Keppel-Aleks, G., Koven, C. D., Riley, W. J., Mu, M., and Randerson, J. T.: The International Land Model Benchmarking (ILAMB) System: Design, theory, and implementation, J. Adv. Model. Earth Sy., 10, 2731–2754, https://doi.org/10.1029/2018ms001354, 2018.
Covey, C., AchutaRao, K., Cubasch, U., Jones, P., Lambert, S. J., Mann, M., Phillips, T. J., and Taylor, K. E.: An overview of results from the Coupled Model Intercomparison Project, Global. Planet. Change, 37, 103–133, https://doi.org/10.1016/s0921-8181(02)00193-5, 2003.
Covey, C., Gleckler, P. J., Doutriaux, C., Williams, D. N., Dai, A., Fasullo, J. T., Trenberth, K. E., and Berg, A.: Metrics for the diurnal cycle of precipitation: toward routine benchmarks for climate models, J. Climate, 29, 4461–4471, https://doi.org/10.1175/jcli-d-15-0664.1, 2016.
Crockford, D.: The application/json media type for javascript object notation (json) (No. rfc4627), https://www.rfc-editor.org/rfc/pdfrfc/rfc4627.txt.pdf (last access: 4 April 2024), 2006.
Crockford, D. and Morningstar, C.: The JSON Data Interchange Syntax, ECMA-404, ECMA International, https://doi.org/10.13140/RG.2.2.28181.14560, 2017.
Dalelane, C., Winderlich, K., and Walter, A.: Evaluation of global teleconnections in CMIP6 climate projections using complex networks, Earth Syst. Dynam., 14, 17–37, https://doi.org/10.5194/esd-14-17-2023, 2023.
Dawson, A.: eofs: A Library for EOF Analysis of Meteorological, Oceanographic, and Climate Data, J. Open Res. Software, 4, e14, https://doi.org/10.5334/jors.122, 2016.
Dee, D. P., Uppala, S. M., Simmons, A. J., Berrisford, P., Poli, P., Kobayashi, S., Andrae, U., Balmaseda, M. A., Balsamo, G., Bauer, P., Bechtold, P., Beljaars, A. C. M., van de Berg, L., Bidlot, J., Bormann, N., Delsol, C., Dragani, R., Fuentes, M., Geer, A. J., Haimberger, L., Healy, S. B., Hersbach, H., Hólm, E. V., Isaksen, L., Kållberg, P., Köhler, M., Matricardi, M., McNally, A. P., Monge-Sanz, B. M., Morcrette, J.-J., Park, B.-K., Peubey, C., de Rosnay, P., Tavolato, C., Thépaut, J.-N., and Vitart, F.: The ERA-Interim reanalysis: Configuration and performance of the data assimilation system, Q. J. Roy. Meteor. Soc., 137, 553–597, https://doi.org/10.1002/qj.828, 2011.
Deser, C. and Phillips, A. S.: Defining the internal component of Atlantic multidecadal variability in a changing climate, Geophys. Res. Lett., 48, e2021GL095023, https://doi.org/10.1029/2021gl095023, 2021.
Doutriaux, C., Nadeau, D., Wittenburg, S., Lipsa, D., Muryanto, L., Chaudhary, A., and Williams, D. N.: CDAT/cdat: CDAT 8.1, Zenodo [code], https://doi.org/10.5281/zenodo.2586088, 2019.
Durack, P. J., Taylor, K. E., Eyring, V., Ames, S., Hoang, T., Nadeau, D., Doutriaux, C., Stockhause, M., and Gleckler, P. J.: Toward standardized data sets for climate model experimentation, Eos T. Am. Geophys. Un., 99, https://doi.org/10.1029/2018eo101751, 2018.
Eaton, B., Gregory, J., Drach, B., Taylor, K., Hankin, S., Blower, J., Caron, J., Signell, R., Bentley, P., Rappa, G., Höck, H., Pamment, A., Juckes, M., Raspaud, M., Horne, R., Whiteaker, T., Blodgett, D., Zender, C., Lee, D., Hassell, D., Snow, A. D., Kölling, T., Allured, D., Jelenak, A., Soerensen, A. M., Gaultier, L., and Herlédan, S.: NetCDF Climate and Forecast (CF) Meta-data Conventions V1.10, http://cfconventions.org/Data/cf-conventions/cf-conventions-1.10/cf-conventions.html (last access: 4 April 2024), 2022.
ESGF LLNL Metagrid: https://esgf-node.llnl.gov/, last access: 8 May 2024.
Eyring, V., Righi, M., Lauer, A., Evaldsson, M., Wenzel, S., Jones, C., Anav, A., Andrews, O., Cionni, I., Davin, E. L., Deser, C., Ehbrecht, C., Friedlingstein, P., Gleckler, P., Gottschaldt, K.-D., Hagemann, S., Juckes, M., Kindermann, S., Krasting, J., Kunert, D., Levine, R., Loew, A., Mäkelä, J., Martin, G., Mason, E., Phillips, A. S., Read, S., Rio, C., Roehrig, R., Senftleben, D., Sterl, A., van Ulft, L. H., Walton, J., Wang, S., and Williams, K. D.: ESMValTool (v1.0) – a community diagnostic and performance metrics tool for routine evaluation of Earth system models in CMIP, Geosci. Model Dev., 9, 1747–1802, https://doi.org/10.5194/gmd-9-1747-2016, 2016a.
Eyring, V., Bony, S., Meehl, G. A., Senior, C. A., Stevens, B., Stouffer, R. J., and Taylor, K. E.: Overview of the Coupled Model Intercomparison Project Phase 6 (CMIP6) experimental design and organization, Geosci. Model Dev., 9, 1937–1958, https://doi.org/10.5194/gmd-9-1937-2016, 2016b.
Eyring, V., Cox, P. M., Flato, G. M., Gleckler, P. J., Abramowitz, G., Caldwell, P., Collins, W. D., Gier, B. K., Hall, A., Hoffman, F. M., Hurtt, G. C., Jahn, A., Jones, C. D., Klein, S. A., Krasting, J. P., Kwiatkowski, L., Lorenz, R., Maloney, E. D., Meehl, G. A., Pendergrass, A. G., Pincus, R., Ruane, A. C., Russell, J. L., Sanderson, B. M., Santer, B. D., Sherwood, S. C., Simpson, I. R., Stouffer, R. J., and Williamson, M. S.: Taking climate model evaluation to the next level, Nat. Clim. Change, 9, 102–110, https://doi.org/10.1038/s41558-018-0355-y, 2019.
Eyring, V., Bock, L., Lauer, A., Righi, M., Schlund, M., Andela, B., Arnone, E., Bellprat, O., Brötz, B., Caron, L.-P., Carvalhais, N., Cionni, I., Cortesi, N., Crezee, B., Davin, E. L., Davini, P., Debeire, K., de Mora, L., Deser, C., Docquier, D., Earnshaw, P., Ehbrecht, C., Gier, B. K., Gonzalez-Reviriego, N., Goodman, P., Hagemann, S., Hardiman, S., Hassler, B., Hunter, A., Kadow, C., Kindermann, S., Koirala, S., Koldunov, N., Lejeune, Q., Lembo, V., Lovato, T., Lucarini, V., Massonnet, F., Müller, B., Pandde, A., Pérez-Zanón, N., Phillips, A., Predoi, V., Russell, J., Sellar, A., Serva, F., Stacke, T., Swaminathan, R., Torralba, V., Vegas-Regidor, J., von Hardenberg, J., Weigel, K., and Zimmermann, K.: Earth System Model Evaluation Tool (ESMValTool) v2.0 – an extended set of large-scale diagnostics for quasi-operational and comprehensive evaluation of Earth system models in CMIP, Geosci. Model Dev., 13, 3383–3438, https://doi.org/10.5194/gmd-13-3383-2020, 2020.
Eyring, V., Gillett, N. P., Achuta Rao, K. M., Barimalala, R., Barreiro Parrillo, M., Bellouin, N., Cassou, C., Durack, P. J., Kosaka, Y., McGregor, S. and Min, S., Morgenstern, O., and Sun, Y.: Human Influence on the Climate System, in: Climate Change 2021: The Physical Science Basis, Contribution of Working Group I to the Sixth Assessment Report of the Intergovernmental Panel on Climate Change, 105, 423–552, https://doi.org/10.1017/9781009157896.005, 2021.
Fasullo, J. T.: Evaluating simulated climate patterns from the CMIP archives using satellite and reanalysis datasets using the Climate Model Assessment Tool (CMATv1), Geosci. Model Dev., 13, 3627–3642, https://doi.org/10.5194/gmd-13-3627-2020, 2020.
Fasullo, J. T., Phillips, A. S., and Deser, C.: Evaluation of leading modes of climate variability in the CMIP archives, J. Climate, 33, 5527–5545, https://doi.org/10.1175/jcli-d-19-1024.1, 2020.
Ferraro, R., Waliser, D. E., Gleckler, P. J., Taylor, K. E., and Eyring, V.: Evolving OBS4MIPS to support Phase 6 of the Coupled Model Intercomparison Project (CMIP6), B. Am. Meteorol. Soc., 96, ES131–ES133, https://doi.org/10.1175/bams-d-14-00216.1, 2015.
Flato, G., Marotzke, J., Abiodun, B., Braconnot, P., Chou, S. C., Collins, W., Cox, P., Driouech, F., Emori, S., Eyring, V., and Forest, C.: Evaluation of climate models, in: Climate change 2013: the physical science basis, Contribution of Working Group I to the Fifth Assessment Report of the Intergovernmental Panel on Climate Change, Cambridge University Press, 741–866, 2014.
Fu, W., Moore, J. K., Primeau, F., Collier, N., Ogunro, O. O., Hoffman, F. M., and Randerson, J. T.: Evaluation of ocean biogeochemistry and carbon cycling in CMIP earth system models with the international ocean model benchmarking (IOMB) software System. J. Geophys. Res.-Oceans, 127, e2022JC018965, https://doi.org/10.1029/2022JC018965, 2022.
Gates, W. L.: AN AMS continuing series: Global CHANGE–AMIP: The Atmospheric Model Intercomparison Project, B. Am. Meteorol. Soc., 73, 1962–1970, 1992.
Gates, W. L., Henderson-Sellers, A., Boer, G. J., Folland, C. K., Kitoh, A., McAvaney, B. J., Semazzi, F., Smith, N., Weaver, A. J., and Zeng, Q. C.: Climate models – evaluation, Climate Change, 1, 229–284, 1995.
Gates, W. L., Boyle, J. S., Covey, C., Dease, C. G., Doutriaux, C. M., Drach, R. S., Fiorino, M., Gleckler, P. J., Hnilo, J. J., Marlais, S. M., and Phillips, T. J.: An overview of the results of the Atmospheric Model Intercomparison Project (AMIP I), B. Am. Meteorol. Soc., 80, 29–56, 1999.
Gleckler, P. J., Taylor, K. E., and Doutriaux, C.: Performance metrics for climate models, J. Geophys. Res., 113, D06104, https://doi.org/10.1029/2007jd008972, 2008.
Gleckler, P. J., Ferraro, R., and Waliser, D. E.: Improving use of satellite data in evaluating climate models, Eos T. Am. Geophys. Un., 92, 172, https://doi.org/10.1029/2011eo200005, 2011.
Gleckler, P. J., Doutriaux, C., Durack, P. J., Taylor, K. E., Zhang, Y., Williams, D. N., Mason, E., and Servonnat, J.: A more powerful reality test for climate models, Eos T. Am. Geophys. Un., 97, https://doi.org/10.1029/2016eo051663, 2016.
Golaz, J.-C., Caldwell, P., Van Roekel, L., Petersen, M. R., Tang, Q., Wolfe, J. D., Abeshu, G. W., Anantharaj, V., Asay-Davis, X., Bader, D. C., Baldwin, S., Bisht, G., Bogenschutz, P., Branstetter, M. L., Brunke, M. A., Brus, S., Burrows, S. M., Cameron-Smith, P. J., Donahue, A. S., Deakin, M., Easter, R. C., Evans, K. J., Feng, Y., Flanner, M., Foucar, J. G., Fyke, J., Griffin, B. M., Hannay, C., Harrop, B. E., Hoffman, M. J., Hunke, E., Jacob, R., Jacobsen, D. W., Jeffery, N., Jones, P. W., Keen, N. D., Klein, S. A., Larson, V. E., Leung, L. R., Li, H. Y., Lin, W., Lipscomb, W. H., Lun, P., Mahajan, S., Maltrud, M., Mametjanov, A., McClean, J. L., McCoy, R., Neale, R., Price, S., Qian, Y., Rasch, P. J., Eyre, J. E. J. R., Riley, W. J., Ringler, T. D., Roberts, A., Roesler, E. L., Salinger, A. G., Shaheen, Z., Shi, X., Singh, B., Tang, J., Taylor, M. A., Thornton, P. E., Turner, A. K., Veneziani, M., Wan, H., Wang, H., Wang, S., Williams, D. N., Wolfram, P. J., Worley, P. H., Xie, S., Yang, Y., Yoon, J., Zelinka, M. D., Zender, C. S., Zeng, X., Zhang, C., Zhang, K., Zhang, Y., Zheng, X., Zhou, T., and Zhu, Q.: The DOE E3SM Coupled Model Version 1: Overview and evaluation at standard resolution, J. Adv. Model. Earth Sy., 11, 2089–2129, https://doi.org/10.1029/2018ms001603, 2019.
Goldenson, N., Leung, L. R., Mearns, L. O., Pierce, D. W., Reed, K. A., Simpson, I. R., Ullrich, P., Krantz, W., Hall, A., Jones, A., and Rahimi, S.: Use-Inspired, Process-Oriented GCM Selection: Prioritizing Models for Regional Dynamical Downscaling, B. Am. Meteorol. Soc., 104, E1619–E1629, https://doi.org/10.1175/BAMS-D-23-0100.1, 2023.
Guilyardi, E., Wittenberg, A., Fedorov, A., Collins, M., Wang, C., Capotondi, A., Van Oldenborgh, G. J., and Stockdale, T.: Understanding El Niño in ocean–atmosphere general circulation models: Progress and challenges, B. Am. Meteorol. Soc., 90, 325–340, https://doi.org/10.1175/2008BAMS2387.1, 2009.
Guilyardi, E., Capotondi, A., Lengaigne, M., Thual, S., and Wittenberg, A. T.: ENSO modelling: history, progress and challenges, in: El Niño in a changing climate, edited by: McPhaden, M. J., Santoso, A., Cai, W., AGU monograph, ISBN 9781119548164, https://doi.org/10.1002/9781119548164.ch9, 2020.
Gutowski Jr., W. J., Giorgi, F., Timbal, B., Frigon, A., Jacob, D., Kang, H.-S., Raghavan, K., Lee, B., Lennard, C., Nikulin, G., O'Rourke, E., Rixen, M., Solman, S., Stephenson, T., and Tangang, F.: WCRP COordinated Regional Downscaling EXperiment (CORDEX): a diagnostic MIP for CMIP6, Geosci. Model Dev., 9, 4087–4095, https://doi.org/10.5194/gmd-9-4087-2016, 2016.
Haarsma, R. J., Roberts, M. J., Vidale, P. L., Senior, C. A., Bellucci, A., Bao, Q., Chang, P., Corti, S., Fučkar, N. S., Guemas, V., von Hardenberg, J., Hazeleger, W., Kodama, C., Koenigk, T., Leung, L. R., Lu, J., Luo, J.-J., Mao, J., Mizielinski, M. S., Mizuta, R., Nobre, P., Satoh, M., Scoccimarro, E., Semmler, T., Small, J., and von Storch, J.-S.: High Resolution Model Intercomparison Project (HighResMIP v1.0) for CMIP6, Geosci. Model Dev., 9, 4185–4208, https://doi.org/10.5194/gmd-9-4185-2016, 2016.
Hannah, W. M., Bradley, A. M., Guba, O., Tang, Q., Golaz, J.-C., and Wolfe, J. D.: Separating physics and dynamics grids for improved computational efficiency in spectral element Earth system models, J. Adv. Model. Earth Sy., 13, e2020MS002419, https://doi.org/10.1029/2020ms002419, 2021.
Hassan, K. A., Rönnberg, N., Forsell, C., Cooper, M., and Johansson, J.: A study on 2D and 3D parallel coordinates for pattern identification in temporal multivariate data, in: 2019 23rd International Conference Information Visualisation (IV), 145–150, https://doi.org/10.1109/IV.2019.00033, 2019.
Hassell, D., Gregory, J., Blower, J., Lawrence, B. N., and Taylor, K. E.: A data model of the Climate and Forecast metadata conventions (CF-1.6) with a software implementation (cf-python v2.1), Geosci. Model Dev., 10, 4619–4646, https://doi.org/10.5194/gmd-10-4619-2017, 2017.
Hausfather, Z., Marvel, K., Schmidt, G. A., Nielsen-Gammon, J. W., and Zelinka, M.: Climate simulations: Recognize the “hot model” problem, Nature, 605, 26–29, https://doi.org/10.1038/d41586-022-01192-2, 2022.
Held, I. M., Guo, H., Adcroft, A., Dunne, J. P., Horowitz, L. W., Krasting, J., Shevliakova, E., Winton, M., Zhao, M., Bushuk, M., Wittenberg, A. T., and coauthors: Structure and performance of GFDL's CM4.0 climate model, J. Adv. Model. Earth Sy., 11, 3691–3727, https://doi.org/10.1029/2019MS001829, 2019.
Hendon, H. H., Zhang, C., and Glick, J. D.: Interannual Variation of the Madden–Julian Oscillation during Austral Summer, J. Climate, 12, 2538–2550, 1999.
Herger, N., Abramowitz, G., Knutti, R., Angélil, O., Lehmann, K., and Sanderson, B. M.: Selecting a climate model subset to optimise key ensemble properties, Earth Syst. Dynam., 9, 135–151, https://doi.org/10.5194/esd-9-135-2018, 2018.
Hersbach, H., Bell, B., Berrisford, P., Hirahara, S., Horányi, A., Muñoz-Sabater, J., Nicolas, J., Peubey, C., Radu, R., Schepers, D., and coauthors: The ERA5 global reanalysis, Q. J. Roy. Meteor. Soc., 146, 1999–2049, https://doi.org/10.1002/qj.3803, 2020.
Hintze, J. L. and Nelson, R. D.: Violin plots: A box plot-density trace synergism, Am. Stat., 52, 181–184, https://doi.org/10.1080/00031305.1998.10480559, 1998.
Hoyer, S. and Hamman, J.: xarray: N-D labeled Arrays and Datasets in Python, J. Open Res. Software, 5, 10, https://doi.org/10.5334/jors.148, 2017.
Huffman, G. J., Adler, R. F., Morrissey, M. M., Bolvin, D. T., Curtis, S., Joyce, R., McGavock, B., and Susskind, J.: Global precipitation at one-degree daily resolution from multisatellite observations, J. Hydrometeorol., 2, 36–50, 2001.
Huffman, G. J., Bolvin, D. T., Braithwaite, D., Hsu, K., Joyce, R., Kidd, C., Nelkin, E. J., Sorooshian, S., Tan, J., and Xie, P.: NASA global precipitation measurement (GPM) integrated multi-satellite retrievals for GPM (IMERG), Algorithm theoretical basis document (ATBD) version, 4, p. 30, 2015.
Inselberg, A.: Multidimensional detective, in: Proceedings of IEEE Symposium on Information Visualization, 100–107, https://doi.org/10.1109/INFVIS.1997.636793, 1997.
Inselberg, A.: Parallel Coordinates: Visualization, Exploration and Classification of High-Dimensional Data, in: Handbook of Data Visualization, edited by: Chen, C., Härdle, W., and Unwin, A., Springer, Berlin, Heidelberg, Germany, 643–680, https://doi.org/10.1007/978-3-540-33037-0_25, 2008.
Inselberg, A.: Parallel Coordinates, in: Encyclopedia of Database Systems, Springer, edited by: Liu, L., and Özsu, M. T., Springer, New York, NY, U.S.A., https://doi.org/10.1007/978-1-4899-7993-3_262-2, 2016.
Jakob, C., Gettelman, A., and Pitman, A.: The need to operationalize climate modelling, Nat. Clim. Change, 13, 1158–1160, https://doi.org/10.1038/s41558-023-01849-4, 2023.
Johansson, J. and Forsell, C.: Evaluation of parallel coordinates: Overview, categorization and guidelines for future research, IEEE T. Vis. Comput. G. R., 22, 579–588, https://doi.org/10.1109/TVCG.2015.2466992, 2016.
Joyce, R. J., Janowiak, J. E., Arkin, P. A., and Xie, P.: CMORPH: A method that produces global precipitation estimates from passive microwave and infrared data at high spatial and temporal resolution, J. Hydrometeorol., 5, 487–503, 2004.
Kang, D., Kim, D. H., Ahn, M.-S., Neale, R., Lee, J., and Gleckler, P. J.: The role of the mean state on MJO simulation in CESM2 ensemble simulation, Geophys. Res. Lett., 47, e2020GL089824, https://doi.org/10.1029/2020gl089824, 2020.
Kim, D., Sperber, K. R., Stern, W., Waliser, D. E., Kang, I. S., Maloney, E. D., Wang, W., Weickmann, K. M., Benedict, J. J., Khairoutdinov, M., Lee, M.-I., Neale, R., Suarez, M. J., Thayer-Calder, K., and Zhang, G.: Application of MJO simulation diagnostics to climate models, J. Climate, 22, 6413–6436, https://doi.org/10.1175/2009jcli3063.1, 2009.
Kim, H., Caron, J. M., Richter, J. H. and Simpson, I. R.: The lack of QBO-MJO connection in CMIP6 models, Geophys. Res. Lett., 47, e2020GL087295, https://doi.org/10.1029/2020GL087295, 2020.
Klein, S. A., Zhang, Y., Zelinka, M. D., Pincus, R., Boyle, J., and Gleckler, P. J.: Are climate model simulations of clouds improving? An evaluation using the ISCCP simulator, J. Geophys. Res.-Atmos., 118, 1329–1342, https://doi.org/10.1002/jgrd.50141, 2013.
Klingaman, N. P., Martin, G. M., and Moise, A.: ASoP (v1.0): a set of methods for analyzing scales of precipitation in general circulation models, Geosci. Model Dev., 10, 57–83, https://doi.org/10.5194/gmd-10-57-2017, 2017.
Knutti, R.: The end of model democracy? Climatic Change, 102, 395–404, https://doi.org/10.1007/s10584-010-9800-2, 2010.
Knutti, R., Abramowitz, G., Collins, M., Eyring, V., Gleckler, P. J., Hewitson, B., and Mearns, L.: Good Practice Guidance Paper on Assessing and Combining Multi Model Climate Projections, in: Meeting Report of the Intergovernmental Panel on Climate Change Expert Meeting on Assessing and Combining Multi Model Climate Projections, edited by: Stocker, T. F., Qin, D., Plattner, G.-K., Tignor, M., and Midgley, P. M., IPCC Working Group I Technical Support Unit, University of Bern, Bern, Switzerland, 2010.
Knutti, R., Sedláček, J., Sanderson, B. M., Lorenz, R., Fischer, E. M., and Eyring, V.: A climate model projection weighting scheme accounting for performance and interdependence, Geophys. Res. Lett., 44, 1909–1918, https://doi.org/10.1002/2016gl072012, 2017.
Labe, Z. M. and Barnes, E. A.: Comparison of Climate Model Large Ensembles With Observations in the Arctic Using Simple Neural Networks, Earth Space Sci., 9, e2022EA002348, https://doi.org/10.1029/2022EA002348, 2022.
Lambert, S. J. and Boer, G. J.: CMIP1 evaluation and intercomparison of coupled climate models, Clim. Dynam., 17, 83–106, https://doi.org/10.1007/PL00013736, 2001.
Lee, H., Goodman, A., McGibbney, L., Waliser, D. E., Kim, J., Loikith, P. C., Gibson, P. B., and Massoud, E. C.: Regional Climate Model Evaluation System powered by Apache Open Climate Workbench v1.3.0: an enabling tool for facilitating regional climate studies, Geosci. Model Dev., 11, 4435–4449, https://doi.org/10.5194/gmd-11-4435-2018, 2018.
Lee, J., Gleckler, P., Sperber, K., Doutriaux, C., and Williams, D.: High-dimensional Data Visualization for Climate Model Intercomparison: Application of the Circular Plot, in: Proceedings of the 8th International Workshop on Climate Informatics: CI 2018, NCAR Technical Note NCAR/TN-550+PROC, 12–14, https://doi.org/10.5065/D6BZ64XQ, 2018.
Lee, J., Sperber, K. R., Gleckler, P. J., Bonfils, C., and Taylor, K. E.: Quantifying the agreement between observed and simulated extratropical modes of interannual variability, Clim. Dynam., 52, 4057–4089, https://doi.org/10.1007/s00382-018-4355-4, 2019a.
Lee, J., Xue, Y., De Sales, F., Diallo, I., Marx, L., Ek, M., Sperber, K. R., and Gleckler, P. J.: Evaluation of multi-decadal UCLA-CFSv2 simulation and impact of interactive atmospheric-ocean feedback on global and regional variability, Clim. Dynam., 52, 3683–3707, https://doi.org/10.1007/s00382-018-4351-8, 2019b.
Lee, J., Planton, Y., Gleckler, P. J., Sperber, K. R., Guilyardi, E., Wittenberg, A. T., McPhaden, M. J., and Pallotta, G.: Robust evaluation of ENSO in climate models: How many ensemble members are needed?, Geophys. Res. Lett., 48, e2021GL095041, https://doi.org/10.1029/2021gl095041, 2021a.
Lee, J., Sperber, K. R., Gleckler, P. J., Taylor, K. E., and Bonfils, C.: Benchmarking performance changes in the simulation of extratropical modes of variability across CMIP generations, J. Climate, 34, 6945–6969, https://doi.org/10.1175/jcli-d-20-0832.1, 2021b.
Lee, J., Ahn, M.-S., Ordonez, A., Gleckler, P., and Ullrich, P.: PCMDI/pcmdi_metrics_results_archive, Zenodo [data set], https://doi.org/10.5281/zenodo.10181201, 2023a.
Lee, J., Gleckler, P., Ordonez, A., Ahn, M.-S., Ullrich, P., Tom, V., Jason, B., Charles, D., Durack, P., Shaheen, Z., Muryanto, L., Painter, J., and Krasting, J.: PCMDI/pcmdi_metrics: PMP Version 3.1.1, Zenodo [code], https://doi.org/10.5281/zenodo.592790, 2023b.
Leung, L. R., Boos, W. R., Catto, J. L., DeMott, C. A., Martin, G. M., Neelin, J. D., O'Brien, T. A., Xie, S., Feng, Z., Klingaman, N. P. Kuo, Y.-H., Lee, R. W., Martinez-Villalobos, C., Vishnu S., Priestley, M. D. K., Tao, C., and Zhou, Y.: Exploratory precipitation metrics: Spatiotemporal characteristics, process-oriented, and phenomena-based, J. Climate, 35, 3659–3686, https://doi.org/10.1175/JCLI-D-21-0590.1, 2022.
Lin, J.-P., Kiladis, G. N., Mapes, B. E., Weickmann, K. M., Sperber, K. R., Lin, W., Wheeler, M. C., Schubert, S. D., Del Genio, A. D., Donner, L. J., Emori, S., Guérémy, J.-F., Hourdin, F., Rasch, P. J., Roeckner, E., and Scinocca, J.: Tropical intraseasonal variability in 14 IPCC AR4 climate Models. Part I: Convective Signals, J. Climate, 19, 2665–2690, https://doi.org/10.1175/jcli3735.1, 2006.
Lin, Y., Huang, X., Liang, Y., Qin, Y., Xu, S., Huang, W., Xu, F., Liu, L., Wang, Y., Peng, Y., and Wang, L.: Community integrated earth system model (CIESM): Description and evaluation, J. Adv. Model. Earth Sy., 12, e2019MS002036, https://doi.org/10.1029/2019ms002036, 2020.
Loeb, N. G., Doelling, D. R., Wang, H., Su, W., Nguyen, C., Corbett, J. G., Liang, L., Mitrescu, C., Rose, F. G., and Seiji, K.: Clouds and the Earth's Radiant Energy System (CERES) Energy Balanced and Filled (EBAF) top-of-atmosphere (TOA) Edition-4.0 data product, Int. J. Climatol., 31, 895–918, https://doi.org/10.1175/JCLI-D-17-0208.1, 2018.
Longmate, J. M., Risser, M. D., and Feldman, D. R.: Prioritizing the selection of CMIP6 model ensemble members for downscaling projections of CONUS temperature and precipitation, Clim. Dynam., 61, 5171–5197, https://doi.org/10.1007/s00382-023-06846-z, 2023.
Lu, L., Wang, W. and Tan, Z.: Double-arc parallel coordinates and its axes re-ordering methods, Mobile Networks and Applications, 25, 1376–1391, https://doi.org/10.1007/s11036-019-01455-9, 2020.
Madden, R. A. and Julian, P.: Detection of a 40–50 day oscillation in the zonal wind in the Tropical Pacific, J. Atmos. Sci., 28, 702–708, https://doi.org/10.1175/1520-0469(1971)028, 1971.
Madden, R. A. and Julian, P.: Description of Global-Scale Circulation Cells in the Tropics with a 40–50 Day Period, J. Atmos. Sci., 29, 1109–1123, https://doi.org/10.1175/1520-0469(1972)029, 1972.
Madden, R. A. and Julian, P.: Observations of the 40–50-Day Tropical Oscillation – A Review, Mon. Weather Rev., 122, 814–837, https://doi.org/10.1175/1520-0493(1994)122, 1994.
Maloney, E. D., Gettelman, A., Ming, Y., Neelin, J. D., Barrie, D., Mariotti, A., Chen, C., Coleman, D., Kuo, Y. H., Singh, B., Annamalai, H., Berg, A., Booth, J. F., Camargo, S. J., Dai, A., Gonzalez, A., Hafner, J., Jiang, X., Jing, X., Kim, D. H., Kumar, A., Moon, Y., Naud, C. M., Sobel, A. H., Suzuki, K., Wang, F., Wang, J., Wing, A. A., Xu, X., and Zhao, M.: Process-Oriented evaluation of climate and weather forecasting models, B. Am. Meteorol. Soc., 100, 1665–1686, https://doi.org/10.1175/bams-d-18-0042.1, 2019.
Martin, G. M., Klingaman, N. P., and Moise, A. F.: Connecting spatial and temporal scales of tropical precipitation in observations and the MetUM-GA6, Geosci. Model Dev., 10, 105–126, https://doi.org/10.5194/gmd-10-105-2017, 2017.
McAvaney, B. J., Covey, C., Joussaume, S., Kattsov, V., Kitoh, A., Ogana, W., Pitman, A. J., Weaver, A. J., Wood, R. A., and Zhao, Z. C.: Model evaluation. In Climate Change 2001: The scientific basis, Contribution of WG1 to the Third Assessment Report of the IPCC (TAR) 471-523, Cambridge University Press, ISBN 0521 80767 0, 2001.
McPhaden, M. J., Zebiak, S. E., and Glantz, M. H.: ENSO as an integrating concept in Earth Science, Science, 314, 1740–1745, https://doi.org/10.1126/science.1132588, 2006.
McPhaden, M. J., Santoso, A., and Cai, W. (Eds.): El Niño Southern oscillation in a changing climate, American Geophysical Union, USA, 528 pp., ISBN 9781119548126, https://doi.org/10.1002/9781119548164, 2020.
Meehl, G. A., Boer, G. J., Covey, C., Latif, M., and Stouffer, R. J.: Intercomparison makes for a better climate model, Eos T. Am. Geophys. Un., 78, 445, https://doi.org/10.1029/97eo00276, 1997.
Meehl, G. A., Boer, G. J., Covey, C., Latif, M., and Stouffer, R. J.: The Coupled Model Intercomparison Project (CMIP), B. Am. Meteorol. Soc., 81, 313–318, 2000.
Meehl, G. A., Covey, C., Delworth, T. L., Latif, M., McAvaney, B. J., Mitchell, J. F. B., Stouffer, R. J., and Taylor, K. E.: THE WCRP CMIP3 Multimodel Dataset: A new era in climate change research, B. Am. Meteorol. Soc., 88, 1383–1394, https://doi.org/10.1175/bams-88-9-1383, 2007.
Merrifield, A. L., Brunner, L., Lorenz, R., Humphrey, V., and Knutti, R.: Climate model Selection by Independence, Performance, and Spread (ClimSIPS v1.0.1) for regional applications, Geosci. Model Dev., 16, 4715–4747, https://doi.org/10.5194/gmd-16-4715-2023, 2023.
Neelin, J. D., Krasting, J. P., Radhakrishnan, A., Liptak, J., Jackson, T. J., Ming, Y., Dong, W., Gettelman, A., Coleman, D., Maloney, E. D., Wing, A. A., Kuo, Y. H., Ahmed, F., Ullrich, P. A., Bitz, C. M., Neale, R., Ordonez, A., and Maroon, E.: Process-oriented diagnostics: principles, practice, community development and common standards, B. Am. Meteorol. Soc., 104, E1452–E1468, https://doi.org/10.1175/bams-d-21-0268.1, 2023.
Nowack, P., Runge, J., Eyring, V., and Haigh, J. D.: Causal networks for climate model evaluation and constrained projections, Nat. Commun., 11, 1415, https://doi.org/10.1038/s41467-020-15195-y, 2020.
Orbe, C., Van Roekel, L., Adames, Á. F., Dezfuli, A., Fasullo, J. T., Gleckler, P. J., Lee, J., Li, W., Nazarenko, L., Schmidt, G. A., Sperber, K. R., and Zhao, M.: Representation of modes of variability in six U.S. climate models, J. Climate, 33, 7591–7617, https://doi.org/10.1175/jcli-d-19-0956.1, 2020.
Ordonez, A. C., Klingaman, N. P., and Martin, G.: Analysing scales of precipitation, OSTI OAI (U.S. Department of Energy Office of Scientific and Technical Information), https://doi.org/10.11578/dc.20211029.5, 2021.
Papalexiou, S. M., Rajulapati, C. R., Clark, M. P., and Lehner, F.: Robustness of CMIP6 historical global mean temperature simulations: Trends, long-term persistence, autocorrelation, and distributional shape, Earth's Future, 8, e2020EF001667, https://doi.org/10.1029/2020EF001667, 2020.
Pascoe, C., Lawrence, B. N., Guilyardi, E., Juckes, M., and Taylor, K. E.: Documenting numerical experiments in support of the Coupled Model Intercomparison Project Phase 6 (CMIP6), Geosci. Model Dev., 13, 2149–2167, https://doi.org/10.5194/gmd-13-2149-2020, 2020.
PCMDI Simulation Summaries: https://pcmdi.llnl.gov/metrics/, last access: 8 May 2024.
Pendergrass, A. G., Gleckler, P. J., Leung, L. R., and Jakob, C.: Benchmarking simulated precipitation in earth system models, B. Am. Meteorol. Soc., 101, E814–E816, https://doi.org/10.1175/bams-d-19-0318.1, 2020.
Phillips, A. S., Deser, C., and Fasullo, J. T.: Evaluating modes of variability in climate models, Eos T. Am. Geophys. Un., 95, 453–455, https://doi.org/10.1002/2014eo490002, 2014.
Planton, Y., Guilyardi, E., Wittenberg, A. T., Lee, J., Gleckler, P. J., Bayr, T., McGregor, S., McPhaden, M. J., Power, S. B., Roehrig, R., Vialard, J., and Voldoire, A.: Evaluating Climate Models with the CLIVAR 2020 ENSO Metrics Package, B. Am. Meteorol. Soc., 102, E193–E217, https://doi.org/10.1175/bams-d-19-0337.1, 2021.
Planton, Y. Y., Lee, J., Wittenberg, A. T. Gleckler, P. J., Guilyardi, E., McGregor, S., and McPhaden, M. J.: Estimating uncertainty in simulated ENSO statistics, J. Adv. Model. Earth Sy., ESS Open Archive [preprint], https://doi.org10.22541/essoar.170196744.48068128/v1, 2023.
PMP Installation: http://pcmdi.github.io/pcmdi_metrics/install.html, last access: 8 May 2024.
Potter, G. L., Bader, D. C., Riches, M., Bamzai, A. and Joseph, R.: Celebrating two decades of the Program for Climate Model Diagnosis and Intercomparison, B. Am. Meteorol. Soc., 92, 629–631, https://doi.org/10.1175/2011BAMS3018.1, 2011.
Qin, Y., Zelinka, M. D., and Klein, S. A.: On the Correspondence Between Atmosphere-Only and Coupled Simulations for Radiative Feedbacks and Forcing From CO2, J. Geophys. Res.-Atmos., 127, e2021JD035460, https://doi.org/10.1029/2021jd035460, 2022.
Randall, D. A., Wood, R. A., Bony, S., Colman, R., Fichefet, T., Fyfe, J., Kattsov, V., Pitman, A., Shukla, J., Srinivasan, J., and Stouffer, R. J.: Climate models and their evaluation, in: Climate change 2007: The physical science basis. Contribution of Working Group I to the Fourth Assessment Report of the IPCC (FAR), Cambridge University Press, 589–662, ISBN 978-0-521-88009-1, 2007.
Rasch, P. J., Xie, S., Ma, P.-L., Lin, W., Wang, H., Tang, Q., Burrows, S. M., Caldwell, P., Zhang, K., Easter, R. C., Cameron-Smith, P. J., Singh, B., Wan, H., Golaz, J.-C., Harrop, B. E., Roesler, E. L., Bacmeister, J. T., Larson, V. E., Evans, K. J., Qian, Y., Taylor, M. A., Leung, L. R., Zhang, Y., Brent, L., Branstetter, M. L., Hannay, C., Mahajan, S., Mametjanov, A., Neale, R., Richter, J. H., Yoon, J.-H., Zender, C. S., Bader, D. C., Flanner, M., Foucar, J. G., Jacob, R., Keen, N. D., Klein, S. A., Liu, X., Salinger, A. G., Shrivastava, M., and Yang, Y.: An overview of the atmospheric component of the Energy Exascale Earth System model, J. Adv. Model. Earth Sy., 11, 2377–2411, https://doi.org/10.1029/2019ms001629, 2019.
Reed, K. A., Goldenson, N., Grotjahn, R., Gutowski, W. J., Jagannathan, K., Jones, A. D., Leung, L. R., McGinnis, S. A., Pryor, S. C., Srivastava, A. K., Ullrich, P. A., and Zarzycki, C. M.: Metrics as tools for bridging climate science and applications, WIREs Climate Change, 13, e799, https://doi.org/10.1002/wcc.799, 2022.
Reichler, T. and Kim, J.: How well do coupled models simulate today's climate?, B. Am. Meteorol. Soc., 89, 303–312, https://doi.org/10.1175/bams-89-3-303, 2008.
Righi, M., Andela, B., Eyring, V., Lauer, A., Predoi, V., Schlund, M., Vegas-Regidor, J., Bock, L., Brötz, B., de Mora, L., Diblen, F., Dreyer, L., Drost, N., Earnshaw, P., Hassler, B., Koldunov, N., Little, B., Loosveldt Tomas, S., and Zimmermann, K.: Earth System Model Evaluation Tool (ESMValTool) v2.0 – technical overview, Geosci. Model Dev., 13, 1179–1199, https://doi.org/10.5194/gmd-13-1179-2020, 2020.
Sanderson, B. M. and Wehner, M. F.: Weighting strategy for the Fourth National Climate Assessment, in: Climate Science Special Report: Fourth National Climate Assessment, Volume I, edited by: Wuebbles, D. J., Fahey, D. W., Hibbard, K. A., Dokken, D. J., Stewart, B. C., and Maycock, T. K., U.S. Global Change Research Program, Washington, DC, USA, 436–442, https://doi.org/10.7930/J06T0JS3, 2017.
Sanderson, B. M., Wehner, M., and Knutti, R.: Skill and independence weighting for multi-model assessments, Geosci. Model Dev., 10, 2379–2395, https://doi.org/10.5194/gmd-10-2379-2017, 2017.
Sherwood, S. C., Webb, M. J., Annan, J. D., Armour, K. C., Forster, P. M., Hargreaves, J. C., Hegerl, G. C., Klein, S. A., Marvel, K., Rohling, E. J., Watanabe, M., Andrews, T., Braconnot, P., Bretherton, C. S., Foster, G. L., Hausfather, Z., Von Der Heydt, A. S., Knutti, R., Mauritsen, T., Norris, J. R., Proistosescu, C., Rugenstein, M., Schmidt, G. A., Tokarska, K., and Zelinka, M. D.: An assessment of Earth's climate sensitivity using multiple lines of evidence, Rev. Geophys., 58, e2019RG000678, https://doi.org/10.1029/2019rg000678, 2020.
Singh, R., and AchutaRao, K.: Sensitivity of future climate change and uncertainty over India to performance-based model weighting, Climatic Change, 160, 385–406, https://doi.org/10.1007/s10584-019-02643-y, 2020.
Sillmann, J., Kharin, V. V., Zhang, X., Zwiers, F. W., and Bronaugh, D.: Climate extremes indices in the CMIP5 multimodel ensemble: Part 1. Model evaluation in the present climate, J. Geophys. Res.-Atmos., 118, 1716–1733, https://doi.org/10.1002/jgrd.50203, 2013.
Sperber, K. R.: Madden-Julian variability in NCAR CAM2.0 and CCSM2.0, Clim. Dynam., 23, 259–278, https://doi.org/10.1007/s00382-004-0447-4, 2004.
Sperber, K. R. and Annamalai, H.: The use of fractional accumulated precipitation for the evaluation of the annual cycle of monsoons, Clim. Dynam., 43, 3219–3244, https://doi.org/10.1007/s00382-014-2099-3, 2014.
Sperber, K. R., Annamalai, H., Kang, I.-S., Kitoh, A., Moise, A., Turner, A., Wang, B., and Zhou, T.: The Asian summer monsoon: an intercomparison of CMIP5 vs. CMIP3 simulation of the late 20th century, Clim. Dynam., 41, 2711–2744, https://doi.org/10.1007/s00382-012-1607-6, 2013.
Sperber, K. R., Gualdi, S., Legutke, S., and Gayler, V.: The Madden–Julian oscillation in ECHAM4 coupled and uncoupled general circulation models, Clim. Dynam., 25, 117–140, https://doi.org/10.1007/s00382-005-0026-3, 2005.
Srivastava, A., Grotjahn, R., and Ullrich, P. A.: Evaluation of historical CMIP6 model simulations of extreme precipitation over contiguous US regions, Weather Climate Extremes, 29, 100268, https://doi.org/10.1016/j.wace.2020.100268, 2020.
Steed, C. A., Shipman, G., Thornton, P., Ricciuto, D., Erickson, D. and Branstetter, M.: Practical application of parallel coordinates for climate model analysis, Procedia Comput. Sci., 9, 877-886, https://doi.org/10.1016/j.procs.2012.04.094, 2012.
Stevens, B., Satoh, M., Auger, L., Biercamp, J., Bretherton, C. S., Chen, X., Düben, P., Judt, F., Khairoutdinov, M., Klocke, D., Kodama, C., Kornblueh, L., Lin, S.-J., Neumann, P., Putman, W. M., Röber, N., Shibuya, R., Vanniere, B., Vidale, P. L., Wedi, N., and Zhou, L.: DYAMOND: the DYnamics of the Atmospheric general circulation Modeled On Non-hydrostatic Domains, Prog. Earth Planet. Sci., 6, 61, https://doi.org/10.1186/s40645-019-0304-z, 2019.
Stoner, A. M. K., Hayhoe, K., and Wuebbles, D. J.: Assessing general circulation model simulations of atmospheric teleconnection patterns, J. Climate, 22, 4348–4372, https://doi.org/10.1175/2009jcli2577.1, 2009.
Sung, H. M., Kim, J., Shim, S., Seo, J., Kwon, S.-H., Sun, M.-A., Moon, H.-J., Lee, J., Lim, Y. C., Boo, K.-O., Kim, Y., Lee, J., Lee, J., Kim, J.-S., Marzin, C., and Byun, Y.-H.: Climate change projection in the Twenty-First Century simulated by NIMS-KMA CMIP6 model based on new GHGs concentration pathways, Asia-Pac. J. Atmos. Sci., 57, 851–862, https://doi.org/10.1007/s13143-021-00225-6, 2021.
Tang, Q., Prather, M. J., Hsu, J., Ruiz, D. J., Cameron-Smith, P. J., Xie, S., and Golaz, J.-C.: Evaluation of the interactive stratospheric ozone (O3v2) module in the E3SM version 1 Earth system model, Geosci. Model Dev., 14, 1219–1236, https://doi.org/10.5194/gmd-14-1219-2021, 2021.
Tang, S., Fast, J. D., Zhang, K., Hardin, J. C., Varble, A. C., Shilling, J. E., Mei, F., Zawadowicz, M. A., and Ma, P.-L.: Earth System Model Aerosol–Cloud Diagnostics (ESMAC Diags) package, version 1: assessing E3SM aerosol predictions using aircraft, ship, and surface measurements, Geosci. Model Dev., 15, 4055–4076, https://doi.org/10.5194/gmd-15-4055-2022, 2022.
Tang, S., Varble, A. C., Fast, J. D., Zhang, K., Wu, P., Dong, X., Mei, F., Pekour, M., Hardin, J. C., and Ma, P.-L.: Earth System Model Aerosol–Cloud Diagnostics (ESMAC Diags) package, version 2: assessing aerosols, clouds, and aerosol–cloud interactions via field campaign and long-term observations, Geosci. Model Dev., 16, 6355–6376, https://doi.org/10.5194/gmd-16-6355-2023, 2023.
Taylor, K. E.: Summarizing multiple aspects of model performance in a single diagram, J. Geophys. Res., 106, 7183–7192, https://doi.org/10.1029/2000jd900719, 2001.
Taylor, K. E.: Truly conserving with conservative remapping methods, Geosci. Model Dev., 17, 415–430, https://doi.org/10.5194/gmd-17-415-2024, 2024.
Taylor, K. E., Stouffer, R. J., and Meehl, G. A.: An overview of CMIP5 and the experiment design, B. Am. Meteorol. Soc., 93, 485–498, https://doi.org/10.1175/bams-d-11-00094.1, 2012.
Teixeira, J., Waliser, D. E., Ferraro, R., Gleckler, P. J., Lee, T., and Potter, G. L.: Satellite observations for CMIP5: The Genesis of OBS4MIPs, B. Am. Meteorol. Soc., 95, 1329–1334, https://doi.org/10.1175/bams-d-12-00204.1, 2014.
Tian, B. and Dong, X.: The Double-ITCZ Bias in CMIP3, CMIP5, and CMIP6 Models Based on Annual Mean Precipitation, Geophys. Res. Lett., 47, e2020GL087232, https://doi.org/10.1029/2020GL087232, 2020.
Ullrich, P. A. and Zarzycki, C. M.: TempestExtremes: a framework for scale-insensitive pointwise feature tracking on unstructured grids, Geosci. Model Dev., 10, 1069–1090, https://doi.org/10.5194/gmd-10-1069-2017, 2017.
Ullrich, P. A., Zarzycki, C. M., McClenny, E. E., Pinheiro, M. C., Stansfield, A. M., and Reed, K. A.: TempestExtremes v2.1: a community framework for feature detection, tracking, and analysis in large datasets, Geosci. Model Dev., 14, 5023–5048, https://doi.org/10.5194/gmd-14-5023-2021, 2021.
U.S. Department of Energy (DOE): Benchmarking Simulated Precipitation in Earth System Models Workshop Report, DOE/SC-0203, U.S. Department of Energy Office of Science, Biological and Environmental Research (BER) Program. Germantown, Maryland, USA, 2020.
Vo, T., Po-Chedley, P., Boutte, J., Zhang, C., Lee, J., Gleckler, P., Durack, P., Taylor, K., and Golaz, J.-C.: Xarray Climate Data Analysis Tools (xCDAT): A Python Package for Simple and Robust Analysis of Climate Data, The 103rd AMS Annual Meeting, Abstract, 8–12 January, 2023, in Denver, Colorado, 11.3, 412648, 2023.
Waliser, D., Gleckler, P. J., Ferraro, R., Taylor, K. E., Ames, S., Biard, J., Bosilovich, M. G., Brown, O., Chepfer, H., Cinquini, L., Durack, P. J., Eyring, V., Mathieu, P.-P., Lee, T., Pinnock, S., Potter, G. L., Rixen, M., Saunders, R., Schulz, J., Thépaut, J.-N., and Tuma, M.: Observations for Model Intercomparison Project (Obs4MIPs): status for CMIP6, Geosci. Model Dev., 13, 2945–2958, https://doi.org/10.5194/gmd-13-2945-2020, 2020.
Waliser, D. E., Sperber, K. R., Hendon, H. H., Kim, D., Maloney, E. D., Wheeler, M. C., Weickmann, K. M., Zhang, C., Donner, L. J., Gottschalck, J., Higgins, W., Kang, I. S., Legler, D. M., Moncrieff, M. W., Schubert, S. D., Stern, W., Vitart, F., Wang, B., Wang, W., and Woolnough, S. J.: MJO Simulation Diagnostics, J. Climate, 22, 3006–3030, https://doi.org/10.1175/2008jcli2731.1, 2009.
Wang, J., Liu, X., Shen, H. W., and Lin, G.: Multi-resolution climate ensemble parameter analysis with nested parallel coordinates plots, IEEE T. Vis. Comput. G. R., 23, 81–90, https://doi.org/10.1109/TVCG.2016.2598830, 2017.
Wehner, M., Gleckler, P. J., and Lee, J.: Characterization of long period return values of extreme daily temperature and precipitation in the CMIP6 models: Part 1, model evaluation, Weather Climate Extremes, 30, 100283, https://doi.org/10.1016/j.wace.2020.100283, 2020.
Wehner, M., Lee, J., Risser, M. D., Ullrich, P. A., Gleckler, P. J., and Collins, W. D.: Evaluation of extreme sub-daily precipitation in high-resolution global climate model simulations, Philos. T. R. Soc. A., 379, 20190545, https://doi.org/10.1098/rsta.2019.0545, 2021.
Williams, D. N.: Visualization and analysis tools for ultrascale climate data, Eos T. Am. Geophys. Un., 95, 377–378, https://doi.org/10.1002/2014eo420002, 2014.
Williams, D. N., Doutriaux, C., Drach, R., and McCoy, R.: The Flexible Climate Data Analysis Tools (CDAT) for Multi-model Climate Simulation Data, IEEE International Conference on Data Mining Workshops, 254–261, https://doi.org/10.1109/icdmw.2009.64, 2009.
Williams, D. N., Balaji, V., Cinquini, L., Denvil, S., Duffy, D. Q., Evans, B., Ferraro, R., Hansen, R., Lautenschlager, M., and Trenham, C.: A global repository for Planet-Sized experiments and observations, B. Am. Meteorol. Soc., 97, 803–816, https://doi.org/10.1175/bams-d-15-00132.1, 2016.
Wong, P. C., Shen, H. W., Leung, R., Hagos, S., Lee, T. Y., Tong, X. and Lu, K.: Visual analytics of large-scale climate model data, in: 2014 IEEE 4th Symposium on Large Data Analysis and Visualization (LDAV), 85–92, https://doi.org/10.1109/LDAV.2014.7013208, 2014.
Xie, P., Joyce, R., Wu, S., Yoo, S. H., Yarosh, Y., Sun, F. and Lin, R.: Reprocessed, bias-corrected CMORPH global high-resolution precipitation estimates from 1998, J. Hydrometeorol., 18, 1617–1641, 2017.
Xue, Z. and Ullrich, P. A.: A Comprehensive Intermediate-Term Drought Evaluation System and Evaluation of Climate Data Products over the Conterminous United States, J. Hydrometeorol., 22, 2311–2337, https://doi.org/10.1175/jhm-d-20-0314.1, 2021.
Young, A. H., Knapp, K. R., Inamdar, A., Hankins, W., and Rossow, W. B.: The International Satellite Cloud Climatology Project H-Series climate data record product, Earth Syst. Sci. Data, 10, 583–593, https://doi.org/10.5194/essd-10-583-2018, 2018.
Zelinka, M. D., Myers, T. A., McCoy, D. T., Po-Chedley, S., Caldwell, P. M., Ceppi, P., Klein, S. A., and Taylor, K. E.: Causes of higher climate sensitivity in CMIP6 models, Geophys. Res. Lett., 47, e2019GL085782, https://doi.org/10.1029/2019GL085782, 2020.
Zelinka, M. D., Klein, S. A., Qin, Y., and Myers, T. A.: Evaluating climate models' cloud feedbacks against expert judgment, J. Geophys. Res.-Atmos., 127, e2021JD035198, https://doi.org/10.1029/2021jd035198, 2022.
Zhang, C. and Hendon, H. H.: Propagating and standing components of the intraseasonal oscillation in tropical convection, J. Atmos. Sci., 54, 741–752, https://doi.org/10.1175/1520-0469(1997)054, 1997.
Zhang, C., Xie, S., Klein, S. A., Ma, H. Y., Tang, S., Van Weverberg, K., Morcrette, C. J., and Petch, J.: CAUSES: Diagnosis of the summertime warm bias in CMIP5 climate models at the ARM Southern Great Plains site. J. Geophys. Res.-Atmos., 123, 2968–2992, https://doi.org/10.1002/2017JD027200, 2018.
Zhang, C., Xie, S., Tao, C., Tang, S., Emmenegger, T., Neelin, J. D., Schiro, K. A., Lin, W., and Shaheen, Z.: The ARM data-oriented metrics and diagnostics package for climate models: A new tool for evaluating climate models with field data, B. Am. Meteorol. Soc., 101, E1619-E1627, https://doi.org/10.1175/BAMS-D-19-0282.1, 2020.
Zhang, C., Golaz, J.-C., Forsyth, R., Vo, T., Xie, S., Shaheen, Z., Potter, G. L., Asay-Davis, X. S., Zender, C. S., Lin, W., Chen, C.-C., Terai, C. R., Mahajan, S., Zhou, T., Balaguru, K., Tang, Q., Tao, C., Zhang, Y., Emmenegger, T., Burrows, S., and Ullrich, P. A.: The E3SM Diagnostics Package (E3SM Diags v2.7): a Python-based diagnostics package for Earth system model evaluation, Geosci. Model Dev., 15, 9031–9056, https://doi.org/10.5194/gmd-15-9031-2022, 2022.
Zhao, B., Lin, P., Hu, A., Liu, H., Ding, M., Yu, Z., and Yu, Y.: Uncertainty in Atlantic Multidecadal Oscillation derived from different observed datasets and their possible causes, Front. Mar. Sci., 9, 1007646, https://doi.org/10.3389/fmars.2022.1007646, 2022.
Zhao, M., Golaz, J.-C., Held, I. M., Guo, H., Balaji, V., Benson, R., Chen, J. H., Chen, X., Donner, L. J., Dunne, J., Dunne, K. A., Durachta, J., Fan, S.-M., Freidenreich, S. M., Garner, S. T., Ginoux, P., Harris, L., Horowitz, L. W., Krasting, J. P., Langenhorst, A. R., Zhi, L., Lin, P., Lin, S. J., Malyshev, S., Mason, E., Milly, P. C. D., Ming, Y., Naik, V., Paulot, F., Paynter, D., Phillipps, P. J., Radhakrishnan, A., Ramaswamy, V., Robinson, T., Schwarzkopf, D., Seman, C. J., Shevliakova, E., Shen, Z., Shin, H. H., Silvers, L. G., Wilson, J. R., Winton, M., Wittenberg, A. T., Wyman, B., and Xiang, B.: The GFDL Global Atmosphere and Land Model AM4.0/LM4.0: 1. Simulation characteristics with prescribed SSTS, J. Adv. Model. Earth Sy., 10, 691–734, https://doi.org/10.1002/2017ms001208, 2018.
Short summary
We introduce an open-source software, the PCMDI Metrics Package (PMP), developed for a comprehensive comparison of Earth system models (ESMs) with real-world observations. Using diverse metrics evaluating climatology, variability, and extremes simulated in thousands of simulations from the Coupled Model Intercomparison Project (CMIP), PMP aids in benchmarking model improvements across generations. PMP also enables efficient tracking of performance evolutions during ESM developments.
We introduce an open-source software, the PCMDI Metrics Package (PMP), developed for a...
