Articles | Volume 17, issue 9
https://doi.org/10.5194/gmd-17-3919-2024
© Author(s) 2024. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
https://doi.org/10.5194/gmd-17-3919-2024
© Author(s) 2024. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
Model evaluation paper
| 
15 May 2024
Model evaluation paper |
| 15 May 2024
| 15 May 2024
Systematic and objective evaluation of Earth system models: PCMDI Metrics Package (PMP) version 3
Lawrence Livermore National Laboratory, Livermore, CA, USA
Peter J. Gleckler
Lawrence Livermore National Laboratory, Livermore, CA, USA
Min-Seop Ahn
NASA Goddard Space Flight Center, Greenbelt, MD, USA
ESSIC, University of Maryland, College Park, MD, USA
Ana Ordonez
Lawrence Livermore National Laboratory, Livermore, CA, USA
Paul A. Ullrich
Lawrence Livermore National Laboratory, Livermore, CA, USA
Department of Land, Air and Water Resources, University of California, Davis, Davis, CA, USA
Kenneth R. Sperber
Lawrence Livermore National Laboratory, Livermore, CA, USA
retired
Karl E. Taylor
Lawrence Livermore National Laboratory, Livermore, CA, USA
Yann Y. Planton
NOAA Pacific Marine Environmental Laboratory, Seattle, WA, USA
School of Earth Atmosphere and Environment, Monash University, Clayton, VIC, Australia
Eric Guilyardi
LOCEAN-IPSL, CNRS-IRD-MNHN-Sorbonne Université, Paris, France
National Centre for Atmospheric Science – Climate, University of Reading, Reading, UK
Paul Durack
Lawrence Livermore National Laboratory, Livermore, CA, USA
Celine Bonfils
Lawrence Livermore National Laboratory, Livermore, CA, USA
Mark D. Zelinka
Lawrence Livermore National Laboratory, Livermore, CA, USA
Li-Wei Chao
Lawrence Livermore National Laboratory, Livermore, CA, USA
Bo Dong
Lawrence Livermore National Laboratory, Livermore, CA, USA
Charles Doutriaux
Lawrence Livermore National Laboratory, Livermore, CA, USA
Chengzhu Zhang
Lawrence Livermore National Laboratory, Livermore, CA, USA
Tom Vo
Lawrence Livermore National Laboratory, Livermore, CA, USA
Jason Boutte
Lawrence Livermore National Laboratory, Livermore, CA, USA
Michael F. Wehner
Lawrence Berkeley National Laboratory, Berkeley, CA, USA
Angeline G. Pendergrass
Department of Earth and Atmospheric Science, Cornell University, Ithaca, NY, USA
National Center for Atmospheric Research, Boulder, CO, USA
Daehyun Kim
School of Earth and Environmental Sciences, Seoul National University, Seoul, South Korea
Pacific Northwest National Laboratory, Richland, WA, USA
Andrew T. Wittenberg
NOAA Geophysical Fluid Dynamics Laboratory, Princeton, NJ, USA
John Krasting
NOAA Geophysical Fluid Dynamics Laboratory, Princeton, NJ, USA
Viewed
Total article views: 4,181 (including HTML, PDF, and XML)
Cumulative views and downloads
(calculated since 24 Nov 2023)
| HTML | XML | Total | Supplement | BibTeX | EndNote | |
|---|---|---|---|---|---|---|
| 3,276 | 810 | 95 | 4,181 | 178 | 118 | 183 |
- HTML: 3,276
- PDF: 810
- XML: 95
- Total: 4,181
- Supplement: 178
- BibTeX: 118
- EndNote: 183
Total article views: 3,637 (including HTML, PDF, and XML)
Cumulative views and downloads
(calculated since 15 May 2024)
| HTML | XML | Total | Supplement | BibTeX | EndNote | |
|---|---|---|---|---|---|---|
| 2,946 | 623 | 68 | 3,637 | 116 | 96 | 165 |
- HTML: 2,946
- PDF: 623
- XML: 68
- Total: 3,637
- Supplement: 116
- BibTeX: 96
- EndNote: 165
Total article views: 544 (including HTML, PDF, and XML)
Cumulative views and downloads
(calculated since 24 Nov 2023)
| HTML | XML | Total | Supplement | BibTeX | EndNote | |
|---|---|---|---|---|---|---|
| 330 | 187 | 27 | 544 | 62 | 22 | 18 |
- HTML: 330
- PDF: 187
- XML: 27
- Total: 544
- Supplement: 62
- BibTeX: 22
- EndNote: 18
Viewed (geographical distribution)
Total article views: 4,181 (including HTML, PDF, and XML)
Thereof 4,143 with geography defined
and 38 with unknown origin.
Total article views: 3,637 (including HTML, PDF, and XML)
Thereof 3,615 with geography defined
and 22 with unknown origin.
Total article views: 544 (including HTML, PDF, and XML)
Thereof 528 with geography defined
and 16 with unknown origin.
| Country | # | Views | % |
|---|
| Country | # | Views | % |
|---|
| Country | # | Views | % |
|---|
| Total: | 0 |
| HTML: | 0 |
| PDF: | 0 |
| XML: | 0 |
- 1
1
| Total: | 0 |
| HTML: | 0 |
| PDF: | 0 |
| XML: | 0 |
- 1
1
| Total: | 0 |
| HTML: | 0 |
| PDF: | 0 |
| XML: | 0 |
- 1
1
Cited
22 citations as recorded by crossref.
- Hosting downscaled decision-relevant community data products in ESGF2-US E. Massoud et al.
- High-Resolution Model Intercomparison Project phase 2 (HighResMIP2) towards CMIP7 M. Roberts et al.
- Evaluating statistical consistency for the ocean component of earth system models using physics informed convolutional autoencoder Y. Yu et al.
- Bimodality in simulated precipitation frequency distributions and its relationship with convective parameterizations M. Ahn et al.
- Climate classification systems for validating Earth System Models A. Navarro & F. Tapiador
- Challenges and alternatives to empirical orthogonal functions for earth system data C. Shields et al.
- Fusion of multi-source precipitation records via coordinate-based generative models S. Sun et al.
- Diagnosing aerosol–meteorological interactions on snow within Earth system models: a proof-of-concept study over High Mountain Asia C. Roychoudhury et al.
- Storylines reveal contrasting thermodynamic effects of climate change on 2020/21 East Asian cold extremes W. Zhuo et al.
- Robust circulation changes in the tropics under a warming climate: a topical review T. Thomas & G. Bala
- A Python diagnostics package for evaluation of Madden–Julian Oscillation (MJO) teleconnections in subseasonal-to-seasonal (S2S) forecast systems C. Stan et al.
- Opinion: The role of AerChemMIP in advancing climate and air quality research P. Griffiths et al.
- Monitoring and benchmarking Earth system model simulations with ESMValTool v2.12.0 A. Lauer et al.
- Best practices in software development for robust and reproducible geoscientific models based on insights from the Global Carbon Budget's dynamic vegetation models K. Gregor et al.
- Three decades of simulating global temperature patterns with coupled global climate models L. Brunner et al.
- A deep-learning-based consistency test approach for Earth system models on HPC systems Y. Yu et al.
- The DOE E3SM version 2.1: overview and assessment of the impacts of parameterized ocean submesoscales K. Smith et al.
- Granger causal inference for climate change attribution M. Risser et al.
- A new metrics framework for quantifying and intercomparing atmospheric rivers in observations, reanalyses, and climate models B. Dong et al.
- The updated Multi-Model Large Ensemble Archive and the Climate Variability Diagnostics Package: new tools for the study of climate variability and change N. Maher et al.
- How climate change intensified storm Boris’ extreme rainfall, revealed by near-real-time storylines M. Athanase et al.
- Baseline Climate Variables for Earth System Modelling M. Juckes et al.
22 citations as recorded by crossref.
- Hosting downscaled decision-relevant community data products in ESGF2-US E. Massoud et al.
- High-Resolution Model Intercomparison Project phase 2 (HighResMIP2) towards CMIP7 M. Roberts et al.
- Evaluating statistical consistency for the ocean component of earth system models using physics informed convolutional autoencoder Y. Yu et al.
- Bimodality in simulated precipitation frequency distributions and its relationship with convective parameterizations M. Ahn et al.
- Climate classification systems for validating Earth System Models A. Navarro & F. Tapiador
- Challenges and alternatives to empirical orthogonal functions for earth system data C. Shields et al.
- Fusion of multi-source precipitation records via coordinate-based generative models S. Sun et al.
- Diagnosing aerosol–meteorological interactions on snow within Earth system models: a proof-of-concept study over High Mountain Asia C. Roychoudhury et al.
- Storylines reveal contrasting thermodynamic effects of climate change on 2020/21 East Asian cold extremes W. Zhuo et al.
- Robust circulation changes in the tropics under a warming climate: a topical review T. Thomas & G. Bala
- A Python diagnostics package for evaluation of Madden–Julian Oscillation (MJO) teleconnections in subseasonal-to-seasonal (S2S) forecast systems C. Stan et al.
- Opinion: The role of AerChemMIP in advancing climate and air quality research P. Griffiths et al.
- Monitoring and benchmarking Earth system model simulations with ESMValTool v2.12.0 A. Lauer et al.
- Best practices in software development for robust and reproducible geoscientific models based on insights from the Global Carbon Budget's dynamic vegetation models K. Gregor et al.
- Three decades of simulating global temperature patterns with coupled global climate models L. Brunner et al.
- A deep-learning-based consistency test approach for Earth system models on HPC systems Y. Yu et al.
- The DOE E3SM version 2.1: overview and assessment of the impacts of parameterized ocean submesoscales K. Smith et al.
- Granger causal inference for climate change attribution M. Risser et al.
- A new metrics framework for quantifying and intercomparing atmospheric rivers in observations, reanalyses, and climate models B. Dong et al.
- The updated Multi-Model Large Ensemble Archive and the Climate Variability Diagnostics Package: new tools for the study of climate variability and change N. Maher et al.
- How climate change intensified storm Boris’ extreme rainfall, revealed by near-real-time storylines M. Athanase et al.
- Baseline Climate Variables for Earth System Modelling M. Juckes et al.
Saved (final revised paper)
Latest update: 30 Apr 2026
Short summary
We introduce an open-source software, the PCMDI Metrics Package (PMP), developed for a comprehensive comparison of Earth system models (ESMs) with real-world observations. Using diverse metrics evaluating climatology, variability, and extremes simulated in thousands of simulations from the Coupled Model Intercomparison Project (CMIP), PMP aids in benchmarking model improvements across generations. PMP also enables efficient tracking of performance evolutions during ESM developments.
We introduce an open-source software, the PCMDI Metrics Package (PMP), developed for a...
