Articles | Volume 17, issue 9
https://doi.org/10.5194/gmd-17-3919-2024
© Author(s) 2024. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
https://doi.org/10.5194/gmd-17-3919-2024
© Author(s) 2024. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
Model evaluation paper
| 
15 May 2024
Model evaluation paper |
| 15 May 2024
| 15 May 2024
Systematic and objective evaluation of Earth system models: PCMDI Metrics Package (PMP) version 3
Lawrence Livermore National Laboratory, Livermore, CA, USA
Peter J. Gleckler
Lawrence Livermore National Laboratory, Livermore, CA, USA
Min-Seop Ahn
NASA Goddard Space Flight Center, Greenbelt, MD, USA
ESSIC, University of Maryland, College Park, MD, USA
Ana Ordonez
Lawrence Livermore National Laboratory, Livermore, CA, USA
Paul A. Ullrich
Lawrence Livermore National Laboratory, Livermore, CA, USA
Department of Land, Air and Water Resources, University of California, Davis, Davis, CA, USA
Kenneth R. Sperber
Lawrence Livermore National Laboratory, Livermore, CA, USA
retired
Karl E. Taylor
Lawrence Livermore National Laboratory, Livermore, CA, USA
Yann Y. Planton
NOAA Pacific Marine Environmental Laboratory, Seattle, WA, USA
School of Earth Atmosphere and Environment, Monash University, Clayton, VIC, Australia
Eric Guilyardi
LOCEAN-IPSL, CNRS-IRD-MNHN-Sorbonne Université, Paris, France
National Centre for Atmospheric Science – Climate, University of Reading, Reading, UK
Paul Durack
Lawrence Livermore National Laboratory, Livermore, CA, USA
Celine Bonfils
Lawrence Livermore National Laboratory, Livermore, CA, USA
Mark D. Zelinka
Lawrence Livermore National Laboratory, Livermore, CA, USA
Li-Wei Chao
Lawrence Livermore National Laboratory, Livermore, CA, USA
Bo Dong
Lawrence Livermore National Laboratory, Livermore, CA, USA
Charles Doutriaux
Lawrence Livermore National Laboratory, Livermore, CA, USA
Chengzhu Zhang
Lawrence Livermore National Laboratory, Livermore, CA, USA
Tom Vo
Lawrence Livermore National Laboratory, Livermore, CA, USA
Jason Boutte
Lawrence Livermore National Laboratory, Livermore, CA, USA
Michael F. Wehner
Lawrence Berkeley National Laboratory, Berkeley, CA, USA
Angeline G. Pendergrass
Department of Earth and Atmospheric Science, Cornell University, Ithaca, NY, USA
National Center for Atmospheric Research, Boulder, CO, USA
Daehyun Kim
School of Earth and Environmental Sciences, Seoul National University, Seoul, South Korea
Pacific Northwest National Laboratory, Richland, WA, USA
Andrew T. Wittenberg
NOAA Geophysical Fluid Dynamics Laboratory, Princeton, NJ, USA
John Krasting
NOAA Geophysical Fluid Dynamics Laboratory, Princeton, NJ, USA
Viewed
Total article views: 6,478 (including HTML, PDF, and XML)
Cumulative views and downloads
(calculated since 24 Nov 2023)
| HTML | XML | Total | Supplement | BibTeX | EndNote | |
|---|---|---|---|---|---|---|
| 4,742 | 1,577 | 159 | 6,478 | 422 | 248 | 370 |
- HTML: 4,742
- PDF: 1,577
- XML: 159
- Total: 6,478
- Supplement: 422
- BibTeX: 248
- EndNote: 370
Total article views: 4,111 (including HTML, PDF, and XML)
Cumulative views and downloads
(calculated since 15 May 2024)
| HTML | XML | Total | Supplement | BibTeX | EndNote | |
|---|---|---|---|---|---|---|
| 3,278 | 753 | 80 | 4,111 | 147 | 107 | 187 |
- HTML: 3,278
- PDF: 753
- XML: 80
- Total: 4,111
- Supplement: 147
- BibTeX: 107
- EndNote: 187
Total article views: 2,367 (including HTML, PDF, and XML)
Cumulative views and downloads
(calculated since 24 Nov 2023)
| HTML | XML | Total | Supplement | BibTeX | EndNote | |
|---|---|---|---|---|---|---|
| 1,464 | 824 | 79 | 2,367 | 275 | 141 | 183 |
- HTML: 1,464
- PDF: 824
- XML: 79
- Total: 2,367
- Supplement: 275
- BibTeX: 141
- EndNote: 183
Viewed (geographical distribution)
Total article views: 6,478 (including HTML, PDF, and XML)
Thereof 6,440 with geography defined
and 38 with unknown origin.
Total article views: 4,111 (including HTML, PDF, and XML)
Thereof 4,092 with geography defined
and 19 with unknown origin.
Total article views: 2,367 (including HTML, PDF, and XML)
Thereof 2,348 with geography defined
and 19 with unknown origin.
| Country | # | Views | % |
|---|
| Country | # | Views | % |
|---|
| Country | # | Views | % |
|---|
| Total: | 0 |
| HTML: | 0 |
| PDF: | 0 |
| XML: | 0 |
- 1
1
| Total: | 0 |
| HTML: | 0 |
| PDF: | 0 |
| XML: | 0 |
- 1
1
| Total: | 0 |
| HTML: | 0 |
| PDF: | 0 |
| XML: | 0 |
- 1
1
Cited
24 citations as recorded by crossref.
- Evaluating statistical consistency for the ocean component of earth system models using physics informed convolutional autoencoder Y. Yu et al. https://doi.org/10.1038/s41598-025-03092-7
- New framework for benchmarking decadal predictions leveraging the PCMDI Metric Package with interactive visualization J. Choi et al. https://doi.org/10.5194/gmd-19-6189-2026
- Bimodality in simulated precipitation frequency distributions and its relationship with convective parameterizations M. Ahn et al. https://doi.org/10.1038/s41612-024-00685-3
- Fusion of multi-source precipitation records via coordinate-based generative models S. Sun et al. https://doi.org/10.1038/s41467-025-67987-9
- Diagnosing aerosol–meteorological interactions on snow within Earth system models: a proof-of-concept study over High Mountain Asia C. Roychoudhury et al. https://doi.org/10.5194/esd-16-1237-2025
- Robust circulation changes in the tropics under a warming climate: a topical review T. Thomas & G. Bala https://doi.org/10.3389/fclim.2025.1713513
- Monitoring and benchmarking Earth system model simulations with ESMValTool v2.12.0 A. Lauer et al. https://doi.org/10.5194/gmd-18-1169-2025
- Could Climate Projections Be Verifiable? A. Pendergrass https://doi.org/10.1002/met.70200
- A deep-learning-based consistency test approach for Earth system models on HPC systems Y. Yu et al. https://doi.org/10.1016/j.isci.2024.111574
- Baseline Climate Variables for Earth System Modelling M. Juckes et al. https://doi.org/10.5194/gmd-18-2639-2025
- Hosting downscaled decision-relevant community data products in ESGF2-US E. Massoud et al. https://doi.org/10.1088/2752-5295/ae27ea
- High-Resolution Model Intercomparison Project phase 2 (HighResMIP2) towards CMIP7 M. Roberts et al. https://doi.org/10.5194/gmd-18-1307-2025
- Climate classification systems for validating Earth System Models A. Navarro & F. Tapiador https://doi.org/10.1088/2752-5295/ad6632
- Challenges and alternatives to empirical orthogonal functions for earth system data C. Shields et al. https://doi.org/10.1038/s41598-026-49505-z
- Storylines reveal contrasting thermodynamic effects of climate change on 2020/21 East Asian cold extremes W. Zhuo et al. https://doi.org/10.1038/s41612-025-01031-x
- A Python diagnostics package for evaluation of Madden–Julian Oscillation (MJO) teleconnections in subseasonal-to-seasonal (S2S) forecast systems C. Stan et al. https://doi.org/10.5194/gmd-18-7969-2025
- Opinion: The role of AerChemMIP in advancing climate and air quality research P. Griffiths et al. https://doi.org/10.5194/acp-25-8289-2025
- Best practices in software development for robust and reproducible geoscientific models based on insights from the Global Carbon Budget's dynamic vegetation models K. Gregor et al. https://doi.org/10.5194/gmd-19-2407-2026
- Three decades of simulating global temperature patterns with coupled global climate models L. Brunner et al. https://doi.org/10.1038/s43247-026-03497-w
- The DOE E3SM version 2.1: overview and assessment of the impacts of parameterized ocean submesoscales K. Smith et al. https://doi.org/10.5194/gmd-18-1613-2025
- Granger causal inference for climate change attribution M. Risser et al. https://doi.org/10.1088/2752-5295/add046
- A new metrics framework for quantifying and intercomparing atmospheric rivers in observations, reanalyses, and climate models B. Dong et al. https://doi.org/10.5194/gmd-18-961-2025
- The updated Multi-Model Large Ensemble Archive and the Climate Variability Diagnostics Package: new tools for the study of climate variability and change N. Maher et al. https://doi.org/10.5194/gmd-18-6341-2025
- How climate change intensified storm Boris’ extreme rainfall, revealed by near-real-time storylines M. Athanase et al. https://doi.org/10.1038/s43247-024-01847-0
24 citations as recorded by crossref.
- Evaluating statistical consistency for the ocean component of earth system models using physics informed convolutional autoencoder Y. Yu et al. https://doi.org/10.1038/s41598-025-03092-7
- New framework for benchmarking decadal predictions leveraging the PCMDI Metric Package with interactive visualization J. Choi et al. https://doi.org/10.5194/gmd-19-6189-2026
- Bimodality in simulated precipitation frequency distributions and its relationship with convective parameterizations M. Ahn et al. https://doi.org/10.1038/s41612-024-00685-3
- Fusion of multi-source precipitation records via coordinate-based generative models S. Sun et al. https://doi.org/10.1038/s41467-025-67987-9
- Diagnosing aerosol–meteorological interactions on snow within Earth system models: a proof-of-concept study over High Mountain Asia C. Roychoudhury et al. https://doi.org/10.5194/esd-16-1237-2025
- Robust circulation changes in the tropics under a warming climate: a topical review T. Thomas & G. Bala https://doi.org/10.3389/fclim.2025.1713513
- Monitoring and benchmarking Earth system model simulations with ESMValTool v2.12.0 A. Lauer et al. https://doi.org/10.5194/gmd-18-1169-2025
- Could Climate Projections Be Verifiable? A. Pendergrass https://doi.org/10.1002/met.70200
- A deep-learning-based consistency test approach for Earth system models on HPC systems Y. Yu et al. https://doi.org/10.1016/j.isci.2024.111574
- Baseline Climate Variables for Earth System Modelling M. Juckes et al. https://doi.org/10.5194/gmd-18-2639-2025
- Hosting downscaled decision-relevant community data products in ESGF2-US E. Massoud et al. https://doi.org/10.1088/2752-5295/ae27ea
- High-Resolution Model Intercomparison Project phase 2 (HighResMIP2) towards CMIP7 M. Roberts et al. https://doi.org/10.5194/gmd-18-1307-2025
- Climate classification systems for validating Earth System Models A. Navarro & F. Tapiador https://doi.org/10.1088/2752-5295/ad6632
- Challenges and alternatives to empirical orthogonal functions for earth system data C. Shields et al. https://doi.org/10.1038/s41598-026-49505-z
- Storylines reveal contrasting thermodynamic effects of climate change on 2020/21 East Asian cold extremes W. Zhuo et al. https://doi.org/10.1038/s41612-025-01031-x
- A Python diagnostics package for evaluation of Madden–Julian Oscillation (MJO) teleconnections in subseasonal-to-seasonal (S2S) forecast systems C. Stan et al. https://doi.org/10.5194/gmd-18-7969-2025
- Opinion: The role of AerChemMIP in advancing climate and air quality research P. Griffiths et al. https://doi.org/10.5194/acp-25-8289-2025
- Best practices in software development for robust and reproducible geoscientific models based on insights from the Global Carbon Budget's dynamic vegetation models K. Gregor et al. https://doi.org/10.5194/gmd-19-2407-2026
- Three decades of simulating global temperature patterns with coupled global climate models L. Brunner et al. https://doi.org/10.1038/s43247-026-03497-w
- The DOE E3SM version 2.1: overview and assessment of the impacts of parameterized ocean submesoscales K. Smith et al. https://doi.org/10.5194/gmd-18-1613-2025
- Granger causal inference for climate change attribution M. Risser et al. https://doi.org/10.1088/2752-5295/add046
- A new metrics framework for quantifying and intercomparing atmospheric rivers in observations, reanalyses, and climate models B. Dong et al. https://doi.org/10.5194/gmd-18-961-2025
- The updated Multi-Model Large Ensemble Archive and the Climate Variability Diagnostics Package: new tools for the study of climate variability and change N. Maher et al. https://doi.org/10.5194/gmd-18-6341-2025
- How climate change intensified storm Boris’ extreme rainfall, revealed by near-real-time storylines M. Athanase et al. https://doi.org/10.1038/s43247-024-01847-0
Saved (final revised paper)
Latest update: 21 Jul 2026
Short summary
We introduce an open-source software, the PCMDI Metrics Package (PMP), developed for a comprehensive comparison of Earth system models (ESMs) with real-world observations. Using diverse metrics evaluating climatology, variability, and extremes simulated in thousands of simulations from the Coupled Model Intercomparison Project (CMIP), PMP aids in benchmarking model improvements across generations. PMP also enables efficient tracking of performance evolutions during ESM developments.
We introduce an open-source software, the PCMDI Metrics Package (PMP), developed for a...
