Articles | Volume 17, issue 9
https://doi.org/10.5194/gmd-17-3919-2024
© Author(s) 2024. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
https://doi.org/10.5194/gmd-17-3919-2024
© Author(s) 2024. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
Model evaluation paper
| 
15 May 2024
Model evaluation paper |
| 15 May 2024
| 15 May 2024
Systematic and objective evaluation of Earth system models: PCMDI Metrics Package (PMP) version 3
Lawrence Livermore National Laboratory, Livermore, CA, USA
Peter J. Gleckler
Lawrence Livermore National Laboratory, Livermore, CA, USA
Min-Seop Ahn
NASA Goddard Space Flight Center, Greenbelt, MD, USA
ESSIC, University of Maryland, College Park, MD, USA
Ana Ordonez
Lawrence Livermore National Laboratory, Livermore, CA, USA
Paul A. Ullrich
Lawrence Livermore National Laboratory, Livermore, CA, USA
Department of Land, Air and Water Resources, University of California, Davis, Davis, CA, USA
Kenneth R. Sperber
Lawrence Livermore National Laboratory, Livermore, CA, USA
retired
Karl E. Taylor
Lawrence Livermore National Laboratory, Livermore, CA, USA
Yann Y. Planton
NOAA Pacific Marine Environmental Laboratory, Seattle, WA, USA
School of Earth Atmosphere and Environment, Monash University, Clayton, VIC, Australia
Eric Guilyardi
LOCEAN-IPSL, CNRS-IRD-MNHN-Sorbonne Université, Paris, France
National Centre for Atmospheric Science – Climate, University of Reading, Reading, UK
Paul Durack
Lawrence Livermore National Laboratory, Livermore, CA, USA
Celine Bonfils
Lawrence Livermore National Laboratory, Livermore, CA, USA
Mark D. Zelinka
Lawrence Livermore National Laboratory, Livermore, CA, USA
Li-Wei Chao
Lawrence Livermore National Laboratory, Livermore, CA, USA
Bo Dong
Lawrence Livermore National Laboratory, Livermore, CA, USA
Charles Doutriaux
Lawrence Livermore National Laboratory, Livermore, CA, USA
Chengzhu Zhang
Lawrence Livermore National Laboratory, Livermore, CA, USA
Tom Vo
Lawrence Livermore National Laboratory, Livermore, CA, USA
Jason Boutte
Lawrence Livermore National Laboratory, Livermore, CA, USA
Michael F. Wehner
Lawrence Berkeley National Laboratory, Berkeley, CA, USA
Angeline G. Pendergrass
Department of Earth and Atmospheric Science, Cornell University, Ithaca, NY, USA
National Center for Atmospheric Research, Boulder, CO, USA
Daehyun Kim
School of Earth and Environmental Sciences, Seoul National University, Seoul, South Korea
Pacific Northwest National Laboratory, Richland, WA, USA
Andrew T. Wittenberg
NOAA Geophysical Fluid Dynamics Laboratory, Princeton, NJ, USA
John Krasting
NOAA Geophysical Fluid Dynamics Laboratory, Princeton, NJ, USA
Viewed
Total article views: 6,921 (including HTML, PDF, and XML)
Cumulative views and downloads
(calculated since 24 Nov 2023)
| HTML | XML | Total | Supplement | BibTeX | EndNote | |
|---|---|---|---|---|---|---|
| 5,016 | 1,694 | 211 | 6,921 | 455 | 283 | 409 |
- HTML: 5,016
- PDF: 1,694
- XML: 211
- Total: 6,921
- Supplement: 455
- BibTeX: 283
- EndNote: 409
Total article views: 4,485 (including HTML, PDF, and XML)
Cumulative views and downloads
(calculated since 15 May 2024)
| HTML | XML | Total | Supplement | BibTeX | EndNote | |
|---|---|---|---|---|---|---|
| 3,518 | 837 | 130 | 4,485 | 167 | 139 | 223 |
- HTML: 3,518
- PDF: 837
- XML: 130
- Total: 4,485
- Supplement: 167
- BibTeX: 139
- EndNote: 223
Total article views: 2,436 (including HTML, PDF, and XML)
Cumulative views and downloads
(calculated since 24 Nov 2023)
| HTML | XML | Total | Supplement | BibTeX | EndNote | |
|---|---|---|---|---|---|---|
| 1,498 | 857 | 81 | 2,436 | 288 | 144 | 186 |
- HTML: 1,498
- PDF: 857
- XML: 81
- Total: 2,436
- Supplement: 288
- BibTeX: 144
- EndNote: 186
Viewed (geographical distribution)
Total article views: 6,921 (including HTML, PDF, and XML)
Thereof 6,836 with geography defined
and 85 with unknown origin.
Total article views: 4,485 (including HTML, PDF, and XML)
Thereof 4,426 with geography defined
and 59 with unknown origin.
Total article views: 2,436 (including HTML, PDF, and XML)
Thereof 2,410 with geography defined
and 26 with unknown origin.
| Country | # | Views | % |
|---|
| Country | # | Views | % |
|---|
| Country | # | Views | % |
|---|
| Total: | 0 |
| HTML: | 0 |
| PDF: | 0 |
| XML: | 0 |
- 1
1
| Total: | 0 |
| HTML: | 0 |
| PDF: | 0 |
| XML: | 0 |
- 1
1
| Total: | 0 |
| HTML: | 0 |
| PDF: | 0 |
| XML: | 0 |
- 1
1
Cited
28 citations as recorded by crossref.
- Evaluating statistical consistency for the ocean component of earth system models using physics informed convolutional autoencoder Y. Yu et al. https://doi.org/10.1038/s41598-025-03092-7
- New framework for benchmarking decadal predictions leveraging the PCMDI Metric Package with interactive visualization J. Choi et al. https://doi.org/10.5194/gmd-19-6189-2026
- Bimodality in simulated precipitation frequency distributions and its relationship with convective parameterizations M. Ahn et al. https://doi.org/10.1038/s41612-024-00685-3
- Fusion of multi-source precipitation records via coordinate-based generative models S. Sun et al. https://doi.org/10.1038/s41467-025-67987-9
- Diagnosing aerosol–meteorological interactions on snow within Earth system models: a proof-of-concept study over High Mountain Asia C. Roychoudhury et al. https://doi.org/10.5194/esd-16-1237-2025
- ESMBenchmarkViz: A Python Toolkit for Interactive Visualization of Earth System Model Evaluation and Benchmarking J. Lee et al. https://doi.org/10.21105/joss.10644
- Rapid Evaluation Framework for the CMIP7 Assessment Fast Track F. Hoffman et al. https://doi.org/10.5194/gmd-19-7415-2026
- Robust circulation changes in the tropics under a warming climate: a topical review T. Thomas & G. Bala https://doi.org/10.3389/fclim.2025.1713513
- Monitoring and benchmarking Earth system model simulations with ESMValTool v2.12.0 A. Lauer et al. https://doi.org/10.5194/gmd-18-1169-2025
- Could Climate Projections Be Verifiable? A. Pendergrass https://doi.org/10.1002/met.70200
- A deep-learning-based consistency test approach for Earth system models on HPC systems Y. Yu et al. https://doi.org/10.1016/j.isci.2024.111574
- Baseline Climate Variables for Earth System Modelling M. Juckes et al. https://doi.org/10.5194/gmd-18-2639-2025
- Hosting downscaled decision-relevant community data products in ESGF2-US E. Massoud et al. https://doi.org/10.1088/2752-5295/ae27ea
- High-Resolution Model Intercomparison Project phase 2 (HighResMIP2) towards CMIP7 M. Roberts et al. https://doi.org/10.5194/gmd-18-1307-2025
- Climate classification systems for validating Earth System Models A. Navarro & F. Tapiador https://doi.org/10.1088/2752-5295/ad6632
- Challenges and alternatives to empirical orthogonal functions for earth system data C. Shields et al. https://doi.org/10.1038/s41598-026-49505-z
- Integrating Climate Modelling, Downscaling, and Bias Correction for Drought Studies: Current Approaches and Future Directions C. Naresh & A. Mathew https://doi.org/10.1007/s11269-026-04843-5
- Storylines reveal contrasting thermodynamic effects of climate change on 2020/21 East Asian cold extremes W. Zhuo et al. https://doi.org/10.1038/s41612-025-01031-x
- A Python diagnostics package for evaluation of Madden–Julian Oscillation (MJO) teleconnections in subseasonal-to-seasonal (S2S) forecast systems C. Stan et al. https://doi.org/10.5194/gmd-18-7969-2025
- AQUA v1.0.0: The Application for QUality Assessment for the Climate Change Adaptation Digital Twin – the core engine M. Nurisso et al. https://doi.org/10.5194/gmd-19-7725-2026
- Opinion: The role of AerChemMIP in advancing climate and air quality research P. Griffiths et al. https://doi.org/10.5194/acp-25-8289-2025
- Best practices in software development for robust and reproducible geoscientific models based on insights from the Global Carbon Budget's dynamic vegetation models K. Gregor et al. https://doi.org/10.5194/gmd-19-2407-2026
- Three decades of simulating global temperature patterns with coupled global climate models L. Brunner et al. https://doi.org/10.1038/s43247-026-03497-w
- The DOE E3SM version 2.1: overview and assessment of the impacts of parameterized ocean submesoscales K. Smith et al. https://doi.org/10.5194/gmd-18-1613-2025
- Granger causal inference for climate change attribution M. Risser et al. https://doi.org/10.1088/2752-5295/add046
- A new metrics framework for quantifying and intercomparing atmospheric rivers in observations, reanalyses, and climate models B. Dong et al. https://doi.org/10.5194/gmd-18-961-2025
- The updated Multi-Model Large Ensemble Archive and the Climate Variability Diagnostics Package: new tools for the study of climate variability and change N. Maher et al. https://doi.org/10.5194/gmd-18-6341-2025
- How climate change intensified storm Boris’ extreme rainfall, revealed by near-real-time storylines M. Athanase et al. https://doi.org/10.1038/s43247-024-01847-0
28 citations as recorded by crossref.
- Evaluating statistical consistency for the ocean component of earth system models using physics informed convolutional autoencoder Y. Yu et al. https://doi.org/10.1038/s41598-025-03092-7
- New framework for benchmarking decadal predictions leveraging the PCMDI Metric Package with interactive visualization J. Choi et al. https://doi.org/10.5194/gmd-19-6189-2026
- Bimodality in simulated precipitation frequency distributions and its relationship with convective parameterizations M. Ahn et al. https://doi.org/10.1038/s41612-024-00685-3
- Fusion of multi-source precipitation records via coordinate-based generative models S. Sun et al. https://doi.org/10.1038/s41467-025-67987-9
- Diagnosing aerosol–meteorological interactions on snow within Earth system models: a proof-of-concept study over High Mountain Asia C. Roychoudhury et al. https://doi.org/10.5194/esd-16-1237-2025
- ESMBenchmarkViz: A Python Toolkit for Interactive Visualization of Earth System Model Evaluation and Benchmarking J. Lee et al. https://doi.org/10.21105/joss.10644
- Rapid Evaluation Framework for the CMIP7 Assessment Fast Track F. Hoffman et al. https://doi.org/10.5194/gmd-19-7415-2026
- Robust circulation changes in the tropics under a warming climate: a topical review T. Thomas & G. Bala https://doi.org/10.3389/fclim.2025.1713513
- Monitoring and benchmarking Earth system model simulations with ESMValTool v2.12.0 A. Lauer et al. https://doi.org/10.5194/gmd-18-1169-2025
- Could Climate Projections Be Verifiable? A. Pendergrass https://doi.org/10.1002/met.70200
- A deep-learning-based consistency test approach for Earth system models on HPC systems Y. Yu et al. https://doi.org/10.1016/j.isci.2024.111574
- Baseline Climate Variables for Earth System Modelling M. Juckes et al. https://doi.org/10.5194/gmd-18-2639-2025
- Hosting downscaled decision-relevant community data products in ESGF2-US E. Massoud et al. https://doi.org/10.1088/2752-5295/ae27ea
- High-Resolution Model Intercomparison Project phase 2 (HighResMIP2) towards CMIP7 M. Roberts et al. https://doi.org/10.5194/gmd-18-1307-2025
- Climate classification systems for validating Earth System Models A. Navarro & F. Tapiador https://doi.org/10.1088/2752-5295/ad6632
- Challenges and alternatives to empirical orthogonal functions for earth system data C. Shields et al. https://doi.org/10.1038/s41598-026-49505-z
- Integrating Climate Modelling, Downscaling, and Bias Correction for Drought Studies: Current Approaches and Future Directions C. Naresh & A. Mathew https://doi.org/10.1007/s11269-026-04843-5
- Storylines reveal contrasting thermodynamic effects of climate change on 2020/21 East Asian cold extremes W. Zhuo et al. https://doi.org/10.1038/s41612-025-01031-x
- A Python diagnostics package for evaluation of Madden–Julian Oscillation (MJO) teleconnections in subseasonal-to-seasonal (S2S) forecast systems C. Stan et al. https://doi.org/10.5194/gmd-18-7969-2025
- AQUA v1.0.0: The Application for QUality Assessment for the Climate Change Adaptation Digital Twin – the core engine M. Nurisso et al. https://doi.org/10.5194/gmd-19-7725-2026
- Opinion: The role of AerChemMIP in advancing climate and air quality research P. Griffiths et al. https://doi.org/10.5194/acp-25-8289-2025
- Best practices in software development for robust and reproducible geoscientific models based on insights from the Global Carbon Budget's dynamic vegetation models K. Gregor et al. https://doi.org/10.5194/gmd-19-2407-2026
- Three decades of simulating global temperature patterns with coupled global climate models L. Brunner et al. https://doi.org/10.1038/s43247-026-03497-w
- The DOE E3SM version 2.1: overview and assessment of the impacts of parameterized ocean submesoscales K. Smith et al. https://doi.org/10.5194/gmd-18-1613-2025
- Granger causal inference for climate change attribution M. Risser et al. https://doi.org/10.1088/2752-5295/add046
- A new metrics framework for quantifying and intercomparing atmospheric rivers in observations, reanalyses, and climate models B. Dong et al. https://doi.org/10.5194/gmd-18-961-2025
- The updated Multi-Model Large Ensemble Archive and the Climate Variability Diagnostics Package: new tools for the study of climate variability and change N. Maher et al. https://doi.org/10.5194/gmd-18-6341-2025
- How climate change intensified storm Boris’ extreme rainfall, revealed by near-real-time storylines M. Athanase et al. https://doi.org/10.1038/s43247-024-01847-0
Saved (final revised paper)
Latest update: 19 Sep 2026
Short summary
We introduce an open-source software, the PCMDI Metrics Package (PMP), developed for a comprehensive comparison of Earth system models (ESMs) with real-world observations. Using diverse metrics evaluating climatology, variability, and extremes simulated in thousands of simulations from the Coupled Model Intercomparison Project (CMIP), PMP aids in benchmarking model improvements across generations. PMP also enables efficient tracking of performance evolutions during ESM developments.
We introduce an open-source software, the PCMDI Metrics Package (PMP), developed for a...
