Articles | Volume 17, issue 9 
            
                
                    
            
            
            https://doi.org/10.5194/gmd-17-3919-2024
                    © Author(s) 2024. This work is distributed under 
the Creative Commons Attribution 4.0 License.
                the Creative Commons Attribution 4.0 License.
https://doi.org/10.5194/gmd-17-3919-2024
                    © Author(s) 2024. This work is distributed under 
the Creative Commons Attribution 4.0 License.
                the Creative Commons Attribution 4.0 License.
Systematic and objective evaluation of Earth system models: PCMDI Metrics Package (PMP) version 3
                                            Lawrence Livermore National Laboratory, Livermore, CA, USA
                                        
                                    Peter J. Gleckler
                                            Lawrence Livermore National Laboratory, Livermore, CA, USA
                                        
                                    Min-Seop Ahn
                                            NASA Goddard Space Flight Center, Greenbelt, MD, USA
                                        
                                    
                                            ESSIC, University of Maryland, College Park, MD, USA
                                        
                                    Ana Ordonez
                                            Lawrence Livermore National Laboratory, Livermore, CA, USA
                                        
                                    Paul A. Ullrich
                                            Lawrence Livermore National Laboratory, Livermore, CA, USA
                                        
                                    
                                            Department of Land, Air and Water Resources, University of California, Davis, Davis, CA, USA
                                        
                                    Kenneth R. Sperber
                                            Lawrence Livermore National Laboratory, Livermore, CA, USA
                                        
                                    
                                            retired
                                        
                                    Karl E. Taylor
                                            Lawrence Livermore National Laboratory, Livermore, CA, USA
                                        
                                    Yann Y. Planton
                                            NOAA Pacific Marine Environmental Laboratory, Seattle, WA, USA
                                        
                                    
                                            School of Earth Atmosphere and Environment, Monash University, Clayton, VIC, Australia
                                        
                                    Eric Guilyardi
                                            LOCEAN-IPSL, CNRS-IRD-MNHN-Sorbonne Université, Paris, France
                                        
                                    
                                            National Centre for Atmospheric Science – Climate, University of Reading, Reading, UK
                                        
                                    Paul Durack
                                            Lawrence Livermore National Laboratory, Livermore, CA, USA
                                        
                                    Celine Bonfils
                                            Lawrence Livermore National Laboratory, Livermore, CA, USA
                                        
                                    Mark D. Zelinka
                                            Lawrence Livermore National Laboratory, Livermore, CA, USA
                                        
                                    Li-Wei Chao
                                            Lawrence Livermore National Laboratory, Livermore, CA, USA
                                        
                                    Bo Dong
                                            Lawrence Livermore National Laboratory, Livermore, CA, USA
                                        
                                    Charles Doutriaux
                                            Lawrence Livermore National Laboratory, Livermore, CA, USA
                                        
                                    Chengzhu Zhang
                                            Lawrence Livermore National Laboratory, Livermore, CA, USA
                                        
                                    Tom Vo
                                            Lawrence Livermore National Laboratory, Livermore, CA, USA
                                        
                                    Jason Boutte
                                            Lawrence Livermore National Laboratory, Livermore, CA, USA
                                        
                                    Michael F. Wehner
                                            Lawrence Berkeley National Laboratory, Berkeley, CA, USA
                                        
                                    Angeline G. Pendergrass
                                            Department of Earth and Atmospheric Science, Cornell University, Ithaca, NY, USA
                                        
                                    
                                            National Center for Atmospheric Research, Boulder, CO, USA
                                        
                                    Daehyun Kim
                                            School of Earth and Environmental Sciences, Seoul National University, Seoul, South Korea
                                        
                                    
                                            Pacific Northwest National Laboratory, Richland, WA, USA
                                        
                                    Andrew T. Wittenberg
                                            NOAA Geophysical Fluid Dynamics Laboratory, Princeton, NJ, USA
                                        
                                    John Krasting
                                            NOAA Geophysical Fluid Dynamics Laboratory, Princeton, NJ, USA
                                        
                                    Data sets
PCMDI/pcmdi_metrics_results_archive (v2023.11.21) Jiwoo Lee et al. https://doi.org/10.5281/zenodo.10181202
Model code and software
PCMDI Metrics Package Jiwoo Lee et al. https://doi.org/10.5281/zenodo.592790
Short summary
            We introduce an open-source software, the PCMDI Metrics Package (PMP), developed for a comprehensive comparison of Earth system models (ESMs) with real-world observations. Using diverse metrics evaluating climatology, variability, and extremes simulated in thousands of simulations from the Coupled Model Intercomparison Project (CMIP), PMP aids in benchmarking model improvements across generations. PMP also enables efficient tracking of performance evolutions during ESM developments.
            We introduce an open-source software, the PCMDI Metrics Package (PMP), developed for a...
            
         
 
             
             
             
            