Articles | Volume 13, issue 3
https://doi.org/10.5194/gmd-13-1179-2020
© Author(s) 2020. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
https://doi.org/10.5194/gmd-13-1179-2020
© Author(s) 2020. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
Methods for assessment of models
| 
16 Mar 2020
Methods for assessment of models |
| 16 Mar 2020
| 16 Mar 2020
Earth System Model Evaluation Tool (ESMValTool) v2.0 – technical overview
Deutsches Zentrum für Luft- und Raumfahrt (DLR), Institut für Physik der Atmosphäre, Oberpfaffenhofen, Germany
Bouwe Andela
Netherlands eScience Center, Science Park 140, 1098 XG Amsterdam, the Netherlands
Veronika Eyring
Deutsches Zentrum für Luft- und Raumfahrt (DLR), Institut für Physik der Atmosphäre, Oberpfaffenhofen, Germany
University of Bremen, Institute of Environmental Physics (IUP), Bremen, Germany
Axel Lauer
Deutsches Zentrum für Luft- und Raumfahrt (DLR), Institut für Physik der Atmosphäre, Oberpfaffenhofen, Germany
Valeriu Predoi
National Centre for Atmospheric Science, Department of Meteorology, University of Reading, Reading, UK
Manuel Schlund
Deutsches Zentrum für Luft- und Raumfahrt (DLR), Institut für Physik der Atmosphäre, Oberpfaffenhofen, Germany
Javier Vegas-Regidor
Barcelona Supercomputing Center, Barcelona, Spain
Lisa Bock
Deutsches Zentrum für Luft- und Raumfahrt (DLR), Institut für Physik der Atmosphäre, Oberpfaffenhofen, Germany
Björn Brötz
Deutsches Zentrum für Luft- und Raumfahrt (DLR), Institut für Physik der Atmosphäre, Oberpfaffenhofen, Germany
Lee de Mora
Plymouth Marine Laboratory, Prospect Place, The Hoe, Plymouth, Devon, PL1 3DH, UK
Faruk Diblen
Netherlands eScience Center, Science Park 140, 1098 XG Amsterdam, the Netherlands
Laura Dreyer
Met Office, FitzRoy Road, Exeter, EX1 3PB, UK
Niels Drost
Netherlands eScience Center, Science Park 140, 1098 XG Amsterdam, the Netherlands
Paul Earnshaw
Met Office, FitzRoy Road, Exeter, EX1 3PB, UK
Birgit Hassler
Deutsches Zentrum für Luft- und Raumfahrt (DLR), Institut für Physik der Atmosphäre, Oberpfaffenhofen, Germany
Nikolay Koldunov
Alfred Wegener Institute, Helmholtz Centre for Polar and Marine
Research, Bremerhaven, Germany
MARUM – Center for Marine Environmental Sciences, Bremen, Germany
Bill Little
Met Office, FitzRoy Road, Exeter, EX1 3PB, UK
Saskia Loosveldt Tomas
Barcelona Supercomputing Center, Barcelona, Spain
Klaus Zimmermann
Swedish Meteorological and Hydrological Institute (SMHI),
Norrköping, Sweden
Viewed
Total article views: 6,926 (including HTML, PDF, and XML)
Cumulative views and downloads
(calculated since 20 Sep 2019)
| HTML | XML | Total | Supplement | BibTeX | EndNote | |
|---|---|---|---|---|---|---|
| 5,101 | 1,724 | 101 | 6,926 | 290 | 151 | 158 |
- HTML: 5,101
- PDF: 1,724
- XML: 101
- Total: 6,926
- Supplement: 290
- BibTeX: 151
- EndNote: 158
Total article views: 5,651 (including HTML, PDF, and XML)
Cumulative views and downloads
(calculated since 16 Mar 2020)
| HTML | XML | Total | Supplement | BibTeX | EndNote | |
|---|---|---|---|---|---|---|
| 4,480 | 1,079 | 92 | 5,651 | 196 | 138 | 143 |
- HTML: 4,480
- PDF: 1,079
- XML: 92
- Total: 5,651
- Supplement: 196
- BibTeX: 138
- EndNote: 143
Total article views: 1,275 (including HTML, PDF, and XML)
Cumulative views and downloads
(calculated since 20 Sep 2019)
| HTML | XML | Total | Supplement | BibTeX | EndNote | |
|---|---|---|---|---|---|---|
| 621 | 645 | 9 | 1,275 | 94 | 13 | 15 |
- HTML: 621
- PDF: 645
- XML: 9
- Total: 1,275
- Supplement: 94
- BibTeX: 13
- EndNote: 15
Viewed (geographical distribution)
Total article views: 6,926 (including HTML, PDF, and XML)
Thereof 6,317 with geography defined
and 609 with unknown origin.
Total article views: 5,651 (including HTML, PDF, and XML)
Thereof 5,182 with geography defined
and 469 with unknown origin.
Total article views: 1,275 (including HTML, PDF, and XML)
Thereof 1,135 with geography defined
and 140 with unknown origin.
| Country | # | Views | % |
|---|
| Country | # | Views | % |
|---|
| Country | # | Views | % |
|---|
| Total: | 0 |
| HTML: | 0 |
| PDF: | 0 |
| XML: | 0 |
- 1
1
| Total: | 0 |
| HTML: | 0 |
| PDF: | 0 |
| XML: | 0 |
- 1
1
| Total: | 0 |
| HTML: | 0 |
| PDF: | 0 |
| XML: | 0 |
- 1
1
Cited
62 citations as recorded by crossref.
- Updating the radiation infrastructure in MESSy (based on MESSy version 2.55) M. Nützel et al. 10.5194/gmd-17-5821-2024
- Spatially resolved evaluation of Earth system models with satellite column-averaged CO2 B. Gier et al. 10.5194/bg-17-6115-2020
- Climate classification systems for validating Earth System Models A. Navarro & F. Tapiador 10.1088/2752-5295/ad6632
- Filtering CMIP6 models in the Euro-Mediterranean based on a circulation patterns approach M. Olmo et al. 10.1016/j.wace.2025.100765
- Constraining uncertainty in projected precipitation over land with causal discovery K. Debeire et al. 10.5194/esd-16-607-2025
- Earth System Model Evaluation Tool (ESMValTool) v2.0 – diagnostics for emergent constraints and future projections from Earth system models in CMIP A. Lauer et al. 10.5194/gmd-13-4205-2020
- Evaluation of native Earth system model output with ESMValTool v2.6.0 M. Schlund et al. 10.5194/gmd-16-315-2023
- Scenario choice impacts carbon allocation projection at global warming levels L. de Mora et al. 10.5194/esd-14-1295-2023
- climdex-kit: An open software for climate index calculation, sharing and analysis towards tailored climate services P. Campalani et al. 10.1016/j.envsoft.2025.106442
- Majority of global river flow sustained by groundwater J. Xie et al. 10.1038/s41561-024-01483-5
- The Mediterranean climate change hotspot in the CMIP5 and CMIP6 projections J. Cos et al. 10.5194/esd-13-321-2022
- Context for interpreting equilibrium climate sensitivity and transient climate response from the CMIP6 Earth system models G. Meehl et al. 10.1126/sciadv.aba1981
- CO2 Increase Experiments Using the CESM: Relationship to Climate Sensitivity and Comparison of CESM1 to CESM2 J. Bacmeister et al. 10.1029/2020MS002120
- Efficient and Flexible Aggregation and Distribution of MODIS Atmospheric Products Based on Climate Analytics as a Service Framework J. Zheng et al. 10.3390/rs13173541
- Are We at Risk of Losing the Current Generation of Climate Researchers to Data Science? S. Jain et al. 10.1029/2022AV000676
- Earth System Model Evaluation Tool (ESMValTool) v2.0 – diagnostics for extreme events, regional and impact evaluation, and analysis of Earth system models in CMIP K. Weigel et al. 10.5194/gmd-14-3159-2021
- The Physical Climate at Global Warming Thresholds as Seen in the U.K. Earth System Model 10.1175/JCLI-D-21-0234.1
- Observations for Model Intercomparison Project (Obs4MIPs): status for CMIP6 D. Waliser et al. 10.5194/gmd-13-2945-2020
- pyam: Analysis and visualisation of integrated assessment and macro-energy scenarios D. Huppmann et al. 10.12688/openreseurope.13633.1
- Climate Services Toolbox (CSTools) v4.0: from climate forecasts to climate forecast information N. Pérez-Zanón et al. 10.5194/gmd-15-6115-2022
- HESS Opinions: Participatory Digital eARth Twin Hydrology systems (DARTHs) for everyone – a blueprint for hydrologists R. Rigon et al. 10.5194/hess-26-4773-2022
- Quantifying Progress Across Different CMIP Phases With the ESMValTool L. Bock et al. 10.1029/2019JD032321
- Changing effects of external forcing on Atlantic–Pacific interactions S. Karmouche et al. 10.5194/esd-15-689-2024
- Cloud properties and their projected changes in CMIP models with low to high climate sensitivity L. Bock & A. Lauer 10.5194/acp-24-1587-2024
- Large-sample assessment of varying spatial resolution on the streamflow estimates of the wflow_sbm hydrological model J. Aerts et al. 10.5194/hess-26-4407-2022
- Cloud Climatologies from Global Climate Models—A Comparison of CMIP5 and CMIP6 Models with Satellite Data A. Lauer et al. 10.1175/JCLI-D-22-0181.1
- Detecting Extreme Temperature Events Using Gaussian Mixture Models A. Paçal et al. 10.1029/2023JD038906
- Current status on the need for improved accessibility to climate models code J. Añel et al. 10.5194/gmd-14-923-2021
- The 2021 heatwave was less rare in Western Canada than previously thought E. Malinina & N. Gillett 10.1016/j.wace.2024.100642
- Earth system music: music generated from the United Kingdom Earth System Model (UKESM1) L. de Mora et al. 10.5194/gc-3-263-2020
- Open weather and climate science in the digital era M. de Vos et al. 10.5194/gc-3-191-2020
- The eWaterCycle platform for open and FAIR hydrological collaboration R. Hut et al. 10.5194/gmd-15-5371-2022
- Evaluating stratospheric ozone and water vapour changes in CMIP6 models from 1850 to 2100 J. Keeble et al. 10.5194/acp-21-5015-2021
- Systematic and objective evaluation of Earth system models: PCMDI Metrics Package (PMP) version 3 J. Lee et al. 10.5194/gmd-17-3919-2024
- ESM-Tools version 5.0: a modular infrastructure for stand-alone and coupled Earth system modelling (ESM) D. Barbi et al. 10.5194/gmd-14-4051-2021
- ERA5 and ERA-Interim Data Processing for the GlobWat Global Hydrological Model B. Abdollahi et al. 10.3390/w14121950
- Tropical Cyclone Integrated Kinetic Energy in an Ensemble of HighResMIP Simulations P. Kreussler et al. 10.1029/2020GL090963
- pyam: Analysis and visualisation of integrated assessment and macro-energy scenarios D. Huppmann et al. 10.12688/openreseurope.13633.2
- Evaluating Climate Models with the CLIVAR 2020 ENSO Metrics Package Y. Planton et al. 10.1175/BAMS-D-19-0337.1
- Evaluation of a new 12 km regional perturbed parameter ensemble over Europe S. Tucker et al. 10.1007/s00382-021-05941-3
- Impact of volcanic eruptions on CMIP6 decadal predictions: a multi-model analysis R. Bilbao et al. 10.5194/esd-15-501-2024
- Evaluating Causal Arctic‐Midlatitude Teleconnections in CMIP6 E. Galytska et al. 10.1029/2022JD037978
- Representation of the terrestrial carbon cycle in CMIP6 B. Gier et al. 10.5194/bg-21-5321-2024
- Emergent constraints on equilibrium climate sensitivity in CMIP5: do they hold for CMIP6? M. Schlund et al. 10.5194/esd-11-1233-2020
- Dynamic 3-D Visualization of Climate Model Development and Results J. Walton et al. 10.1109/MCG.2020.3042587
- Climate model Selection by Independence, Performance, and Spread (ClimSIPS v1.0.1) for regional applications A. Merrifield et al. 10.5194/gmd-16-4715-2023
- Constraining Uncertainty in Projected Gross Primary Production With Machine Learning M. Schlund et al. 10.1029/2019JG005619
- Comparison of Reanalysis and Observational Precipitation Datasets Including ERA5 and WFDE5 B. Hassler & A. Lauer 10.3390/atmos12111462
- The E3SM Diagnostics Package (E3SM Diags v2.7): a Python-based diagnostics package for Earth system model evaluation C. Zhang et al. 10.5194/gmd-15-9031-2022
- A deep-learning-based consistency test approach for Earth system models on HPC systems Y. Yu et al. 10.1016/j.isci.2024.111574
- Climate model projections from the Scenario Model Intercomparison Project (ScenarioMIP) of CMIP6 C. Tebaldi et al. 10.5194/esd-12-253-2021
- TATOO – Python Topographic Analysis Tool Library for semi-automated setup of high-resolution integrated hydrologic models J. Mitterer 10.1016/j.envsoft.2022.105406
- Human driven climate change increased the likelihood of the 2023 record area burned in Canada M. Kirchmeier-Young et al. 10.1038/s41612-024-00841-9
- Bringing it all together: science priorities for improved understanding of Earth system change and to support international climate policy C. Jones et al. 10.5194/esd-15-1319-2024
- Validation of terrestrial biogeochemistry in CMIP6 Earth system models: a review L. Spafford & A. MacDougall 10.5194/gmd-14-5863-2021
- Spatiotemporal upscaling of sparse air-sea pCO2 data via physics-informed transfer learning S. Kim et al. 10.1038/s41597-024-03959-w
- Do Emergent Constraints on Carbon Cycle Feedbacks Hold in CMIP6? S. Zechlau et al. 10.1029/2022JG006985
- Monitoring and benchmarking Earth system model simulations with ESMValTool v2.12.0 A. Lauer et al. 10.5194/gmd-18-1169-2025
- Can we trust CMIP5/6 future projections of European winter precipitation? E. Moreno-Chamarro et al. 10.1088/1748-9326/abf28a
- Technology to aid the analysis of large-volume multi-institute climate model output at a central analysis facility (PRIMAVERA Data Management Tool V2.10) J. Seddon et al. 10.5194/gmd-16-6689-2023
- Earth System Model Evaluation Tool (ESMValTool) v2.0 – an extended set of large-scale diagnostics for quasi-operational and comprehensive evaluation of Earth system models in CMIP V. Eyring et al. 10.5194/gmd-13-3383-2020
- Machine learning of cloud types in satellite observations and climate models P. Kuma et al. 10.5194/acp-23-523-2023
62 citations as recorded by crossref.
- Updating the radiation infrastructure in MESSy (based on MESSy version 2.55) M. Nützel et al. 10.5194/gmd-17-5821-2024
- Spatially resolved evaluation of Earth system models with satellite column-averaged CO2 B. Gier et al. 10.5194/bg-17-6115-2020
- Climate classification systems for validating Earth System Models A. Navarro & F. Tapiador 10.1088/2752-5295/ad6632
- Filtering CMIP6 models in the Euro-Mediterranean based on a circulation patterns approach M. Olmo et al. 10.1016/j.wace.2025.100765
- Constraining uncertainty in projected precipitation over land with causal discovery K. Debeire et al. 10.5194/esd-16-607-2025
- Earth System Model Evaluation Tool (ESMValTool) v2.0 – diagnostics for emergent constraints and future projections from Earth system models in CMIP A. Lauer et al. 10.5194/gmd-13-4205-2020
- Evaluation of native Earth system model output with ESMValTool v2.6.0 M. Schlund et al. 10.5194/gmd-16-315-2023
- Scenario choice impacts carbon allocation projection at global warming levels L. de Mora et al. 10.5194/esd-14-1295-2023
- climdex-kit: An open software for climate index calculation, sharing and analysis towards tailored climate services P. Campalani et al. 10.1016/j.envsoft.2025.106442
- Majority of global river flow sustained by groundwater J. Xie et al. 10.1038/s41561-024-01483-5
- The Mediterranean climate change hotspot in the CMIP5 and CMIP6 projections J. Cos et al. 10.5194/esd-13-321-2022
- Context for interpreting equilibrium climate sensitivity and transient climate response from the CMIP6 Earth system models G. Meehl et al. 10.1126/sciadv.aba1981
- CO2 Increase Experiments Using the CESM: Relationship to Climate Sensitivity and Comparison of CESM1 to CESM2 J. Bacmeister et al. 10.1029/2020MS002120
- Efficient and Flexible Aggregation and Distribution of MODIS Atmospheric Products Based on Climate Analytics as a Service Framework J. Zheng et al. 10.3390/rs13173541
- Are We at Risk of Losing the Current Generation of Climate Researchers to Data Science? S. Jain et al. 10.1029/2022AV000676
- Earth System Model Evaluation Tool (ESMValTool) v2.0 – diagnostics for extreme events, regional and impact evaluation, and analysis of Earth system models in CMIP K. Weigel et al. 10.5194/gmd-14-3159-2021
- The Physical Climate at Global Warming Thresholds as Seen in the U.K. Earth System Model 10.1175/JCLI-D-21-0234.1
- Observations for Model Intercomparison Project (Obs4MIPs): status for CMIP6 D. Waliser et al. 10.5194/gmd-13-2945-2020
- pyam: Analysis and visualisation of integrated assessment and macro-energy scenarios D. Huppmann et al. 10.12688/openreseurope.13633.1
- Climate Services Toolbox (CSTools) v4.0: from climate forecasts to climate forecast information N. Pérez-Zanón et al. 10.5194/gmd-15-6115-2022
- HESS Opinions: Participatory Digital eARth Twin Hydrology systems (DARTHs) for everyone – a blueprint for hydrologists R. Rigon et al. 10.5194/hess-26-4773-2022
- Quantifying Progress Across Different CMIP Phases With the ESMValTool L. Bock et al. 10.1029/2019JD032321
- Changing effects of external forcing on Atlantic–Pacific interactions S. Karmouche et al. 10.5194/esd-15-689-2024
- Cloud properties and their projected changes in CMIP models with low to high climate sensitivity L. Bock & A. Lauer 10.5194/acp-24-1587-2024
- Large-sample assessment of varying spatial resolution on the streamflow estimates of the wflow_sbm hydrological model J. Aerts et al. 10.5194/hess-26-4407-2022
- Cloud Climatologies from Global Climate Models—A Comparison of CMIP5 and CMIP6 Models with Satellite Data A. Lauer et al. 10.1175/JCLI-D-22-0181.1
- Detecting Extreme Temperature Events Using Gaussian Mixture Models A. Paçal et al. 10.1029/2023JD038906
- Current status on the need for improved accessibility to climate models code J. Añel et al. 10.5194/gmd-14-923-2021
- The 2021 heatwave was less rare in Western Canada than previously thought E. Malinina & N. Gillett 10.1016/j.wace.2024.100642
- Earth system music: music generated from the United Kingdom Earth System Model (UKESM1) L. de Mora et al. 10.5194/gc-3-263-2020
- Open weather and climate science in the digital era M. de Vos et al. 10.5194/gc-3-191-2020
- The eWaterCycle platform for open and FAIR hydrological collaboration R. Hut et al. 10.5194/gmd-15-5371-2022
- Evaluating stratospheric ozone and water vapour changes in CMIP6 models from 1850 to 2100 J. Keeble et al. 10.5194/acp-21-5015-2021
- Systematic and objective evaluation of Earth system models: PCMDI Metrics Package (PMP) version 3 J. Lee et al. 10.5194/gmd-17-3919-2024
- ESM-Tools version 5.0: a modular infrastructure for stand-alone and coupled Earth system modelling (ESM) D. Barbi et al. 10.5194/gmd-14-4051-2021
- ERA5 and ERA-Interim Data Processing for the GlobWat Global Hydrological Model B. Abdollahi et al. 10.3390/w14121950
- Tropical Cyclone Integrated Kinetic Energy in an Ensemble of HighResMIP Simulations P. Kreussler et al. 10.1029/2020GL090963
- pyam: Analysis and visualisation of integrated assessment and macro-energy scenarios D. Huppmann et al. 10.12688/openreseurope.13633.2
- Evaluating Climate Models with the CLIVAR 2020 ENSO Metrics Package Y. Planton et al. 10.1175/BAMS-D-19-0337.1
- Evaluation of a new 12 km regional perturbed parameter ensemble over Europe S. Tucker et al. 10.1007/s00382-021-05941-3
- Impact of volcanic eruptions on CMIP6 decadal predictions: a multi-model analysis R. Bilbao et al. 10.5194/esd-15-501-2024
- Evaluating Causal Arctic‐Midlatitude Teleconnections in CMIP6 E. Galytska et al. 10.1029/2022JD037978
- Representation of the terrestrial carbon cycle in CMIP6 B. Gier et al. 10.5194/bg-21-5321-2024
- Emergent constraints on equilibrium climate sensitivity in CMIP5: do they hold for CMIP6? M. Schlund et al. 10.5194/esd-11-1233-2020
- Dynamic 3-D Visualization of Climate Model Development and Results J. Walton et al. 10.1109/MCG.2020.3042587
- Climate model Selection by Independence, Performance, and Spread (ClimSIPS v1.0.1) for regional applications A. Merrifield et al. 10.5194/gmd-16-4715-2023
- Constraining Uncertainty in Projected Gross Primary Production With Machine Learning M. Schlund et al. 10.1029/2019JG005619
- Comparison of Reanalysis and Observational Precipitation Datasets Including ERA5 and WFDE5 B. Hassler & A. Lauer 10.3390/atmos12111462
- The E3SM Diagnostics Package (E3SM Diags v2.7): a Python-based diagnostics package for Earth system model evaluation C. Zhang et al. 10.5194/gmd-15-9031-2022
- A deep-learning-based consistency test approach for Earth system models on HPC systems Y. Yu et al. 10.1016/j.isci.2024.111574
- Climate model projections from the Scenario Model Intercomparison Project (ScenarioMIP) of CMIP6 C. Tebaldi et al. 10.5194/esd-12-253-2021
- TATOO – Python Topographic Analysis Tool Library for semi-automated setup of high-resolution integrated hydrologic models J. Mitterer 10.1016/j.envsoft.2022.105406
- Human driven climate change increased the likelihood of the 2023 record area burned in Canada M. Kirchmeier-Young et al. 10.1038/s41612-024-00841-9
- Bringing it all together: science priorities for improved understanding of Earth system change and to support international climate policy C. Jones et al. 10.5194/esd-15-1319-2024
- Validation of terrestrial biogeochemistry in CMIP6 Earth system models: a review L. Spafford & A. MacDougall 10.5194/gmd-14-5863-2021
- Spatiotemporal upscaling of sparse air-sea pCO2 data via physics-informed transfer learning S. Kim et al. 10.1038/s41597-024-03959-w
- Do Emergent Constraints on Carbon Cycle Feedbacks Hold in CMIP6? S. Zechlau et al. 10.1029/2022JG006985
- Monitoring and benchmarking Earth system model simulations with ESMValTool v2.12.0 A. Lauer et al. 10.5194/gmd-18-1169-2025
- Can we trust CMIP5/6 future projections of European winter precipitation? E. Moreno-Chamarro et al. 10.1088/1748-9326/abf28a
- Technology to aid the analysis of large-volume multi-institute climate model output at a central analysis facility (PRIMAVERA Data Management Tool V2.10) J. Seddon et al. 10.5194/gmd-16-6689-2023
- Earth System Model Evaluation Tool (ESMValTool) v2.0 – an extended set of large-scale diagnostics for quasi-operational and comprehensive evaluation of Earth system models in CMIP V. Eyring et al. 10.5194/gmd-13-3383-2020
- Machine learning of cloud types in satellite observations and climate models P. Kuma et al. 10.5194/acp-23-523-2023
Latest update: 29 May 2025
Download
- Article
(512 KB) - Full-text XML
Short summary
This paper describes the second major release of ESMValTool, a community diagnostic and performance metrics tool for the evaluation of Earth system models. This new version features a brand new design, with an improved interface and a revised preprocessor. It takes advantage of state-of-the-art computational libraries and methods to deploy efficient and user-friendly data processing, improving the performance over its predecessor by more than a factor of 30.
This paper describes the second major release of ESMValTool, a community diagnostic and...
