Articles | Volume 10, issue 1
https://doi.org/10.5194/gmd-10-19-2017
© Author(s) 2017. This work is distributed under
the Creative Commons Attribution 3.0 License.
the Creative Commons Attribution 3.0 License.
https://doi.org/10.5194/gmd-10-19-2017
© Author(s) 2017. This work is distributed under
the Creative Commons Attribution 3.0 License.
the Creative Commons Attribution 3.0 License.
Methods for assessment of models
| 
02 Jan 2017
Methods for assessment of models |
| 02 Jan 2017
CPMIP: measurements of real computational performance of Earth system models in CMIP6
Princeton University, Cooperative Institute of Climate Science,
Princeton, NJ, USA
NOAA/Geophysical Fluid Dynamics Laboratory, Princeton, NJ, USA
Eric Maisonnave
Centre Européen de Recherche Avancée en
Calcul Scientifique (CERFACS), Toulouse, France
Niki Zadeh
Engility Inc., Dover, NJ, USA
NOAA/Geophysical Fluid Dynamics Laboratory, Princeton, NJ, USA
Bryan N. Lawrence
National Centre for Atmospheric Science and University of Reading, Reading, UK
Science and Technology Facilities Council, Abingdon, UK
Joachim Biercamp
Deutsches Klimarechenzentrum GmbH, Hamburg, Germany
Uwe Fladrich
Swedish Meteorological and Hydrological Institute, Norrköping, Sweden
Giovanni Aloisio
Centro Euro-Mediterraneo sui Cambiamenti Climatici (CMCC) Foundation, Lecce, Italy
University of Salento, Lecce, Italy
Rusty Benson
NOAA/Geophysical Fluid Dynamics Laboratory, Princeton, NJ, USA
Arnaud Caubel
Laboratoire des Sciences du Climat et de
l'Environnement LSCE/IPSL, CEA-CNRS-UVSQ, Université Paris-Saclay, 91191
Gif-sur-Yvette CEDEX, France
Jeffrey Durachta
Engility Inc., Dover, NJ, USA
NOAA/Geophysical Fluid Dynamics Laboratory, Princeton, NJ, USA
Marie-Alice Foujols
Institut Pierre-Simon Laplace, CNRS/UPMC, Paris, France
Grenville Lister
Science and Technology Facilities Council, Abingdon, UK
Silvia Mocavero
Centro Euro-Mediterraneo sui Cambiamenti Climatici (CMCC) Foundation, Lecce, Italy
Seth Underwood
Engility Inc., Dover, NJ, USA
NOAA/Geophysical Fluid Dynamics Laboratory, Princeton, NJ, USA
Garrett Wright
Engility Inc., Dover, NJ, USA
NOAA/Geophysical Fluid Dynamics Laboratory, Princeton, NJ, USA
Viewed
Total article views: 7,029 (including HTML, PDF, and XML)
Cumulative views and downloads
(calculated since 24 Aug 2016)
| HTML | XML | Total | BibTeX | EndNote | |
|---|---|---|---|---|---|
| 4,517 | 2,279 | 233 | 7,029 | 299 | 273 |
- HTML: 4,517
- PDF: 2,279
- XML: 233
- Total: 7,029
- BibTeX: 299
- EndNote: 273
Total article views: 6,414 (including HTML, PDF, and XML)
Cumulative views and downloads
(calculated since 02 Jan 2017)
| HTML | XML | Total | BibTeX | EndNote | |
|---|---|---|---|---|---|
| 4,173 | 2,010 | 231 | 6,414 | 297 | 272 |
- HTML: 4,173
- PDF: 2,010
- XML: 231
- Total: 6,414
- BibTeX: 297
- EndNote: 272
Total article views: 615 (including HTML, PDF, and XML)
Cumulative views and downloads
(calculated since 24 Aug 2016)
| HTML | XML | Total | BibTeX | EndNote | |
|---|---|---|---|---|---|
| 344 | 269 | 2 | 615 | 2 | 1 |
- HTML: 344
- PDF: 269
- XML: 2
- Total: 615
- BibTeX: 2
- EndNote: 1
Viewed (geographical distribution)
Total article views: 7,029 (including HTML, PDF, and XML)
Thereof 6,524 with geography defined
and 505 with unknown origin.
Total article views: 6,414 (including HTML, PDF, and XML)
Thereof 5,923 with geography defined
and 491 with unknown origin.
Total article views: 615 (including HTML, PDF, and XML)
Thereof 601 with geography defined
and 14 with unknown origin.
| Country | # | Views | % |
|---|
| Country | # | Views | % |
|---|
| Country | # | Views | % |
|---|
| Total: | 0 |
| HTML: | 0 |
| PDF: | 0 |
| XML: | 0 |
- 1
1
| Total: | 0 |
| HTML: | 0 |
| PDF: | 0 |
| XML: | 0 |
- 1
1
| Total: | 0 |
| HTML: | 0 |
| PDF: | 0 |
| XML: | 0 |
- 1
1
Cited
34 citations as recorded by crossref.
- Robustness of Competing Climatic States C. Ragon et al. 10.1175/JCLI-D-21-0148.1
- Are general circulation models obsolete? V. Balaji et al. 10.1073/pnas.2202075119
- The GFDL Global Ocean and Sea Ice Model OM4.0: Model Description and Simulation Features A. Adcroft et al. 10.1029/2019MS001726
- AWI-CM3 coupled climate model: description and evaluation experiments for a prototype post-CMIP6 model J. Streffing et al. 10.5194/gmd-15-6399-2022
- A New Number Format for Ensemble Simulations P. Düben 10.1029/2018MS001420
- Scalability and some optimization of the Finite-volumE Sea ice–Ocean Model, Version 2.0 (FESOM2) N. Koldunov et al. 10.5194/gmd-12-3991-2019
- Compact Modeling Framework v3.0 for high-resolution global ocean–ice–atmosphere models V. Kalmykov et al. 10.5194/gmd-11-3983-2018
- The computational and energy cost of simulation and storage for climate science: lessons from CMIP6 M. Acosta et al. 10.5194/gmd-17-3081-2024
- Optimizing domain decomposition in an ocean model: the case of NEMO O. Tintó et al. 10.1016/j.procs.2017.05.257
- « Science des données » versus science physique : la technologie des données nous conduit-elle vers une nouvelle synthèse ? V. Balaji 10.5802/crgeos.24
- EC-Earth3-AerChem: a global climate model with interactive aerosols and atmospheric chemistry participating in CMIP6 T. van Noije et al. 10.5194/gmd-14-5637-2021
- Balancing EC‐Earth3 Improving the Performance of EC‐Earth CMIP6 Configurations by Minimizing the Coupling Cost M. Acosta et al. 10.1029/2023EA002912
- Non-local discretization of the isoneutral diffusion operator in a terrain-following climate ocean model D. Blagodatskikh et al. 10.1515/rnam-2023-0026
- The digital revolution of Earth-system science P. Bauer et al. 10.1038/s43588-021-00023-0
- Autosubmit GUI: A Javascript-based Graphical User Interface to Monitor Experiments Workflow Execution W. Uruchi et al. 10.21105/joss.03049
- Coupling framework (1.0) for the PISM (1.1.4) ice sheet model and the MOM5 (5.1.0) ocean model via the PICO ice shelf cavity model in an Antarctic domain M. Kreuzer et al. 10.5194/gmd-14-3697-2021
- Requirements for a global data infrastructure in support of CMIP6 V. Balaji et al. 10.5194/gmd-11-3659-2018
- ACCESS datasets for CMIP6: methodology and idealised experiments C. Mackallah et al. 10.1071/ES21031
- Climbing down Charney’s ladder: machine learning and the post-Dennard era of computational climate science V. Balaji 10.1098/rsta.2020.0085
- The GFDL Global Atmosphere and Land Model AM4.0/LM4.0: 2. Model Description, Sensitivity Studies, and Tuning Strategies M. Zhao et al. 10.1002/2017MS001209
- Global Observations and CMIP6 Simulations of Compound Extremes of Monthly Temperature and Precipitation Y. Wu et al. 10.1029/2021GH000390
- IPSL-CM5A2 – an Earth system model designed for multi-millennial climate simulations P. Sepulchre et al. 10.5194/gmd-13-3011-2020
- Crossing the chasm: how to develop weather and climate models for next generation computers? B. Lawrence et al. 10.5194/gmd-11-1799-2018
- The GPU version of LASG/IAP Climate System Ocean Model version 3 (LICOM3) under the heterogeneous-compute interface for portability (HIP) framework and its large-scale application P. Wang et al. 10.5194/gmd-14-2781-2021
- Near-global climate simulation at 1 km resolution: establishing a performance baseline on 4888 GPUs with COSMO 5.0 O. Fuhrer et al. 10.5194/gmd-11-1665-2018
- On Equilibrium Fluctuations J. von Storch 10.16993/tellusa.25
- “Data science” versus physical science: is data technology leading us towards a new synthesis? R. Dziegielinski 10.5802/crgeos.24-en
- LIVVkit: An extensible, python‐based, land ice verification and validation toolkit for ice sheet models J. Kennedy et al. 10.1002/2017MS000916
- The EC-Earth3 Earth system model for the Coupled Model Intercomparison Project 6 R. Döscher et al. 10.5194/gmd-15-2973-2022
- Breaking Down the Computational Barriers to Real‐Time Urban Flood Forecasting V. Ivanov et al. 10.1029/2021GL093585
- The COSMO-CLM 4.8 regional climate model coupled to regional ocean, land surface and global earth system models using OASIS3-MCT: description and performance A. Will et al. 10.5194/gmd-10-1549-2017
- Bridging observations, theory and numerical simulation of the ocean using machine learning M. Sonnewald et al. 10.1088/1748-9326/ac0eb0
- CICERO Simple Climate Model (CICERO-SCM v1.1.1) – an improved simple climate model with a parameter calibration tool M. Sandstad et al. 10.5194/gmd-17-6589-2024
- Coarse-grained component concurrency in Earth system modeling: parallelizing atmospheric radiative transfer in the GFDL AM3 model using the Flexible Modeling System coupling framework V. Balaji et al. 10.5194/gmd-9-3605-2016
33 citations as recorded by crossref.
- Robustness of Competing Climatic States C. Ragon et al. 10.1175/JCLI-D-21-0148.1
- Are general circulation models obsolete? V. Balaji et al. 10.1073/pnas.2202075119
- The GFDL Global Ocean and Sea Ice Model OM4.0: Model Description and Simulation Features A. Adcroft et al. 10.1029/2019MS001726
- AWI-CM3 coupled climate model: description and evaluation experiments for a prototype post-CMIP6 model J. Streffing et al. 10.5194/gmd-15-6399-2022
- A New Number Format for Ensemble Simulations P. Düben 10.1029/2018MS001420
- Scalability and some optimization of the Finite-volumE Sea ice–Ocean Model, Version 2.0 (FESOM2) N. Koldunov et al. 10.5194/gmd-12-3991-2019
- Compact Modeling Framework v3.0 for high-resolution global ocean–ice–atmosphere models V. Kalmykov et al. 10.5194/gmd-11-3983-2018
- The computational and energy cost of simulation and storage for climate science: lessons from CMIP6 M. Acosta et al. 10.5194/gmd-17-3081-2024
- Optimizing domain decomposition in an ocean model: the case of NEMO O. Tintó et al. 10.1016/j.procs.2017.05.257
- « Science des données » versus science physique : la technologie des données nous conduit-elle vers une nouvelle synthèse ? V. Balaji 10.5802/crgeos.24
- EC-Earth3-AerChem: a global climate model with interactive aerosols and atmospheric chemistry participating in CMIP6 T. van Noije et al. 10.5194/gmd-14-5637-2021
- Balancing EC‐Earth3 Improving the Performance of EC‐Earth CMIP6 Configurations by Minimizing the Coupling Cost M. Acosta et al. 10.1029/2023EA002912
- Non-local discretization of the isoneutral diffusion operator in a terrain-following climate ocean model D. Blagodatskikh et al. 10.1515/rnam-2023-0026
- The digital revolution of Earth-system science P. Bauer et al. 10.1038/s43588-021-00023-0
- Autosubmit GUI: A Javascript-based Graphical User Interface to Monitor Experiments Workflow Execution W. Uruchi et al. 10.21105/joss.03049
- Coupling framework (1.0) for the PISM (1.1.4) ice sheet model and the MOM5 (5.1.0) ocean model via the PICO ice shelf cavity model in an Antarctic domain M. Kreuzer et al. 10.5194/gmd-14-3697-2021
- Requirements for a global data infrastructure in support of CMIP6 V. Balaji et al. 10.5194/gmd-11-3659-2018
- ACCESS datasets for CMIP6: methodology and idealised experiments C. Mackallah et al. 10.1071/ES21031
- Climbing down Charney’s ladder: machine learning and the post-Dennard era of computational climate science V. Balaji 10.1098/rsta.2020.0085
- The GFDL Global Atmosphere and Land Model AM4.0/LM4.0: 2. Model Description, Sensitivity Studies, and Tuning Strategies M. Zhao et al. 10.1002/2017MS001209
- Global Observations and CMIP6 Simulations of Compound Extremes of Monthly Temperature and Precipitation Y. Wu et al. 10.1029/2021GH000390
- IPSL-CM5A2 – an Earth system model designed for multi-millennial climate simulations P. Sepulchre et al. 10.5194/gmd-13-3011-2020
- Crossing the chasm: how to develop weather and climate models for next generation computers? B. Lawrence et al. 10.5194/gmd-11-1799-2018
- The GPU version of LASG/IAP Climate System Ocean Model version 3 (LICOM3) under the heterogeneous-compute interface for portability (HIP) framework and its large-scale application P. Wang et al. 10.5194/gmd-14-2781-2021
- Near-global climate simulation at 1 km resolution: establishing a performance baseline on 4888 GPUs with COSMO 5.0 O. Fuhrer et al. 10.5194/gmd-11-1665-2018
- On Equilibrium Fluctuations J. von Storch 10.16993/tellusa.25
- “Data science” versus physical science: is data technology leading us towards a new synthesis? R. Dziegielinski 10.5802/crgeos.24-en
- LIVVkit: An extensible, python‐based, land ice verification and validation toolkit for ice sheet models J. Kennedy et al. 10.1002/2017MS000916
- The EC-Earth3 Earth system model for the Coupled Model Intercomparison Project 6 R. Döscher et al. 10.5194/gmd-15-2973-2022
- Breaking Down the Computational Barriers to Real‐Time Urban Flood Forecasting V. Ivanov et al. 10.1029/2021GL093585
- The COSMO-CLM 4.8 regional climate model coupled to regional ocean, land surface and global earth system models using OASIS3-MCT: description and performance A. Will et al. 10.5194/gmd-10-1549-2017
- Bridging observations, theory and numerical simulation of the ocean using machine learning M. Sonnewald et al. 10.1088/1748-9326/ac0eb0
- CICERO Simple Climate Model (CICERO-SCM v1.1.1) – an improved simple climate model with a parameter calibration tool M. Sandstad et al. 10.5194/gmd-17-6589-2024
Discussed (preprint)
Latest update: 15 Nov 2024
Short summary
Climate models are among the most computationally expensive scientific applications in the world. We present a set of measures of computational performance that can be used to compare models that are independent of underlying hardware and the model formulation. They are easy to collect and reflect performance actually achieved in practice. We are preparing a systematic effort to collect these metrics for the world's climate models during CMIP6, the next Climate Model Intercomparison Project.
Climate models are among the most computationally expensive scientific applications in the...
