A new end-to-end workflow for the Community Earth System Model (version 2.0) for the Coupled Model Intercomparison Project Phase 6 (CMIP6)

Mickelson, Sheri; Bertini, Alice; Strand, Gary; Paul, Kevin; Nienhouse, Eric; Dennis, John; Vertenstein, Mariana

doi:https://doi.org/10.5194/gmd-13-5567-2020

Articles | Volume 13, issue 11

https://doi.org/10.5194/gmd-13-5567-2020

© Author(s) 2020. This work is distributed under
the Creative Commons Attribution 4.0 License.

https://doi.org/10.5194/gmd-13-5567-2020

© Author(s) 2020. This work is distributed under
the Creative Commons Attribution 4.0 License.

Articles | Volume 13, issue 11

Development and technical paper

|

13 Nov 2020

Development and technical paper |

| 13 Nov 2020

A new end-to-end workflow for the Community Earth System Model (version 2.0) for the Coupled Model Intercomparison Project Phase 6 (CMIP6)

Sheri Mickelson, Alice Bertini, Gary Strand, Kevin Paul, Eric Nienhouse, John Dennis, and Mariana Vertenstein

Model code and software

PyReshaper Kevin Paul, Sheri Mickelson, John Dennis, and Haiying Xu https://doi.org/10.5281/zenodo.3894842

pyAverager Sheri Mickelson, Kevin Paul, and John Dennis https://doi.org/10.5281/zenodo.3894862

PyConform Kevin Paul, Sheri Mickelson, and John Dennis https://doi.org/10.5281/zenodo.3895009

CESM Postprocessing Alice Bertini and Sheri Mickelson, https://doi.org/10.5281/zenodo.3895033

CESM Workflow Sheri Mickelson https://doi.org/10.5281/zenodo.3895058

CESM-release-cesm2.1.0 G. Danabasoglu, J. F. Lamarque, J. Bachmeister, D. A. Bailey, A. K. DuVivier, J. Edwards, L. K. Emmons, J. Fasullo, R. Garcia, A. Gettelman, C. Hannay, M. M. Holland, W. G. Large, D. M. Lawrence, J. T. M. Lenaerts, K. Lindsay, W. H. Lipscomb, M. J. Mills, R. Neale, K. W. Oleson, B. Otto-Bliesner, A. S. Phillips, W. Sacks, S. Tilmes, L. van Kampenhout, M. Vertenstein, A. Bertini, J. Dennis, C. Deser, C. Fischer, B. Fox-Kember, J. E. Kay, D. Kinnison, P. J. Kushner, M. C. Long, S. Mickelson, J. K. Moore, E. Nienhouse, L. Polvani, P. J. Rasch, and W. G. Strand https://doi.org/10.5281/zenodo.3895306

CESM-release-cesm2.1.1 G. Danabasoglu, J. F. Lamarque, J. Bachmeister, D. A. Bailey, A. K. DuVivier, J. Edwards, L. K. Emmons, J. Fasullo, R. Garcia, A. Gettelman, C. Hannay, M. M. Holland, W. G. Large, D. M. Lawrence, J. T. M. Lenaerts, K. Lindsay, W. H. Lipscomb, M. J. Mills, R. Neale, K. W. Oleson, B. Otto-Bliesner, A. S. Phillips, W. Sacks, S. Tilmes, L. van Kampenhout, M. Vertenstein, A. Bertini, J. Dennis, C. Deser, C. Fischer, B. Fox-Kember, J. E. Kay, D. Kinnison, P. J. Kushner, M. C. Long, S. Mickelson, J. K. Moore, E. Nienhouse, L. Polvani, P. J. Rasch, and W. G. Strand https://doi.org/10.5281/zenodo.3895315

CESM-release-cesm2.1.2 G. Danabasoglu, J. F. Lamarque, J. Bachmeister, D. A. Bailey, A. K. DuVivier, J. Edwards, L. K. Emmons, J. Fasullo, R. Garcia, A. Gettelman, C. Hannay, M. M. Holland, W. G. Large, D. M. Lawrence, J. T. M. Lenaerts, K. Lindsay, W. H. Lipscomb, M. J. Mills, R. Neale, K. W. Oleson, B. Otto-Bliesner, A. S. Phillips, W. Sacks, S. Tilmes, L. van Kampenhout, M. Vertenstein, A. Bertini, J. Dennis, C. Deser, C. Fischer, B. Fox-Kember, J. E. Kay, D. Kinnison, P. J. Kushner, M. C. Long, S. Mickelson, J. K. Moore, E. Nienhouse, L. Polvani, P. J. Rasch, and W. G. Strand https://doi.org/10.5281/zenodo.3895328

cylc/cylc-flow: cylc-7.8.3 Hilary James Oliver, Matt Shin, Ben Fitzpatrick, Andrew Clark, Oliver Sanders, Bruno P. Kinoshita, Sadie L. Bartholomew, Declan Valters, challurip, Tomek Trzeciak, David Matthews, Scott Wales, David Sutherland, wxtim, lhuggett, Jonny Williams, Rosalyn Hatcher, Annette Osprey, Alex Reinecke, Martin Dix, Kevin Pulo, and Andrew https://doi.org/10.5281/zenodo.3243691

Short summary

Every generation of MIP exercises introduces new layers of complexity and an exponential growth in the amount of data requested. CMIP6 required us to develop a new tool chain and forced us to change our methodologies. The new methods discussed in this paper provided us with an 18 times faster speedup over our existing methods. This allowed us to meet our deadlines and we were able to publish more than half a million data sets on the Earth System Grid Federation (ESGF) for the CMIP6 project.