Articles | Volume 11, issue 2
Development and technical paper
26 Feb 2018
Development and technical paper |  | 26 Feb 2018

Nine time steps: ultra-fast statistical consistency testing of the Community Earth System Model (pyCECT v3.0)

Daniel J. Milroy, Allison H. Baker, Dorit M. Hammerling, and Elizabeth R. Jessup

Related authors

Optimizing high-resolution Community Earth System Model on a heterogeneous many-core supercomputing platform
Shaoqing Zhang, Haohuan Fu, Lixin Wu, Yuxuan Li, Hong Wang, Yunhui Zeng, Xiaohui Duan, Wubing Wan, Li Wang, Yuan Zhuang, Hongsong Meng, Kai Xu, Ping Xu, Lin Gan, Zhao Liu, Sihai Wu, Yuhu Chen, Haining Yu, Shupeng Shi, Lanning Wang, Shiming Xu, Wei Xue, Weiguo Liu, Qiang Guo, Jie Zhang, Guanghui Zhu, Yang Tu, Jim Edwards, Allison Baker, Jianlin Yong, Man Yuan, Yangyang Yu, Qiuying Zhang, Zedong Liu, Mingkui Li, Dongning Jia, Guangwen Yang, Zhiqiang Wei, Jingshan Pan, Ping Chang, Gokhan Danabasoglu, Stephen Yeager, Nan Rosenbloom, and Ying Guo
Geosci. Model Dev., 13, 4809–4829,,, 2020
Short summary
ESD Reviews: Model dependence in multi-model climate ensembles: weighting, sub-selection and out-of-sample testing
Gab Abramowitz, Nadja Herger, Ethan Gutmann, Dorit Hammerling, Reto Knutti, Martin Leduc, Ruth Lorenz, Robert Pincus, and Gavin A. Schmidt
Earth Syst. Dynam., 10, 91–105,,, 2019
Short summary
Evaluating lossy data compression on climate simulation data within a large ensemble
Allison H. Baker, Dorit M. Hammerling, Sheri A. Mickelson, Haiying Xu, Martin B. Stolpe, Phillipe Naveau, Ben Sanderson, Imme Ebert-Uphoff, Savini Samarasinghe, Francesco De Simone, Francesco Carbone, Christian N. Gencarelli, John M. Dennis, Jennifer E. Kay, and Peter Lindstrom
Geosci. Model Dev., 9, 4381–4403,,, 2016
Short summary
P-CSI v1.0, an accelerated barotropic solver for the high-resolution ocean model component in the Community Earth System Model v2.0
Xiaomeng Huang, Qiang Tang, Yuheng Tseng, Yong Hu, Allison H. Baker, Frank O. Bryan, John Dennis, Haohuan Fu, and Guangwen Yang
Geosci. Model Dev., 9, 4209–4225,,, 2016
Short summary
Evaluating statistical consistency in the ocean model component of the Community Earth System Model (pyCECT v2.0)
Allison H. Baker, Yong Hu, Dorit M. Hammerling, Yu-heng Tseng, Haiying Xu, Xiaomeng Huang, Frank O. Bryan, and Guangwen Yang
Geosci. Model Dev., 9, 2391–2406,,, 2016
Short summary

Related subject area

Climate and Earth system modeling
The emergence of the Gulf Stream and interior western boundary as key regions to constrain the future North Atlantic carbon uptake
Nadine Goris, Klaus Johannsen, and Jerry Tjiputra
Geosci. Model Dev., 16, 2095–2117,,, 2023
Short summary
Evaluating wind profiles in a numerical weather prediction model with Doppler lidar
Pyry Pentikäinen, Ewan J. O'Connor, and Pablo Ortiz-Amezcua
Geosci. Model Dev., 16, 2077–2094,,, 2023
Short summary
Evaluation of bias correction methods for a multivariate drought index: case study of the Upper Jhelum Basin
Rubina Ansari, Ana Casanueva, Muhammad Usman Liaqat, and Giovanna Grossi
Geosci. Model Dev., 16, 2055–2076,,, 2023
Short summary
The impact of lateral boundary forcing in the CORDEX-Africa ensemble over southern Africa
Maria Chara Karypidou, Stefan Pieter Sobolowski, Lorenzo Sangelantoni, Grigory Nikulin, and Eleni Katragkou
Geosci. Model Dev., 16, 1887–1908,,, 2023
Short summary
Effects of complex terrain on the shortwave radiative balance: a sub-grid-scale parameterization for the GFDL Earth System Model version 4.1
Enrico Zorzetto, Sergey Malyshev, Nathaniel Chaney, David Paynter, Raymond Menzel, and Elena Shevliakova
Geosci. Model Dev., 16, 1937–1960,,, 2023
Short summary

Cited articles

Anderson, J., Burns, P. J., Milroy, D., Ruprecht, P., Hauser, T., and Siegel, H. J.: Deploying RMACC Summit: An HPC Resource for the Rocky Mountain Region, in: Proceedings of the Practice and Experience in Advanced Research Computing 2017 on Sustainability, Success and Impact, PEARC17, 8:1–8:7, ACM, New York, NY, USA,, 2017. a
Baker, A. H., Hammerling, D. M., Levy, M. N., Xu, H., Dennis, J. M., Eaton, B. E., Edwards, J., Hannay, C., Mickelson, S. A., Neale, R. B., Nychka, D., Shollenberger, J., Tribbia, J., Vertenstein, M., and Williamson, D.: A new ensemble-based consistency test for the Community Earth System Model (pyCECT v1.0), Geosci. Model Dev., 8, 2829–2840,, 2015. a, b, c, d, e, f, g, h, i, j, k, l, m, n, o, p, q, r, s, t, u
Baker, A. H., Hu, Y., Hammerling, D. M., Tseng, Y.-H., Xu, H., Huang, X., Bryan, F. O., and Yang, G.: Evaluating statistical consistency in the ocean model component of the Community Earth System Model (pyCECT v2.0), Geosci. Model Dev., 9, 2391–2406,, 2016.  a
Branstator, G. and Teng, H.: Two Limits of Initial-Value Decadal Predictability in a CGCM, J. Climate, 23, 6292–6311,, 2010. a, b
Deser, C., Phillips, A., Bourdette, V., and Teng, H.: Uncertainty in climate change projections: the role of internal variability, Clim. Dynam., 38, 527–546,, 2012. a
Short summary
The Community Earth System Model Ensemble Consistency Test (CESM-ECT) suite was developed as an alternative to requiring bitwise identical output for quality assurance. We extend the CESM-ECT suite with an inexpensive and robust test for ensemble consistency that is applied to Community Atmospheric Model output after only nine model time steps. The new ultra-fast test facilitates CESM development, porting, and optimization efforts, and complements the original suite of tools.