Articles | Volume 8, issue 9
Development and technical paper
09 Sep 2015
Development and technical paper |  | 09 Sep 2015

A new ensemble-based consistency test for the Community Earth System Model (pyCECT v1.0)

A. H. Baker, D. M. Hammerling, M. N. Levy, H. Xu, J. M. Dennis, B. E. Eaton, J. Edwards, C. Hannay, S. A. Mickelson, R. B. Neale, D. Nychka, J. Shollenberger, J. Tribbia, M. Vertenstein, and D. Williamson

Related authors

Optimizing high-resolution Community Earth System Model on a heterogeneous many-core supercomputing platform
Shaoqing Zhang, Haohuan Fu, Lixin Wu, Yuxuan Li, Hong Wang, Yunhui Zeng, Xiaohui Duan, Wubing Wan, Li Wang, Yuan Zhuang, Hongsong Meng, Kai Xu, Ping Xu, Lin Gan, Zhao Liu, Sihai Wu, Yuhu Chen, Haining Yu, Shupeng Shi, Lanning Wang, Shiming Xu, Wei Xue, Weiguo Liu, Qiang Guo, Jie Zhang, Guanghui Zhu, Yang Tu, Jim Edwards, Allison Baker, Jianlin Yong, Man Yuan, Yangyang Yu, Qiuying Zhang, Zedong Liu, Mingkui Li, Dongning Jia, Guangwen Yang, Zhiqiang Wei, Jingshan Pan, Ping Chang, Gokhan Danabasoglu, Stephen Yeager, Nan Rosenbloom, and Ying Guo
Geosci. Model Dev., 13, 4809–4829,,, 2020
Short summary
Nine time steps: ultra-fast statistical consistency testing of the Community Earth System Model (pyCECT v3.0)
Daniel J. Milroy, Allison H. Baker, Dorit M. Hammerling, and Elizabeth R. Jessup
Geosci. Model Dev., 11, 697–711,,, 2018
Short summary
Evaluating lossy data compression on climate simulation data within a large ensemble
Allison H. Baker, Dorit M. Hammerling, Sheri A. Mickelson, Haiying Xu, Martin B. Stolpe, Phillipe Naveau, Ben Sanderson, Imme Ebert-Uphoff, Savini Samarasinghe, Francesco De Simone, Francesco Carbone, Christian N. Gencarelli, John M. Dennis, Jennifer E. Kay, and Peter Lindstrom
Geosci. Model Dev., 9, 4381–4403,,, 2016
Short summary
P-CSI v1.0, an accelerated barotropic solver for the high-resolution ocean model component in the Community Earth System Model v2.0
Xiaomeng Huang, Qiang Tang, Yuheng Tseng, Yong Hu, Allison H. Baker, Frank O. Bryan, John Dennis, Haohuan Fu, and Guangwen Yang
Geosci. Model Dev., 9, 4209–4225,,, 2016
Short summary
Evaluating statistical consistency in the ocean model component of the Community Earth System Model (pyCECT v2.0)
Allison H. Baker, Yong Hu, Dorit M. Hammerling, Yu-heng Tseng, Haiying Xu, Xiaomeng Huang, Frank O. Bryan, and Guangwen Yang
Geosci. Model Dev., 9, 2391–2406,,, 2016
Short summary

Related subject area

Climate and Earth system modeling
A sub-grid parameterization scheme for topographic vertical motion in CAM5-SE
Yaqi Wang, Lanning Wang, Juan Feng, Zhenya Song, Qizhong Wu, and Huaqiong Cheng
Geosci. Model Dev., 16, 6857–6873,,, 2023
Short summary
Technology to aid the analysis of large-volume multi-institute climate model output at a central analysis facility (PRIMAVERA Data Management Tool V2.10)
Jon Seddon, Ag Stephens, Matthew S. Mizielinski, Pier Luigi Vidale, and Malcolm J. Roberts
Geosci. Model Dev., 16, 6689–6700,,, 2023
Short summary
A diffusion-based kernel density estimator (diffKDE, version 1) with optimal bandwidth approximation for the analysis of data in geoscience and ecological research
Maria-Theresia Pelz, Markus Schartau, Christopher J. Somes, Vanessa Lampe, and Thomas Slawig
Geosci. Model Dev., 16, 6609–6634,,, 2023
Short summary
Monte Carlo drift correction – quantifying the drift uncertainty of global climate models
Benjamin S. Grandey, Zhi Yang Koh, Dhrubajyoti Samanta, Benjamin P. Horton, Justin Dauwels, and Lock Yue Chew
Geosci. Model Dev., 16, 6593–6608,,, 2023
Short summary
Improvements in the Canadian Earth System Model (CanESM) through systematic model analysis: CanESM5.0 and CanESM5.1
Michael Sigmond, James Anstey, Vivek Arora, Ruth Digby, Nathan Gillett, Viatcheslav Kharin, William Merryfield, Catherine Reader, John Scinocca, Neil Swart, John Virgin, Carsten Abraham, Jason Cole, Nicolas Lambert, Woo-Sung Lee, Yongxiao Liang, Elizaveta Malinina, Landon Rieger, Knut von Salzen, Christian Seiler, Clint Seinen, Andrew Shao, Reinel Sospedra-Alfonso, Libo Wang, and Duo Yang
Geosci. Model Dev., 16, 6553–6591,,, 2023
Short summary

Cited articles

Baker, A. H., Xu, H., Dennis, J. M., Levy, M. N., Nychka, D., Mickelson, S. A., Edwards, J., Vertenstein, M., and Wegener, A.: A methodology for evaluating the impact of data compression on climate simulation data, in: Proceedings of the 23rd international symposium on High-Performance Parallel and Distributed Computing, HPDC '14, 203–214, 2014.
Carson II, J. S.: Model verification and validation, in: Proceedings of the 2002 Winter Simulation Conference, 52–58, 2002.
Clune, T. and Rood, R.: Software testing and verification in climate model development, IEEE Softw., 28, 49–55,, 2011.
Dai, A., Meehl, G., Washington, W., Wigley, T., and Arblaster, J. M.: Ensemble simulation of 21st century climate changes: business as usual vs. CO2 stabilization, B. Am. Meteor. Soc., 82, 2377–2388, 2001.
Easterbrook, S. M. and Johns, T. C.: Engineering the software for understanding climate change, Comput. Sci. Eng., 11, 65–74,, 2009.
Short summary
Climate simulation codes are especially complex, and their ongoing state of development requires frequent software quality assurance to both preserve code quality and instil model confidence. To formalize and simplify this previously subjective and expensive process, we have developed a new tool for evaluating climate consistency. The tool has proven its utility in detecting errors in software and hardware environments and providing rapid feedback to model developers.