Articles | Volume 18, issue 8
https://doi.org/10.5194/gmd-18-2349-2025
https://doi.org/10.5194/gmd-18-2349-2025
Development and technical paper
 | 
22 Apr 2025
Development and technical paper |  | 22 Apr 2025

The ensemble consistency test: from CESM to MPAS and beyond

Teo Price-Broncucia, Allison Baker, Dorit Hammerling, Michael Duda, and Rebecca Morrison

Related authors

Incremental analysis update (IAU) in the Model for Prediction Across Scales coupled with the Joint Effort for Data assimilation Integration (MPAS–JEDI 2.0.0)
Soyoung Ha, Jonathan J. Guerrette, Ivette Hernández Baños, William C. Skamarock, and Michael G. Duda
Geosci. Model Dev., 17, 4199–4211, https://doi.org/10.5194/gmd-17-4199-2024,https://doi.org/10.5194/gmd-17-4199-2024, 2024
Short summary
Advancing precipitation prediction using a new-generation storm-resolving model framework – SIMA-MPAS (V1.0): a case study over the western United States
Xingying Huang, Andrew Gettelman, William C. Skamarock, Peter Hjort Lauritzen, Miles Curry, Adam Herrington, John T. Truesdale, and Michael Duda
Geosci. Model Dev., 15, 8135–8151, https://doi.org/10.5194/gmd-15-8135-2022,https://doi.org/10.5194/gmd-15-8135-2022, 2022
Short summary
Optimizing high-resolution Community Earth System Model on a heterogeneous many-core supercomputing platform
Shaoqing Zhang, Haohuan Fu, Lixin Wu, Yuxuan Li, Hong Wang, Yunhui Zeng, Xiaohui Duan, Wubing Wan, Li Wang, Yuan Zhuang, Hongsong Meng, Kai Xu, Ping Xu, Lin Gan, Zhao Liu, Sihai Wu, Yuhu Chen, Haining Yu, Shupeng Shi, Lanning Wang, Shiming Xu, Wei Xue, Weiguo Liu, Qiang Guo, Jie Zhang, Guanghui Zhu, Yang Tu, Jim Edwards, Allison Baker, Jianlin Yong, Man Yuan, Yangyang Yu, Qiuying Zhang, Zedong Liu, Mingkui Li, Dongning Jia, Guangwen Yang, Zhiqiang Wei, Jingshan Pan, Ping Chang, Gokhan Danabasoglu, Stephen Yeager, Nan Rosenbloom, and Ying Guo
Geosci. Model Dev., 13, 4809–4829, https://doi.org/10.5194/gmd-13-4809-2020,https://doi.org/10.5194/gmd-13-4809-2020, 2020
Short summary

Cited articles

Ahn, D. H., Baker, A. H., Bentley, M., Briggs, I., Gopalakrishnan, G., Hammerling, D. M., Laguna, I., Lee, G. L., Milroy, D. J., and Vertenstein, M.: Keeping science on keel when software moves, Commun. ACM, 64, 66–74, https://doi.org/10.1145/3382037, 2021. a, b, c
Baker, A. H., Hammerling, D. M., Levy, M. N., Xu, H., Dennis, J. M., Eaton, B. E., Edwards, J., Hannay, C., Mickelson, S. A., Neale, R. B., Nychka, D., Shollenberger, J., Tribbia, J., Vertenstein, M., and Williamson, D.: A new ensemble-based consistency test for the Community Earth System Model (pyCECT v1.0), Geosci. Model Dev., 8, 2829–2840, https://doi.org/10.5194/gmd-8-2829-2015, 2015. a, b, c, d, e
Baker, A. H., Hu, Y., Hammerling, D. M., Tseng, Y.-H., Xu, H., Huang, X., Bryan, F. O., and Yang, G.: Evaluating statistical consistency in the ocean model component of the Community Earth System Model (pyCECT v2.0), Geosci. Model Dev., 9, 2391–2406, https://doi.org/10.5194/gmd-9-2391-2016, 2016. a
Baker, A., Price-Broncucia, T., Xu, H., Milroy, D., and Johnson, B.: pyCECT: Tools to support and run the CESM Ensemble Consistency Test, Zenodo [code and data set] https://doi.org/10.5281/zenodo.11662747, 2024. 
Charney, J. G., Fjörtoft, R., and Von Neumann, J.: Numerical Integration of the Barotropic Vorticity Equation, Tellus, 2, 237–254, https://doi.org/10.1111/j.2153-3490.1950.tb00336.x, 1950. a
Download
Short summary
The ensemble consistency test (ECT) and its ultrafast variant (UF-ECT) have become powerful tools in the development community for the identification of unwanted changes in the Community Earth System Model (CESM). We develop a generalized setup framework to enable easy adoption of the ECT approach for other model developers and communities. This framework specifies test parameters to accurately characterize model variability and balance test sensitivity and computational cost.
Share