Articles | Volume 10, issue 2
Methods for assessment of models
03 Feb 2017
Methods for assessment of models |  | 03 Feb 2017

A new and inexpensive non-bit-for-bit solution reproducibility test based on time step convergence (TSC1.0)

Hui Wan, Kai Zhang, Philip J. Rasch, Balwinder Singh, Xingyuan Chen, and Jim Edwards

Related authors

Further improvement and evaluation of nudging in the E3SM Atmosphere Model version 1 (EAMv1): simulations of the mean climate, weather events, and anthropogenic aerosol effects
Shixuan Zhang, Kai Zhang, Hui Wan, and Jian Sun
Geosci. Model Dev., 15, 6787–6816,,, 2022
Short summary
Effective radiative forcing of anthropogenic aerosols in E3SM version 1: historical changes, causality, decomposition, and parameterization sensitivities
Kai Zhang, Wentao Zhang, Hui Wan, Philip J. Rasch, Steven J. Ghan, Richard C. Easter, Xiangjun Shi, Yong Wang, Hailong Wang, Po-Lun Ma, Shixuan Zhang, Jian Sun, Susannah M. Burrows, Manish Shrivastava, Balwinder Singh, Yun Qian, Xiaohong Liu, Jean-Christophe Golaz, Qi Tang, Xue Zheng, Shaocheng Xie, Wuyin Lin, Yan Feng, Minghuai Wang, Jin-Ho Yoon, and L. Ruby Leung
Atmos. Chem. Phys., 22, 9129–9160,,, 2022
Short summary
CondiDiag1.0: a flexible online diagnostic tool for conditional sampling and budget analysis in the E3SM atmosphere model (EAM)
Hui Wan, Kai Zhang, Philip J. Rasch, Vincent E. Larson, Xubin Zeng, Shixuan Zhang, and Ross Dixon
Geosci. Model Dev., 15, 3205–3231,,, 2022
Short summary
Better calibration of cloud parameterizations and subgrid effects increases the fidelity of the E3SM Atmosphere Model version 1
Po-Lun Ma, Bryce E. Harrop, Vincent E. Larson, Richard B. Neale, Andrew Gettelman, Hugh Morrison, Hailong Wang, Kai Zhang, Stephen A. Klein, Mark D. Zelinka, Yuying Zhang, Yun Qian, Jin-Ho Yoon, Christopher R. Jones, Meng Huang, Sheng-Lun Tai, Balwinder Singh, Peter A. Bogenschutz, Xue Zheng, Wuyin Lin, Johannes Quaas, Hélène Chepfer, Michael A. Brunke, Xubin Zeng, Johannes Mülmenstädt, Samson Hagos, Zhibo Zhang, Hua Song, Xiaohong Liu, Michael S. Pritchard, Hui Wan, Jingyu Wang, Qi Tang, Peter M. Caldwell, Jiwen Fan, Larry K. Berg, Jerome D. Fast, Mark A. Taylor, Jean-Christophe Golaz, Shaocheng Xie, Philip J. Rasch, and L. Ruby Leung
Geosci. Model Dev., 15, 2881–2916,,, 2022
Short summary
Quantifying and attributing time step sensitivities in present-day climate simulations conducted with EAMv1
Hui Wan, Shixuan Zhang, Philip J. Rasch, Vincent E. Larson, Xubin Zeng, and Huiping Yan
Geosci. Model Dev., 14, 1921–1948,,, 2021
Short summary

Related subject area

Climate and Earth system modeling
Implementation of a machine-learned gas optics parameterization in the ECMWF Integrated Forecasting System: RRTMGP-NN 2.0
Peter Ukkonen and Robin J. Hogan
Geosci. Model Dev., 16, 3241–3261,,, 2023
Short summary
Differentiable programming for Earth system modeling
Maximilian Gelbrecht, Alistair White, Sebastian Bathiany, and Niklas Boers
Geosci. Model Dev., 16, 3123–3135,,, 2023
Short summary
Evaluation of CMIP6 model performances in simulating fire weather spatiotemporal variability on global and regional scales
Carolina Gallo, Jonathan M. Eden, Bastien Dieppois, Igor Drobyshev, Peter Z. Fulé, Jesús San-Miguel-Ayanz, and Matthew Blackett
Geosci. Model Dev., 16, 3103–3122,,, 2023
Short summary
Data-driven aeolian dust emission scheme for climate modelling evaluated with EMAC 2.55.2
Klaus Klingmüller and Jos Lelieveld
Geosci. Model Dev., 16, 3013–3028,,, 2023
Short summary
Testing the reconstruction of modelled particulate organic carbon from surface ecosystem components using PlankTOM12 and machine learning
Anna Denvil-Sommer, Erik T. Buitenhuis, Rainer Kiko, Fabien Lombard, Lionel Guidi, and Corinne Le Quéré
Geosci. Model Dev., 16, 2995–3012,,, 2023
Short summary

Cited articles

Baker, A. H., Hammerling, D. M., Levy, M. N., Xu, H., Dennis, J. M., Eaton, B. E., Edwards, J., Hannay, C., Mickelson, S. A., Neale, R. B., Nychka, D., Shollenberger, J., Tribbia, J., Vertenstein, M., and Williamson, D.: A new ensemble-based consistency test for the Community Earth System Model (pyCECT v1.0), Geosci. Model Dev., 8, 2829–2840,, 2015.
Baker, A. H., Hu, Y., Hammerling, D. M., Tseng, Y.-H., Xu, H., Huang, X., Bryan, F. O., and Yang, G.: Evaluating statistical consistency in the ocean model component of the Community Earth System Model (pyCECT v2.0), Geosci. Model Dev., 9, 2391–2406,, 2016.
Bodas-Salcedo, A., Webb, M. J., Bony, S., Chepfer, H., Dufresne, J.-L., Klein, S. A., Zhang, Y., Marchand, R., Haynes, J. M., Pincus, R., and John, V. O.: COSP: Satellite simulation software for model assessment, B. Am. Meteorol. Soc., 92, 1023–1043,, 2011.
Dennis, J. M., Edwards, J., Evans, K. J., Guba, O., Lauritzen, P. H., Mirin, A. A., St-Cyr, A., Taylor, M. A., and Worley, P. H.: CAM-SE: A scalable spectral element dynamical core for the Community Atmosphere Model, Int. J. High Perform. C., 26, 74–89,, 2012.
Ghan, S. J., Liu, X., Easter, R. C., Zaveri, R., Rasch, P. J., Yoon, J.-H., and Eaton, B.: Toward a Minimal Representation of Aerosols in Climate Models: Comparative Decomposition of Aerosol Direct, Semidirect, and Indirect Radiative Forcing, J. Climate, 25, 6461–6476,, 2012.
Short summary
Solution reproductibility testing is an important task for assuring the software quality of a climate model. A new method is developed using the concept of numerical convergence with respect to temporal resolution. The method is objective, easy to implement, and computationally efficient. This paper describes the new test and demonstrates its utility in the Community Atmosphere Model version 5 (CAM5).