Articles | Volume 10, issue 2
https://doi.org/10.5194/gmd-10-537-2017
© Author(s) 2017. This work is distributed under
the Creative Commons Attribution 3.0 License.
the Creative Commons Attribution 3.0 License.
https://doi.org/10.5194/gmd-10-537-2017
© Author(s) 2017. This work is distributed under
the Creative Commons Attribution 3.0 License.
the Creative Commons Attribution 3.0 License.
A new and inexpensive non-bit-for-bit solution reproducibility test based on time step convergence (TSC1.0)
Atmospheric Sciences and Global Change Division, Pacific Northwest National Laboratory, Richland, WA, USA
Kai Zhang
Atmospheric Sciences and Global Change Division, Pacific Northwest National Laboratory, Richland, WA, USA
Philip J. Rasch
Atmospheric Sciences and Global Change Division, Pacific Northwest National Laboratory, Richland, WA, USA
Balwinder Singh
Atmospheric Sciences and Global Change Division, Pacific Northwest National Laboratory, Richland, WA, USA
Xingyuan Chen
Atmospheric Sciences and Global Change Division, Pacific Northwest National Laboratory, Richland, WA, USA
Jim Edwards
Climate and Global Dynamics Laboratory, National Center for Atmospheric Research, Boulder, CO, USA
Viewed
Total article views: 4,665 (including HTML, PDF, and XML)
Cumulative views and downloads
(calculated since 28 Jun 2016)
| HTML | XML | Total | BibTeX | EndNote | |
|---|---|---|---|---|---|
| 2,874 | 1,458 | 333 | 4,665 | 244 | 283 |
- HTML: 2,874
- PDF: 1,458
- XML: 333
- Total: 4,665
- BibTeX: 244
- EndNote: 283
Total article views: 4,005 (including HTML, PDF, and XML)
Cumulative views and downloads
(calculated since 03 Feb 2017)
| HTML | XML | Total | BibTeX | EndNote | |
|---|---|---|---|---|---|
| 2,638 | 1,039 | 328 | 4,005 | 235 | 275 |
- HTML: 2,638
- PDF: 1,039
- XML: 328
- Total: 4,005
- BibTeX: 235
- EndNote: 275
Total article views: 660 (including HTML, PDF, and XML)
Cumulative views and downloads
(calculated since 28 Jun 2016)
| HTML | XML | Total | BibTeX | EndNote | |
|---|---|---|---|---|---|
| 236 | 419 | 5 | 660 | 9 | 8 |
- HTML: 236
- PDF: 419
- XML: 5
- Total: 660
- BibTeX: 9
- EndNote: 8
Cited
11 citations as recorded by crossref.
- Exploring an Ensemble-Based Approach to Atmospheric Climate Modeling and Testing at Scale S. Mahajan et al.
- OCEANFILMS (Organic Compounds from Ecosystems to Aerosols: Natural Films and Interfaces via Langmuir Molecular Surfactants) sea spray organic aerosol emissions – implementation in a global climate model and impacts on clouds S. Burrows et al.
- Predicted Land Carbon Dynamics Are Strongly Dependent on the Numerical Coupling of Nitrogen Mobilizing and Immobilizing Processes: A Demonstration with the E3SM Land Model J. Tang & W. Riley
- An Objective and Efficient Method for Assessing the Impact of Reduced‐Precision Calculations On Solution Correctness S. Zhang et al.
- A deep-learning-based consistency test approach for Earth system models on HPC systems Y. Yu et al.
- Enhanced climate reproducibility testing with false discovery rate correction M. Kelleher & S. Mahajan
- The ensemble consistency test: from CESM to MPAS and beyond T. Price-Broncucia et al.
- Evaluating statistical consistency for the ocean component of earth system models using physics informed convolutional autoencoder Y. Yu et al.
- A Scalable Semi‐Implicit Barotropic Mode Solver for the MPAS‐Ocean H. Kang et al.
- An ensemble-based statistical methodology to detect differences in weather and climate model executables C. Zeman & C. Schär
- Nine time steps: ultra-fast statistical consistency testing of the Community Earth System Model (pyCECT v3.0) D. Milroy et al.
11 citations as recorded by crossref.
- Exploring an Ensemble-Based Approach to Atmospheric Climate Modeling and Testing at Scale S. Mahajan et al.
- OCEANFILMS (Organic Compounds from Ecosystems to Aerosols: Natural Films and Interfaces via Langmuir Molecular Surfactants) sea spray organic aerosol emissions – implementation in a global climate model and impacts on clouds S. Burrows et al.
- Predicted Land Carbon Dynamics Are Strongly Dependent on the Numerical Coupling of Nitrogen Mobilizing and Immobilizing Processes: A Demonstration with the E3SM Land Model J. Tang & W. Riley
- An Objective and Efficient Method for Assessing the Impact of Reduced‐Precision Calculations On Solution Correctness S. Zhang et al.
- A deep-learning-based consistency test approach for Earth system models on HPC systems Y. Yu et al.
- Enhanced climate reproducibility testing with false discovery rate correction M. Kelleher & S. Mahajan
- The ensemble consistency test: from CESM to MPAS and beyond T. Price-Broncucia et al.
- Evaluating statistical consistency for the ocean component of earth system models using physics informed convolutional autoencoder Y. Yu et al.
- A Scalable Semi‐Implicit Barotropic Mode Solver for the MPAS‐Ocean H. Kang et al.
- An ensemble-based statistical methodology to detect differences in weather and climate model executables C. Zeman & C. Schär
- Nine time steps: ultra-fast statistical consistency testing of the Community Earth System Model (pyCECT v3.0) D. Milroy et al.
Saved (final revised paper)
Latest update: 29 Apr 2026
Short summary
Solution reproductibility testing is an important task for assuring the software quality of a climate model. A new method is developed using the concept of numerical convergence with respect to temporal resolution. The method is objective, easy to implement, and computationally efficient. This paper describes the new test and demonstrates its utility in the Community Atmosphere Model version 5 (CAM5).
Solution reproductibility testing is an important task for assuring the software quality of a...