Articles | Volume 10, issue 2
https://doi.org/10.5194/gmd-10-537-2017
© Author(s) 2017. This work is distributed under
the Creative Commons Attribution 3.0 License.
the Creative Commons Attribution 3.0 License.
https://doi.org/10.5194/gmd-10-537-2017
© Author(s) 2017. This work is distributed under
the Creative Commons Attribution 3.0 License.
the Creative Commons Attribution 3.0 License.
Methods for assessment of models
| 
03 Feb 2017
Methods for assessment of models |
| 03 Feb 2017
A new and inexpensive non-bit-for-bit solution reproducibility test based on time step convergence (TSC1.0)
Atmospheric Sciences and Global Change Division, Pacific Northwest National Laboratory, Richland, WA, USA
Kai Zhang
Atmospheric Sciences and Global Change Division, Pacific Northwest National Laboratory, Richland, WA, USA
Philip J. Rasch
Atmospheric Sciences and Global Change Division, Pacific Northwest National Laboratory, Richland, WA, USA
Balwinder Singh
Atmospheric Sciences and Global Change Division, Pacific Northwest National Laboratory, Richland, WA, USA
Xingyuan Chen
Atmospheric Sciences and Global Change Division, Pacific Northwest National Laboratory, Richland, WA, USA
Jim Edwards
Climate and Global Dynamics Laboratory, National Center for Atmospheric Research, Boulder, CO, USA
Viewed
Total article views: 4,029 (including HTML, PDF, and XML)
Cumulative views and downloads
(calculated since 28 Jun 2016)
| HTML | XML | Total | BibTeX | EndNote | |
|---|---|---|---|---|---|
| 2,510 | 1,223 | 296 | 4,029 | 198 | 176 |
- HTML: 2,510
- PDF: 1,223
- XML: 296
- Total: 4,029
- BibTeX: 198
- EndNote: 176
Total article views: 3,434 (including HTML, PDF, and XML)
Cumulative views and downloads
(calculated since 03 Feb 2017)
| HTML | XML | Total | BibTeX | EndNote | |
|---|---|---|---|---|---|
| 2,285 | 858 | 291 | 3,434 | 189 | 168 |
- HTML: 2,285
- PDF: 858
- XML: 291
- Total: 3,434
- BibTeX: 189
- EndNote: 168
Total article views: 595 (including HTML, PDF, and XML)
Cumulative views and downloads
(calculated since 28 Jun 2016)
| HTML | XML | Total | BibTeX | EndNote | |
|---|---|---|---|---|---|
| 225 | 365 | 5 | 595 | 9 | 8 |
- HTML: 225
- PDF: 365
- XML: 5
- Total: 595
- BibTeX: 9
- EndNote: 8
Cited
9 citations as recorded by crossref.
- Exploring an Ensemble-Based Approach to Atmospheric Climate Modeling and Testing at Scale S. Mahajan et al. 10.1016/j.procs.2017.05.259
- OCEANFILMS (Organic Compounds from Ecosystems to Aerosols: Natural Films and Interfaces via Langmuir Molecular Surfactants) sea spray organic aerosol emissions – implementation in a global climate model and impacts on clouds S. Burrows et al. 10.5194/acp-22-5223-2022
- The ensemble consistency test: from CESM to MPAS and beyond T. Price-Broncucia et al. 10.5194/gmd-18-2349-2025
- Predicted Land Carbon Dynamics Are Strongly Dependent on the Numerical Coupling of Nitrogen Mobilizing and Immobilizing Processes: A Demonstration with the E3SM Land Model J. Tang & W. Riley 10.1175/EI-D-17-0023.1
- An Objective and Efficient Method for Assessing the Impact of Reduced‐Precision Calculations On Solution Correctness S. Zhang et al. 10.1029/2019MS001817
- A Scalable Semi‐Implicit Barotropic Mode Solver for the MPAS‐Ocean H. Kang et al. 10.1029/2020MS002238
- An ensemble-based statistical methodology to detect differences in weather and climate model executables C. Zeman & C. Schär 10.5194/gmd-15-3183-2022
- A deep-learning-based consistency test approach for Earth system models on HPC systems Y. Yu et al. 10.1016/j.isci.2024.111574
- Nine time steps: ultra-fast statistical consistency testing of the Community Earth System Model (pyCECT v3.0) D. Milroy et al. 10.5194/gmd-11-697-2018
9 citations as recorded by crossref.
- Exploring an Ensemble-Based Approach to Atmospheric Climate Modeling and Testing at Scale S. Mahajan et al. 10.1016/j.procs.2017.05.259
- OCEANFILMS (Organic Compounds from Ecosystems to Aerosols: Natural Films and Interfaces via Langmuir Molecular Surfactants) sea spray organic aerosol emissions – implementation in a global climate model and impacts on clouds S. Burrows et al. 10.5194/acp-22-5223-2022
- The ensemble consistency test: from CESM to MPAS and beyond T. Price-Broncucia et al. 10.5194/gmd-18-2349-2025
- Predicted Land Carbon Dynamics Are Strongly Dependent on the Numerical Coupling of Nitrogen Mobilizing and Immobilizing Processes: A Demonstration with the E3SM Land Model J. Tang & W. Riley 10.1175/EI-D-17-0023.1
- An Objective and Efficient Method for Assessing the Impact of Reduced‐Precision Calculations On Solution Correctness S. Zhang et al. 10.1029/2019MS001817
- A Scalable Semi‐Implicit Barotropic Mode Solver for the MPAS‐Ocean H. Kang et al. 10.1029/2020MS002238
- An ensemble-based statistical methodology to detect differences in weather and climate model executables C. Zeman & C. Schär 10.5194/gmd-15-3183-2022
- A deep-learning-based consistency test approach for Earth system models on HPC systems Y. Yu et al. 10.1016/j.isci.2024.111574
- Nine time steps: ultra-fast statistical consistency testing of the Community Earth System Model (pyCECT v3.0) D. Milroy et al. 10.5194/gmd-11-697-2018
Latest update: 30 May 2025
Short summary
Solution reproductibility testing is an important task for assuring the software quality of a climate model. A new method is developed using the concept of numerical convergence with respect to temporal resolution. The method is objective, easy to implement, and computationally efficient. This paper describes the new test and demonstrates its utility in the Community Atmosphere Model version 5 (CAM5).
Solution reproductibility testing is an important task for assuring the software quality of a...
