Preprints
https://doi.org/10.5194/gmd-2024-115
https://doi.org/10.5194/gmd-2024-115
Submitted as: development and technical paper
 | 
12 Jul 2024
Submitted as: development and technical paper |  | 12 Jul 2024
Status: this preprint is currently under review for the journal GMD.

The Ensemble Consistency Test: From CESM to MPAS and Beyond

Teo Price-Broncucia, Allison Baker, Dorit Hammerling, Michael Duda, and Rebecca Morrison

Abstract. The Ensemble Consistency Test (ECT) and its Ultra-Fast variant (UF-ECT) have become powerful tools in the development community for the identification of unwanted changes in the Community Earth System Model (CESM). By characterizing the distribution of an accepted ensemble of perturbed ultra-fast model runs, the UF-ECT is able to identify changes exceeding internal variability in expensive chaotic numerical models with reasonable computational costs. However, up until now this approach has not seen adoption by other communities, in part because the process of adopting the UF-ECT procedure to other models was not clear. In this work we develop a generalized setup framework for applying the UF-ECT to different models and show how our specification of UF-ECT parameters allow us to balance important goals like test sensitivity and computational cost. Finally, we walk through the setup framework in detail and demonstrate the performance of the UF-ECT with our new determined parameters for the Model Across Prediction Scales-Atmosphere (MPAS-A) model, the substantially updated CESM atmospheric model, and realistic development scenarios.

Publisher's note: Copernicus Publications remains neutral with regard to jurisdictional claims made in the text, published maps, institutional affiliations, or any other geographical representation in this preprint. The responsibility to include appropriate place names lies with the authors.
Teo Price-Broncucia, Allison Baker, Dorit Hammerling, Michael Duda, and Rebecca Morrison

Status: final response (author comments only)

Comment types: AC – author | RC – referee | CC – community | EC – editor | CEC – chief editor | : Report abuse
  • RC1: 'Comment on gmd-2024-115', Anonymous Referee #1, 13 Sep 2024
  • RC2: 'Comment on gmd-2024-115', Anonymous Referee #2, 24 Oct 2024
Teo Price-Broncucia, Allison Baker, Dorit Hammerling, Michael Duda, and Rebecca Morrison
Teo Price-Broncucia, Allison Baker, Dorit Hammerling, Michael Duda, and Rebecca Morrison

Viewed

Total article views: 414 (including HTML, PDF, and XML)
HTML PDF XML Total BibTeX EndNote
324 73 17 414 9 12
  • HTML: 324
  • PDF: 73
  • XML: 17
  • Total: 414
  • BibTeX: 9
  • EndNote: 12
Views and downloads (calculated since 12 Jul 2024)
Cumulative views and downloads (calculated since 12 Jul 2024)

Viewed (geographical distribution)

Total article views: 406 (including HTML, PDF, and XML) Thereof 406 with geography defined and 0 with unknown origin.
Country # Views %
  • 1
1
 
 
 
 
Latest update: 06 Dec 2024
Download
Short summary
The Ensemble Consistency Test (ECT) and its Ultra-Fast variant (UF-ECT) have become powerful tools in the development community for the identification of unwanted changes in the Community Earth System Model (CESM). We develop a generalized setup framework to enable easy adoption of the ECT approach for other model developers and communities. This framework specifies test parameters to accurately characterize model variability and balance test sensitivity and computational cost.