Articles | Volume 8, issue 9
https://doi.org/10.5194/gmd-8-2829-2015
© Author(s) 2015. This work is distributed under
the Creative Commons Attribution 3.0 License.
the Creative Commons Attribution 3.0 License.
https://doi.org/10.5194/gmd-8-2829-2015
© Author(s) 2015. This work is distributed under
the Creative Commons Attribution 3.0 License.
the Creative Commons Attribution 3.0 License.
Development and technical paper
| 
09 Sep 2015
Development and technical paper |
| 09 Sep 2015
A new ensemble-based consistency test for the Community Earth System Model (pyCECT v1.0)
The National Center for Atmospheric Research, Boulder, CO, USA
D. M. Hammerling
The National Center for Atmospheric Research, Boulder, CO, USA
M. N. Levy
The National Center for Atmospheric Research, Boulder, CO, USA
H. Xu
The National Center for Atmospheric Research, Boulder, CO, USA
J. M. Dennis
The National Center for Atmospheric Research, Boulder, CO, USA
B. E. Eaton
The National Center for Atmospheric Research, Boulder, CO, USA
J. Edwards
The National Center for Atmospheric Research, Boulder, CO, USA
C. Hannay
The National Center for Atmospheric Research, Boulder, CO, USA
S. A. Mickelson
The National Center for Atmospheric Research, Boulder, CO, USA
R. B. Neale
The National Center for Atmospheric Research, Boulder, CO, USA
D. Nychka
The National Center for Atmospheric Research, Boulder, CO, USA
J. Shollenberger
The National Center for Atmospheric Research, Boulder, CO, USA
J. Tribbia
The National Center for Atmospheric Research, Boulder, CO, USA
M. Vertenstein
The National Center for Atmospheric Research, Boulder, CO, USA
D. Williamson
The National Center for Atmospheric Research, Boulder, CO, USA
Related authors
Teo Price-Broncucia, Allison Baker, Dorit Hammerling, Michael Duda, and Rebecca Morrison
Geosci. Model Dev., 18, 2349–2372, https://doi.org/10.5194/gmd-18-2349-2025, https://doi.org/10.5194/gmd-18-2349-2025, 2025
Short summary
Short summary
The ensemble consistency test (ECT) and its ultrafast variant (UF-ECT) have become powerful tools in the development community for the identification of unwanted changes in the Community Earth System Model (CESM). We develop a generalized setup framework to enable easy adoption of the ECT approach for other model developers and communities. This framework specifies test parameters to accurately characterize model variability and balance test sensitivity and computational cost.
Shaoqing Zhang, Haohuan Fu, Lixin Wu, Yuxuan Li, Hong Wang, Yunhui Zeng, Xiaohui Duan, Wubing Wan, Li Wang, Yuan Zhuang, Hongsong Meng, Kai Xu, Ping Xu, Lin Gan, Zhao Liu, Sihai Wu, Yuhu Chen, Haining Yu, Shupeng Shi, Lanning Wang, Shiming Xu, Wei Xue, Weiguo Liu, Qiang Guo, Jie Zhang, Guanghui Zhu, Yang Tu, Jim Edwards, Allison Baker, Jianlin Yong, Man Yuan, Yangyang Yu, Qiuying Zhang, Zedong Liu, Mingkui Li, Dongning Jia, Guangwen Yang, Zhiqiang Wei, Jingshan Pan, Ping Chang, Gokhan Danabasoglu, Stephen Yeager, Nan Rosenbloom, and Ying Guo
Geosci. Model Dev., 13, 4809–4829, https://doi.org/10.5194/gmd-13-4809-2020, https://doi.org/10.5194/gmd-13-4809-2020, 2020
Short summary
Short summary
Science advancement and societal needs require Earth system modelling with higher resolutions that demand tremendous computing power. We successfully scale the 10 km ocean and 25 km atmosphere high-resolution Earth system model to a new leading-edge heterogeneous supercomputer using state-of-the-art optimizing methods, promising the solution of high spatial resolution and time-varying frequency. Corresponding technical breakthroughs are of significance in modelling and HPC design communities.
Daniel J. Milroy, Allison H. Baker, Dorit M. Hammerling, and Elizabeth R. Jessup
Geosci. Model Dev., 11, 697–711, https://doi.org/10.5194/gmd-11-697-2018, https://doi.org/10.5194/gmd-11-697-2018, 2018
Short summary
Short summary
The Community Earth System Model Ensemble Consistency Test (CESM-ECT) suite was developed as an alternative to requiring bitwise identical output for quality assurance. We extend the CESM-ECT suite with an inexpensive and robust test for ensemble consistency that is applied to Community Atmospheric Model output after only nine model time steps. The new ultra-fast test facilitates CESM development, porting, and optimization efforts, and complements the original suite of tools.
Allison H. Baker, Dorit M. Hammerling, Sheri A. Mickelson, Haiying Xu, Martin B. Stolpe, Phillipe Naveau, Ben Sanderson, Imme Ebert-Uphoff, Savini Samarasinghe, Francesco De Simone, Francesco Carbone, Christian N. Gencarelli, John M. Dennis, Jennifer E. Kay, and Peter Lindstrom
Geosci. Model Dev., 9, 4381–4403, https://doi.org/10.5194/gmd-9-4381-2016, https://doi.org/10.5194/gmd-9-4381-2016, 2016
Short summary
Short summary
We apply lossy data compression to output from the Community Earth System Model Large Ensemble Community Project. We challenge climate scientists to examine features of the data relevant to their interests and identify which of the ensemble members have been compressed, and we perform direct comparisons on features critical to climate science. We find that applying lossy data compression to climate model data effectively reduces data volumes with minimal effect on scientific results.
Xiaomeng Huang, Qiang Tang, Yuheng Tseng, Yong Hu, Allison H. Baker, Frank O. Bryan, John Dennis, Haohuan Fu, and Guangwen Yang
Geosci. Model Dev., 9, 4209–4225, https://doi.org/10.5194/gmd-9-4209-2016, https://doi.org/10.5194/gmd-9-4209-2016, 2016
Short summary
Short summary
Refining model resolution is helpful for representing climate processes. With resolution increasing, the computational cost will become very huge. We designed a new solver to accelerate the high-resolution ocean simulation so as to reduce the computational cost and make full use of the computing resource of supercomputers. Our results show that the simulation speed of the improved ocean component with 0.1° resolution achieves 10.5 simulated years per wall-clock day on 16875 CPU cores.
Allison H. Baker, Yong Hu, Dorit M. Hammerling, Yu-heng Tseng, Haiying Xu, Xiaomeng Huang, Frank O. Bryan, and Guangwen Yang
Geosci. Model Dev., 9, 2391–2406, https://doi.org/10.5194/gmd-9-2391-2016, https://doi.org/10.5194/gmd-9-2391-2016, 2016
Short summary
Short summary
Software quality assurance is critical to detecting errors in large, complex climate simulation codes. We focus on ocean model simulation data in the context of an ensemble-based statistical consistency testing approach developed for atmospheric data. Because ocean and atmosphere models have differing characteristics, we develop a new statistical tool to evaluate ocean model simulation data that provide a simple, subjective, and systematic way to detect errors and instil model confidence.
Teo Price-Broncucia, Allison Baker, Dorit Hammerling, Michael Duda, and Rebecca Morrison
Geosci. Model Dev., 18, 2349–2372, https://doi.org/10.5194/gmd-18-2349-2025, https://doi.org/10.5194/gmd-18-2349-2025, 2025
Short summary
Short summary
The ensemble consistency test (ECT) and its ultrafast variant (UF-ECT) have become powerful tools in the development community for the identification of unwanted changes in the Community Earth System Model (CESM). We develop a generalized setup framework to enable easy adoption of the ECT approach for other model developers and communities. This framework specifies test parameters to accurately characterize model variability and balance test sensitivity and computational cost.
Ryan J. O'Loughlin, Dan Li, Richard Neale, and Travis A. O'Brien
Geosci. Model Dev., 18, 787–802, https://doi.org/10.5194/gmd-18-787-2025, https://doi.org/10.5194/gmd-18-787-2025, 2025
Short summary
Short summary
We draw from traditional climate modeling practices to make recommendations for machine-learning (ML)-driven climate science. Our intended audience is climate modelers who are relatively new to ML. We show how component-level understanding – obtained when scientists can link model behavior to parts within the overall model – should guide the development and evaluation of ML models. Better understanding yields a stronger basis for trust in the models. We highlight several examples to demonstrate.
Joshua Coupe, Nicole S. Lovenduski, Luise S. Gleason, Michael N. Levy, Kristen Krumhardt, Keith Lindsay, Charles Bardeen, Clay Tabor, Cheryl Harrison, Kenneth G. MacLeod, Siddhartha Mitra, and Julio Sepúlveda
Geosci. Model Dev. Discuss., https://doi.org/10.5194/gmd-2024-94, https://doi.org/10.5194/gmd-2024-94, 2024
Revised manuscript accepted for GMD
Short summary
Short summary
We develop a new feature in the atmosphere and ocean components of the Community Earth System Model version 2. We have implemented ultraviolet (UV) radiation inhibition of photosynthesis of four marine phytoplankton functional groups represented in the Marine Biogeochemistry Library. The new feature is tested with varying levels of UV radiation. The new feature will enable an analysis of an asteroid impact’s effect on the ozone layer and how that affects the base of the marine food web.
Marika M. Holland, Cecile Hannay, John Fasullo, Alexandra Jahn, Jennifer E. Kay, Michael Mills, Isla R. Simpson, William Wieder, Peter Lawrence, Erik Kluzek, and David Bailey
Geosci. Model Dev., 17, 1585–1602, https://doi.org/10.5194/gmd-17-1585-2024, https://doi.org/10.5194/gmd-17-1585-2024, 2024
Short summary
Short summary
Climate evolves in response to changing forcings, as prescribed in simulations. Models and forcings are updated over time to reflect new understanding. This makes it difficult to attribute simulation differences to either model or forcing changes. Here we present new simulations which enable the separation of model structure and forcing influence between two widely used simulation sets. Results indicate a strong influence of aerosol emission uncertainty on historical climate.
Genevieve L. Clow, Nicole S. Lovenduski, Michael N. Levy, Keith Lindsay, and Jennifer E. Kay
Geosci. Model Dev., 17, 975–995, https://doi.org/10.5194/gmd-17-975-2024, https://doi.org/10.5194/gmd-17-975-2024, 2024
Short summary
Short summary
Satellite observations of chlorophyll allow us to study marine phytoplankton on a global scale; yet some of these observations are missing due to clouds and other issues. To investigate the impact of missing data, we developed a satellite simulator for chlorophyll in an Earth system model. We found that missing data can impact the global mean chlorophyll by nearly 20 %. The simulated observations provide a more direct comparison to real-world data and can be used to improve model validation.
Andrew Gettelman, Hugh Morrison, Trude Eidhammer, Katherine Thayer-Calder, Jian Sun, Richard Forbes, Zachary McGraw, Jiang Zhu, Trude Storelvmo, and John Dennis
Geosci. Model Dev., 16, 1735–1754, https://doi.org/10.5194/gmd-16-1735-2023, https://doi.org/10.5194/gmd-16-1735-2023, 2023
Short summary
Short summary
Clouds are a critical part of weather and climate prediction. In this work, we document updates and corrections to the description of clouds used in several Earth system models. These updates include the ability to run the scheme on graphics processing units (GPUs), changes to the numerical description of precipitation, and a correction to the ice number. There are big improvements in the computational performance that can be achieved with GPU acceleration.
Po-Lun Ma, Bryce E. Harrop, Vincent E. Larson, Richard B. Neale, Andrew Gettelman, Hugh Morrison, Hailong Wang, Kai Zhang, Stephen A. Klein, Mark D. Zelinka, Yuying Zhang, Yun Qian, Jin-Ho Yoon, Christopher R. Jones, Meng Huang, Sheng-Lun Tai, Balwinder Singh, Peter A. Bogenschutz, Xue Zheng, Wuyin Lin, Johannes Quaas, Hélène Chepfer, Michael A. Brunke, Xubin Zeng, Johannes Mülmenstädt, Samson Hagos, Zhibo Zhang, Hua Song, Xiaohong Liu, Michael S. Pritchard, Hui Wan, Jingyu Wang, Qi Tang, Peter M. Caldwell, Jiwen Fan, Larry K. Berg, Jerome D. Fast, Mark A. Taylor, Jean-Christophe Golaz, Shaocheng Xie, Philip J. Rasch, and L. Ruby Leung
Geosci. Model Dev., 15, 2881–2916, https://doi.org/10.5194/gmd-15-2881-2022, https://doi.org/10.5194/gmd-15-2881-2022, 2022
Short summary
Short summary
An alternative set of parameters for E3SM Atmospheric Model version 1 has been developed based on a tuning strategy that focuses on clouds. When clouds in every regime are improved, other aspects of the model are also improved, even though they are not the direct targets for calibration. The recalibrated model shows a lower sensitivity to anthropogenic aerosols and surface warming, suggesting potential improvements to the simulated climate in the past and future.
Keith B. Rodgers, Sun-Seon Lee, Nan Rosenbloom, Axel Timmermann, Gokhan Danabasoglu, Clara Deser, Jim Edwards, Ji-Eun Kim, Isla R. Simpson, Karl Stein, Malte F. Stuecker, Ryohei Yamaguchi, Tamás Bódai, Eui-Seok Chung, Lei Huang, Who M. Kim, Jean-François Lamarque, Danica L. Lombardozzi, William R. Wieder, and Stephen G. Yeager
Earth Syst. Dynam., 12, 1393–1411, https://doi.org/10.5194/esd-12-1393-2021, https://doi.org/10.5194/esd-12-1393-2021, 2021
Short summary
Short summary
A large ensemble of simulations with 100 members has been conducted with the state-of-the-art CESM2 Earth system model, using historical and SSP3-7.0 forcing. Our main finding is that there are significant changes in the variance of the Earth system in response to anthropogenic forcing, with these changes spanning a broad range of variables important to impacts for human populations and ecosystems.
Sheri Mickelson, Alice Bertini, Gary Strand, Kevin Paul, Eric Nienhouse, John Dennis, and Mariana Vertenstein
Geosci. Model Dev., 13, 5567–5581, https://doi.org/10.5194/gmd-13-5567-2020, https://doi.org/10.5194/gmd-13-5567-2020, 2020
Short summary
Short summary
Every generation of MIP exercises introduces new layers of complexity and an exponential growth in the amount of data requested. CMIP6 required us to develop a new tool chain and forced us to change our methodologies. The new methods discussed in this paper provided us with an 18 times faster speedup over our existing methods. This allowed us to meet our deadlines and we were able to publish more than half a million data sets on the Earth System Grid Federation (ESGF) for the CMIP6 project.
Shaoqing Zhang, Haohuan Fu, Lixin Wu, Yuxuan Li, Hong Wang, Yunhui Zeng, Xiaohui Duan, Wubing Wan, Li Wang, Yuan Zhuang, Hongsong Meng, Kai Xu, Ping Xu, Lin Gan, Zhao Liu, Sihai Wu, Yuhu Chen, Haining Yu, Shupeng Shi, Lanning Wang, Shiming Xu, Wei Xue, Weiguo Liu, Qiang Guo, Jie Zhang, Guanghui Zhu, Yang Tu, Jim Edwards, Allison Baker, Jianlin Yong, Man Yuan, Yangyang Yu, Qiuying Zhang, Zedong Liu, Mingkui Li, Dongning Jia, Guangwen Yang, Zhiqiang Wei, Jingshan Pan, Ping Chang, Gokhan Danabasoglu, Stephen Yeager, Nan Rosenbloom, and Ying Guo
Geosci. Model Dev., 13, 4809–4829, https://doi.org/10.5194/gmd-13-4809-2020, https://doi.org/10.5194/gmd-13-4809-2020, 2020
Short summary
Short summary
Science advancement and societal needs require Earth system modelling with higher resolutions that demand tremendous computing power. We successfully scale the 10 km ocean and 25 km atmosphere high-resolution Earth system model to a new leading-edge heterogeneous supercomputer using state-of-the-art optimizing methods, promising the solution of high spatial resolution and time-varying frequency. Corresponding technical breakthroughs are of significance in modelling and HPC design communities.
Christopher J. Smith, Ryan J. Kramer, Gunnar Myhre, Kari Alterskjær, William Collins, Adriana Sima, Olivier Boucher, Jean-Louis Dufresne, Pierre Nabat, Martine Michou, Seiji Yukimoto, Jason Cole, David Paynter, Hideo Shiogama, Fiona M. O'Connor, Eddy Robertson, Andy Wiltshire, Timothy Andrews, Cécile Hannay, Ron Miller, Larissa Nazarenko, Alf Kirkevåg, Dirk Olivié, Stephanie Fiedler, Anna Lewinschal, Chloe Mackallah, Martin Dix, Robert Pincus, and Piers M. Forster
Atmos. Chem. Phys., 20, 9591–9618, https://doi.org/10.5194/acp-20-9591-2020, https://doi.org/10.5194/acp-20-9591-2020, 2020
Short summary
Short summary
The spread in effective radiative forcing for both CO2 and aerosols is narrower in the latest CMIP6 (Coupled Model Intercomparison Project) generation than in CMIP5. For the case of CO2 it is likely that model radiation parameterisations have improved. Tropospheric and stratospheric radiative adjustments to the forcing behave differently for different forcing agents, and there is still significant diversity in how clouds respond to forcings, particularly for total anthropogenic forcing.
Thomas Toniazzo, Mats Bentsen, Cheryl Craig, Brian E. Eaton, Jim Edwards, Steve Goldhaber, Christiane Jablonowski, and Peter H. Lauritzen
Geosci. Model Dev., 13, 685–705, https://doi.org/10.5194/gmd-13-685-2020, https://doi.org/10.5194/gmd-13-685-2020, 2020
Short summary
Short summary
We show that ensuring global conservation of the angular (rotational) momentum (AM) of the atmosphere along the Earth's axis of rotation, which is a property of the governing equations, has important and beneficial consequences for the quality of the numerical simulation of the general circulation of the atmosphere. We discuss the causes of non-conservation in the FV dynamical core of the Community Atmosphere Model (CAM), propose remedies, and show their impact in correcting systematic biases.
Qi Tang, Stephen A. Klein, Shaocheng Xie, Wuyin Lin, Jean-Christophe Golaz, Erika L. Roesler, Mark A. Taylor, Philip J. Rasch, David C. Bader, Larry K. Berg, Peter Caldwell, Scott E. Giangrande, Richard B. Neale, Yun Qian, Laura D. Riihimaki, Charles S. Zender, Yuying Zhang, and Xue Zheng
Geosci. Model Dev., 12, 2679–2706, https://doi.org/10.5194/gmd-12-2679-2019, https://doi.org/10.5194/gmd-12-2679-2019, 2019
Gab Abramowitz, Nadja Herger, Ethan Gutmann, Dorit Hammerling, Reto Knutti, Martin Leduc, Ruth Lorenz, Robert Pincus, and Gavin A. Schmidt
Earth Syst. Dynam., 10, 91–105, https://doi.org/10.5194/esd-10-91-2019, https://doi.org/10.5194/esd-10-91-2019, 2019
Short summary
Short summary
Best estimates of future climate projections typically rely on a range of climate models from different international research institutions. However, it is unclear how independent these different estimates are, and, for example, the degree to which their agreement implies robustness. This work presents a review of the varied and disparate attempts to quantify and address model dependence within multi-model climate projection ensembles.
Daniel J. Milroy, Allison H. Baker, Dorit M. Hammerling, and Elizabeth R. Jessup
Geosci. Model Dev., 11, 697–711, https://doi.org/10.5194/gmd-11-697-2018, https://doi.org/10.5194/gmd-11-697-2018, 2018
Short summary
Short summary
The Community Earth System Model Ensemble Consistency Test (CESM-ECT) suite was developed as an alternative to requiring bitwise identical output for quality assurance. We extend the CESM-ECT suite with an inexpensive and robust test for ensemble consistency that is applied to Community Atmospheric Model output after only nine model time steps. The new ultra-fast test facilitates CESM development, porting, and optimization efforts, and complements the original suite of tools.
Peter A. Bogenschutz, Andrew Gettelman, Cecile Hannay, Vincent E. Larson, Richard B. Neale, Cheryl Craig, and Chih-Chieh Chen
Geosci. Model Dev., 11, 235–255, https://doi.org/10.5194/gmd-11-235-2018, https://doi.org/10.5194/gmd-11-235-2018, 2018
Short summary
Short summary
This paper compares results of developmental versions of a widely used climate model. The simulations only differ in the choice of how to model the sub-grid-scale physics in the atmospheric model. This work is novel because it is the first time that a particular physics option has been tested in a fully coupled climate model. Here, we demonstrate that this physics option has the ability to produce credible coupled climate simulations, with improved metrics in certain fields.
Giorgia Verri, Nadia Pinardi, David Gochis, Joseph Tribbia, Antonio Navarra, Giovanni Coppini, and Tomislava Vukicevic
Nat. Hazards Earth Syst. Sci., 17, 1741–1761, https://doi.org/10.5194/nhess-17-1741-2017, https://doi.org/10.5194/nhess-17-1741-2017, 2017
Gavin A. Schmidt, David Bader, Leo J. Donner, Gregory S. Elsaesser, Jean-Christophe Golaz, Cecile Hannay, Andrea Molod, Richard B. Neale, and Suranjana Saha
Geosci. Model Dev., 10, 3207–3223, https://doi.org/10.5194/gmd-10-3207-2017, https://doi.org/10.5194/gmd-10-3207-2017, 2017
Short summary
Short summary
The development of coupled ocean atmosphere climate models is a complex process that inevitably includes multiple calibration steps (sometimes called
tuning). Tuning uses degrees of freedom allowed by uncertainties in model approximations to modify parameters to make the simulation better align with some selected observed target(s). We describe how these tuning targets, parameters, and philosophy vary across six US modeling centers in order to increase the transparency of the practice.
Hui Wan, Kai Zhang, Philip J. Rasch, Balwinder Singh, Xingyuan Chen, and Jim Edwards
Geosci. Model Dev., 10, 537–552, https://doi.org/10.5194/gmd-10-537-2017, https://doi.org/10.5194/gmd-10-537-2017, 2017
Short summary
Short summary
Solution reproductibility testing is an important task for assuring the software quality of a climate model. A new method is developed using the concept of numerical convergence with respect to temporal resolution. The method is objective, easy to implement, and computationally efficient. This paper describes the new test and demonstrates its utility in the Community Atmosphere Model version 5 (CAM5).
Allison H. Baker, Dorit M. Hammerling, Sheri A. Mickelson, Haiying Xu, Martin B. Stolpe, Phillipe Naveau, Ben Sanderson, Imme Ebert-Uphoff, Savini Samarasinghe, Francesco De Simone, Francesco Carbone, Christian N. Gencarelli, John M. Dennis, Jennifer E. Kay, and Peter Lindstrom
Geosci. Model Dev., 9, 4381–4403, https://doi.org/10.5194/gmd-9-4381-2016, https://doi.org/10.5194/gmd-9-4381-2016, 2016
Short summary
Short summary
We apply lossy data compression to output from the Community Earth System Model Large Ensemble Community Project. We challenge climate scientists to examine features of the data relevant to their interests and identify which of the ensemble members have been compressed, and we perform direct comparisons on features critical to climate science. We find that applying lossy data compression to climate model data effectively reduces data volumes with minimal effect on scientific results.
Xiaomeng Huang, Qiang Tang, Yuheng Tseng, Yong Hu, Allison H. Baker, Frank O. Bryan, John Dennis, Haohuan Fu, and Guangwen Yang
Geosci. Model Dev., 9, 4209–4225, https://doi.org/10.5194/gmd-9-4209-2016, https://doi.org/10.5194/gmd-9-4209-2016, 2016
Short summary
Short summary
Refining model resolution is helpful for representing climate processes. With resolution increasing, the computational cost will become very huge. We designed a new solver to accelerate the high-resolution ocean simulation so as to reduce the computational cost and make full use of the computing resource of supercomputers. Our results show that the simulation speed of the improved ocean component with 0.1° resolution achieves 10.5 simulated years per wall-clock day on 16875 CPU cores.
Allison H. Baker, Yong Hu, Dorit M. Hammerling, Yu-heng Tseng, Haiying Xu, Xiaomeng Huang, Frank O. Bryan, and Guangwen Yang
Geosci. Model Dev., 9, 2391–2406, https://doi.org/10.5194/gmd-9-2391-2016, https://doi.org/10.5194/gmd-9-2391-2016, 2016
Short summary
Short summary
Software quality assurance is critical to detecting errors in large, complex climate simulation codes. We focus on ocean model simulation data in the context of an ensemble-based statistical consistency testing approach developed for atmospheric data. Because ocean and atmosphere models have differing characteristics, we develop a new statistical tool to evaluate ocean model simulation data that provide a simple, subjective, and systematic way to detect errors and instil model confidence.
R. A. Fisher, S. Muszala, M. Verteinstein, P. Lawrence, C. Xu, N. G. McDowell, R. G. Knox, C. Koven, J. Holm, B. M. Rogers, A. Spessa, D. Lawrence, and G. Bonan
Geosci. Model Dev., 8, 3593–3619, https://doi.org/10.5194/gmd-8-3593-2015, https://doi.org/10.5194/gmd-8-3593-2015, 2015
Short summary
Short summary
Predicting the distribution of vegetation under novel climates is important, both to understand how climate change will impact ecosystem services, but also to understand how vegetation changes might affect the carbon, energy and water cycles. Historically, predictions have been heavily dependent upon observations of existing vegetation boundaries. In this paper, we attempt to predict ecosystem boundaries from the ``bottom up'', and illustrate the complexities and promise of this approach.
N. Žagar, A. Kasahara, K. Terasaki, J. Tribbia, and H. Tanaka
Geosci. Model Dev., 8, 1169–1195, https://doi.org/10.5194/gmd-8-1169-2015, https://doi.org/10.5194/gmd-8-1169-2015, 2015
Short summary
Short summary
The article presents MODES, a new software for the analysis of properties of balanced and inertio-gravity circulations across many scales in (re)analyses, weather forecasts and climate models. The software and real-time results based on ECMWF model can be found at http://meteo.fmf.uni-lj.si/MODES. Evaluation of models' ability to reproduce the unbalanced tropical circulation is expected to provide new insights on model performance that is helpful to diagnose deficiencies and define improvements.
S. Valcke, V. Balaji, A. Craig, C. DeLuca, R. Dunlap, R. W. Ford, R. Jacob, J. Larson, R. O'Kuinghttons, G. D. Riley, and M. Vertenstein
Geosci. Model Dev., 5, 1589–1596, https://doi.org/10.5194/gmd-5-1589-2012, https://doi.org/10.5194/gmd-5-1589-2012, 2012
Related subject area
Climate and Earth system modeling
Representing lateral groundwater flow from land to river in Earth system models
FINAM is not a model (v1.0): a new Python-based model coupling framework
The Detection and Attribution Model Intercomparison Project (DAMIP v2.0) contribution to CMIP7
Enhancing winter climate simulations of the Great Lakes: insights from a new coupled lake–ice–atmosphere (CLIAv1) system on the importance of integrating 3D hydrodynamics with a regional climate model
Modelling emission and transport of key components of primary marine organic aerosol using the global aerosol–climate model ECHAM6.3–HAM2.3
Assessing the climate impact of an improved volcanic sulfate aerosol representation in E3SM
Advanced climate model evaluation with ESMValTool v2.11.0 using parallel, out-of-core, and distributed computing
ICON-HAM-lite 1.0: simulating the Earth system with interactive aerosols at kilometer scales
Process-based modeling framework for sustainable irrigation management at the regional scale: integrating rice production, water use, and greenhouse gas emissions
Implementing deep soil and dynamic root uptake in Noah-MP (v4.5): impact on Amazon dry-season transpiration
Reducing time and computing costs in EC-Earth: an automatic load-balancing approach for coupled Earth system models
FLAME 1.0: a novel approach for modelling burned area in the Brazilian biomes using the maximum entropy concept
SURFER v3.0: a fast model with ice sheet tipping points and carbon cycle feedbacks for short- and long-term climate scenarios
NMH-CS 3.0: a C# programming language and Windows-system-based ecohydrological model derived from Noah-MP
A method for quantifying uncertainty in spatially interpolated meteorological data with application to daily maximum air temperature
Baseline Climate Variables for Earth System Modelling
PaleoSTeHM v1.0: a modern, scalable spatiotemporal hierarchical modeling framework for paleo-environmental data
The Tropical Basin Interaction Model Intercomparison Project (TBIMIP)
ZEMBA v1.0: an energy and moisture balance climate model to investigate Quaternary climate
Development and evaluation of a new 4DEnVar-based weakly coupled ocean data assimilation system in E3SMv2
TemDeep: a self-supervised framework for temporal downscaling of atmospheric fields at arbitrary time resolutions
The ensemble consistency test: from CESM to MPAS and beyond
Presentation, calibration and testing of the DCESS II Earth system model of intermediate complexity (version 1.0)
Synthesizing global carbon–nitrogen coupling effects – the MAGICC coupled carbon–nitrogen cycle model v1.0
Historical trends and controlling factors of isoprene emissions in CMIP6 Earth system models
Investigating carbon and nitrogen conservation in reported CMIP6 Earth system model data
OpenBench: a land models evaluation system
From weather data to river runoff: using spatiotemporal convolutional networks for discharge forecasting
A Fortran–Python interface for integrating machine learning parameterization into earth system models
ROCKE-3D 2.0: An updated general circulation model for simulating the climates of rocky planets
A rapid-application emissions-to-impacts tool for scenario assessment: Probabilistic Regional Impacts from Model patterns and Emissions (PRIME)
A first calibration of the JULES-crop version 7.4 for rice using the novel O3-FACE experiment in China
The DOE E3SM version 2.1: overview and assessment of the impacts of parameterized ocean submesoscales
WRF-ELM v1.0: a regional climate model to study land–atmosphere interactions over heterogeneous land use regions
Modeling commercial-scale CO2 storage in the gas hydrate stability zone with PFLOTRAN v6.0
DiuSST: a conceptual model of diurnal warm layers for idealized atmospheric simulations with interactive sea surface temperature
High-Resolution Model Intercomparison Project phase 2 (HighResMIP2) towards CMIP7
T&C-CROP: representing mechanistic crop growth with a terrestrial biosphere model (T&C, v1.5) – model formulation and validation
An updated non-intrusive, multi-scale, and flexible coupling interface in WRF 4.6.0
Monitoring and benchmarking Earth system model simulations with ESMValTool v2.12.0
The Earth Science Box Modeling Toolkit (ESBMTK 0.14.0.11): a Python library for research and teaching
CropSuite v1.0 – a comprehensive open-source crop suitability model considering climate variability for climate impact assessment
ICON ComIn – the ICON Community Interface (ComIn version 0.1.0, with ICON version 2024.01-01)
Using feature importance as an exploratory data analysis tool on Earth system models
A new metrics framework for quantifying and intercomparing atmospheric rivers in observations, reanalyses, and climate models
nextGEMS: entering the era of kilometer-scale Earth system modeling
The real challenges for climate and weather modelling on its way to sustained exascale performance: a case study using ICON (v2.6.6)
COSP-RTTOV-1.0: Flexible radiation diagnostics to enable new science applications in model evaluation, climate change detection, and satellite mission design
Evaluation of Ozone and its Precursors using the Multi-Scale Infrastructure for Chemistry and Aerosols Version 0 (MUSICAv0) during the Michigan-Ontario Ozone Source Experiment (MOOSE)
Impact of spatial resolution on CMIP6-driven Mediterranean climate simulations: a focus on precipitation distribution over Italy
Chang Liao, L. Ruby Leung, Yilin Fang, Teklu Tesfa, and Robinson Negron-Juarez
Geosci. Model Dev., 18, 4601–4624, https://doi.org/10.5194/gmd-18-4601-2025, https://doi.org/10.5194/gmd-18-4601-2025, 2025
Short summary
Short summary
Understanding horizontal groundwater flow is important for understanding how water moves through the ground. Current climate models often simplify this process because they do not have information about the land surface that is detailed enough. Our study developed a new model that divides the land surface into hillslopes to better represent how groundwater flows. This model can help improve predictions of water availability and how it affects ecosystems.
Sebastian Müller, Martin Lange, Thomas Fischer, Sara König, Matthias Kelbling, Jeisson Javier Leal Rojas, and Stephan Thober
Geosci. Model Dev., 18, 4483–4498, https://doi.org/10.5194/gmd-18-4483-2025, https://doi.org/10.5194/gmd-18-4483-2025, 2025
Short summary
Short summary
This study presents FINAM (
FINAM is not a model), a new coupling framework written in Python to dynamically connect independently developed models. Python, as the ultimate glue language, enables the use of codes from nearly any programming language like Fortran, C++, Rust, and others. FINAM is designed to simplify the integration of various models with minimal effort, as demonstrated through various examples ranging from simple to complex systems.
Nathan P. Gillett, Isla R. Simpson, Gabi Hegerl, Reto Knutti, Dann Mitchell, Aurélien Ribes, Hideo Shiogama, Dáithí Stone, Claudia Tebaldi, Piotr Wolski, Wenxia Zhang, and Vivek K. Arora
Geosci. Model Dev., 18, 4399–4416, https://doi.org/10.5194/gmd-18-4399-2025, https://doi.org/10.5194/gmd-18-4399-2025, 2025
Short summary
Short summary
Climate model simulations of the response to human and natural influences together, natural climate influences alone and greenhouse gases alone are key to quantifying human influence on the climate. The last set of such coordinated simulations underpinned key findings in the last Intergovernmental Panel on Climate Change (IPCC) report. Here we propose a new set of such simulations to be used in the next generation of attribution studies and to underpin the next IPCC report.
Pengfei Xue, Chenfu Huang, Yafang Zhong, Michael Notaro, Miraj B. Kayastha, Xing Zhou, Chuyan Zhao, Christa Peters-Lidard, Carlos Cruz, and Eric Kemp
Geosci. Model Dev., 18, 4293–4316, https://doi.org/10.5194/gmd-18-4293-2025, https://doi.org/10.5194/gmd-18-4293-2025, 2025
Short summary
Short summary
This study introduces a new 3D lake–ice–atmosphere coupled model that significantly improves winter climate simulations for the Great Lakes compared to traditional 1D lake model coupling. The key contribution is the identification of critical hydrodynamic processes – ice transport, heat advection, and shear-driven turbulence production – that influence lake thermal structure and ice cover and explain the superior performance of 3D lake models to their 1D counterparts.
Anisbel Leon-Marcos, Moritz Zeising, Manuela van Pinxteren, Sebastian Zeppenfeld, Astrid Bracher, Elena Barbaro, Anja Engel, Matteo Feltracco, Ina Tegen, and Bernd Heinold
Geosci. Model Dev., 18, 4183–4213, https://doi.org/10.5194/gmd-18-4183-2025, https://doi.org/10.5194/gmd-18-4183-2025, 2025
Short summary
Short summary
This study represents the primary marine organic aerosol (PMOA) emissions, focusing on their sea–atmosphere transfer. Using the FESOM2.1–REcoM3 model, concentrations of key organic biomolecules were estimated and integrated into the ECHAM6.3–HAM2.3 aerosol–climate model. Results highlight the influence of marine biological activity and surface winds on PMOA emissions, with reasonably good agreement with observations improving aerosol representation in the southern oceans.
Ziming Ke, Qi Tang, Jean-Christophe Golaz, Xiaohong Liu, and Hailong Wang
Geosci. Model Dev., 18, 4137–4153, https://doi.org/10.5194/gmd-18-4137-2025, https://doi.org/10.5194/gmd-18-4137-2025, 2025
Short summary
Short summary
This study assesses volcanic aerosol representation in E3SM (Energy Exascale Earth System Model), showing that an emission-based approach moderately improves temperature variability and cloud responses compared to a prescribed forcing approach, yet significant bias persists.
Manuel Schlund, Bouwe Andela, Jörg Benke, Ruth Comer, Birgit Hassler, Emma Hogan, Peter Kalverla, Axel Lauer, Bill Little, Saskia Loosveldt Tomas, Francesco Nattino, Patrick Peglar, Valeriu Predoi, Stef Smeets, Stephen Worsley, Martin Yeo, and Klaus Zimmermann
Geosci. Model Dev., 18, 4009–4021, https://doi.org/10.5194/gmd-18-4009-2025, https://doi.org/10.5194/gmd-18-4009-2025, 2025
Short summary
Short summary
The Earth System Model Evaluation Tool (ESMValTool) is a community diagnostics and performance metrics tool for the evaluation of Earth system models. Here, we describe recent significant improvements of ESMValTool’s computational efficiency including parallel, out-of-core, and distributed computing. Evaluations with the enhanced version of ESMValTool are faster, use less computational resources, and can handle input data larger than the available memory.
Philipp Weiss, Ross Herbert, and Philip Stier
Geosci. Model Dev., 18, 3877–3894, https://doi.org/10.5194/gmd-18-3877-2025, https://doi.org/10.5194/gmd-18-3877-2025, 2025
Short summary
Short summary
Aerosols strongly influence Earth's climate as they interact with radiation and clouds. New Earth system models run at resolutions of a few kilometers. To simulate the Earth system with interactive aerosols, we developed a new aerosol module. It represents aerosols as an ensemble of lognormal modes with given sizes and compositions. We present a year-long simulation with four modes at a resolution of 5 km. It captures key processes like the formation of dust storms in the Sahara.
Yan Bo, Hao Liang, Tao Li, and Feng Zhou
Geosci. Model Dev., 18, 3799–3817, https://doi.org/10.5194/gmd-18-3799-2025, https://doi.org/10.5194/gmd-18-3799-2025, 2025
Short summary
Short summary
This study proposed an advancing framework for modeling regional rice production, water use, and greenhouse gas emissions. The framework integrated a process-based soil-crop model with vital physiological effects, a novel model upscaling method, and the NSGA-II multi-objective optimization algorithm at a parallel computing platform. The framework provides a valuable tool for multi-objective optimization of rice irrigation schemes at a large scale.
Carolina A. Bieri, Francina Dominguez, Gonzalo Miguez-Macho, and Ying Fan
Geosci. Model Dev., 18, 3755–3779, https://doi.org/10.5194/gmd-18-3755-2025, https://doi.org/10.5194/gmd-18-3755-2025, 2025
Short summary
Short summary
Access to deep moisture below the Earth's surface is important for vegetation in areas of the Amazon where there is little precipitation for part of the year. Most existing numerical models of the Earth system do not adequately capture where and when deep root water uptake occurs. We address this by adding deep soil layers and a root water uptake feature to an existing model. Out modifications lead to increased dry-month transpiration and improved simulation of the annual transpiration cycle.
Sergi Palomas, Mario C. Acosta, Gladys Utrera, and Etienne Tourigny
Geosci. Model Dev., 18, 3661–3679, https://doi.org/10.5194/gmd-18-3661-2025, https://doi.org/10.5194/gmd-18-3661-2025, 2025
Short summary
Short summary
We present an automatic tool that optimizes resource distribution in coupled climate models, enhancing speed and reducing computational costs without requiring expert knowledge. Users can set energy/time criteria or limit resource usage. Tested on various European Community Earth System Model (EC-Earth) configurations and high-performance computing (HPC) platforms, it achieved up to 34 % faster simulations with fewer resources.
Maria Lucia Ferreira Barbosa, Douglas I. Kelley, Chantelle A. Burton, Igor J. M. Ferreira, Renata Moura da Veiga, Anna Bradley, Paulo Guilherme Molin, and Liana O. Anderson
Geosci. Model Dev., 18, 3533–3557, https://doi.org/10.5194/gmd-18-3533-2025, https://doi.org/10.5194/gmd-18-3533-2025, 2025
Short summary
Short summary
As fire seasons in Brazil become increasingly severe, confidently understanding the factors driving fires is more critical than ever. To address this challenge, we developed FLAME (Fire Landscape Analysis using Maximum Entropy), a new model designed to predict fires and to analyse the spatial influence of both environmental and human factors while accounting for uncertainties. By adapting the model to different regions, we can enhance fire management strategies, making FLAME a powerful tool for protecting landscapes in Brazil and beyond.
Victor Couplet, Marina Martínez Montero, and Michel Crucifix
Geosci. Model Dev., 18, 3081–3129, https://doi.org/10.5194/gmd-18-3081-2025, https://doi.org/10.5194/gmd-18-3081-2025, 2025
Short summary
Short summary
We present SURFER v3.0, a simple climate model designed to estimate the impact of CO2 and CH4 emissions on global temperatures, sea levels, and ocean pH. We added new carbon cycle processes and calibrated the model to observations and results from more complex models, enabling use over timescales ranging from decades to millions of years. SURFER v3.0 is fast, transparent, and easy to use, making it an ideal tool for policy assessments and suitable for educational purposes.
Yong-He Liu and Zong-Liang Yang
Geosci. Model Dev., 18, 3157–3174, https://doi.org/10.5194/gmd-18-3157-2025, https://doi.org/10.5194/gmd-18-3157-2025, 2025
Short summary
Short summary
NMH-CS 3.0 is a C#-based ecohydrological model reconstructed from the WRF-Hydro/Noah-MP model by translating the Fortran code of WRF-Hydro 3.0 and integrating a parallel river routing module. It enables efficient execution on multi-core personal computers. Simulations in the Yellow River basin demonstrate its consistency with WRF-Hydro outputs, providing a reliable alternative to the original Noah-MP model.
Conor T. Doherty, Weile Wang, Hirofumi Hashimoto, and Ian G. Brosnan
Geosci. Model Dev., 18, 3003–3016, https://doi.org/10.5194/gmd-18-3003-2025, https://doi.org/10.5194/gmd-18-3003-2025, 2025
Short summary
Short summary
We present, analyze, and validate a methodology for quantifying uncertainty in gridded meteorological data products produced by spatial interpolation. In a validation case study using daily maximum near-surface air temperature (Tmax), the method works well and produces predictive distributions with closely matching theoretical versus actual coverage levels. Application of the method reveals that the magnitude of uncertainty in interpolated Tmax varies significantly in both space and time.
Martin Juckes, Karl E. Taylor, Fabrizio Antonio, David Brayshaw, Carlo Buontempo, Jian Cao, Paul J. Durack, Michio Kawamiya, Hyungjun Kim, Tomas Lovato, Chloe Mackallah, Matthew Mizielinski, Alessandra Nuzzo, Martina Stockhause, Daniele Visioni, Jeremy Walton, Briony Turner, Eleanor O'Rourke, and Beth Dingley
Geosci. Model Dev., 18, 2639–2663, https://doi.org/10.5194/gmd-18-2639-2025, https://doi.org/10.5194/gmd-18-2639-2025, 2025
Short summary
Short summary
The Baseline Climate Variables for Earth System Modelling (ESM-BCVs) are defined as a list of 135 variables which have high utility for the evaluation and exploitation of climate simulations. The list reflects the most frequently used variables from Earth system models based on an assessment of data publication and download records from the largest archive of global climate projects.
Yucheng Lin, Robert E. Kopp, Alexander Reedy, Matteo Turilli, Shantenu Jha, and Erica L. Ashe
Geosci. Model Dev., 18, 2609–2637, https://doi.org/10.5194/gmd-18-2609-2025, https://doi.org/10.5194/gmd-18-2609-2025, 2025
Short summary
Short summary
PaleoSTeHM v1.0 is a state-of-the-art framework designed to reconstruct past environmental conditions using geological data. Built on modern machine learning techniques, it efficiently handles the sparse and noisy nature of paleo-records, allowing scientists to make accurate and scalable inferences about past environmental change. By using flexible statistical models, PaleoSTeHM separates different sources of uncertainty, improving the precision of historical climate reconstructions.
Ingo Richter, Ping Chang, Ping-Gin Chiu, Gokhan Danabasoglu, Takeshi Doi, Dietmar Dommenget, Guillaume Gastineau, Zoe E. Gillett, Aixue Hu, Takahito Kataoka, Noel S. Keenlyside, Fred Kucharski, Yuko M. Okumura, Wonsun Park, Malte F. Stuecker, Andréa S. Taschetto, Chunzai Wang, Stephen G. Yeager, and Sang-Wook Yeh
Geosci. Model Dev., 18, 2587–2608, https://doi.org/10.5194/gmd-18-2587-2025, https://doi.org/10.5194/gmd-18-2587-2025, 2025
Short summary
Short summary
Tropical ocean basins influence each other through multiple pathways and mechanisms, referred to here as tropical basin interaction (TBI). Many researchers have examined TBI using comprehensive climate models but have obtained conflicting results. This may be partly due to differences in experiment protocols and partly due to systematic model errors. The Tropical Basin Interaction Model Intercomparison Project (TBIMIP) aims to address this problem by designing a set of TBI experiments that will be performed by multiple models.
Daniel F. J. Gunning, Kerim H. Nisancioglu, Emilie Capron, and Roderik S. W. van de Wal
Geosci. Model Dev., 18, 2479–2508, https://doi.org/10.5194/gmd-18-2479-2025, https://doi.org/10.5194/gmd-18-2479-2025, 2025
Short summary
Short summary
This work documents the first results from ZEMBA: an energy balance model of the climate system. The model is a computationally efficient tool designed to study the response of climate to changes in the Earth's orbit. We demonstrate that ZEMBA reproduces many features of the Earth's climate for both the pre-industrial period and the Earth's most recent cold extreme – the Last Glacial Maximum. We intend to develop ZEMBA further and investigate the glacial cycles of the last 2.5 million years.
Pengfei Shi, L. Ruby Leung, and Bin Wang
Geosci. Model Dev., 18, 2443–2460, https://doi.org/10.5194/gmd-18-2443-2025, https://doi.org/10.5194/gmd-18-2443-2025, 2025
Short summary
Short summary
Improving climate predictions has significant socio-economic impacts. In this study, we develop and apply a new weakly coupled ocean data assimilation (WCODA) system to a coupled climate model. The WCODA system improves simulations of ocean temperature and salinity across many global regions. This system is meant to advance our understanding of the ocean's role in climate predictability.
Liwen Wang, Qian Li, Qi Lv, Xuan Peng, and Wei You
Geosci. Model Dev., 18, 2427–2442, https://doi.org/10.5194/gmd-18-2427-2025, https://doi.org/10.5194/gmd-18-2427-2025, 2025
Short summary
Short summary
Our research presents a novel deep learning approach called "TemDeep" for downscaling atmospheric variables at arbitrary time resolutions based on temporal coherence. Results show that our method can accurately recover evolution details superior to other methods, reaching 53.7 % in the restoration rate. Our findings are important for advancing weather forecasting models and enabling more precise and reliable predictions to support disaster preparedness, agriculture, and sustainable development.
Teo Price-Broncucia, Allison Baker, Dorit Hammerling, Michael Duda, and Rebecca Morrison
Geosci. Model Dev., 18, 2349–2372, https://doi.org/10.5194/gmd-18-2349-2025, https://doi.org/10.5194/gmd-18-2349-2025, 2025
Short summary
Short summary
The ensemble consistency test (ECT) and its ultrafast variant (UF-ECT) have become powerful tools in the development community for the identification of unwanted changes in the Community Earth System Model (CESM). We develop a generalized setup framework to enable easy adoption of the ECT approach for other model developers and communities. This framework specifies test parameters to accurately characterize model variability and balance test sensitivity and computational cost.
Esteban Fernández Villanueva and Gary Shaffer
Geosci. Model Dev., 18, 2161–2192, https://doi.org/10.5194/gmd-18-2161-2025, https://doi.org/10.5194/gmd-18-2161-2025, 2025
Short summary
Short summary
We describe, calibrate and test the Danish Center for Earth System Science (DCESS) II model, a new, broad, adaptable and fast Earth system model. DCESS II is designed for global simulations over timescales of years to millions of years using limited computer resources like a personal computer. With its flexibility and comprehensive treatment of the global carbon cycle, DCESS II is a useful, computationally friendly tool for simulations of past climates as well as for future Earth system projections.
Gang Tang, Zebedee Nicholls, Alexander Norton, Sönke Zaehle, and Malte Meinshausen
Geosci. Model Dev., 18, 2193–2230, https://doi.org/10.5194/gmd-18-2193-2025, https://doi.org/10.5194/gmd-18-2193-2025, 2025
Short summary
Short summary
We studied carbon–nitrogen coupling in Earth system models by developing a global carbon–nitrogen cycle model (CNit v1.0) within the widely used emulator MAGICC. CNit effectively reproduced the global carbon–nitrogen cycle dynamics observed in complex models. Our results show persistent nitrogen limitations on plant growth (net primary production) from 1850 to 2100, suggesting that nitrogen deficiency may constrain future land carbon sequestration.
Ngoc Thi Nhu Do, Kengo Sudo, Akihiko Ito, Louisa K. Emmons, Vaishali Naik, Kostas Tsigaridis, Øyvind Seland, Gerd A. Folberth, and Douglas I. Kelley
Geosci. Model Dev., 18, 2079–2109, https://doi.org/10.5194/gmd-18-2079-2025, https://doi.org/10.5194/gmd-18-2079-2025, 2025
Short summary
Short summary
Understanding historical isoprene emission changes is important for predicting future climate, but trends and their controlling factors remain uncertain. This study shows that long-term isoprene trends vary among Earth system models mainly due to partially incorporating CO2 effects and land cover changes rather than to climate. Future models that refine these factors’ effects on isoprene emissions, along with long-term observations, are essential for better understanding plant–climate interactions.
Gang Tang, Zebedee Nicholls, Chris Jones, Thomas Gasser, Alexander Norton, Tilo Ziehn, Alejandro Romero-Prieto, and Malte Meinshausen
Geosci. Model Dev., 18, 2111–2136, https://doi.org/10.5194/gmd-18-2111-2025, https://doi.org/10.5194/gmd-18-2111-2025, 2025
Short summary
Short summary
We analyzed carbon and nitrogen mass conservation in data from various Earth system models. Our findings reveal significant discrepancies between flux and pool size data, where cumulative imbalances can reach hundreds of gigatons of carbon or nitrogen. These imbalances appear primarily due to missing or inconsistently reported fluxes – especially for land-use and fire emissions. To enhance data quality, we recommend that future climate data protocols address this issue at the reporting stage.
Zhongwang Wei, Qingchen Xu, Fan Bai, Xionghui Xu, Zixin Wei, Wenzong Dong, Hongbin Liang, Nan Wei, Xingjie Lu, Lu Li, Shupeng Zhang, Hua Yuan, Laibo Liu, and Yongjiu Dai
EGUsphere, https://doi.org/10.5194/egusphere-2025-1380, https://doi.org/10.5194/egusphere-2025-1380, 2025
Short summary
Short summary
Land surface models are used for simulating earth's surface interacts with the atmosphere. As models grow more complex and detailed, researchers need better tools to evaluate their performance. OpenBench, a new software system that makes evaluation process more comprehensive and efficient. It stands out by incorporating various factors and working with data at any scale which enabling scientists to incorporate new types of models and measurements as our understanding of Earth’s systems evolves.
Florian Börgel, Sven Karsten, Karoline Rummel, and Ulf Gräwe
Geosci. Model Dev., 18, 2005–2019, https://doi.org/10.5194/gmd-18-2005-2025, https://doi.org/10.5194/gmd-18-2005-2025, 2025
Short summary
Short summary
Forecasting river runoff, which is crucial for managing water resources and understanding climate impacts, can be challenging. This study introduces a new method using convolutional long short-term memory (ConvLSTM) networks, a machine learning model that processes spatial and temporal data. Focusing on the Baltic Sea region, our model uses weather data as input to predict daily river runoff for 97 rivers.
Tao Zhang, Cyril Morcrette, Meng Zhang, Wuyin Lin, Shaocheng Xie, Ye Liu, Kwinten Van Weverberg, and Joana Rodrigues
Geosci. Model Dev., 18, 1917–1928, https://doi.org/10.5194/gmd-18-1917-2025, https://doi.org/10.5194/gmd-18-1917-2025, 2025
Short summary
Short summary
Earth system models (ESMs) struggle with the uncertainties associated with parameterizing subgrid physics. Machine learning (ML) algorithms offer a solution by learning the important relationships and features from high-resolution models. To incorporate ML parameterizations into ESMs, we develop a Fortran–Python interface that allows for calling Python functions within Fortran-based ESMs. Through two case studies, this interface demonstrates its feasibility, modularity, and effectiveness.
Kostas Tsigaridis, Andrew S. Ackerman, Igor Aleinov, Mark A. Chandler, Thomas L. Clune, Christopher M. Colose, Anthony D. Del Genio, Maxwell Kelley, Nancy Y. Kiang, Anthony Leboissetier, Jan P. Perlwitz, Reto A. Ruedy, Gary L. Russell, Linda E. Sohl, Michael J. Way, and Eric T. Wolf
EGUsphere, https://doi.org/10.5194/egusphere-2025-925, https://doi.org/10.5194/egusphere-2025-925, 2025
Short summary
Short summary
We present the second generation of ROCKE-3D, a generalized 3-dimensional model for use in Solar System and exoplanetary simulations of rocky planet climates. We quantify how the different component choices affect model results, and discuss strengths and limitations of using each component, together with how one can select which component to use. ROCKE-3D is publicly available and tutorial sessions are available for the community, greatly facilitating its use by any interested group.
Camilla Mathison, Eleanor J. Burke, Gregory Munday, Chris D. Jones, Chris J. Smith, Norman J. Steinert, Andy J. Wiltshire, Chris Huntingford, Eszter Kovacs, Laila K. Gohar, Rebecca M. Varney, and Douglas McNeall
Geosci. Model Dev., 18, 1785–1808, https://doi.org/10.5194/gmd-18-1785-2025, https://doi.org/10.5194/gmd-18-1785-2025, 2025
Short summary
Short summary
We present PRIME (Probabilistic Regional Impacts from Model patterns and Emissions), which is designed to take new emissions scenarios and rapidly provide regional impact information. PRIME allows large ensembles to be run on multi-centennial timescales, including the analysis of many important variables for impact assessments. Our evaluation shows that PRIME reproduces the climate response for known scenarios, providing confidence in using PRIME for novel scenarios.
Beiyao Xu, Steven Dobbie, Huiyi Yang, Lianxin Yang, Yu Jiang, Andrew Challinor, Karina Williams, Yunxia Wang, and Tijian Wang
EGUsphere, https://doi.org/10.5194/egusphere-2024-4077, https://doi.org/10.5194/egusphere-2024-4077, 2025
Short summary
Short summary
Ozone (O3) pollution harms rice production and threatens food security. To understand these impacts, we calibrated a crop model using unique data from experiments where rice was grown in open fields under controlled O3 exposure (free air). This is the first time such data has been used to improve a model’s ability to predict how rice responds to O3 pollution. Our work provides a more accurate tool to study O3’s effects and guide strategies to protect agriculture.
Katherine M. Smith, Alice M. Barthel, LeAnn M. Conlon, Luke P. Van Roekel, Anthony Bartoletti, Jean-Christophe Golaz, Chengzhu Zhang, Carolyn Branecky Begeman, James J. Benedict, Gautam Bisht, Yan Feng, Walter Hannah, Bryce E. Harrop, Nicole Jeffery, Wuyin Lin, Po-Lun Ma, Mathew E. Maltrud, Mark R. Petersen, Balwinder Singh, Qi Tang, Teklu Tesfa, Jonathan D. Wolfe, Shaocheng Xie, Xue Zheng, Karthik Balaguru, Oluwayemi Garuba, Peter Gleckler, Aixue Hu, Jiwoo Lee, Ben Moore-Maley, and Ana C. Ordoñez
Geosci. Model Dev., 18, 1613–1633, https://doi.org/10.5194/gmd-18-1613-2025, https://doi.org/10.5194/gmd-18-1613-2025, 2025
Short summary
Short summary
Version 2.1 of the U.S. Department of Energy's Energy Exascale Earth System Model (E3SM) adds the Fox-Kemper et al. (2011) mixed-layer eddy parameterization, which restratifies the ocean surface layer through an overturning streamfunction. Results include surface layer bias reduction in temperature, salinity, and sea ice extent in the North Atlantic; a small strengthening of the Atlantic meridional overturning circulation; and improvements to many atmospheric climatological variables.
Huilin Huang, Yun Qian, Gautam Bisht, Jiali Wang, Tirthankar Chakraborty, Dalei Hao, Jianfeng Li, Travis Thurber, Balwinder Singh, Zhao Yang, Ye Liu, Pengfei Xue, William J. Sacks, Ethan Coon, and Robert Hetland
Geosci. Model Dev., 18, 1427–1443, https://doi.org/10.5194/gmd-18-1427-2025, https://doi.org/10.5194/gmd-18-1427-2025, 2025
Short summary
Short summary
We integrate the E3SM Land Model (ELM) with the WRF model through the Lightweight Infrastructure for Land Atmosphere Coupling (LILAC) Earth System Modeling Framework (ESMF). This framework includes a top-level driver, LILAC, for variable communication between WRF and ELM and ESMF caps for ELM initialization, execution, and finalization. The LILAC–ESMF framework maintains the integrity of the ELM's source code structure and facilitates the transfer of future ELM model developments to WRF-ELM.
Michael Nole, Jonah Bartrand, Fawz Naim, and Glenn Hammond
Geosci. Model Dev., 18, 1413–1425, https://doi.org/10.5194/gmd-18-1413-2025, https://doi.org/10.5194/gmd-18-1413-2025, 2025
Short summary
Short summary
Safe carbon dioxide (CO2) storage is likely to be critical for mitigating some of the most severe effects of climate change. We present a simulation framework for modeling CO2 storage beneath the seafloor, where CO2 can form a solid. This can aid in permanent CO2 storage for long periods of time. Our models show what a commercial-scale CO2 injection would look like in a marine environment. We discuss what would need to be considered when designing a subsea CO2 injection.
Reyk Börner, Jan O. Haerter, and Romain Fiévet
Geosci. Model Dev., 18, 1333–1356, https://doi.org/10.5194/gmd-18-1333-2025, https://doi.org/10.5194/gmd-18-1333-2025, 2025
Short summary
Short summary
The daily cycle of sea surface temperature (SST) impacts clouds above the ocean and could influence the clustering of thunderstorms linked to extreme rainfall and hurricanes. However, daily SST variability is often poorly represented in modeling studies of how clouds cluster. We present a simple, wind-responsive model of upper-ocean temperature for use in atmospheric simulations. Evaluating the model against observations, we show that it performs significantly better than common slab models.
Malcolm J. Roberts, Kevin A. Reed, Qing Bao, Joseph J. Barsugli, Suzana J. Camargo, Louis-Philippe Caron, Ping Chang, Cheng-Ta Chen, Hannah M. Christensen, Gokhan Danabasoglu, Ivy Frenger, Neven S. Fučkar, Shabeh ul Hasson, Helene T. Hewitt, Huanping Huang, Daehyun Kim, Chihiro Kodama, Michael Lai, Lai-Yung Ruby Leung, Ryo Mizuta, Paulo Nobre, Pablo Ortega, Dominique Paquin, Christopher D. Roberts, Enrico Scoccimarro, Jon Seddon, Anne Marie Treguier, Chia-Ying Tu, Paul A. Ullrich, Pier Luigi Vidale, Michael F. Wehner, Colin M. Zarzycki, Bosong Zhang, Wei Zhang, and Ming Zhao
Geosci. Model Dev., 18, 1307–1332, https://doi.org/10.5194/gmd-18-1307-2025, https://doi.org/10.5194/gmd-18-1307-2025, 2025
Short summary
Short summary
HighResMIP2 is a model intercomparison project focusing on high-resolution global climate models, that is, those with grid spacings of 25 km or less in the atmosphere and ocean, using simulations of decades to a century in length. We are proposing an update of our simulation protocol to make the models more applicable to key questions for climate variability and hazard in present-day and future projections and to build links with other communities to provide more robust climate information.
Jordi Buckley Paules, Simone Fatichi, Bonnie Warring, and Athanasios Paschalis
Geosci. Model Dev., 18, 1287–1305, https://doi.org/10.5194/gmd-18-1287-2025, https://doi.org/10.5194/gmd-18-1287-2025, 2025
Short summary
Short summary
We present and validate enhancements to the process-based T&C model aimed at improving its representation of crop growth and management practices. The updated model, T&C-CROP, enables applications such as analysing the hydrological and carbon storage impacts of land use transitions (e.g. conversions between crops, forests, and pastures) and optimizing irrigation and fertilization strategies in response to climate change.
Sébastien Masson, Swen Jullien, Eric Maisonnave, David Gill, Guillaume Samson, Mathieu Le Corre, and Lionel Renault
Geosci. Model Dev., 18, 1241–1263, https://doi.org/10.5194/gmd-18-1241-2025, https://doi.org/10.5194/gmd-18-1241-2025, 2025
Short summary
Short summary
This article details a new feature we implemented in the popular regional atmospheric model WRF. This feature allows for data exchange between WRF and any other model (e.g. an ocean model) using the coupling library Ocean–Atmosphere–Sea–Ice–Soil Model Coupling Toolkit (OASIS3-MCT). This coupling interface is designed to be non-intrusive, flexible and modular. It also offers the possibility of taking into account the nested zooms used in WRF or in the models with which it is coupled.
Axel Lauer, Lisa Bock, Birgit Hassler, Patrick Jöckel, Lukas Ruhe, and Manuel Schlund
Geosci. Model Dev., 18, 1169–1188, https://doi.org/10.5194/gmd-18-1169-2025, https://doi.org/10.5194/gmd-18-1169-2025, 2025
Short summary
Short summary
Earth system models are important tools to improve our understanding of current climate and to project climate change. Thus, it is crucial to understand possible shortcomings in the models. New features of the ESMValTool software package allow one to compare and visualize a model's performance with respect to reproducing observations in the context of other climate models in an easy and user-friendly way. We aim to help model developers assess and monitor climate simulations more efficiently.
Ulrich G. Wortmann, Tina Tsan, Mahrukh Niazi, Irene A. Ma, Ruben Navasardyan, Magnus-Roland Marun, Bernardo S. Chede, Jingwen Zhong, and Morgan Wolfe
Geosci. Model Dev., 18, 1155–1167, https://doi.org/10.5194/gmd-18-1155-2025, https://doi.org/10.5194/gmd-18-1155-2025, 2025
Short summary
Short summary
The Earth Science Box Modeling Toolkit (ESBMTK) is a user-friendly Python library that simplifies the creation of models to study earth system processes, such as the carbon cycle and ocean chemistry. It enhances learning by emphasizing concepts over programming and is accessible to students and researchers alike. By automating complex calculations and promoting code clarity, ESBMTK accelerates model development while improving reproducibility and the usability of scientific research.
Florian Zabel, Matthias Knüttel, and Benjamin Poschlod
Geosci. Model Dev., 18, 1067–1087, https://doi.org/10.5194/gmd-18-1067-2025, https://doi.org/10.5194/gmd-18-1067-2025, 2025
Short summary
Short summary
CropSuite is a new open-source crop suitability model. It provides a GUI and a wide range of options, including a spatial downscaling of climate data. We apply CropSuite to 48 staple and opportunity crops at a 1 km spatial resolution in Africa. We find that climate variability significantly impacts suitable areas but also affects optimal sowing dates and multiple cropping potential. The results provide valuable information for climate impact assessments, adaptation, and land-use planning.
Kerstin Hartung, Bastian Kern, Nils-Arne Dreier, Jörn Geisbüsch, Mahnoosh Haghighatnasab, Patrick Jöckel, Astrid Kerkweg, Wilton Jaciel Loch, Florian Prill, and Daniel Rieger
Geosci. Model Dev., 18, 1001–1015, https://doi.org/10.5194/gmd-18-1001-2025, https://doi.org/10.5194/gmd-18-1001-2025, 2025
Short summary
Short summary
The ICOsahedral Non-hydrostatic (ICON) model system Community Interface (ComIn) library supports connecting third-party modules to the ICON model. Third-party modules can range from simple diagnostic Python scripts to full chemistry models. ComIn offers a low barrier for code extensions to ICON, provides multi-language support (Fortran, C/C++, and Python), and reduces the migration effort in response to new ICON releases. This paper presents the ComIn design principles and a range of use cases.
Daniel Ries, Katherine Goode, Kellie McClernon, and Benjamin Hillman
Geosci. Model Dev., 18, 1041–1065, https://doi.org/10.5194/gmd-18-1041-2025, https://doi.org/10.5194/gmd-18-1041-2025, 2025
Short summary
Short summary
Machine learning has advanced research in the climate science domain, but its models are difficult to understand. In order to understand the impacts and consequences of climate interventions such as stratospheric aerosol injection, complex models are often necessary. We use a case study to illustrate how we can understand the inner workings of a complex model. We present this technique as an exploratory tool that can be used to quickly discover and assess relationships in complex climate data.
Bo Dong, Paul Ullrich, Jiwoo Lee, Peter Gleckler, Kristin Chang, and Travis A. O'Brien
Geosci. Model Dev., 18, 961–976, https://doi.org/10.5194/gmd-18-961-2025, https://doi.org/10.5194/gmd-18-961-2025, 2025
Short summary
Short summary
A metrics package designed for easy analysis of atmospheric river (AR) characteristics and statistics is presented. The tool is efficient for diagnosing systematic AR bias in climate models and useful for evaluating new AR characteristics in model simulations. In climate models, landfalling AR precipitation shows dry biases globally, and AR tracks are farther poleward (equatorward) in the North and South Atlantic (South Pacific and Indian Ocean).
Hans Segura, Xabier Pedruzo-Bagazgoitia, Philipp Weiss, Sebastian K. Müller, Thomas Rackow, Junhong Lee, Edgar Dolores-Tesillos, Imme Benedict, Matthias Aengenheyster, Razvan Aguridan, Gabriele Arduini, Alexander J. Baker, Jiawei Bao, Swantje Bastin, Eulàlia Baulenas, Tobias Becker, Sebastian Beyer, Hendryk Bockelmann, Nils Brüggemann, Lukas Brunner, Suvarchal K. Cheedela, Sushant Das, Jasper Denissen, Ian Dragaud, Piotr Dziekan, Madeleine Ekblom, Jan Frederik Engels, Monika Esch, Richard Forbes, Claudia Frauen, Lilli Freischem, Diego García-Maroto, Philipp Geier, Paul Gierz, Álvaro González-Cervera, Katherine Grayson, Matthew Griffith, Oliver Gutjahr, Helmuth Haak, Ioan Hadade, Kerstin Haslehner, Shabeh ul Hasson, Jan Hegewald, Lukas Kluft, Aleksei Koldunov, Nikolay Koldunov, Tobias Kölling, Shunya Koseki, Sergey Kosukhin, Josh Kousal, Peter Kuma, Arjun U. Kumar, Rumeng Li, Nicolas Maury, Maximilian Meindl, Sebastian Milinski, Kristian Mogensen, Bimochan Niraula, Jakub Nowak, Divya Sri Praturi, Ulrike Proske, Dian Putrasahan, René Redler, David Santuy, Domokos Sármány, Reiner Schnur, Patrick Scholz, Dmitry Sidorenko, Dorian Spät, Birgit Sützl, Daisuke Takasuka, Adrian Tompkins, Alejandro Uribe, Mirco Valentini, Menno Veerman, Aiko Voigt, Sarah Warnau, Fabian Wachsmann, Marta Wacławczyk, Nils Wedi, Karl-Hermann Wieners, Jonathan Wille, Marius Winkler, Yuting Wu, Florian Ziemen, Janos Zimmermann, Frida A.-M. Bender, Dragana Bojovic, Sandrine Bony, Simona Bordoni, Patrice Brehmer, Marcus Dengler, Emanuel Dutra, Saliou Faye, Erich Fischer, Chiel van Heerwaarden, Cathy Hohenegger, Heikki Järvinen, Markus Jochum, Thomas Jung, Johann H. Jungclaus, Noel S. Keenlyside, Daniel Klocke, Heike Konow, Martina Klose, Szymon Malinowski, Olivia Martius, Thorsten Mauritsen, Juan Pedro Mellado, Theresa Mieslinger, Elsa Mohino, Hanna Pawłowska, Karsten Peters-von Gehlen, Abdoulaye Sarré, Pajam Sobhani, Philip Stier, Lauri Tuppi, Pier Luigi Vidale, Irina Sandu, and Bjorn Stevens
EGUsphere, https://doi.org/10.5194/egusphere-2025-509, https://doi.org/10.5194/egusphere-2025-509, 2025
Short summary
Short summary
The nextGEMS project developed two Earth system models that resolve processes of the order of 10 km, giving more fidelity to the representation of local phenomena, globally. In its fourth cycle, nextGEMS performed simulations with coupled ocean, land, and atmosphere over the 2020–2049 period under the SSP3-7.0 scenario. Here, we provide an overview of nextGEMS, insights into the model development, and the realism of multi-decadal, kilometer-scale simulations.
Panagiotis Adamidis, Erik Pfister, Hendryk Bockelmann, Dominik Zobel, Jens-Olaf Beismann, and Marek Jacob
Geosci. Model Dev., 18, 905–919, https://doi.org/10.5194/gmd-18-905-2025, https://doi.org/10.5194/gmd-18-905-2025, 2025
Short summary
Short summary
In this paper, we investigated performance indicators of the climate model ICON (ICOsahedral Nonhydrostatic) on different compute architectures to answer the question of how to generate high-resolution climate simulations. Evidently, it is not enough to use more computing units of the conventionally used architectures; higher memory throughput is the most promising approach. More potential can be gained from single-node optimization rather than simply increasing the number of compute nodes.
Jonah K. Shaw, Dustin J. Swales, Sergio DeSouza-Machado, David D. Turner, Jennifer E. Kay, and David P. Schneider
EGUsphere, https://doi.org/10.5194/egusphere-2025-169, https://doi.org/10.5194/egusphere-2025-169, 2025
Short summary
Short summary
Satellites have observed earth's emission of infrared radiation since the 1970s. Because infrared wavelengths interact with the atmosphere in distinct ways, these observations contain information about the earth and atmosphere. We present a tool that runs alongside global climate models and produces output that can be directly compared with satellite measurements of infrared radiation. We then use this tool for climate model evaluation, climate change detection, and satellite mission design.
Noribeth Mariscal, Louisa K. Emmons, Duseong S. Jo, Ying Xiong, Laura M. Judd, Scott J. Janz, Jiajue Chai, and Yaoxian Huang
EGUsphere, https://doi.org/10.5194/egusphere-2025-228, https://doi.org/10.5194/egusphere-2025-228, 2025
Short summary
Short summary
The distribution of ozone (O3) and its precursors (NOx, VOCs) is explored using the chemistry-climate model, MUSICAv0, and evaluated using measurements from the Michigan-Ontario Ozone Source Experiment. A custom grid of ~7 km was created over Michigan. A sector-based diurnal cycle for anthropogenic nitric oxide was included in the model. This work shows that grid resolution played a more important role for O3 precursors, and the diurnal cycle significantly impacted nighttime O3 formation.
Maria Vittoria Struglia, Alessandro Anav, Marta Antonelli, Sandro Calmanti, Franco Catalano, Alessandro Dell'Aquila, Emanuela Pichelli, and Giovanna Pisacane
EGUsphere, https://doi.org/10.5194/egusphere-2025-387, https://doi.org/10.5194/egusphere-2025-387, 2025
Short summary
Short summary
We present the results of downscaling global climate projections for the Mediterranean and Italian regions aiming to produce high-resolution climate information for the assessment of climate change signals, focusing on extreme events. A general warming is foreseen by the end of century with a mean precipitation reduction accompanied, over Italian Peninsula, by a strong increase in the intensity of extreme precipitation events, particularly relevant for the high emissions scenario during autumn
Cited articles
Baker, A. H., Xu, H., Dennis, J. M., Levy, M. N., Nychka, D., Mickelson, S. A., Edwards, J., Vertenstein, M., and Wegener, A.: A methodology for evaluating the impact of data compression on climate simulation data, in: Proceedings of the 23rd international symposium on High-Performance Parallel and Distributed Computing, HPDC '14, 203–214, 2014.
Carson II, J. S.: Model verification and validation, in: Proceedings of the 2002 Winter Simulation Conference, 52–58, 2002.
Clune, T. and Rood, R.: Software testing and verification in climate model development, IEEE Softw., 28, 49–55, https://doi.org/10.1109/MS.2011.117, 2011.
Dai, A., Meehl, G., Washington, W., Wigley, T., and Arblaster, J. M.: Ensemble simulation of 21st century climate changes: business as usual vs. CO2 stabilization, B. Am. Meteor. Soc., 82, 2377–2388, 2001.
Easterbrook, S. M. and Johns, T. C.: Engineering the software for understanding climate change, Comput. Sci. Eng., 11, 65–74, https://doi.org/10.1109/MCSE.2009.193, 2009.
Easterbrook, S. M., Edwards, P. N., Balaji, V., and Budich, R.: Guest editors' introduction: climate change – science and software, IEEE Softw., 28, 32–35, 2011.
Goosse, H., Barriat, P., Lefebvre, W., Loutre, M., and Zunz, V.: Introduction to climate dynamics and climate modeling, available at: http://www.climate.be/textbook (last access: 5 May 2015), 2014.
Hurrell, J. W., Holland, M. M., Gent, P. R., Ghan, S., Kay, J. E., Kushner, P. J., Lamarque, J. F., Large, W. G., Lawrence, D., Lindsay, K., Lipscomb, W. H., Long, M. C., Mahowald, N., Marsh, D. R., Neale, R. B., Rasch, P., Vavrus, S., Vertenstein, M., Bader, D., Collins, W. D., Hack, J. J., Kiehl, J., and Marshall, S.: The Community Earth System Model: a framework for collaborative research, B. Am. Metereol. Soc., 94, 1339–1360, https://doi.org/10.1175/BAMS-D-12-00121.1, 2013.
IPCC Data Collection Centre 2015, available at: http://www.ipcc-data.org/ (last access: 5 May 2015), 2015.
Kay, J., Deser, C., Phillips, A., A. Mai, A., Hannay, C., Strand, G., Arblaster, J., Bates, S., Danabasoglu, G., Edwards, J., Holland, M., Kushner, P., Lamarque, J.-F., Lawrence, D., Lindsay, K., Middleton, A., Munoz, E., Neale, R., Oleson, K., Polvani, L., and Vertenstein, M.: The Community Earth System Model (CESM) Large Ensemble Project: A Community Resource for Studying Climate Change in the Presence of Internal Climate Variability, B. Am. Meteorol. Soc., https://doi.org/10.1175/BAMS-D-13-00255.1, in press, 2015.
Oberkamf, W. and Roy, C.: Verification and Validation in Scientific Computing, Cambridge University Press, Cambridge, 13–51, 2010.
Orsekes, N., K. Shrader-Frechette, K. Belitz: Verification, validation, and confirmation of numerical models in the earth sciences, Science, 263, 641–646, 1994.
Orsekes, N.: Evaluation (not validation) of quantitative models, Environ. Health Perspect., 106, 1453–1460, 1998.
Pipitone, J. and Easterbrook, S.: Assessing climate model software quality: a defect density analysis of three models, Geosci. Model Dev., 5, 1009–1022, https://doi.org/10.5194/gmd-5-1009-2012, 2012.
Rosinski, J. M. and Williamson, D. L.: The accumulation of rounding errors and port validation for global atmospheric models, SIAM J. Sci. Comput., 18, 552–564, https://doi.org/10.1137/S1064827594275534, 1997.
Sansom, P. G., Stephenson, D. B., Ferro, C. A. T., Zappa, G., and Shaffrey, L.: Simple uncertainty frameworks for selecting weighting schemes and interpreting multimodel ensemble climate change experiments, J. Climate, 26, 4017–4037, 2013.
Sargent, R. G.: Verification and Validation of Simulation Models, in: Proceedings of the 2011 Winter Simulation Conference, 183–198, 2011.
Shlens, J.: A Tutorial on Principal Component Analysis, CoRR, abs/1404.1100, available at: http://arxiv.org/abs/1404.1100 (last access: 5 May 2015), 2014.
von Storch, H. and Zwiers, F.: Testing ensembles of climate change scenarios for "statistical significance", Clim. Change, 117, 1–9, 2013.
Whitner, R. B. and Balci, O.: Guidelines for selecting and using simulation model verification techniques, in: Winter Simulation Conference, 559–568, 1989.
Zhu, Y.: Ensemble forecast: a new approach to uncertainty and predictability, Adv. Atmos. Sci., 22, 781–788, 2005.
Zhu, Y. and Toth, Z.: Ensemble based probabilistic forecast verification, in: 19th Conference on Probability and Statistics, Am. Meteor. Soc., 1–6, 2008.
Short summary
Climate simulation codes are especially complex, and their ongoing state of development requires frequent software quality assurance to both
preserve code quality and instil model confidence. To formalize and simplify this previously subjective and expensive process, we
have developed a new tool for evaluating climate consistency.
The tool has proven its utility in detecting errors in software and hardware
environments and providing rapid feedback to model developers.
Climate simulation codes are especially complex, and their ongoing state of development requires...
