Articles | Volume 14, issue 7
https://doi.org/10.5194/gmd-14-4495-2021
© Author(s) 2021. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
https://doi.org/10.5194/gmd-14-4495-2021
© Author(s) 2021. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
Methods for assessment of models
| 
22 Jul 2021
Methods for assessment of models |
| 22 Jul 2021
| 22 Jul 2021
Testing the reliability of interpretable neural networks in geoscience using the Madden–Julian oscillation
Benjamin A. Toms
CORRESPONDING AUTHOR
Department of Atmospheric Science, Colorado State University, Fort Collins, Colorado, USA
Karthik Kashinath
Lawrence Berkeley National Laboratory, Berkeley, California, USA
Prabhat
Lawrence Berkeley National Laboratory, Berkeley, California, USA
Lawrence Berkeley National Laboratory, Berkeley, California, USA
Department of Agricultural and Environmental Sciences, University of California, Davis, Davis, California, USA
Related authors
No articles found.
Ashesh Chattopadhyay, Mustafa Mustafa, Pedram Hassanzadeh, Eviatar Bach, and Karthik Kashinath
Geosci. Model Dev., 15, 2221–2237, https://doi.org/10.5194/gmd-15-2221-2022, https://doi.org/10.5194/gmd-15-2221-2022, 2022
Short summary
Short summary
There is growing interest in data-driven weather forecasting, i.e., to predict the weather by using a deep neural network that learns from the evolution of past atmospheric patterns. Here, we propose three components to add to the current data-driven weather forecast models to improve their performance. These components involve a feature that incorporates physics into the neural network, a method to add data assimilation, and an algorithm to use several different time intervals in the forecast.
Prabhat, Karthik Kashinath, Mayur Mudigonda, Sol Kim, Lukas Kapp-Schwoerer, Andre Graubner, Ege Karaismailoglu, Leo von Kleist, Thorsten Kurth, Annette Greiner, Ankur Mahesh, Kevin Yang, Colby Lewis, Jiayi Chen, Andrew Lou, Sathyavat Chandran, Ben Toms, Will Chapman, Katherine Dagon, Christine A. Shields, Travis O'Brien, Michael Wehner, and William Collins
Geosci. Model Dev., 14, 107–124, https://doi.org/10.5194/gmd-14-107-2021, https://doi.org/10.5194/gmd-14-107-2021, 2021
Short summary
Short summary
Detecting extreme weather events is a crucial step in understanding how they change due to climate change. Deep learning (DL) is remarkable at pattern recognition; however, it works best only when labeled datasets are available. We create
ClimateNet– an expert-labeled curated dataset – to train a DL model for detecting weather events and predicting changes in extreme precipitation. This work paves the way for DL-based automated, high-fidelity, and highly precise analytics of climate data.
Travis A. O'Brien, Mark D. Risser, Burlen Loring, Abdelrahman A. Elbashandy, Harinarayan Krishnan, Jeffrey Johnson, Christina M. Patricola, John P. O'Brien, Ankur Mahesh, Prabhat, Sarahí Arriaga Ramirez, Alan M. Rhoades, Alexander Charn, Héctor Inda Díaz, and William D. Collins
Geosci. Model Dev., 13, 6131–6148, https://doi.org/10.5194/gmd-13-6131-2020, https://doi.org/10.5194/gmd-13-6131-2020, 2020
Short summary
Short summary
Researchers utilize various algorithms to identify extreme weather features in climate data, and we seek to answer this question: given a
plausibleweather event detector, how does uncertainty in the detector impact scientific results? We generate a suite of statistical models that emulate expert identification of weather features. We find that the connection between El Niño and atmospheric rivers – a specific extreme weather type – depends systematically on the design of the detector.
Grzegorz Muszynski, Karthik Kashinath, Vitaliy Kurlin, Michael Wehner, and Prabhat
Geosci. Model Dev., 12, 613–628, https://doi.org/10.5194/gmd-12-613-2019, https://doi.org/10.5194/gmd-12-613-2019, 2019
Short summary
Short summary
We present the automated method for recognizing atmospheric rivers in climate data, i.e., climate model output and reanalysis product. The method is based on topological data analysis and machine learning, both of which are powerful tools that the climate science community often does not use. An advantage of the proposed method is that it is free of selection of subjective threshold conditions on a physical variable. This method is also suitable for rapidly analyzing large amounts of data.
Christine A. Shields, Jonathan J. Rutz, Lai-Yung Leung, F. Martin Ralph, Michael Wehner, Brian Kawzenuk, Juan M. Lora, Elizabeth McClenny, Tashiana Osborne, Ashley E. Payne, Paul Ullrich, Alexander Gershunov, Naomi Goldenson, Bin Guan, Yun Qian, Alexandre M. Ramos, Chandan Sarangi, Scott Sellars, Irina Gorodetskaya, Karthik Kashinath, Vitaliy Kurlin, Kelly Mahoney, Grzegorz Muszynski, Roger Pierce, Aneesh C. Subramanian, Ricardo Tome, Duane Waliser, Daniel Walton, Gary Wick, Anna Wilson, David Lavers, Prabhat, Allison Collow, Harinarayan Krishnan, Gudrun Magnusdottir, and Phu Nguyen
Geosci. Model Dev., 11, 2455–2474, https://doi.org/10.5194/gmd-11-2455-2018, https://doi.org/10.5194/gmd-11-2455-2018, 2018
Short summary
Short summary
ARTMIP (Atmospheric River Tracking Method Intercomparison Project) is a community effort with the explicit goal of understanding the uncertainties, and the implications of those uncertainties, in atmospheric river science solely due to detection algorithm. ARTMIP strives to quantify these differences and provide guidance on appropriate algorithmic choices for the science question posed. Project goals, experimental design, and preliminary results are provided.
Related subject area
Climate and Earth system modeling
The very-high-resolution configuration of the EC-Earth global model for HighResMIP
GOSI9: UK Global Ocean and Sea Ice configurations
Decomposition of skill scores for conditional verification: impact of Atlantic Multidecadal Oscillation phases on the predictability of decadal temperature forecasts
Virtual Integration of Satellite and In-situ Observation Networks (VISION) v1.0: In-Situ Observations Simulator (ISO_simulator)
Climate model downscaling in central Asia: a dynamical and a neural network approach
Multi-year simulations at kilometre scale with the Integrated Forecasting System coupled to FESOM2.5 and NEMOv3.4
Subsurface hydrological controls on the short-term effects of hurricanes on nitrate–nitrogen runoff loading: a case study of Hurricane Ida using the Energy Exascale Earth System Model (E3SM) Land Model (v2.1)
CARIB12: a regional Community Earth System Model/Modular Ocean Model 6 configuration of the Caribbean Sea
Architectural insights into and training methodology optimization of Pangu-Weather
Evaluation of global fire simulations in CMIP6 Earth system models
Evaluating downscaled products with expected hydroclimatic co-variances
Software sustainability of global impact models
fair-calibrate v1.4.1: calibration, constraining, and validation of the FaIR simple climate model for reliable future climate projections
ISOM 1.0: a fully mesoscale-resolving idealized Southern Ocean model and the diversity of multiscale eddy interactions
A computationally lightweight model for ensemble forecasting of environmental hazards: General TAMSAT-ALERT v1.2.1
Introducing the MESMER-M-TPv0.1.0 module: spatially explicit Earth system model emulation for monthly precipitation and temperature
The need for carbon-emissions-driven climate projections in CMIP7
Robust handling of extremes in quantile mapping – “Murder your darlings”
A protocol for model intercomparison of impacts of marine cloud brightening climate intervention
An extensible perturbed parameter ensemble for the Community Atmosphere Model version 6
Coupling the regional climate model ICON-CLM v2.6.6 to the Earth system model GCOAST-AHOI v2.0 using OASIS3-MCT v4.0
A fully coupled solid-particle microphysics scheme for stratospheric aerosol injections within the aerosol–chemistry–climate model SOCOL-AERv2
An improved representation of aerosol in the ECMWF IFS-COMPO 49R1 through the integration of EQSAM4Climv12 – a first attempt at simulating aerosol acidity
At-scale Model Output Statistics in mountain environments (AtsMOS v1.0)
Impact of ocean vertical-mixing parameterization on Arctic sea ice and upper-ocean properties using the NEMO-SI3 model
Bridging the gap: a new module for human water use in the Community Earth System Model version 2.2.1
Historical Trends and Controlling Factors of Isoprene Emissions in CMIP6 Earth System Models
Modeling Commercial-Scale CO2 Storage in the Gas Hydrate Stability Zone with PFLOTRAN v6.0
A new lightning scheme in the Canadian Atmospheric Model (CanAM5.1): implementation, evaluation, and projections of lightning and fire in future climates
Methane dynamics in the Baltic Sea: investigating concentration, flux, and isotopic composition patterns using the coupled physical–biogeochemical model BALTSEM-CH4 v1.0
Using feature importance as exploratory data analysis tool on earth system models
CropSuite – A comprehensive open-source crop suitability model considering climate variability for climate impact assessment
ICON ComIn – The ICON Community Interface (ComIn version 0.1.0, with ICON version 2024.01-01)
Split-explicit external mode solver in the finite volume sea ice–ocean model FESOM2
Applying double cropping and interactive irrigation in the North China Plain using WRF4.5
The sea ice component of GC5: coupling SI3 to HadGEM3 using conductive fluxes
CICE on a C-grid: new momentum, stress, and transport schemes for CICEv6.5
HyPhAICC v1.0: a hybrid physics–AI approach for probability fields advection shown through an application to cloud cover nowcasting
CICERO Simple Climate Model (CICERO-SCM v1.1.1) – an improved simple climate model with a parameter calibration tool
A non-intrusive, multi-scale, and flexible coupling interface in WRF
T&C-CROP: Representing mechanistic crop growth with a terrestrial biosphere model (T&C, v1.5): Model formulation and validation
Development of a plant carbon–nitrogen interface coupling framework in a coupled biophysical-ecosystem–biogeochemical model (SSiB5/TRIFFID/DayCent-SOM v1.0)
The Earth Science Box Modeling Toolkit (ESBMTK)
High Resolution Model Intercomparison Project phase 2 (HighResMIP2) towards CMIP7
Dynamical Madden–Julian Oscillation forecasts using an ensemble subseasonal-to-seasonal forecast system of the IAP-CAS model
Presentation, Calibration and Testing of the DCESS II Earth System Model of Intermediate Complexity (version 1.0)
Baseline Climate Variables for Earth System Modelling
The DOE E3SM Version 2.1: Overview and Assessment of the Impacts of Parameterized Ocean Submesoscales
Evaluation of atmospheric rivers in reanalyses and climate models in a new metrics framework
Implementation of a brittle sea ice rheology in an Eulerian, finite-difference, C-grid modeling framework: impact on the simulated deformation of sea ice in the Arctic
Eduardo Moreno-Chamarro, Thomas Arsouze, Mario Acosta, Pierre-Antoine Bretonnière, Miguel Castrillo, Eric Ferrer, Amanda Frigola, Daria Kuznetsova, Eneko Martin-Martinez, Pablo Ortega, and Sergi Palomas
Geosci. Model Dev., 18, 461–482, https://doi.org/10.5194/gmd-18-461-2025, https://doi.org/10.5194/gmd-18-461-2025, 2025
Short summary
Short summary
We present the high-resolution model version of the EC-Earth global climate model to contribute to HighResMIP. The combined model resolution is about 10–15 km in both the ocean and atmosphere, which makes it one of the finest ever used to complete historical and scenario simulations. This model is compared with two lower-resolution versions, with a 100 km and a 25 km grid. The three models are compared with observations to study the improvements thanks to the increased resolution.
Catherine Guiavarc'h, David Storkey, Adam T. Blaker, Ed Blockley, Alex Megann, Helene Hewitt, Michael J. Bell, Daley Calvert, Dan Copsey, Bablu Sinha, Sophia Moreton, Pierre Mathiot, and Bo An
Geosci. Model Dev., 18, 377–403, https://doi.org/10.5194/gmd-18-377-2025, https://doi.org/10.5194/gmd-18-377-2025, 2025
Short summary
Short summary
The Global Ocean and Sea Ice configuration version 9 (GOSI9) is the new UK hierarchy of model configurations based on the Nucleus for European Modelling of the Ocean (NEMO) and available at three resolutions. It will be used for various applications, e.g. weather forecasting and climate prediction. It improves upon the previous version by reducing global temperature and salinity biases and enhancing the representation of Arctic sea ice and the Antarctic Circumpolar Current.
Andy Richling, Jens Grieger, and Henning W. Rust
Geosci. Model Dev., 18, 361–375, https://doi.org/10.5194/gmd-18-361-2025, https://doi.org/10.5194/gmd-18-361-2025, 2025
Short summary
Short summary
The performance of weather and climate prediction systems is variable in time and space. It is of interest how this performance varies in different situations. We provide a decomposition of a skill score (a measure of forecast performance) as a tool for detailed assessment of performance variability to support model development or forecast improvement. The framework is exemplified with decadal forecasts to assess the impact of different ocean states in the North Atlantic on temperature forecast.
Maria R. Russo, Sadie L. Bartholomew, David Hassell, Alex M. Mason, Erica Neininger, A. James Perman, David A. J. Sproson, Duncan Watson-Parris, and Nathan Luke Abraham
Geosci. Model Dev., 18, 181–191, https://doi.org/10.5194/gmd-18-181-2025, https://doi.org/10.5194/gmd-18-181-2025, 2025
Short summary
Short summary
Observational data and modelling capabilities have expanded in recent years, but there are still barriers preventing these two data sources from being used in synergy. Proper comparison requires generating, storing, and handling a large amount of data. This work describes the first step in the development of a new set of software tools, the VISION toolkit, which can enable the easy and efficient integration of observational and model data required for model evaluation.
Bijan Fallah, Masoud Rostami, Emmanuele Russo, Paula Harder, Christoph Menz, Peter Hoffmann, Iulii Didovets, and Fred F. Hattermann
Geosci. Model Dev., 18, 161–180, https://doi.org/10.5194/gmd-18-161-2025, https://doi.org/10.5194/gmd-18-161-2025, 2025
Short summary
Short summary
We tried to contribute to a local climate change impact study in central Asia, a region that is water-scarce and vulnerable to global climate change. We use regional models and machine learning to produce reliable local data from global climate models. We find that regional models show more realistic and detailed changes in heavy precipitation than global climate models. Our work can help assess the future risks of extreme events and plan adaptation strategies in central Asia.
Thomas Rackow, Xabier Pedruzo-Bagazgoitia, Tobias Becker, Sebastian Milinski, Irina Sandu, Razvan Aguridan, Peter Bechtold, Sebastian Beyer, Jean Bidlot, Souhail Boussetta, Willem Deconinck, Michail Diamantakis, Peter Dueben, Emanuel Dutra, Richard Forbes, Rohit Ghosh, Helge F. Goessling, Ioan Hadade, Jan Hegewald, Thomas Jung, Sarah Keeley, Lukas Kluft, Nikolay Koldunov, Aleksei Koldunov, Tobias Kölling, Josh Kousal, Christian Kühnlein, Pedro Maciel, Kristian Mogensen, Tiago Quintino, Inna Polichtchouk, Balthasar Reuter, Domokos Sármány, Patrick Scholz, Dmitry Sidorenko, Jan Streffing, Birgit Sützl, Daisuke Takasuka, Steffen Tietsche, Mirco Valentini, Benoît Vannière, Nils Wedi, Lorenzo Zampieri, and Florian Ziemen
Geosci. Model Dev., 18, 33–69, https://doi.org/10.5194/gmd-18-33-2025, https://doi.org/10.5194/gmd-18-33-2025, 2025
Short summary
Short summary
Detailed global climate model simulations have been created based on a numerical weather prediction model, offering more accurate spatial detail down to the scale of individual cities ("kilometre-scale") and a better understanding of climate phenomena such as atmospheric storms, whirls in the ocean, and cracks in sea ice. The new model aims to provide globally consistent information on local climate change with greater precision, benefiting environmental planning and local impact modelling.
Yilin Fang, Hoang Viet Tran, and L. Ruby Leung
Geosci. Model Dev., 18, 19–32, https://doi.org/10.5194/gmd-18-19-2025, https://doi.org/10.5194/gmd-18-19-2025, 2025
Short summary
Short summary
Hurricanes may worsen water quality in the lower Mississippi River basin (LMRB) by increasing nutrient runoff. We found that runoff parameterizations greatly affect nitrate–nitrogen runoff simulated using an Earth system land model. Our simulations predicted increased nitrogen runoff in the LMRB during Hurricane Ida in 2021, albeit less pronounced than the observations, indicating areas for model improvement to better understand and manage nutrient runoff loss during hurricanes in the region.
Giovanni Seijo-Ellis, Donata Giglio, Gustavo Marques, and Frank Bryan
Geosci. Model Dev., 17, 8989–9021, https://doi.org/10.5194/gmd-17-8989-2024, https://doi.org/10.5194/gmd-17-8989-2024, 2024
Short summary
Short summary
A CESM–MOM6 regional configuration of the Caribbean Sea was developed in response to the rising need for high-resolution models for climate impact studies. The configuration is validated for the period 2000–2020 and improves significant errors in a low-resolution model. Oceanic properties are well represented. Patterns of freshwater associated with the Amazon River are well captured, and the mean flows of ocean waters across multiple passages in the Caribbean Sea agree with observations.
Deifilia To, Julian Quinting, Gholam Ali Hoshyaripour, Markus Götz, Achim Streit, and Charlotte Debus
Geosci. Model Dev., 17, 8873–8884, https://doi.org/10.5194/gmd-17-8873-2024, https://doi.org/10.5194/gmd-17-8873-2024, 2024
Short summary
Short summary
Pangu-Weather is a breakthrough machine learning model in medium-range weather forecasting that considers 3D atmospheric information. We show that using a simpler 2D framework improves robustness, speeds up training, and reduces computational needs by 20 %–30 %. We introduce a training procedure that varies the importance of atmospheric variables over time to speed up training convergence. Decreasing computational demand increases the accessibility of training and working with the model.
Fang Li, Xiang Song, Sandy P. Harrison, Jennifer R. Marlon, Zhongda Lin, L. Ruby Leung, Jörg Schwinger, Virginie Marécal, Shiyu Wang, Daniel S. Ward, Xiao Dong, Hanna Lee, Lars Nieradzik, Sam S. Rabin, and Roland Séférian
Geosci. Model Dev., 17, 8751–8771, https://doi.org/10.5194/gmd-17-8751-2024, https://doi.org/10.5194/gmd-17-8751-2024, 2024
Short summary
Short summary
This study provides the first comprehensive assessment of historical fire simulations from 19 Earth system models in phase 6 of the Coupled Model Intercomparison Project (CMIP6). Most models reproduce global totals, spatial patterns, seasonality, and regional historical changes well but fail to simulate the recent decline in global burned area and underestimate the fire response to climate variability. CMIP6 simulations address three critical issues of phase-5 models.
Seung H. Baek, Paul A. Ullrich, Bo Dong, and Jiwoo Lee
Geosci. Model Dev., 17, 8665–8681, https://doi.org/10.5194/gmd-17-8665-2024, https://doi.org/10.5194/gmd-17-8665-2024, 2024
Short summary
Short summary
We evaluate downscaled products by examining locally relevant co-variances during precipitation events. Common statistical downscaling techniques preserve expected co-variances during convective precipitation (a stationary phenomenon). However, they dampen future intensification of frontal precipitation (a non-stationary phenomenon) captured in global climate models and dynamical downscaling. Our study quantifies a ramification of the stationarity assumption underlying statistical downscaling.
Emmanuel Nyenah, Petra Döll, Daniel S. Katz, and Robert Reinecke
Geosci. Model Dev., 17, 8593–8611, https://doi.org/10.5194/gmd-17-8593-2024, https://doi.org/10.5194/gmd-17-8593-2024, 2024
Short summary
Short summary
Research software is vital for scientific progress but is often developed by scientists with limited skills, time, and funding, leading to challenges in usability and maintenance. Our study across 10 sectors shows strengths in version control, open-source licensing, and documentation while emphasizing the need for containerization and code quality. We recommend workshops; code quality metrics; funding; and following the findable, accessible, interoperable, and reusable (FAIR) standards.
Chris Smith, Donald P. Cummins, Hege-Beate Fredriksen, Zebedee Nicholls, Malte Meinshausen, Myles Allen, Stuart Jenkins, Nicholas Leach, Camilla Mathison, and Antti-Ilari Partanen
Geosci. Model Dev., 17, 8569–8592, https://doi.org/10.5194/gmd-17-8569-2024, https://doi.org/10.5194/gmd-17-8569-2024, 2024
Short summary
Short summary
Climate projections are only useful if the underlying models that produce them are well calibrated and can reproduce observed climate change. We formalise a software package that calibrates the open-source FaIR simple climate model to full-complexity Earth system models. Observations, including historical warming, and assessments of key climate variables such as that of climate sensitivity are used to constrain the model output.
Jingwei Xie, Xi Wang, Hailong Liu, Pengfei Lin, Jiangfeng Yu, Zipeng Yu, Junlin Wei, and Xiang Han
Geosci. Model Dev., 17, 8469–8493, https://doi.org/10.5194/gmd-17-8469-2024, https://doi.org/10.5194/gmd-17-8469-2024, 2024
Short summary
Short summary
We propose the concept of mesoscale ocean direct numerical simulation (MODNS), which should resolve the first baroclinic deformation radius and ensure the numerical dissipative effects do not directly contaminate the mesoscale motions. It can be a benchmark for testing mesoscale ocean large eddy simulation (MOLES) methods in ocean models. We build an idealized Southern Ocean model using MITgcm to generate a type of MODNS. We also illustrate the diversity of multiscale eddy interactions.
Emily Black, John Ellis, and Ross I. Maidment
Geosci. Model Dev., 17, 8353–8372, https://doi.org/10.5194/gmd-17-8353-2024, https://doi.org/10.5194/gmd-17-8353-2024, 2024
Short summary
Short summary
We present General TAMSAT-ALERT, a computationally lightweight and versatile tool for generating ensemble forecasts from time series data. General TAMSAT-ALERT is capable of combining multiple streams of monitoring and meteorological forecasting data into probabilistic hazard assessments. In this way, it complements existing systems and enhances their utility for actionable hazard assessment.
Sarah Schöngart, Lukas Gudmundsson, Mathias Hauser, Peter Pfleiderer, Quentin Lejeune, Shruti Nath, Sonia Isabelle Seneviratne, and Carl-Friedrich Schleussner
Geosci. Model Dev., 17, 8283–8320, https://doi.org/10.5194/gmd-17-8283-2024, https://doi.org/10.5194/gmd-17-8283-2024, 2024
Short summary
Short summary
Precipitation and temperature are two of the most impact-relevant climatic variables. Yet, projecting future precipitation and temperature data under different emission scenarios relies on complex models that are computationally expensive. In this study, we propose a method that allows us to generate monthly means of local precipitation and temperature at low computational costs. Our modelling framework is particularly useful for all downstream applications of climate model data.
Benjamin M. Sanderson, Ben B. B. Booth, John Dunne, Veronika Eyring, Rosie A. Fisher, Pierre Friedlingstein, Matthew J. Gidden, Tomohiro Hajima, Chris D. Jones, Colin G. Jones, Andrew King, Charles D. Koven, David M. Lawrence, Jason Lowe, Nadine Mengis, Glen P. Peters, Joeri Rogelj, Chris Smith, Abigail C. Snyder, Isla R. Simpson, Abigail L. S. Swann, Claudia Tebaldi, Tatiana Ilyina, Carl-Friedrich Schleussner, Roland Séférian, Bjørn H. Samset, Detlef van Vuuren, and Sönke Zaehle
Geosci. Model Dev., 17, 8141–8172, https://doi.org/10.5194/gmd-17-8141-2024, https://doi.org/10.5194/gmd-17-8141-2024, 2024
Short summary
Short summary
We discuss how, in order to provide more relevant guidance for climate policy, coordinated climate experiments should adopt a greater focus on simulations where Earth system models are provided with carbon emissions from fossil fuels together with land use change instructions, rather than past approaches that have largely focused on experiments with prescribed atmospheric carbon dioxide concentrations. We discuss how these goals might be achieved in coordinated climate modeling experiments.
Peter Berg, Thomas Bosshard, Denica Bozhinova, Lars Bärring, Joakim Löw, Carolina Nilsson, Gustav Strandberg, Johan Södling, Johan Thuresson, Renate Wilcke, and Wei Yang
Geosci. Model Dev., 17, 8173–8179, https://doi.org/10.5194/gmd-17-8173-2024, https://doi.org/10.5194/gmd-17-8173-2024, 2024
Short summary
Short summary
When bias adjusting climate model data using quantile mapping, one needs to prescribe what to do at the tails of the distribution, where a larger data range is likely encountered outside of the calibration period. The end result is highly dependent on the method used. We show that, to avoid discontinuities in the time series, one needs to exclude data in the calibration range to also activate the extrapolation functionality in that time period.
Philip J. Rasch, Haruki Hirasawa, Mingxuan Wu, Sarah J. Doherty, Robert Wood, Hailong Wang, Andy Jones, James Haywood, and Hansi Singh
Geosci. Model Dev., 17, 7963–7994, https://doi.org/10.5194/gmd-17-7963-2024, https://doi.org/10.5194/gmd-17-7963-2024, 2024
Short summary
Short summary
We introduce a protocol to compare computer climate simulations to better understand a proposed strategy intended to counter warming and climate impacts from greenhouse gas increases. This slightly changes clouds in six ocean regions to reflect more sunlight and cool the Earth. Example changes in clouds and climate are shown for three climate models. Cloud changes differ between the models, but precipitation and surface temperature changes are similar when their cooling effects are made similar.
Trude Eidhammer, Andrew Gettelman, Katherine Thayer-Calder, Duncan Watson-Parris, Gregory Elsaesser, Hugh Morrison, Marcus van Lier-Walqui, Ci Song, and Daniel McCoy
Geosci. Model Dev., 17, 7835–7853, https://doi.org/10.5194/gmd-17-7835-2024, https://doi.org/10.5194/gmd-17-7835-2024, 2024
Short summary
Short summary
We describe a dataset where 45 parameters related to cloud processes in the Community Earth System Model version 2 (CESM2) Community Atmosphere Model version 6 (CAM6) are perturbed. Three sets of perturbed parameter ensembles (263 members) were created: current climate, preindustrial aerosol loading and future climate with sea surface temperature increased by 4 K.
Ha Thi Minh Ho-Hagemann, Vera Maurer, Stefan Poll, and Irina Fast
Geosci. Model Dev., 17, 7815–7834, https://doi.org/10.5194/gmd-17-7815-2024, https://doi.org/10.5194/gmd-17-7815-2024, 2024
Short summary
Short summary
The regional Earth system model GCOAST-AHOI v2.0 that includes the regional climate model ICON-CLM coupled to the ocean model NEMO and the hydrological discharge model HD via the OASIS3-MCT coupler can be a useful tool for conducting long-term regional climate simulations over the EURO-CORDEX domain. The new OASIS3-MCT coupling interface implemented in ICON-CLM makes it more flexible for coupling to an external ocean model and an external hydrological discharge model.
Sandro Vattioni, Rahel Weber, Aryeh Feinberg, Andrea Stenke, John A. Dykema, Beiping Luo, Georgios A. Kelesidis, Christian A. Bruun, Timofei Sukhodolov, Frank N. Keutsch, Thomas Peter, and Gabriel Chiodo
Geosci. Model Dev., 17, 7767–7793, https://doi.org/10.5194/gmd-17-7767-2024, https://doi.org/10.5194/gmd-17-7767-2024, 2024
Short summary
Short summary
We quantified impacts and efficiency of stratospheric solar climate intervention via solid particle injection. Microphysical interactions of solid particles with the sulfur cycle were interactively coupled to the heterogeneous chemistry scheme and the radiative transfer code of an aerosol–chemistry–climate model. Compared to injection of SO2 we only find a stronger cooling efficiency for solid particles when normalizing to the aerosol load but not when normalizing to the injection rate.
Samuel Rémy, Swen Metzger, Vincent Huijnen, Jason E. Williams, and Johannes Flemming
Geosci. Model Dev., 17, 7539–7567, https://doi.org/10.5194/gmd-17-7539-2024, https://doi.org/10.5194/gmd-17-7539-2024, 2024
Short summary
Short summary
In this paper we describe the development of the future operational cycle 49R1 of the IFS-COMPO system, used for operational forecasts of atmospheric composition in the CAMS project, and focus on the implementation of the thermodynamical model EQSAM4Clim version 12. The implementation of EQSAM4Clim significantly improves the simulated secondary inorganic aerosol surface concentration. The new aerosol and precipitation acidity diagnostics showed good agreement against observational datasets.
Maximillian Van Wyk de Vries, Tom Matthews, L. Baker Perry, Nirakar Thapa, and Rob Wilby
Geosci. Model Dev., 17, 7629–7643, https://doi.org/10.5194/gmd-17-7629-2024, https://doi.org/10.5194/gmd-17-7629-2024, 2024
Short summary
Short summary
This paper introduces the AtsMOS workflow, a new tool for improving weather forecasts in mountainous areas. By combining advanced statistical techniques with local weather data, AtsMOS can provide more accurate predictions of weather conditions. Using data from Mount Everest as an example, AtsMOS has shown promise in better forecasting hazardous weather conditions, making it a valuable tool for communities in mountainous regions and beyond.
Sofia Allende, Anne Marie Treguier, Camille Lique, Clément de Boyer Montégut, François Massonnet, Thierry Fichefet, and Antoine Barthélemy
Geosci. Model Dev., 17, 7445–7466, https://doi.org/10.5194/gmd-17-7445-2024, https://doi.org/10.5194/gmd-17-7445-2024, 2024
Short summary
Short summary
We study the parameters of the turbulent-kinetic-energy mixed-layer-penetration scheme in the NEMO model with regard to sea-ice-covered regions of the Arctic Ocean. This evaluation reveals the impact of these parameters on mixed-layer depth, sea surface temperature and salinity, and ocean stratification. Our findings demonstrate significant impacts on sea ice thickness and sea ice concentration, emphasizing the need for accurately representing ocean mixing to understand Arctic climate dynamics.
Sabin I. Taranu, David M. Lawrence, Yoshihide Wada, Ting Tang, Erik Kluzek, Sam Rabin, Yi Yao, Steven J. De Hertog, Inne Vanderkelen, and Wim Thiery
Geosci. Model Dev., 17, 7365–7399, https://doi.org/10.5194/gmd-17-7365-2024, https://doi.org/10.5194/gmd-17-7365-2024, 2024
Short summary
Short summary
In this study, we improved a climate model by adding the representation of water use sectors such as domestic, industry, and agriculture. This new feature helps us understand how water is used and supplied in various areas. We tested our model from 1971 to 2010 and found that it accurately identifies areas with water scarcity. By modelling the competition between sectors when water availability is limited, the model helps estimate the intensity and extent of individual sectors' water shortages.
Thi Nhu Ngoc Do, Kengo Sudo, Akihiko Ito, Louisa Emmons, Vaishali Naik, Kostas Tsigaridis, Øyvind Seland, Gerd A. Folberth, and Douglas I. Kelley
EGUsphere, https://doi.org/10.5194/egusphere-2024-2313, https://doi.org/10.5194/egusphere-2024-2313, 2024
Short summary
Short summary
Understanding historical isoprene emission changes is important for predicting future climate, but trends and their controlling factors remain uncertain. This study shows that long-term isoprene trends vary among Earth System Models mainly due to partially incorporating CO2 effects and land cover changes rather than climate. Future models that refine these factors’ effects on isoprene emissions, along with long-term observations, are essential for better understanding plant-climate interactions.
Michael Nole, Jonah Bartrand, Fawz Naim, and Glenn Hammond
Geosci. Model Dev. Discuss., https://doi.org/10.5194/gmd-2024-162, https://doi.org/10.5194/gmd-2024-162, 2024
Revised manuscript accepted for GMD
Short summary
Short summary
Safe carbon dioxide (CO2) storage is likely to be critical for mitigating some of the most dangerous effects of climate change. We present a simulation framework for modeling CO2 storage beneath the seafloor where CO2 can form a solid. This can aid in permanent CO2 storage for long periods of time. Our models show what a commercial-scale CO2 injection would look like in a marine environment. We discuss what would need to be considered when designing a sub-sea CO2 injection.
Cynthia Whaley, Montana Etten-Bohm, Courtney Schumacher, Ayodeji Akingunola, Vivek Arora, Jason Cole, Michael Lazare, David Plummer, Knut von Salzen, and Barbara Winter
Geosci. Model Dev., 17, 7141–7155, https://doi.org/10.5194/gmd-17-7141-2024, https://doi.org/10.5194/gmd-17-7141-2024, 2024
Short summary
Short summary
This paper describes how lightning was added as a process in the Canadian Earth System Model in order to interactively respond to climate changes. As lightning is an important cause of global wildfires, this new model development allows for more realistic projections of how wildfires may change in the future, responding to a changing climate.
Erik Gustafsson, Bo G. Gustafsson, Martijn Hermans, Christoph Humborg, and Christian Stranne
Geosci. Model Dev., 17, 7157–7179, https://doi.org/10.5194/gmd-17-7157-2024, https://doi.org/10.5194/gmd-17-7157-2024, 2024
Short summary
Short summary
Methane (CH4) cycling in the Baltic Proper is studied through model simulations, enabling a first estimate of key CH4 fluxes. A preliminary budget identifies benthic CH4 release as the dominant source and two main sinks: CH4 oxidation in the water (92 % of sinks) and outgassing to the atmosphere (8 % of sinks). This study addresses CH4 emissions from coastal seas and is a first step toward understanding the relative importance of open-water outgassing compared with local coastal hotspots.
Daniel Ries, Katherine Goode, Kellie McClernon, and Benjamin Hillman
Geosci. Model Dev. Discuss., https://doi.org/10.5194/gmd-2024-133, https://doi.org/10.5194/gmd-2024-133, 2024
Revised manuscript accepted for GMD
Short summary
Short summary
Machine learning has advanced research in the climate science domain, but its models are difficult to understand. In order to understand the impacts and consequences of climate interventions such as stratospheric aerosol injection, complex models are often necessary. We use a case study to illustrate how we can understand the inner workings of a complex model. We present this technique as an exploratory tool that can be used to quickly discover and assess relationships in complex climate data.
Florian Zabel, Matthias Knüttel, and Benjamin Poschlod
EGUsphere, https://doi.org/10.5194/egusphere-2024-2526, https://doi.org/10.5194/egusphere-2024-2526, 2024
Short summary
Short summary
CropSuite is a fuzzy-logic based high resolution open-source crop suitability model considering the impact of climate variability. We apply CropSuite for 48 important staple and cash crops at 1 km spatial resolution for Africa. We find that climate variability significantly impacts on suitable areas, but also affects optimal sowing dates, and multiple cropping potentials. The results provide information that can be used for climate impact assessments, adaptation and land-use planning.
Kerstin Hartung, Bastian Kern, Nils-Arne Dreier, Jörn Geisbüsch, Mahnoosh Haghighatnasab, Patrick Jöckel, Astrid Kerkweg, Wilton Jaciel Loch, Florian Prill, and Daniel Rieger
Geosci. Model Dev. Discuss., https://doi.org/10.5194/gmd-2024-135, https://doi.org/10.5194/gmd-2024-135, 2024
Revised manuscript accepted for GMD
Short summary
Short summary
The Icosahedral Nonhydrostatic (ICON) Model Community Interface (ComIn) library supports connecting third-party modules to the ICON model. Third-party modules can range from simple diagnostic Python scripts to full chemistry models. ComIn offers a low barrier for code extensions to ICON, provides multi-language support (Fortran, C/C++ and Python) and reduces the migration effort in response to new ICON releases. This paper presents the ComIn design principles and a range of use cases.
Tridib Banerjee, Patrick Scholz, Sergey Danilov, Knut Klingbeil, and Dmitry Sidorenko
Geosci. Model Dev., 17, 7051–7065, https://doi.org/10.5194/gmd-17-7051-2024, https://doi.org/10.5194/gmd-17-7051-2024, 2024
Short summary
Short summary
In this paper we propose a new alternative to one of the functionalities of the sea ice model FESOM2. The alternative we propose allows the model to capture and simulate fast changes in quantities like sea surface elevation more accurately. We also demonstrate that the new alternative is faster and more adept at taking advantages of highly parallelized computing infrastructure. We therefore show that this new alternative is a great addition to the sea ice model FESOM2.
Yuwen Fan, Zhao Yang, Min-Hui Lo, Jina Hur, and Eun-Soon Im
Geosci. Model Dev., 17, 6929–6947, https://doi.org/10.5194/gmd-17-6929-2024, https://doi.org/10.5194/gmd-17-6929-2024, 2024
Short summary
Short summary
Irrigated agriculture in the North China Plain (NCP) has a significant impact on the local climate. To better understand this impact, we developed a specialized model specifically for the NCP region. This model allows us to simulate the double-cropping vegetation and the dynamic irrigation practices that are commonly employed in the NCP. This model shows improved performance in capturing the general crop growth, such as crop stages, biomass, crop yield, and vegetation greenness.
Ed Blockley, Emma Fiedler, Jeff Ridley, Luke Roberts, Alex West, Dan Copsey, Daniel Feltham, Tim Graham, David Livings, Clement Rousset, David Schroeder, and Martin Vancoppenolle
Geosci. Model Dev., 17, 6799–6817, https://doi.org/10.5194/gmd-17-6799-2024, https://doi.org/10.5194/gmd-17-6799-2024, 2024
Short summary
Short summary
This paper documents the sea ice model component of the latest Met Office coupled model configuration, which will be used as the physical basis for UK contributions to CMIP7. Documentation of science options used in the configuration are given along with a brief model evaluation. This is the first UK configuration to use NEMO’s new SI3 sea ice model. We provide details on how SI3 was adapted to work with Met Office coupling methodology and documentation of coupling processes in the model.
Jean-François Lemieux, William H. Lipscomb, Anthony Craig, David A. Bailey, Elizabeth C. Hunke, Philippe Blain, Till A. S. Rasmussen, Mats Bentsen, Frédéric Dupont, David Hebert, and Richard Allard
Geosci. Model Dev., 17, 6703–6724, https://doi.org/10.5194/gmd-17-6703-2024, https://doi.org/10.5194/gmd-17-6703-2024, 2024
Short summary
Short summary
We present the latest version of the CICE model. It solves equations that describe the dynamics and the growth and melt of sea ice. To do so, the domain is divided into grid cells and variables are positioned at specific locations in the cells. A new implementation (C-grid) is presented, with the velocity located on cell edges. Compared to the previous B-grid, the C-grid allows for a natural coupling with some oceanic and atmospheric models. It also allows for ice transport in narrow channels.
Rachid El Montassir, Olivier Pannekoucke, and Corentin Lapeyre
Geosci. Model Dev., 17, 6657–6681, https://doi.org/10.5194/gmd-17-6657-2024, https://doi.org/10.5194/gmd-17-6657-2024, 2024
Short summary
Short summary
This study introduces a novel approach that combines physics and artificial intelligence (AI) for improved cloud cover forecasting. This approach outperforms traditional deep learning (DL) methods in producing realistic and physically consistent results while requiring less training data. This architecture provides a promising solution to overcome the limitations of classical AI methods and contributes to open up new possibilities for combining physical knowledge with deep learning models.
Marit Sandstad, Borgar Aamaas, Ane Nordlie Johansen, Marianne Tronstad Lund, Glen Philip Peters, Bjørn Hallvard Samset, Benjamin Mark Sanderson, and Ragnhild Bieltvedt Skeie
Geosci. Model Dev., 17, 6589–6625, https://doi.org/10.5194/gmd-17-6589-2024, https://doi.org/10.5194/gmd-17-6589-2024, 2024
Short summary
Short summary
The CICERO-SCM has existed as a Fortran model since 1999 that calculates the radiative forcing and concentrations from emissions and is an upwelling diffusion energy balance model of the ocean that calculates temperature change. In this paper, we describe an updated version ported to Python and publicly available at https://github.com/ciceroOslo/ciceroscm (https://doi.org/10.5281/zenodo.10548720). This version contains functionality for parallel runs and automatic calibration.
Sébastien Masson, Swen Jullien, Eric Maisonnave, David Gill, Guillaume Samson, Mathieu Le Corre, and Lionel Renault
Geosci. Model Dev. Discuss., https://doi.org/10.5194/gmd-2024-140, https://doi.org/10.5194/gmd-2024-140, 2024
Revised manuscript accepted for GMD
Short summary
Short summary
This article details a new feature we implemented in the most popular regional atmospheric model (WRF). This feature allows data to be exchanged between WRF and any other model (e.g. an ocean model) using the coupling library Ocean-Atmosphere-Sea-Ice-Soil – Model Coupling Toolkit (OASIS3-MCT). This coupling interface is designed to be non-intrusive, flexible and modular. It also offers the possibility of taking into account the nested zooms used in WRF or in the models with which it is coupled.
Jordi Buckley Paules, Simone Fatichi, Bonnie Warring, and Athanasios Paschalis
EGUsphere, https://doi.org/10.5194/egusphere-2024-2072, https://doi.org/10.5194/egusphere-2024-2072, 2024
Short summary
Short summary
We outline and validate developments to the pre-existing process-based model T&C to better represent cropland processes. Foreseen applications of T&C-CROP include hydrological and carbon storage implications of land-use transitions involving crop, forest, and pasture conversion, as well as studies on optimal irrigation and fertilization under a changing climate.
Zheng Xiang, Yongkang Xue, Weidong Guo, Melannie D. Hartman, Ye Liu, and William J. Parton
Geosci. Model Dev., 17, 6437–6464, https://doi.org/10.5194/gmd-17-6437-2024, https://doi.org/10.5194/gmd-17-6437-2024, 2024
Short summary
Short summary
A process-based plant carbon (C)–nitrogen (N) interface coupling framework has been developed which mainly focuses on plant resistance and N-limitation effects on photosynthesis, plant respiration, and plant phenology. A dynamic C / N ratio is introduced to represent plant resistance and self-adjustment. The framework has been implemented in a coupled biophysical-ecosystem–biogeochemical model, and testing results show a general improvement in simulating plant properties with this framework.
Ulrich Georg Wortmann, Tina Tsan, Mahrukh Niazi, Ruben Navasardyan, Magnus-Roland Marun, Bernardo S. Chede, Jingwen Zhong, and Morgan Wolfe
EGUsphere, https://doi.org/10.5194/egusphere-2024-1864, https://doi.org/10.5194/egusphere-2024-1864, 2024
Short summary
Short summary
The Earth Science Box Modeling Toolkit (ESBMTK) is a Python library designed to separate model description from numerical implementation. This approach results in well-documented, easily readable, and maintainable model code, allowing students and researchers to concentrate on conceptual challenges rather than mathematical intricacies.
Malcolm John Roberts, Kevin A. Reed, Qing Bao, Joseph J. Barsugli, Suzana J. Camargo, Louis-Philippe Caron, Ping Chang, Cheng-Ta Chen, Hannah M. Christensen, Gokhan Danabasoglu, Ivy Frenger, Neven S. Fučkar, Shabeh ul Hasson, Helene T. Hewitt, Huanping Huang, Daehyun Kim, Chihiro Kodama, Michael Lai, Lai-Yung Ruby Leung, Ryo Mizuta, Paulo Nobre, Pablo Ortega, Dominique Paquin, Christopher D. Roberts, Enrico Scoccimarro, Jon Seddon, Anne Marie Treguier, Chia-Ying Tu, Paul A. Ullrich, Pier Luigi Vidale, Michael F. Wehner, Colin M. Zarzycki, Bosong Zhang, Wei Zhang, and Ming Zhao
EGUsphere, https://doi.org/10.5194/egusphere-2024-2582, https://doi.org/10.5194/egusphere-2024-2582, 2024
Short summary
Short summary
HighResMIP2 is a model intercomparison project focussing on high resolution global climate models, that is those with grid spacings of 25 km or less in atmosphere and ocean, using simulations of decades to a century or so in length. We are proposing an update of our simulation protocol to make the models more applicable to key questions for climate variability and hazard in present day and future projections, and to build links with other communities to provide more robust climate information.
Yangke Liu, Qing Bao, Bian He, Xiaofei Wu, Jing Yang, Yimin Liu, Guoxiong Wu, Tao Zhu, Siyuan Zhou, Yao Tang, Ankang Qu, Yalan Fan, Anling Liu, Dandan Chen, Zhaoming Luo, Xing Hu, and Tongwen Wu
Geosci. Model Dev., 17, 6249–6275, https://doi.org/10.5194/gmd-17-6249-2024, https://doi.org/10.5194/gmd-17-6249-2024, 2024
Short summary
Short summary
We give an overview of the Institute of Atmospheric Physics–Chinese Academy of Sciences subseasonal-to-seasonal ensemble forecasting system and Madden–Julian Oscillation forecast evaluation of the system. Compared to other S2S models, the IAP-CAS model has its benefits but also biases, i.e., underdispersive ensemble, overestimated amplitude, and faster propagation speed when forecasting MJO. We provide a reason for these biases and prospects for further improvement of this system in the future.
Esteban Fernández and Gary Shaffer
Geosci. Model Dev. Discuss., https://doi.org/10.5194/gmd-2024-122, https://doi.org/10.5194/gmd-2024-122, 2024
Revised manuscript accepted for GMD
Short summary
Short summary
Here we describe, calibrate and test DCESS II, a new, broad, adaptable and fast Earth System Model. DCESS II has been designed for global simulations over time scales of years to millions of years using limited computer resources like a personal computer. With its flexibility and comprehensive treatment of the global carbon cycle, DCESS II should prove to be a useful, computational-friendly tool for simulations of past climates as well as for future Earth System projections.
Martin Juckes, Karl E. Taylor, Fabrizio Antonio, David Brayshaw, Carlo Buontempo, Jian Cao, Paul J. Durack, Michio Kawamiya, Hyungjun Kim, Tomas Lovato, Chloe Mackallah, Matthew Mizielinski, Alessandra Nuzzo, Martina Stockhause, Daniele Visioni, Jeremy Walton, Briony Turner, Eleanor O’Rourke, and Beth Dingley
EGUsphere, https://doi.org/10.5194/egusphere-2024-2363, https://doi.org/10.5194/egusphere-2024-2363, 2024
Short summary
Short summary
The Baseline Climate Variables for Earth System Modelling (ESM-BCVs) are defined as a list of 132 variables which have high utility for the evaluation and exploitation of climate simulations. The list reflects the most heavily used variables from Earth System Models, based on an assessment of data publication and download records from the largest archive of global climate projects.
Katherine Smith, Alice M. Barthel, LeAnn M. Conlon, Luke P. Van Roekel, Anthony Bartoletti, Jean-Christophe Golez, Chengzhu Zhang, Carolyn Branecky Begeman, James J. Benedict, Gautum Bisht, Yan Feng, Walter Hannah, Bryce E. Harrop, Nicole Jeffery, Wuyin Lin, Po-Lun Ma, Mathew E. Maltrud, Mark R. Petersen, Balwinder Singh, Qi Tang, Teklu Tesfa, Jonathan D. Wolfe, Shaocheng Xie, Xue Zheng, Karthik Balaguru, Oluwayemi Garuba, Peter Gleckler, Aixue Hu, Jiwoo Lee, Ben Moore-Maley, and Ana C. Ordonez
Geosci. Model Dev. Discuss., https://doi.org/10.5194/gmd-2024-149, https://doi.org/10.5194/gmd-2024-149, 2024
Revised manuscript accepted for GMD
Short summary
Short summary
Version 2.1 of the U.S. Department of Energy's Energy Exascale Earth System Model (E3SM) adds the Fox-Kemper et al. (2011) mixed layer eddy parameterization, which restratifies the ocean surface layer through an overturning streamfunction. Results include surface layer biases reduction in temperature, salinity, and sea-ice extent in the North Atlantic, a small strengthening of the Atlantic Meridional Overturning Circulation, and improvements in many atmospheric climatological variables.
Bo Dong, Paul Ullrich, Jiwoo Lee, Peter Gleckler, Kristin Chang, and Travis O'Brien
Geosci. Model Dev. Discuss., https://doi.org/10.5194/gmd-2024-142, https://doi.org/10.5194/gmd-2024-142, 2024
Revised manuscript accepted for GMD
Short summary
Short summary
1. A metrics package designed for easy analysis of AR characteristics and statistics is presented. 2. The tool is efficient for diagnosing systematic AR bias in climate models, and useful for evaluating new AR characteristics in model simulations. 3. In climate models, landfalling AR precipitation shows dry biases globally, and AR tracks are farther poleward (equatorward) in the north and south Atlantic (south Pacific and Indian Ocean).
Laurent Brodeau, Pierre Rampal, Einar Ólason, and Véronique Dansereau
Geosci. Model Dev., 17, 6051–6082, https://doi.org/10.5194/gmd-17-6051-2024, https://doi.org/10.5194/gmd-17-6051-2024, 2024
Short summary
Short summary
A new brittle sea ice rheology, BBM, has been implemented into the sea ice component of NEMO. We describe how a new spatial discretization framework was introduced to achieve this. A set of idealized and realistic ocean and sea ice simulations of the Arctic have been performed using BBM and the standard viscous–plastic rheology of NEMO. When compared to satellite data, our simulations show that our implementation of BBM leads to a fairly good representation of sea ice deformations.
Cited articles
Abhik, S. and Hendon, H. H.: Influence of the QBO on the MJO during coupled
model multiweek forecasts, Geophys. Res. Lett., 46, 9213–9221,
2019. a
Adames, Á. F. and Kim, D.: The MJO as a dispersive, convectively coupled
moisture wave: Theory and observations, J. Atmos. Sci.,
73, 913–941, 2016. a
Adames, Á. F. and Wallace, J. M.: Three-dimensional structure and evolution
of the MJO and its relation to the mean flow, J. Atmos.
Sci., 71, 2007–2026, 2014. a
Adames, Á. F. and Wallace, J. M.: Three-dimensional structure and evolution
of the moisture field in the MJO, J. Atmos. Sci., 72,
3733–3754, 2015. a
Bach, S., Binder, A., Montavon, G., Klauschen, F., Müller, K.-R., and
Samek, W.: On pixel-wise explanations for non-linear classifier decisions by
layer-wise relevance propagation, PloS one, 10, e0130140, https://doi.org/10.1371/journal.pone.0130140, 2015. a
Barnes, E. A., Hurrell, J. W., Ebert-Uphoff, I., Anderson, C., and Anderson,
D.: Viewing forced climate patterns through an AI Lens, Geophys. Res.
Lett., 46, 13389–13398, 2019. a
Brenowitz, N. D. and Bretherton, C. S.: Prognostic validation of a neural
network unified physics parameterization, Geophys. Res. Lett., 45,
6289–6298, 2018. a
Chen, T. and Chen, H.: Universal approximation to nonlinear operators by neural
networks with arbitrary activation functions and its application to dynamical
systems, IEEE T. Neural Netw., 6, 911–917, 1995. a
Densmore, C. R., Sanabia, E. R., and Barrett, B. S.: QBO influence on MJO
amplitude over the Maritime Continent: Physical mechanisms and seasonality,
Mon. Weather Rev., 147, 389–406, 2019. a
Ebert-Uphoff, I. and Hilburn, K. A.: Evaluation, Tuning and Interpretation of
Neural Networks for Meteorological Applications, arXiv [preprint],
arXiv:2005.03126, 2020. a, b
Gelaro, R., McCarty, W., Suárez, M. J., Todling, R., Molod, A., Takacs, L., Randles, C. A., Darmenov, A., Bosilovich, M. G., Reichle, R., Wargan, K., Coy, L., Cullather, R., Draper, C., Akella, S., Buchard, V., Conaty, A., da Silva, A. M., Gu, W., Kim, G., Koster, R., Lucchesi, R., Merkova, D., Nielsen, J. E., Partyka, G., Pawson, S., Putman, W., Rienecker, M., Schubert, S. D., Sienkiewicz, M., and Zhao, B.: The
modern-era retrospective analysis for research and applications, version 2
(MERRA-2), J. Climate, 30, 5419–5454, 2017. a, b
Goodfellow, I., Bengio, Y., and Courville, A.: Deep learning, MIT press, available at: https://books.google.com/books?hl=en&lr=&id=omivDQAAQBAJ&oi=fnd&pg=PR5&dq=Goodfellow,+I.,+Bengio,+Y.,+and+Courville,+A.:+Deep+learning&ots=MNO3arszWQ&sig=NLK3dUkGYpMXR4-kZ1z7yD9O-7g#v=onepage&q=Goodfellow%2C I.%2C Bengio%2C Y.%2C and Courville%2C A.%3A Deep learning&f=false (last access: 31 December 2020),
2016. a
Hendon, H. H. and Liebmann, B.: Organization of convection within the
Madden-Julian oscillation, J. Geophys. Res.-Atmos., 99,
8073–8083, 1994. a
Jiang, X., Adames, Á. F., Kim, D., Maloney, E. D., Lin, H., Kim, H., Zhang,
C., DeMott, C. A., and Klingaman, N. P.: Fifty Years of Research on the
Madden-Julian Oscillation: Recent Progress, Challenges, and Perspectives,
J. Geophys. Res.-Atmos., 125, e2019JD030911, https://doi.org/10.1029/2019JD030911, 2020. a
Lee, H.-T. and NOAA CDR Program: NOAA Climate Data Record (CDR) of Daily Outgoing Longwave Radiation (OLR), Version 1.2, NOAA National Climatic Data Center, https://doi.org/10.7289/V5SJ1HH2, 2011. a, b
Liebmann, B. and Smith, C. A.: Description of a complete (interpolated)
outgoing longwave radiation dataset, B. Am. Meteorol.
Soc., 77, 1275–1277, 1996. a
Madden, R. A. and Julian, P. R.: Detection of a 40–50 day oscillation in the
zonal wind in the tropical Pacific, J. Atmos. Sci., 28,
702–708, 1971. a
Martin, Z., Vitart, F., Wang, S., and Sobel, A.: The impact of the stratosphere
on the MJO in a forecast model, J. Geophys. Res.-Atmos., 125, e2019JD032106,
https://doi.org/10.1029/2019JD032106,
2020. a
Matsuno, T.: Quasi-geostrophic motions in the equatorial area, J.
Meteorol. Soc. Jpn. Ser. II, 44, 25–43, 1966. a
McGovern, A., Lagerquist, R., John Gagne, D., Jergensen, G. E., Elmore, K. L.,
Homeyer, C. R., and Smith, T.: Making the black box more transparent:
Understanding the physical implications of machine learning, B.
Am. Meteorol. Soc., 100, 2175–2199, 2019. a
Montavon, G., Lapuschkin, S., Binder, A., Samek, W., and Müller, K.-R.:
Explaining nonlinear classification decisions with deep taylor decomposition,
Pattern Recogn., 65, 211–222, 2017. a
Monteiro, J. M., Adames, Á. F., Wallace, J. M., and Sukhatme, J. S.:
Interpreting the upper level structure of the Madden-Julian oscillation,
Geophys. Res. Lett., 41, 9158–9165, 2014. a
NOAA: MJO indices, available at: https://www.psl.noaa.gov/mjo/mjoindex/, (last access: 31 December 2020. a
Olah, C., Mordvintsev, A., and Schubert, L.: Feature visualization, Distill, 2, e7,
2017. a
Rasp, S., Pritchard, M. S., and Gentine, P.: Deep learning to represent subgrid
processes in climate models, P. Natl. Acad. Sci. USA,
115, 9684–9689, 2018. a
Roundy, P. E. and Frank, W. M.: Applications of a multiple linear regression
model to the analysis of relationships between eastward-and westward-moving
intraseasonal modes, J. Atmos. Sci., 61, 3041–3048,
2004. a
Roundy, P. E., MacRitchie, K., Asuma, J., and Melino, T.: Modulation of the
global atmospheric circulation by combined activity in the Madden–Julian
oscillation and the El Niño–Southern Oscillation during boreal winter,
J. Climate, 23, 4045–4059, 2010. a
Simonyan, K., Vedaldi, A., and Zisserman, A.: Deep inside convolutional
networks: Visualising image classification models and saliency maps, arXiv
[preprint], arXiv:1312.6034, 2013. a
Sobel, A. and Maloney, E.: Moisture modes and the eastward propagation of the
MJO, J. Atmos. Sci., 70, 187–192, 2013. a
Son, S.-W., Lim, Y., Yoo, C., Hendon, H. H., and Kim, J.: Stratospheric control
of the Madden–Julian oscillation, J. Climate, 30, 1909–1922, 2017. a
Toms, B.: Data for GMD 2020-152 (Version V1), Zenodo [Data set], https://doi.org/10.5281/zenodo.3968896, 2020. a
Toms, B. A., Barnes, E. A., Maloney, E. D., and van den Heever, S. C.: The
Global Teleconnection Signature of the Madden-Julian Oscillation and its
Modulation by the Quasi-Biennial Oscillation, J. Geophys.
Res.-Atmos., 25, e2020JD032653,
https://doi.org/10.1029/2020JD032653, 2020b. a, b
Tseng, K.-C., Maloney, E., and Barnes, E.: The consistency of MJO
teleconnection patterns: an explanation using linear Rossby wave theory,
J. Climate, 32, 531–548, 2019. a
Weyn, J. A., Durran, D. R., and Caruana, R.: Can Machines Learn to Predict
Weather? Using Deep Learning to Predict Gridded 500-hPa Geopotential Height
From Historical Weather Data, J. Adv. Model. Earth Sy.,
11, 2680–2693, 2019. a
Yang, D. and Ingersoll, A. P.: Testing the hypothesis that the MJO is a mixed
Rossby–gravity wave packet, J. Atmos. Sci., 68,
226–239, 2011. a
Yang, D. and Ingersoll, A. P.: Triggered convection, gravity waves, and the
MJO: A shallow-water model, J. Atmos. Sci., 70,
2476–2486, 2013. a
Yoo, C. and Son, S.-W.: Modulation of the boreal wintertime Madden-Julian
oscillation by the stratospheric quasi-biennial oscillation, Geophys.
Res. Lett., 43, 1392–1398, 2016. a
Yosinski, J., Clune, J., Nguyen, A., Fuchs, T., and Lipson, H.: Understanding
neural networks through deep visualization, arXiv [preprint], arXiv:1506.06579,
2015. a
Zhang, C. and Dong, M.: Seasonality in the Madden–Julian Oscillation, J.
Climate, 17, 3169–3180,
https://doi.org/10.1175/1520-0442(2004)017<3169:SITMO>2.0.CO;2, 2004. a
Zhang, C. and Zhang, B.: QBO-MJO Connection, J. Geophys. Res.-Atmos., 123, 2957–2967, 2018. a
Zhang, C., Adames, Á., Khouider, B., Wang, B., and Yang, D.: Four Theories
of the Madden-Julian Oscillation, Rev. Geophys., 58.3, e2019RG000685,
https://doi.org/10.1029/2019RG000685, 2020. a
Zhao, C., Li, T., and Zhou, T.: Precursor signals and processes associated with
MJO initiation over the tropical Indian Ocean, J. Climate, 26,
291–307, 2013. a
Short summary
We test whether a type of machine learning called neural networks can be used trustfully within the geosciences. We do so by challenging the networks to understand the spatial patterns of a commonly studied geoscientific phenomenon. The neural networks can correctly identify the spatial patterns, which lends confidence that similar networks can be used for more uncertain problems. The results of this study may give geoscientists confidence when using neural networks in their research.
We test whether a type of machine learning called neural networks can be used trustfully within...
