Articles | Volume 16, issue 13
https://doi.org/10.5194/gmd-16-3927-2023
© Author(s) 2023. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
https://doi.org/10.5194/gmd-16-3927-2023
© Author(s) 2023. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
Methods for assessment of models
| 
13 Jul 2023
Methods for assessment of models |
| 13 Jul 2023
| 13 Jul 2023
Evaluating precipitation distributions at regional scales: a benchmarking framework and application to CMIP5 and 6 models
Min-Seop Ahn
CORRESPONDING AUTHOR
PCMDI, Lawrence Livermore National Laboratory, Livermore, CA, USA
GMAO, NASA Goddard Space Flight Center, Greenbelt, MD, USA
ESSIC, University of Maryland, College Park, MD, USA
Paul A. Ullrich
PCMDI, Lawrence Livermore National Laboratory, Livermore, CA, USA
Department of Land, Air and Water Resources, University of California, Davis, CA, USA
Peter J. Gleckler
PCMDI, Lawrence Livermore National Laboratory, Livermore, CA, USA
PCMDI, Lawrence Livermore National Laboratory, Livermore, CA, USA
Ana C. Ordonez
PCMDI, Lawrence Livermore National Laboratory, Livermore, CA, USA
Angeline G. Pendergrass
Earth and Atmospheric Science, Cornell University, Ithaca, NY, USA
CGD, National Center for Atmospheric Research, Boulder, CO, USA
Related authors
No articles found.
Katherine M. Smith, Alice M. Barthel, LeAnn M. Conlon, Luke P. Van Roekel, Anthony Bartoletti, Jean-Christophe Golaz, Chengzhu Zhang, Carolyn Branecky Begeman, James J. Benedict, Gautam Bisht, Yan Feng, Walter Hannah, Bryce E. Harrop, Nicole Jeffery, Wuyin Lin, Po-Lun Ma, Mathew E. Maltrud, Mark R. Petersen, Balwinder Singh, Qi Tang, Teklu Tesfa, Jonathan D. Wolfe, Shaocheng Xie, Xue Zheng, Karthik Balaguru, Oluwayemi Garuba, Peter Gleckler, Aixue Hu, Jiwoo Lee, Ben Moore-Maley, and Ana C. Ordoñez
Geosci. Model Dev., 18, 1613–1633, https://doi.org/10.5194/gmd-18-1613-2025, https://doi.org/10.5194/gmd-18-1613-2025, 2025
Short summary
Short summary
Version 2.1 of the U.S. Department of Energy's Energy Exascale Earth System Model (E3SM) adds the Fox-Kemper et al. (2011) mixed-layer eddy parameterization, which restratifies the ocean surface layer through an overturning streamfunction. Results include surface layer bias reduction in temperature, salinity, and sea ice extent in the North Atlantic; a small strengthening of the Atlantic meridional overturning circulation; and improvements to many atmospheric climatological variables.
Bo Dong, Paul Ullrich, Jiwoo Lee, Peter Gleckler, Kristin Chang, and Travis A. O'Brien
Geosci. Model Dev., 18, 961–976, https://doi.org/10.5194/gmd-18-961-2025, https://doi.org/10.5194/gmd-18-961-2025, 2025
Short summary
Short summary
A metrics package designed for easy analysis of atmospheric river (AR) characteristics and statistics is presented. The tool is efficient for diagnosing systematic AR bias in climate models and useful for evaluating new AR characteristics in model simulations. In climate models, landfalling AR precipitation shows dry biases globally, and AR tracks are farther poleward (equatorward) in the North and South Atlantic (South Pacific and Indian Ocean).
Paul J. Durack, Karl E. Taylor, Peter J. Gleckler, Gerald A. Meehl, Bryan N. Lawrence, Curt Covey, Ronald J. Stouffer, Guillaume Levavasseur, Atef Ben-Nasser, Sebastien Denvil, Martina Stockhause, Jonathan M. Gregory, Martin Juckes, Sasha K. Ames, Fabrizio Antonio, David C. Bader, John P. Dunne, Daniel Ellis, Veronika Eyring, Sandro L. Fiore, Sylvie Joussaume, Philip Kershaw, Jean-Francois Lamarque, Michael Lautenschlager, Jiwoo Lee, Chris F. Mauzey, Matthew Mizielinski, Paola Nassisi, Alessandra Nuzzo, Eleanor O’Rourke, Jeffrey Painter, Gerald L. Potter, Sven Rodriguez, and Dean N. Williams
EGUsphere, https://doi.org/10.5194/egusphere-2024-3729, https://doi.org/10.5194/egusphere-2024-3729, 2025
Short summary
Short summary
CMIP6 was the most expansive and ambitious Model Intercomparison Project (MIP), the latest in a history, extending four decades. CMIP engaged a growing community focused on improving climate understanding, and quantifying and attributing observed climate change being experienced today. The project's profound impact is due to the combining the latest climate science and technology, enabling the latest-generation climate simulations and increasing community attention in every successive phase.
Seung H. Baek, Paul A. Ullrich, Bo Dong, and Jiwoo Lee
Geosci. Model Dev., 17, 8665–8681, https://doi.org/10.5194/gmd-17-8665-2024, https://doi.org/10.5194/gmd-17-8665-2024, 2024
Short summary
Short summary
We evaluate downscaled products by examining locally relevant co-variances during precipitation events. Common statistical downscaling techniques preserve expected co-variances during convective precipitation (a stationary phenomenon). However, they dampen future intensification of frontal precipitation (a non-stationary phenomenon) captured in global climate models and dynamical downscaling. Our study quantifies a ramification of the stationarity assumption underlying statistical downscaling.
Angeline G. Pendergrass, Michael P. Byrne, Oliver Watt-Meyer, Penelope Maher, and Mark J. Webb
Geosci. Model Dev., 17, 6365–6378, https://doi.org/10.5194/gmd-17-6365-2024, https://doi.org/10.5194/gmd-17-6365-2024, 2024
Short summary
Short summary
The width of the tropical rain belt affects many aspects of our climate, yet we do not understand what controls it. To better understand it, we present a method to change it in numerical model experiments. We show that the method works well in four different models. The behavior of the width is unexpectedly simple in some ways, such as how strong the winds are as it changes, but in other ways, it is more complicated, especially how temperature increases with carbon dioxide.
Jiwoo Lee, Peter J. Gleckler, Min-Seop Ahn, Ana Ordonez, Paul A. Ullrich, Kenneth R. Sperber, Karl E. Taylor, Yann Y. Planton, Eric Guilyardi, Paul Durack, Celine Bonfils, Mark D. Zelinka, Li-Wei Chao, Bo Dong, Charles Doutriaux, Chengzhu Zhang, Tom Vo, Jason Boutte, Michael F. Wehner, Angeline G. Pendergrass, Daehyun Kim, Zeyu Xue, Andrew T. Wittenberg, and John Krasting
Geosci. Model Dev., 17, 3919–3948, https://doi.org/10.5194/gmd-17-3919-2024, https://doi.org/10.5194/gmd-17-3919-2024, 2024
Short summary
Short summary
We introduce an open-source software, the PCMDI Metrics Package (PMP), developed for a comprehensive comparison of Earth system models (ESMs) with real-world observations. Using diverse metrics evaluating climatology, variability, and extremes simulated in thousands of simulations from the Coupled Model Intercomparison Project (CMIP), PMP aids in benchmarking model improvements across generations. PMP also enables efficient tracking of performance evolutions during ESM developments.
Justin L. Willson, Kevin A. Reed, Christiane Jablonowski, James Kent, Peter H. Lauritzen, Ramachandran Nair, Mark A. Taylor, Paul A. Ullrich, Colin M. Zarzycki, David M. Hall, Don Dazlich, Ross Heikes, Celal Konor, David Randall, Thomas Dubos, Yann Meurdesoif, Xi Chen, Lucas Harris, Christian Kühnlein, Vivian Lee, Abdessamad Qaddouri, Claude Girard, Marco Giorgetta, Daniel Reinert, Hiroaki Miura, Tomoki Ohno, and Ryuji Yoshida
Geosci. Model Dev., 17, 2493–2507, https://doi.org/10.5194/gmd-17-2493-2024, https://doi.org/10.5194/gmd-17-2493-2024, 2024
Short summary
Short summary
Accurate simulation of tropical cyclones (TCs) is essential to understanding their behavior in a changing climate. One way this is accomplished is through model intercomparison projects, where results from multiple climate models are analyzed to provide benchmark solutions for the wider climate modeling community. This study describes and analyzes the previously developed TC test case for nine climate models in an intercomparison project, providing solutions that aid in model development.
Lele Shu, Paul Ullrich, Xianhong Meng, Christopher Duffy, Hao Chen, and Zhaoguo Li
Geosci. Model Dev., 17, 497–527, https://doi.org/10.5194/gmd-17-497-2024, https://doi.org/10.5194/gmd-17-497-2024, 2024
Short summary
Short summary
Our team developed rSHUD v2.0, a toolkit that simplifies the use of the SHUD, a model simulating water movement in the environment. We demonstrated its effectiveness in two watersheds, one in the USA and one in China. The toolkit also facilitated the creation of the Global Hydrological Data Cloud, a platform for automatic data processing and model deployment, marking a significant advancement in hydrological research.
Qi Tang, Jean-Christophe Golaz, Luke P. Van Roekel, Mark A. Taylor, Wuyin Lin, Benjamin R. Hillman, Paul A. Ullrich, Andrew M. Bradley, Oksana Guba, Jonathan D. Wolfe, Tian Zhou, Kai Zhang, Xue Zheng, Yunyan Zhang, Meng Zhang, Mingxuan Wu, Hailong Wang, Cheng Tao, Balwinder Singh, Alan M. Rhoades, Yi Qin, Hong-Yi Li, Yan Feng, Yuying Zhang, Chengzhu Zhang, Charles S. Zender, Shaocheng Xie, Erika L. Roesler, Andrew F. Roberts, Azamat Mametjanov, Mathew E. Maltrud, Noel D. Keen, Robert L. Jacob, Christiane Jablonowski, Owen K. Hughes, Ryan M. Forsyth, Alan V. Di Vittorio, Peter M. Caldwell, Gautam Bisht, Renata B. McCoy, L. Ruby Leung, and David C. Bader
Geosci. Model Dev., 16, 3953–3995, https://doi.org/10.5194/gmd-16-3953-2023, https://doi.org/10.5194/gmd-16-3953-2023, 2023
Short summary
Short summary
High-resolution simulations are superior to low-resolution ones in capturing regional climate changes and climate extremes. However, uniformly reducing the grid size of a global Earth system model is too computationally expensive. We provide an overview of the fully coupled regionally refined model (RRM) of E3SMv2 and document a first-of-its-kind set of climate production simulations using RRM at an economic cost. The key to this success is our innovative hybrid time step method.
Abhishekh Kumar Srivastava, Paul Aaron Ullrich, Deeksha Rastogi, Pouya Vahmani, Andrew Jones, and Richard Grotjahn
Geosci. Model Dev., 16, 3699–3722, https://doi.org/10.5194/gmd-16-3699-2023, https://doi.org/10.5194/gmd-16-3699-2023, 2023
Short summary
Short summary
Stakeholders need high-resolution regional climate data for applications such as assessing water availability and mountain snowpack. This study examines 3 h and 24 h historical precipitation over the contiguous United States in the 12 km WRF version 4.2.1-based dynamical downscaling of the ERA5 reanalysis. WRF improves precipitation characteristics such as the annual cycle and distribution of the precipitation maxima, but it also displays regionally and seasonally varying precipitation biases.
Zeyu Xue, Paul Ullrich, and Lai-Yung Ruby Leung
Hydrol. Earth Syst. Sci., 27, 1909–1927, https://doi.org/10.5194/hess-27-1909-2023, https://doi.org/10.5194/hess-27-1909-2023, 2023
Short summary
Short summary
We examine the sensitivity and robustness of conclusions drawn from the PGW method over the NEUS by conducting multiple PGW experiments and varying the perturbation spatial scales and choice of perturbed meteorological variables to provide a guideline for this increasingly popular regional modeling method. Overall, we recommend PGW experiments be performed with perturbations to temperature or the combination of temperature and wind at the gridpoint scale, depending on the research question.
David H. Marsico and Paul A. Ullrich
Geosci. Model Dev., 16, 1537–1551, https://doi.org/10.5194/gmd-16-1537-2023, https://doi.org/10.5194/gmd-16-1537-2023, 2023
Short summary
Short summary
Climate models involve several different components, such as the atmosphere, ocean, and land models. Information needs to be exchanged, or remapped, between these models, and devising algorithms for performing this exchange is important for ensuring the accuracy of climate simulations. In this paper, we examine the efficacy of several traditional and novel approaches to remapping on the sphere and demonstrate where our approaches offer improvement.
Iris Elisabeth de Vries, Sebastian Sippel, Angeline Greene Pendergrass, and Reto Knutti
Earth Syst. Dynam., 14, 81–100, https://doi.org/10.5194/esd-14-81-2023, https://doi.org/10.5194/esd-14-81-2023, 2023
Short summary
Short summary
Precipitation change is an important consequence of climate change, but it is hard to detect and quantify. Our intuitive method yields robust and interpretable detection of forced precipitation change in three observational datasets for global mean and extreme precipitation, but the different observational datasets show different magnitudes of forced change. Assessment and reduction of uncertainties surrounding forced precipitation change are important for future projections and adaptation.
Chengzhu Zhang, Jean-Christophe Golaz, Ryan Forsyth, Tom Vo, Shaocheng Xie, Zeshawn Shaheen, Gerald L. Potter, Xylar S. Asay-Davis, Charles S. Zender, Wuyin Lin, Chih-Chieh Chen, Chris R. Terai, Salil Mahajan, Tian Zhou, Karthik Balaguru, Qi Tang, Cheng Tao, Yuying Zhang, Todd Emmenegger, Susannah Burrows, and Paul A. Ullrich
Geosci. Model Dev., 15, 9031–9056, https://doi.org/10.5194/gmd-15-9031-2022, https://doi.org/10.5194/gmd-15-9031-2022, 2022
Short summary
Short summary
Earth system model (ESM) developers run automated analysis tools on data from candidate models to inform model development. This paper introduces a new Python package, E3SM Diags, that has been developed to support ESM development and use routinely in the development of DOE's Energy Exascale Earth System Model. This tool covers a set of essential diagnostics to evaluate the mean physical climate from simulations, as well as several process-oriented and phenomenon-based evaluation diagnostics.
Vijay S. Mahadevan, Jorge E. Guerra, Xiangmin Jiao, Paul Kuberry, Yipeng Li, Paul Ullrich, David Marsico, Robert Jacob, Pavel Bochev, and Philip Jones
Geosci. Model Dev., 15, 6601–6635, https://doi.org/10.5194/gmd-15-6601-2022, https://doi.org/10.5194/gmd-15-6601-2022, 2022
Short summary
Short summary
Coupled Earth system models require transfer of field data between multiple components with varying spatial resolutions to determine the correct climate behavior. We present the Metrics for Intercomparison of Remapping Algorithms (MIRA) protocol to evaluate the accuracy, conservation properties, monotonicity, and local feature preservation of four different remapper algorithms for various unstructured mesh problems of interest. Future extensions to more practical use cases are also discussed.
Benjamin M. Sanderson, Angeline G. Pendergrass, Charles D. Koven, Florent Brient, Ben B. B. Booth, Rosie A. Fisher, and Reto Knutti
Earth Syst. Dynam., 12, 899–918, https://doi.org/10.5194/esd-12-899-2021, https://doi.org/10.5194/esd-12-899-2021, 2021
Short summary
Short summary
Emergent constraints promise a pathway to the reduction in climate projection uncertainties by exploiting ensemble relationships between observable quantities and unknown climate response parameters. This study considers the robustness of these relationships in light of biases and common simplifications that may be present in the original ensemble of climate simulations. We propose a classification scheme for constraints and a number of practical case studies.
Paul A. Ullrich, Colin M. Zarzycki, Elizabeth E. McClenny, Marielle C. Pinheiro, Alyssa M. Stansfield, and Kevin A. Reed
Geosci. Model Dev., 14, 5023–5048, https://doi.org/10.5194/gmd-14-5023-2021, https://doi.org/10.5194/gmd-14-5023-2021, 2021
Short summary
Short summary
TempestExtremes (TE) is a multifaceted framework for feature detection, tracking, and scientific analysis of regional or global Earth system datasets. Version 2.1 of TE now provides extensive support for nodal and areal features. This paper describes the algorithms that have been added to the TE framework since version 1.0 and gives several examples of how these can be combined to produce composite algorithms for evaluating and understanding atmospheric features.
Christina Heinze-Deml, Sebastian Sippel, Angeline G. Pendergrass, Flavio Lehner, and Nicolai Meinshausen
Geosci. Model Dev., 14, 4977–4999, https://doi.org/10.5194/gmd-14-4977-2021, https://doi.org/10.5194/gmd-14-4977-2021, 2021
Short summary
Short summary
Quantifying dynamical and thermodynamical components of regional precipitation change is a key challenge in climate science. We introduce a novel statistical model (Latent Linear Adjustment Autoencoder) that combines the flexibility of deep neural networks with the robustness advantages of linear regression. The method enables estimation of the contribution of a coarse-scale atmospheric circulation proxy to daily precipitation at high resolution and in a spatially coherent manner.
Lukas Brunner, Angeline G. Pendergrass, Flavio Lehner, Anna L. Merrifield, Ruth Lorenz, and Reto Knutti
Earth Syst. Dynam., 11, 995–1012, https://doi.org/10.5194/esd-11-995-2020, https://doi.org/10.5194/esd-11-995-2020, 2020
Short summary
Short summary
In this study, we weight climate models by their performance with respect to simulating aspects of historical climate and their degree of interdependence. Our method is found to increase projection skill and to correct for structurally similar models. The weighted end-of-century mean warming (2081–2100 relative to 1995–2014) is 3.7 °C with a likely (66 %) range of 3.1 to 4.6 °C for the strong climate change scenario SSP5-8.5; this is a reduction of 0.4 °C compared with the unweighted mean.
Duane Waliser, Peter J. Gleckler, Robert Ferraro, Karl E. Taylor, Sasha Ames, James Biard, Michael G. Bosilovich, Otis Brown, Helene Chepfer, Luca Cinquini, Paul J. Durack, Veronika Eyring, Pierre-Philippe Mathieu, Tsengdar Lee, Simon Pinnock, Gerald L. Potter, Michel Rixen, Roger Saunders, Jörg Schulz, Jean-Noël Thépaut, and Matthias Tuma
Geosci. Model Dev., 13, 2945–2958, https://doi.org/10.5194/gmd-13-2945-2020, https://doi.org/10.5194/gmd-13-2945-2020, 2020
Short summary
Short summary
This paper provides an update to an international research activity whose objective is to facilitate access to satellite and other types of regional and global datasets for evaluating global models used to produce 21st century climate projections.
Lele Shu, Paul A. Ullrich, and Christopher J. Duffy
Geosci. Model Dev., 13, 2743–2762, https://doi.org/10.5194/gmd-13-2743-2020, https://doi.org/10.5194/gmd-13-2743-2020, 2020
Short summary
Short summary
Hydrologic modeling is an essential strategy for understanding and predicting natural flows. The paper introduces the design of Simulator for Hydrologic Unstructured Domains (SHUD), from the conceptual and mathematical description of hydrologic processes in a watershed to the model's computational structures. To demonstrate and validate the model performance, we employ three hydrologic experiments: the V-Catchment experiment, Vauclin's experiment, and a model study of the Cache Creek Watershed.
Colin M. Zarzycki, Christiane Jablonowski, James Kent, Peter H. Lauritzen, Ramachandran Nair, Kevin A. Reed, Paul A. Ullrich, David M. Hall, Mark A. Taylor, Don Dazlich, Ross Heikes, Celal Konor, David Randall, Xi Chen, Lucas Harris, Marco Giorgetta, Daniel Reinert, Christian Kühnlein, Robert Walko, Vivian Lee, Abdessamad Qaddouri, Monique Tanguay, Hiroaki Miura, Tomoki Ohno, Ryuji Yoshida, Sang-Hun Park, Joseph B. Klemp, and William C. Skamarock
Geosci. Model Dev., 12, 879–892, https://doi.org/10.5194/gmd-12-879-2019, https://doi.org/10.5194/gmd-12-879-2019, 2019
Short summary
Short summary
We summarize the results of the Dynamical Core Model Intercomparison Project's idealized supercell test case. Supercells are storm-scale weather phenomena that are a key target for next-generation, non-hydrostatic weather prediction models. We show that the dynamical cores of most global numerical models converge between approximately 1 and 0.5 km grid spacing for this test, although differences in final solution exist, particularly due to differing grid discretizations and numerical diffusion.
Christine A. Shields, Jonathan J. Rutz, Lai-Yung Leung, F. Martin Ralph, Michael Wehner, Brian Kawzenuk, Juan M. Lora, Elizabeth McClenny, Tashiana Osborne, Ashley E. Payne, Paul Ullrich, Alexander Gershunov, Naomi Goldenson, Bin Guan, Yun Qian, Alexandre M. Ramos, Chandan Sarangi, Scott Sellars, Irina Gorodetskaya, Karthik Kashinath, Vitaliy Kurlin, Kelly Mahoney, Grzegorz Muszynski, Roger Pierce, Aneesh C. Subramanian, Ricardo Tome, Duane Waliser, Daniel Walton, Gary Wick, Anna Wilson, David Lavers, Prabhat, Allison Collow, Harinarayan Krishnan, Gudrun Magnusdottir, and Phu Nguyen
Geosci. Model Dev., 11, 2455–2474, https://doi.org/10.5194/gmd-11-2455-2018, https://doi.org/10.5194/gmd-11-2455-2018, 2018
Short summary
Short summary
ARTMIP (Atmospheric River Tracking Method Intercomparison Project) is a community effort with the explicit goal of understanding the uncertainties, and the implications of those uncertainties, in atmospheric river science solely due to detection algorithm. ARTMIP strives to quantify these differences and provide guidance on appropriate algorithmic choices for the science question posed. Project goals, experimental design, and preliminary results are provided.
David J. Gardner, Jorge E. Guerra, François P. Hamon, Daniel R. Reynolds, Paul A. Ullrich, and Carol S. Woodward
Geosci. Model Dev., 11, 1497–1515, https://doi.org/10.5194/gmd-11-1497-2018, https://doi.org/10.5194/gmd-11-1497-2018, 2018
Short summary
Short summary
As the computational power of supercomputing systems increases, and models for simulating the fluid flow of the Earth's atmosphere operate at higher resolutions, new approaches for advancing these models in time will be necessary. In order to produce the best possible result in the least amount of time, we evaluate a number of splittings, methods, and solvers on two test cases. Based on these results, we identify the most accurate and efficient approaches for consideration in production models.
Angeline G. Pendergrass, Andrew Conley, and Francis M. Vitt
Earth Syst. Sci. Data, 10, 317–324, https://doi.org/10.5194/essd-10-317-2018, https://doi.org/10.5194/essd-10-317-2018, 2018
Short summary
Short summary
We document and validate radiative kernels for the surface and top-of-atmosphere calculated with NCAR's CESM1 climate model. A radiative kernel is the change in radiation in response to a small change in a property of the atmosphere or surface, essentially a partial derivative. They are used to quantify temperature, water vapor, surface albedo, and cloud feedbacks. We made these kernels because few are available for the surface. We also validate the kernels against the expected model responses.
Paul A. Ullrich, Christiane Jablonowski, James Kent, Peter H. Lauritzen, Ramachandran Nair, Kevin A. Reed, Colin M. Zarzycki, David M. Hall, Don Dazlich, Ross Heikes, Celal Konor, David Randall, Thomas Dubos, Yann Meurdesoif, Xi Chen, Lucas Harris, Christian Kühnlein, Vivian Lee, Abdessamad Qaddouri, Claude Girard, Marco Giorgetta, Daniel Reinert, Joseph Klemp, Sang-Hun Park, William Skamarock, Hiroaki Miura, Tomoki Ohno, Ryuji Yoshida, Robert Walko, Alex Reinecke, and Kevin Viner
Geosci. Model Dev., 10, 4477–4509, https://doi.org/10.5194/gmd-10-4477-2017, https://doi.org/10.5194/gmd-10-4477-2017, 2017
Short summary
Short summary
Atmospheric dynamical cores are a fundamental component of global atmospheric modeling systems and are responsible for capturing the dynamical behavior of the Earth's atmosphere. To better understand modern dynamical cores, this paper aims to provide a comprehensive review of 11 dynamical cores, drawn from modeling centers and groups that participated in the 2016 Dynamical Core Model Intercomparison Project (DCMIP) workshop and summer school.
Benjamin M. Sanderson, Yangyang Xu, Claudia Tebaldi, Michael Wehner, Brian O'Neill, Alexandra Jahn, Angeline G. Pendergrass, Flavio Lehner, Warren G. Strand, Lei Lin, Reto Knutti, and Jean Francois Lamarque
Earth Syst. Dynam., 8, 827–847, https://doi.org/10.5194/esd-8-827-2017, https://doi.org/10.5194/esd-8-827-2017, 2017
Short summary
Short summary
We present the results of a set of climate simulations designed to simulate futures in which the Earth's temperature is stabilized at the levels referred to in the 2015 Paris Agreement. We consider the necessary future emissions reductions and the aspects of extreme weather which differ significantly between the 2 and 1.5 °C climate in the simulations.
Paul A. Ullrich and Colin M. Zarzycki
Geosci. Model Dev., 10, 1069–1090, https://doi.org/10.5194/gmd-10-1069-2017, https://doi.org/10.5194/gmd-10-1069-2017, 2017
Short summary
Short summary
Automated pointwise feature tracking is used for objective identification and tracking of meteorological features, such as extratropical cyclones, tropical cyclones and tropical easterly waves, and has emerged as an important and desirable data-processing capability in climate science. In the interest of exploring tracking functionality, this paper introduces a framework for the development of robust tracking algorithms that is useful for intercomparison and optimization of tracking schemes.
Jorge E. Guerra and Paul A. Ullrich
Geosci. Model Dev., 9, 2007–2029, https://doi.org/10.5194/gmd-9-2007-2016, https://doi.org/10.5194/gmd-9-2007-2016, 2016
Short summary
Short summary
This work introduces a collection of advances in the field of numerical simulation of the atmosphere using mixed finite element methods. We emphasize vertical motions in the atmosphere and apply state-of-the-art mathematics and programming paradigms to solve the differential equations that govern air flow cast in a coordinate-free formulation. The simulations show accurate flow features over a wide range of spatial scales including several important phenomena.
P. A. Ullrich
Geosci. Model Dev., 7, 3017–3035, https://doi.org/10.5194/gmd-7-3017-2014, https://doi.org/10.5194/gmd-7-3017-2014, 2014
Short summary
Short summary
This paper compares continuous and discontinuous discretizations of the shallow-water equations on the sphere using the flux reconstruction formulation. The discontinuous framework comes at a cost, including a reduced time step size and higher computational expense, but has a number of desirable properties which may make it desirable for future use in atmospheric models.
O. Guba, M. A. Taylor, P. A. Ullrich, J. R. Overfelt, and M. N. Levy
Geosci. Model Dev., 7, 2803–2816, https://doi.org/10.5194/gmd-7-2803-2014, https://doi.org/10.5194/gmd-7-2803-2014, 2014
P. H. Lauritzen, P. A. Ullrich, C. Jablonowski, P. A. Bosler, D. Calhoun, A. J. Conley, T. Enomoto, L. Dong, S. Dubey, O. Guba, A. B. Hansen, E. Kaas, J. Kent, J.-F. Lamarque, M. J. Prather, D. Reinert, V. V. Shashkin, W. C. Skamarock, B. Sørensen, M. A. Taylor, and M. A. Tolstykh
Geosci. Model Dev., 7, 105–145, https://doi.org/10.5194/gmd-7-105-2014, https://doi.org/10.5194/gmd-7-105-2014, 2014
Related subject area
Atmospheric sciences
Estimation of aerosol and cloud radiative heating rate in the tropical stratosphere using a radiative kernel method
Evaluation of dust emission and land surface schemes in predicting a mega Asian dust storm over South Korea using WRF-Chem
Sensitivity studies of a four-dimensional local ensemble transform Kalman filter coupled with WRF-Chem version 3.9.1 for improving particulate matter simulation accuracy
A Bayesian method for predicting background radiation at environmental monitoring stations in local-scale networks
Inclusion of the ECMWF ecRad radiation scheme (v1.5.0) in the MAR (v3.14), regional evaluation for Belgium, and assessment of surface shortwave spectral fluxes at Uccle
Development of a fast radiative transfer model for ground-based microwave radiometers (ARMS-gb v1.0): validation and comparison to RTTOV-gb
Indian Institute of Tropical Meteorology (IITM) High-Resolution Global Forecast Model version 1: an attempt to resolve monsoon prediction deadlock
Cell-tracking-based framework for assessing nowcasting model skill in reproducing growth and decay of convective rainfall
NeuralMie (v1.0): an aerosol optics emulator
Simulation performance of planetary boundary layer schemes in WRF v4.3.1 for near-surface wind over the western Sichuan Basin: a single-site assessment
FootNet v1.0: development of a machine learning emulator of atmospheric transport
Updates and evaluation of NOAA's online-coupled air quality model version 7 (AQMv7) within the Unified Forecast System
Quantifying the analysis uncertainty for nowcasting application
Improving the ensemble square root filter (EnSRF) in the Community Inversion Framework: a case study with ICON-ART 2024.01
The MESSy DWARF (based on MESSy v2.55.2)
An enhanced emission module for the PALM model system 23.10 with application for PM10 emission from urban domestic heating
Identifying lightning processes in ERA5 soundings with deep learning
Sensitivity of predicted ultrafine particle size distributions in Europe to different nucleation rate parameterizations using PMCAMx-UF v2.2
Explaining neural networks for detection of tropical cyclones and atmospheric rivers in gridded atmospheric simulation data
PALACE v1.0: Paranal Airglow Line And Continuum Emission model
Accurate space-based NOx emission estimates with the flux divergence approach require fine-scale model information on local oxidation chemistry and profile shapes
Exploring a high-level programming model for the NWP domain using ECMWF microphysics schemes
Quantifying uncertainties in satellite NO2 superobservations for data assimilation and model evaluation
ML-AMPSIT: Machine Learning-based Automated Multi-method Parameter Sensitivity and Importance analysis Tool
Coupling the urban canopy model TEB (SURFEXv9.0) with the radiation model SPARTACUS-Urbanv0.6.1 for more realistic urban radiative exchange calculation
Forecasting contrail climate forcing for flight planning and air traffic management applications: the CocipGrid model in pycontrails 0.51.0
Simulation of the heat mitigation potential of unsealing measures in cities by parameterizing grass grid pavers for urban microclimate modelling with ENVI-met (V5)
AI-NAOS: an AI-based nonspherical aerosol optical scheme for the chemical weather model GRAPES_Meso5.1/CUACE
Orbital-Radar v1.0.0: a tool to transform suborbital radar observations to synthetic EarthCARE cloud radar data
The Modular and Integrated Data Assimilation System at Environment and Climate Change Canada (MIDAS v3.9.1)
A new set of indicators for model evaluation complementing to FAIRMODE’s MQO
Modeling of polycyclic aromatic hydrocarbons (PAHs) from global to regional scales: model development (IAP-AACM_PAH v1.0) and investigation of health risks in 2013 and 2018 in China
LIMA (v2.0): A full two-moment cloud microphysical scheme for the mesoscale non-hydrostatic model Meso-NH v5-6
SLUCM+BEM (v1.0): a simple parameterisation for dynamic anthropogenic heat and electricity consumption in WRF-Urban (v4.3.2)
Carbon dioxide plume dispersion simulated at hectometer scale using DALES: model formulation and observational evaluation
NAQPMS-PDAF v2.0: a novel hybrid nonlinear data assimilation system for improved simulation of PM2.5 chemical components
Source-specific bias correction of US background and anthropogenic ozone modeled in CMAQ
Observational operator for fair model evaluation with ground NO2 measurements
Valid time shifting ensemble Kalman filter (VTS-EnKF) for dust storm forecasting
The third Met Office Unified Model-JULES Regional Atmosphere and Land Configuration, RAL3
Atmospheric moisture tracking with WAM2layers v3
An updated parameterization of the unstable atmospheric surface layer in the Weather Research and Forecasting (WRF) modeling system
The impact of cloud microphysics and ice nucleation on Southern Ocean clouds assessed with single-column modeling and instrument simulators
An updated aerosol simulation in the Community Earth System Model (v2.1.3): dust and marine aerosol emissions and secondary organic aerosol formation
Exploring ship track spreading rates with a physics-informed Langevin particle parameterization
Do data-driven models beat numerical models in forecasting weather extremes? A comparison of IFS HRES, Pangu-Weather, and GraphCast
Development of the MPAS-CMAQ coupled system (V1.0) for multiscale global air quality modeling
UA-ICON with NWP physics package (version: ua-icon-2.1): mean state and variability of the middle atmosphere
Assessment of object-based indices to identify convective organization
Diagnosis of winter precipitation types using Spectral Bin Model (SBM): Comparison of five methods using ICE-POP 2018 field experiment data
Jie Gao, Yi Huang, Jonathon S. Wright, Ke Li, Tao Geng, and Qiurun Yu
Geosci. Model Dev., 18, 2569–2586, https://doi.org/10.5194/gmd-18-2569-2025, https://doi.org/10.5194/gmd-18-2569-2025, 2025
Short summary
Short summary
The aerosol in the upper troposphere and stratosphere is highly variable, and its radiative effect is poorly understood. To estimate this effect, the radiative kernel is constructed and applied. The results show that the kernels can reproduce aerosol radiative effects and are expected to simulate stratospheric aerosol radiative effects. This approach reduces computational expense, is consistent with radiative model calculations, and can be applied to atmospheric models with speed requirements.
Ji Won Yoon, Seungyeon Lee, Ebony Lee, and Seon Ki Park
Geosci. Model Dev., 18, 2303–2328, https://doi.org/10.5194/gmd-18-2303-2025, https://doi.org/10.5194/gmd-18-2303-2025, 2025
Short summary
Short summary
This study evaluates the Weather Research and Forecasting Model (WRF) coupled with Chemistry (WRF-Chem) to predict a mega Asian dust storm (ADS) over South Korea on 28–29 March 2021. We assessed combinations of five dust emission and four land surface schemes by analyzing meteorological and air quality variables. The best scheme combination reduced the root mean square error (RMSE) for particulate matter 10 (PM10) by up to 29.6 %, demonstrating the highest performance.
Jianyu Lin, Tie Dai, Lifang Sheng, Weihang Zhang, Shangfei Hai, and Yawen Kong
Geosci. Model Dev., 18, 2231–2248, https://doi.org/10.5194/gmd-18-2231-2025, https://doi.org/10.5194/gmd-18-2231-2025, 2025
Short summary
Short summary
The effectiveness of this assimilation system and its sensitivity to the ensemble member size and length of the assimilation window are investigated. This study advances our understanding of the selection of basic parameters in the four-dimensional local ensemble transform Kalman filter assimilation system and the performance of ensemble simulation in a particulate-matter-polluted environment.
Jens Peter Karolus Wenceslaus Frankemölle, Johan Camps, Pieter De Meutter, and Johan Meyers
Geosci. Model Dev., 18, 1989–2003, https://doi.org/10.5194/gmd-18-1989-2025, https://doi.org/10.5194/gmd-18-1989-2025, 2025
Short summary
Short summary
To detect anomalous radioactivity in the environment, it is paramount that we understand the natural background level. In this work, we propose a statistical model to describe the most likely background level and the associated uncertainty in a network of dose rate detectors. We train, verify, and validate the model using real environmental data. Using the model, we show that we can correctly predict the background level in a subset of the detector network during a known
anomalous event.
Jean-François Grailet, Robin J. Hogan, Nicolas Ghilain, David Bolsée, Xavier Fettweis, and Marilaure Grégoire
Geosci. Model Dev., 18, 1965–1988, https://doi.org/10.5194/gmd-18-1965-2025, https://doi.org/10.5194/gmd-18-1965-2025, 2025
Short summary
Short summary
The MAR (Modèle Régional Atmosphérique) is a regional climate model used for weather forecasting and studying the climate over various regions. This paper presents an update of MAR thanks to which it can precisely decompose solar radiation, in particular in the UV (ultraviolet) and photosynthesis ranges, both being critical to human health and ecosystems. As a first application of this new capability, this paper presents a method for predicting UV indices with MAR.
Yi-Ning Shi, Jun Yang, Wei Han, Lujie Han, Jiajia Mao, Wanlin Kan, and Fuzhong Weng
Geosci. Model Dev., 18, 1947–1964, https://doi.org/10.5194/gmd-18-1947-2025, https://doi.org/10.5194/gmd-18-1947-2025, 2025
Short summary
Short summary
Direct assimilation of observations from ground-based microwave radiometers (GMRs) holds significant potential for improving forecast accuracy. Radiative transfer models (RTMs) play a crucial role in direct data assimilation. In this study, we introduce a new RTM, the Advanced Radiative Transfer Modeling System – Ground-Based (ARMS-gb), designed to simulate brightness temperatures observed by GMRs along with their Jacobians. Several enhancements have been incorporated to achieve higher accuracy.
R. Phani Murali Krishna, Siddharth Kumar, A. Gopinathan Prajeesh, Peter Bechtold, Nils Wedi, Kumar Roy, Malay Ganai, B. Revanth Reddy, Snehlata Tirkey, Tanmoy Goswami, Radhika Kanase, Sahadat Sarkar, Medha Deshpande, and Parthasarathi Mukhopadhyay
Geosci. Model Dev., 18, 1879–1894, https://doi.org/10.5194/gmd-18-1879-2025, https://doi.org/10.5194/gmd-18-1879-2025, 2025
Short summary
Short summary
The High-Resolution Global Forecast Model (HGFM) is an advanced iteration of the operational Global Forecast System (GFS) model. HGFM can produce forecasts at a spatial scale of ~6 km in tropics. It demonstrates improved accuracy in short- to medium-range weather prediction over the Indian region, with notable success in predicting extreme events. Further, the model will be entrusted to operational forecasting agencies after validation and testing.
Jenna Ritvanen, Seppo Pulkkinen, Dmitri Moisseev, and Daniele Nerini
Geosci. Model Dev., 18, 1851–1878, https://doi.org/10.5194/gmd-18-1851-2025, https://doi.org/10.5194/gmd-18-1851-2025, 2025
Short summary
Short summary
Nowcasting models struggle with the rapid evolution of heavy rain, and common verification methods are unable to describe how accurately the models predict the growth and decay of heavy rain. We propose a framework to assess model performance. In the framework, convective cells are identified and tracked in the forecasts and observations, and the model skill is then evaluated by comparing differences between forecast and observed cells. We demonstrate the framework with four open-source models.
Andrew Geiss and Po-Lun Ma
Geosci. Model Dev., 18, 1809–1827, https://doi.org/10.5194/gmd-18-1809-2025, https://doi.org/10.5194/gmd-18-1809-2025, 2025
Short summary
Short summary
Particles in the Earth's atmosphere strongly impact the planet's energy budget, and atmosphere simulations require accurate representation of their interaction with light. This work introduces two approaches to represent light scattering by small particles. The first is a scattering simulator based on Mie theory implemented in Python. The second is a neural network emulator that is more accurate than existing methods and is fast enough to be used in climate and weather simulations.
Qin Wang, Bo Zeng, Gong Chen, and Yaoting Li
Geosci. Model Dev., 18, 1769–1784, https://doi.org/10.5194/gmd-18-1769-2025, https://doi.org/10.5194/gmd-18-1769-2025, 2025
Short summary
Short summary
This study evaluates the performance of four planetary boundary layer (PBL) schemes in near-surface wind fields over the Sichuan Basin, China. Using 112 sensitivity experiments with the Weather Research and Forecasting (WRF) model and focusing on 28 wind events, it is found that wind direction was less sensitive to the PBL schemes. The quasi-normal scale elimination (QNSE) scheme captured temporal variations best, while the Mellor–Yamada–Janjić (MYJ) scheme had the least error in wind speed.
Tai-Long He, Nikhil Dadheech, Tammy M. Thompson, and Alexander J. Turner
Geosci. Model Dev., 18, 1661–1671, https://doi.org/10.5194/gmd-18-1661-2025, https://doi.org/10.5194/gmd-18-1661-2025, 2025
Short summary
Short summary
It is computationally expensive to infer greenhouse gas (GHG) emissions using atmospheric observations. This is partly due to the detailed model used to represent atmospheric transport. We demonstrate how a machine learning (ML) model can be used to simulate high-resolution atmospheric transport. This type of ML model will help estimate GHG emissions using dense observations, which are becoming increasingly common with the proliferation of urban monitoring networks and geostationary satellites.
Wei Li, Beiming Tang, Patrick C. Campbell, Youhua Tang, Barry Baker, Zachary Moon, Daniel Tong, Jianping Huang, Kai Wang, Ivanka Stajner, and Raffaele Montuoro
Geosci. Model Dev., 18, 1635–1660, https://doi.org/10.5194/gmd-18-1635-2025, https://doi.org/10.5194/gmd-18-1635-2025, 2025
Short summary
Short summary
The study describes the updates of NOAA's current UFS-AQMv7 air quality forecast model by incorporating the latest scientific and structural changes in CMAQv5.4. An evaluation during the summer of 2023 shows that the updated model overall improves the simulation of MDA8 O3 by reducing the bias by 8%–12% in the contiguous US. PM2.5 predictions have mixed results due to wildfire, highlighting the need for future refinements.
Yanwei Zhu, Aitor Atencia, Markus Dabernig, and Yong Wang
Geosci. Model Dev., 18, 1545–1559, https://doi.org/10.5194/gmd-18-1545-2025, https://doi.org/10.5194/gmd-18-1545-2025, 2025
Short summary
Short summary
Most works have delved into convective weather nowcasting, and only a few works have discussed the nowcasting uncertainty for variables at the surface level. Hence, we proposed a method to estimate uncertainty. Generating appropriate noises associated with the characteristic of the error in analysis can simulate the uncertainty of nowcasting. This method can contribute to the estimation of near–surface analysis uncertainty in both nowcasting applications and ensemble nowcasting development.
Joël Thanwerdas, Antoine Berchet, Lionel Constantin, Aki Tsuruta, Michael Steiner, Friedemann Reum, Stephan Henne, and Dominik Brunner
Geosci. Model Dev., 18, 1505–1544, https://doi.org/10.5194/gmd-18-1505-2025, https://doi.org/10.5194/gmd-18-1505-2025, 2025
Short summary
Short summary
The Community Inversion Framework (CIF) brings together methods for estimating greenhouse gas fluxes from atmospheric observations. The initial ensemble method implemented in CIF was found to be incomplete and could hardly be compared to other ensemble methods employed in the inversion community. In this paper, we present and evaluate a new implementation of the ensemble mode, building upon the initial developments.
Astrid Kerkweg, Timo Kirfel, Duong H. Do, Sabine Griessbach, Patrick Jöckel, and Domenico Taraborrelli
Geosci. Model Dev., 18, 1265–1286, https://doi.org/10.5194/gmd-18-1265-2025, https://doi.org/10.5194/gmd-18-1265-2025, 2025
Short summary
Short summary
Normally, the Modular Earth Submodel System (MESSy) is linked to complete dynamic models to create chemical climate models. However, the modular concept of MESSy and the newly developed DWARF component presented here make it possible to create simplified models that contain only one or a few process descriptions. This is very useful for technical optimisation, such as porting to GPUs, and can be used to create less complex models, such as a chemical box model.
Edward C. Chan, Ilona J. Jäkel, Basit Khan, Martijn Schaap, Timothy M. Butler, Renate Forkel, and Sabine Banzhaf
Geosci. Model Dev., 18, 1119–1139, https://doi.org/10.5194/gmd-18-1119-2025, https://doi.org/10.5194/gmd-18-1119-2025, 2025
Short summary
Short summary
An enhanced emission module has been developed for the PALM model system, improving flexibility and scalability of emission source representation across different sectors. A model for parametrized domestic emissions has also been included, for which an idealized model run is conducted for particulate matter (PM10). The results show that, in addition to individual sources and diurnal variations in energy consumption, vertical transport and urban topology play a role in concentration distribution.
Gregor Ehrensperger, Thorsten Simon, Georg J. Mayr, and Tobias Hell
Geosci. Model Dev., 18, 1141–1153, https://doi.org/10.5194/gmd-18-1141-2025, https://doi.org/10.5194/gmd-18-1141-2025, 2025
Short summary
Short summary
As lightning is a brief and localized event, it is not explicitly resolved in atmospheric models. Instead, expert-based auxiliary descriptions are used to assess it. This study explores how AI can improve our understanding of lightning without relying on traditional expert knowledge. We reveal that AI independently identified the key factors known to experts as essential for lightning in the Alps region. This shows how knowledge discovery could be sped up in areas with limited expert knowledge.
David Patoulias, Kalliopi Florou, and Spyros N. Pandis
Geosci. Model Dev., 18, 1103–1118, https://doi.org/10.5194/gmd-18-1103-2025, https://doi.org/10.5194/gmd-18-1103-2025, 2025
Short summary
Short summary
The effect of the assumed atmospheric nucleation mechanism on particle number concentrations and size distribution was investigated. Two quite different mechanisms involving sulfuric acid and ammonia or a biogenic organic vapor gave quite similar results which were consistent with measurements at 26 measurement stations across Europe. The number of larger particles that serve as cloud condensation nuclei showed little sensitivity to the assumed nucleation mechanism.
Tim Radke, Susanne Fuchs, Christian Wilms, Iuliia Polkova, and Marc Rautenhaus
Geosci. Model Dev., 18, 1017–1039, https://doi.org/10.5194/gmd-18-1017-2025, https://doi.org/10.5194/gmd-18-1017-2025, 2025
Short summary
Short summary
In our study, we built upon previous work to investigate the patterns artificial intelligence (AI) learns to detect atmospheric features like tropical cyclones (TCs) and atmospheric rivers (ARs). As primary objective, we adopt a method to explain the AI used and investigate the plausibility of learned patterns. We find that plausible patterns are learned for both TCs and ARs. Hence, the chosen method is very useful for gaining confidence in the AI-based detection of atmospheric features.
Stefan Noll, Carsten Schmidt, Patrick Hannawald, Wolfgang Kausch, and Stefan Kimeswenger
EGUsphere, https://doi.org/10.5194/egusphere-2024-3512, https://doi.org/10.5194/egusphere-2024-3512, 2025
Short summary
Short summary
Non-thermal emission from chemical reactions in the Earth's middle und upper atmosphere strongly contributes to the brightness of the night sky below about 2.3 µm. The new Paranal Airglow Line and Continuum Emission model calculates the emission spectrum and its variability with an unprecedented accuracy. Relying on a large spectroscopic data set from astronomical spectrographs and theoretical molecular/atomic data, it is valuable for airglow research and astronomical observatories.
Felipe Cifuentes, Henk Eskes, Enrico Dammers, Charlotte Bryan, and Folkert Boersma
Geosci. Model Dev., 18, 621–649, https://doi.org/10.5194/gmd-18-621-2025, https://doi.org/10.5194/gmd-18-621-2025, 2025
Short summary
Short summary
We tested the capability of the flux divergence approach (FDA) to reproduce known NOx emissions using synthetic NO2 satellite column retrievals from high-resolution model simulations. The FDA accurately reproduced NOx emissions when column observations were limited to the boundary layer and when the variability of the NO2 lifetime, the NOx : NO2 ratio, and NO2 profile shapes were correctly modeled. This introduces strong model dependency, reducing the simplicity of the original FDA formulation.
Stefano Ubbiali, Christian Kühnlein, Christoph Schär, Linda Schlemmer, Thomas C. Schulthess, Michael Staneker, and Heini Wernli
Geosci. Model Dev., 18, 529–546, https://doi.org/10.5194/gmd-18-529-2025, https://doi.org/10.5194/gmd-18-529-2025, 2025
Short summary
Short summary
We explore a high-level programming model for porting numerical weather prediction (NWP) model codes to graphics processing units (GPUs). We present a Python rewrite with the domain-specific library GT4Py (GridTools for Python) of two renowned cloud microphysics schemes and the associated tangent-linear and adjoint algorithms. We find excellent portability, competitive GPU performance, robust execution on diverse computing architectures, and enhanced code maintainability and user productivity.
Pieter Rijsdijk, Henk Eskes, Arlene Dingemans, K. Folkert Boersma, Takashi Sekiya, Kazuyuki Miyazaki, and Sander Houweling
Geosci. Model Dev., 18, 483–509, https://doi.org/10.5194/gmd-18-483-2025, https://doi.org/10.5194/gmd-18-483-2025, 2025
Short summary
Short summary
Clustering high-resolution satellite observations into superobservations improves model validation and data assimilation applications. In our paper, we derive quantitative uncertainties for satellite NO2 column observations based on knowledge of the retrievals, including a detailed analysis of spatial error correlations and representativity errors. The superobservations and uncertainty estimates are tested in a global chemical data assimilation system and are found to improve the forecasts.
Dario Di Santo, Cenlin He, Fei Chen, and Lorenzo Giovannini
Geosci. Model Dev., 18, 433–459, https://doi.org/10.5194/gmd-18-433-2025, https://doi.org/10.5194/gmd-18-433-2025, 2025
Short summary
Short summary
This paper presents the Machine Learning-based Automated Multi-method Parameter Sensitivity and Importance analysis Tool (ML-AMPSIT), a computationally efficient tool that uses machine learning algorithms for sensitivity analysis in atmospheric models. It is tested with the Weather Research and Forecasting (WRF) model coupled with the Noah-Multiparameterization (Noah-MP) land surface model to investigate sea breeze circulation sensitivity to vegetation-related parameters.
Robert Schoetter, Robin James Hogan, Cyril Caliot, and Valéry Masson
Geosci. Model Dev., 18, 405–431, https://doi.org/10.5194/gmd-18-405-2025, https://doi.org/10.5194/gmd-18-405-2025, 2025
Short summary
Short summary
Radiation is relevant to the atmospheric impact on people and infrastructure in cities as it can influence the urban heat island, building energy consumption, and human thermal comfort. A new urban radiation model, assuming a more realistic form of urban morphology, is coupled to the urban climate model Town Energy Balance (TEB). The new TEB is evaluated with a reference radiation model for a variety of urban morphologies, and an improvement in the simulated radiative observables is found.
Zebediah Engberg, Roger Teoh, Tristan Abbott, Thomas Dean, Marc E. J. Stettler, and Marc L. Shapiro
Geosci. Model Dev., 18, 253–286, https://doi.org/10.5194/gmd-18-253-2025, https://doi.org/10.5194/gmd-18-253-2025, 2025
Short summary
Short summary
Contrails forming in some atmospheric conditions may persist and become strongly warming cirrus, while in other conditions may be neutral or cooling. We develop a contrail forecast model to predict contrail climate forcing for any arbitrary point in space and time and explore integration into flight planning and air traffic management. This approach enables contrail interventions to target high-probability high-climate-impact regions and reduce unintended consequences of contrail management.
Nils Eingrüber, Alina Domm, Wolfgang Korres, and Karl Schneider
Geosci. Model Dev., 18, 141–160, https://doi.org/10.5194/gmd-18-141-2025, https://doi.org/10.5194/gmd-18-141-2025, 2025
Short summary
Short summary
Climate change adaptation measures like unsealings can reduce urban heat stress. As grass grid pavers have never been parameterized for microclimate model simulations with ENVI-met, a new parameterization was developed based on field measurements. To analyse the cooling potential, scenario analyses were performed for a densely developed area in Cologne. Statistically significant average cooling effects of up to −11.1 K were found for surface temperature and up to −2.9 K for 1 m air temperature.
Xuan Wang, Lei Bi, Hong Wang, Yaqiang Wang, Wei Han, Xueshun Shen, and Xiaoye Zhang
Geosci. Model Dev., 18, 117–139, https://doi.org/10.5194/gmd-18-117-2025, https://doi.org/10.5194/gmd-18-117-2025, 2025
Short summary
Short summary
The Artificial-Intelligence-based Nonspherical Aerosol Optical Scheme (AI-NAOS) was developed to improve the estimation of the aerosol direct radiation effect and was coupled online with a chemical weather model. The AI-NAOS scheme considers black carbon as fractal aggregates and soil dust as super-spheroids, encapsulated with hygroscopic aerosols. Real-case simulations emphasize the necessity of accurately representing nonspherical and inhomogeneous aerosols in chemical weather models.
Lukas Pfitzenmaier, Pavlos Kollias, Nils Risse, Imke Schirmacher, Bernat Puigdomenech Treserras, and Katia Lamer
Geosci. Model Dev., 18, 101–115, https://doi.org/10.5194/gmd-18-101-2025, https://doi.org/10.5194/gmd-18-101-2025, 2025
Short summary
Short summary
The Python tool Orbital-Radar transfers suborbital radar data (ground-based, airborne, and forward-simulated numerical weather prediction model) into synthetic spaceborne cloud profiling radar data, mimicking platform-specific instrument characteristics, e.g. EarthCARE or CloudSat. The tool's novelty lies in simulating characteristic errors and instrument noise. Thus, existing data sets are transferred into synthetic observations and can be used for satellite calibration–validation studies.
Mark Buehner, Jean-Francois Caron, Ervig Lapalme, Alain Caya, Ping Du, Yves Rochon, Sergey Skachko, Maziar Bani Shahabadi, Sylvain Heilliette, Martin Deshaies-Jacques, Weiguang Chang, and Michael Sitwell
Geosci. Model Dev., 18, 1–18, https://doi.org/10.5194/gmd-18-1-2025, https://doi.org/10.5194/gmd-18-1-2025, 2025
Short summary
Short summary
The Modular and Integrated Data Assimilation System (MIDAS) software is described. The flexible design of MIDAS enables both deterministic and ensemble prediction applications for the atmosphere and several other Earth system components. It is currently used for all main operational weather prediction systems in Canada and also for sea ice and sea surface temperature analysis. The use of MIDAS for multiple Earth system components will facilitate future research on coupled data assimilation.
Alexander de Meij, Cornelis Cuvelier, Philippe Thunis, and Enrico Pisoni
EGUsphere, https://doi.org/10.5194/egusphere-2024-3690, https://doi.org/10.5194/egusphere-2024-3690, 2025
Short summary
Short summary
We assess the relevance and utility indicators developed within FAIRMODE by evaluating 9 CAMS models in calculated air pollutant values. For NO2, the results highlight difficulties at traffic stations. For PM2.5 and PM10 the bias and Winter-Summer gradients reveal issues. O3 evaluation shows that e.g. seasonal gradients are useful. Overall, the indicators provide valuable insights into model limitations, yet there is a need to reconsider the strictness of some indicators for certain pollutants.
Zichen Wu, Xueshun Chen, Zifa Wang, Huansheng Chen, Zhe Wang, Qing Mu, Lin Wu, Wending Wang, Xiao Tang, Jie Li, Ying Li, Qizhong Wu, Yang Wang, Zhiyin Zou, and Zijian Jiang
Geosci. Model Dev., 17, 8885–8907, https://doi.org/10.5194/gmd-17-8885-2024, https://doi.org/10.5194/gmd-17-8885-2024, 2024
Short summary
Short summary
We developed a model to simulate polycyclic aromatic hydrocarbons (PAHs) from global to regional scales. The model can reproduce PAH distribution well. The concentration of BaP (indicator species for PAHs) could exceed the target values of 1 ng m-3 over some areas (e.g., in central Europe, India, and eastern China). The change in BaP is lower than that in PM2.5 from 2013 to 2018. China still faces significant potential health risks posed by BaP although the Action Plan has been implemented.
Marie Taufour, Jean-Pierre Pinty, Christelle Barthe, Benoît Vié, and Chien Wang
Geosci. Model Dev., 17, 8773–8798, https://doi.org/10.5194/gmd-17-8773-2024, https://doi.org/10.5194/gmd-17-8773-2024, 2024
Short summary
Short summary
We have developed a complete two-moment version of the LIMA (Liquid Ice Multiple Aerosols) microphysics scheme. We have focused on collection processes, where the hydrometeor number transfer is often estimated in proportion to the mass transfer. The impact of these parameterizations on a convective system and the prospects for more realistic estimates of secondary parameters (reflectivity, hydrometeor size) are shown in a first test on an idealized case.
Yuya Takane, Yukihiro Kikegawa, Ko Nakajima, and Hiroyuki Kusaka
Geosci. Model Dev., 17, 8639–8664, https://doi.org/10.5194/gmd-17-8639-2024, https://doi.org/10.5194/gmd-17-8639-2024, 2024
Short summary
Short summary
A new parameterisation for dynamic anthropogenic heat and electricity consumption is described. The model reproduced the temporal variation in and spatial distributions of electricity consumption and temperature well in summer and winter. The partial air conditioning was the most critical factor, significantly affecting the value of anthropogenic heat emission.
Arseniy Karagodin-Doyennel, Fredrik Jansson, Bart van Stratum, Hugo Denier van der Gon, Jordi Vilà-Guerau de Arellano, and Sander Houweling
EGUsphere, https://doi.org/10.5194/egusphere-2024-3721, https://doi.org/10.5194/egusphere-2024-3721, 2024
Short summary
Short summary
We introduce a new simulation platform based on the Dutch Large-Eddy Simulation (DALES) to simulate carbon dioxide (CO2) emissions and their dispersion in the turbulent environments with hectometer resolution. This model incorporates both anthropogenic emission inventory and ecosystem exchanges. Simulation results for the main urban area in the Netherlands demonstrate a strong potential of DALES to enhance CO2 emission modeling, which is important for refining their reduction strategies.
Hongyi Li, Ting Yang, Lars Nerger, Dawei Zhang, Di Zhang, Guigang Tang, Haibo Wang, Yele Sun, Pingqing Fu, Hang Su, and Zifa Wang
Geosci. Model Dev., 17, 8495–8519, https://doi.org/10.5194/gmd-17-8495-2024, https://doi.org/10.5194/gmd-17-8495-2024, 2024
Short summary
Short summary
To accurately characterize the spatiotemporal distribution of particulate matter <2.5 µm chemical components, we developed the Nested Air Quality Prediction Model System with the Parallel Data Assimilation Framework (NAQPMS-PDAF) v2.0 for chemical components with non-Gaussian and nonlinear properties. NAQPMS-PDAF v2.0 has better computing efficiency, excels when used with a small ensemble size, and can significantly improve the simulation performance of chemical components.
T. Nash Skipper, Christian Hogrefe, Barron H. Henderson, Rohit Mathur, Kristen M. Foley, and Armistead G. Russell
Geosci. Model Dev., 17, 8373–8397, https://doi.org/10.5194/gmd-17-8373-2024, https://doi.org/10.5194/gmd-17-8373-2024, 2024
Short summary
Short summary
Chemical transport model simulations are combined with ozone observations to estimate the bias in ozone attributable to US anthropogenic sources and individual sources of US background ozone: natural sources, non-US anthropogenic sources, and stratospheric ozone. Results indicate a positive bias correlated with US anthropogenic emissions during summer in the eastern US and a negative bias correlated with stratospheric ozone during spring.
Li Fang, Jianbing Jin, Arjo Segers, Ke Li, Ji Xia, Wei Han, Baojie Li, Hai Xiang Lin, Lei Zhu, Song Liu, and Hong Liao
Geosci. Model Dev., 17, 8267–8282, https://doi.org/10.5194/gmd-17-8267-2024, https://doi.org/10.5194/gmd-17-8267-2024, 2024
Short summary
Short summary
Model evaluations against ground observations are usually unfair. The former simulates mean status over coarse grids and the latter the surrounding atmosphere. To solve this, we proposed the new land-use-based representative (LUBR) operator that considers intra-grid variance. The LUBR operator is validated to provide insights that align with satellite measurements. The results highlight the importance of considering fine-scale urban–rural differences when comparing models and observation.
Mijie Pang, Jianbing Jin, Arjo Segers, Huiya Jiang, Wei Han, Batjargal Buyantogtokh, Ji Xia, Li Fang, Jiandong Li, Hai Xiang Lin, and Hong Liao
Geosci. Model Dev., 17, 8223–8242, https://doi.org/10.5194/gmd-17-8223-2024, https://doi.org/10.5194/gmd-17-8223-2024, 2024
Short summary
Short summary
The ensemble Kalman filter (EnKF) improves dust storm forecasts but faces challenges with position errors. The valid time shifting EnKF (VTS-EnKF) addresses this by adjusting for position errors, enhancing accuracy in forecasting dust storms, as proven in tests on 2021 events, even with smaller ensembles and time intervals.
Mike Bush, David L. A. Flack, Huw W. Lewis, Sylvia I. Bohnenstengel, Chris J. Short, Charmaine Franklin, Adrian P. Lock, Martin Best, Paul Field, Anne McCabe, Kwinten Van Weverberg, Segolene Berthou, Ian Boutle, Jennifer K. Brooke, Seb Cole, Shaun Cooper, Gareth Dow, John Edwards, Anke Finnenkoetter, Kalli Furtado, Kate Halladay, Kirsty Hanley, Margaret A. Hendry, Adrian Hill, Aravindakshan Jayakumar, Richard W. Jones, Humphrey Lean, Joshua C. K. Lee, Andy Malcolm, Marion Mittermaier, Saji Mohandas, Stuart Moore, Cyril Morcrette, Rachel North, Aurore Porson, Susan Rennie, Nigel Roberts, Belinda Roux, Claudio Sanchez, Chun-Hsu Su, Simon Tucker, Simon Vosper, David Walters, James Warner, Stuart Webster, Mark Weeks, Jonathan Wilkinson, Michael Whitall, Keith D. Williams, and Hugh Zhang
Geosci. Model Dev. Discuss., https://doi.org/10.5194/gmd-2024-201, https://doi.org/10.5194/gmd-2024-201, 2024
Revised manuscript accepted for GMD
Short summary
Short summary
RAL configurations define settings for the Unified Model atmosphere and Joint UK Land Environment Simulator. The third version of the Regional Atmosphere and Land (RAL3) science configuration for kilometre and sub-km scale modelling represents a major advance compared to previous versions (RAL2) by delivering a common science definition for applications in tropical and mid-latitude regions. RAL3 has more realistic precipitation distributions and improved representation of clouds and visibility.
Peter Kalverla, Imme Benedict, Chris Weijenborg, and Ruud J. van der Ent
EGUsphere, https://doi.org/10.5194/egusphere-2024-3401, https://doi.org/10.5194/egusphere-2024-3401, 2024
Short summary
Short summary
We introduce a new version of WAM2layers, a computer program that tracks how the weather brings water from one place to another. It uses data from weather and climate models, whose resolution is steadily increasing. Processing the latest data became a challenge, and the updates presented here ensure that WAM2layers runs smoothly again. We also made it easier to use the program and to understand its source code. This makes it more transparent and reliable, and easier to maintain.
Prabhakar Namdev, Maithili Sharan, Piyush Srivastava, and Saroj Kanta Mishra
Geosci. Model Dev., 17, 8093–8114, https://doi.org/10.5194/gmd-17-8093-2024, https://doi.org/10.5194/gmd-17-8093-2024, 2024
Short summary
Short summary
Inadequate representation of surface–atmosphere interaction processes is a major source of uncertainty in numerical weather prediction models. Here, an effort has been made to improve the Weather Research and Forecasting (WRF) model version 4.2.2 by introducing a unique theoretical framework under convective conditions. In addition, to enhance the potential applicability of the WRF modeling system, various commonly used similarity functions under convective conditions have also been installed.
Andrew Gettelman, Richard Forbes, Roger Marchand, Chih-Chieh Chen, and Mark Fielding
Geosci. Model Dev., 17, 8069–8092, https://doi.org/10.5194/gmd-17-8069-2024, https://doi.org/10.5194/gmd-17-8069-2024, 2024
Short summary
Short summary
Supercooled liquid clouds (liquid clouds colder than 0°C) are common at higher latitudes (especially over the Southern Ocean) and are critical for constraining climate projections. We compare a single-column version of a weather model to observations with two different cloud schemes and find that both the dynamical environment and atmospheric aerosols are important for reproducing observations.
Yujuan Wang, Peng Zhang, Jie Li, Yaman Liu, Yanxu Zhang, Jiawei Li, and Zhiwei Han
Geosci. Model Dev., 17, 7995–8021, https://doi.org/10.5194/gmd-17-7995-2024, https://doi.org/10.5194/gmd-17-7995-2024, 2024
Short summary
Short summary
This study updates the CESM's aerosol schemes, focusing on dust, marine aerosol emissions, and secondary organic aerosol (SOA) . Dust emission modifications make deflation areas more continuous, improving results in North America and the sub-Arctic. Humidity correction to sea-salt emissions has a minor effect. Introducing marine organic aerosol emissions, coupled with ocean biogeochemical processes, and adding aqueous reactions for SOA formation advance the CESM's aerosol modelling results.
Lucas A. McMichael, Michael J. Schmidt, Robert Wood, Peter N. Blossey, and Lekha Patel
Geosci. Model Dev., 17, 7867–7888, https://doi.org/10.5194/gmd-17-7867-2024, https://doi.org/10.5194/gmd-17-7867-2024, 2024
Short summary
Short summary
Marine cloud brightening (MCB) is a climate intervention technique to potentially cool the climate. Climate models used to gauge regional climate impacts associated with MCB often assume large areas of the ocean are uniformly perturbed. However, a more realistic representation of MCB application would require information about how an injected particle plume spreads. This work aims to develop such a plume-spreading model.
Leonardo Olivetti and Gabriele Messori
Geosci. Model Dev., 17, 7915–7962, https://doi.org/10.5194/gmd-17-7915-2024, https://doi.org/10.5194/gmd-17-7915-2024, 2024
Short summary
Short summary
Data-driven models are becoming a viable alternative to physics-based models for weather forecasting up to 15 d into the future. However, it is unclear whether they are as reliable as physics-based models when forecasting weather extremes. We evaluate their performance in forecasting near-surface cold, hot, and windy extremes globally. We find that data-driven models can compete with physics-based models and that the choice of the best model mainly depends on the region and type of extreme.
David C. Wong, Jeff Willison, Jonathan E. Pleim, Golam Sarwar, James Beidler, Russ Bullock, Jerold A. Herwehe, Rob Gilliam, Daiwen Kang, Christian Hogrefe, George Pouliot, and Hosein Foroutan
Geosci. Model Dev., 17, 7855–7866, https://doi.org/10.5194/gmd-17-7855-2024, https://doi.org/10.5194/gmd-17-7855-2024, 2024
Short summary
Short summary
This work describe how we linked the meteorological Model for Prediction Across Scales – Atmosphere (MPAS-A) with the Community Multiscale Air Quality (CMAQ) air quality model to form a coupled modelling system. This could be used to study air quality or climate and air quality interaction at a global scale. This new model scales well in high-performance computing environments and performs well with respect to ground surface networks in terms of ozone and PM2.5.
Markus Kunze, Christoph Zülicke, Tarique Adnan Siddiqui, Claudia Christine Stephan, Yosuke Yamazaki, Claudia Stolle, Sebastian Borchert, and Hauke Schmidt
Geosci. Model Dev. Discuss., https://doi.org/10.5194/gmd-2024-191, https://doi.org/10.5194/gmd-2024-191, 2024
Revised manuscript accepted for GMD
Short summary
Short summary
We present the Icosahedral Nonhydrostatic (ICON) general circulation model with upper atmosphere extension with the physics package for numerical weather prediction (UA-ICON(NWP)). The parameters for the gravity wave parameterizations were optimized, and realistic modelling of the thermal and dynamic state of the mesopause regions was achieved. UA-ICON(NWP) now shows a realistic frequency of major sudden stratospheric warmings and well-represented solar tides in temperature.
Giulio Mandorli and Claudia J. Stubenrauch
Geosci. Model Dev., 17, 7795–7813, https://doi.org/10.5194/gmd-17-7795-2024, https://doi.org/10.5194/gmd-17-7795-2024, 2024
Short summary
Short summary
In recent years, several studies focused their attention on the disposition of convection. Lots of methods, called indices, have been developed to quantify the amount of convection clustering. These indices are evaluated in this study by defining criteria that must be satisfied and then evaluating the indices against these standards. None of the indices meet all criteria, with some only partially meeting them.
Wonbae Bang, Jacob Carlin, Kwonil Kim, Alexander Ryzhkov, Guosheng Liu, and Gyuwon Lee
Geosci. Model Dev. Discuss., https://doi.org/10.5194/gmd-2024-179, https://doi.org/10.5194/gmd-2024-179, 2024
Revised manuscript accepted for GMD
Short summary
Short summary
Microphysics model-based diagnosis such as the spectral bin model (SBM) recently has been attempted to diagnose winter precipitation types. In this study, the accuracy of SBM-based precipitation type diagnosis is compared with other traditional methods. SBM have relatively higher accuracy about snow and wetsnow events whereas lower accuracy about rain event. When microphysics scheme in the SBM was optimized for the corresponding region, accuracy about rain events was improved.
Cited articles
Abramowitz, G.:
Towards a public, standardized, diagnostic benchmarking system for land surface models, Geosci. Model Dev., 5, 819–827, https://doi.org/10.5194/gmd-5-819-2012, 2012.
Ahn, M. and Kang, I.:
A practical approach to scale-adaptive deep convection in a GCM by controlling the cumulus base mass flux, npj Clim. Atmos. Sci., 1, 13, https://doi.org/10.1038/s41612-018-0021-0, 2018.
Ahn, M.-S., Gleckler, P. J., Lee, J., Pendergrass, A. G., and Jakob, C.:
Benchmarking Simulated Precipitation Variability Amplitude across Time Scales, J. Climate, 35, 3173–3196, https://doi.org/10.1175/JCLI-D-21-0542.1, 2022.
Ahn, M.-S., Ullrich, P. A., Lee, J., Gleckler, P. J., Ma, H.-Y., Terai, C. R., Bogenschutz, P. A., and Ordonez, A. C.:
Bimodality in Simulated Precipitation Frequency Distributions and Its Relationship with Convective Parameterizations, npj Clim. Atmos. Sci., submitted, https://doi.org/10.21203/rs.3.rs-2874349/v1, 2023.
Ashouri, H., Hsu, K. L., Sorooshian, S., Braithwaite, D. K., Knapp, K. R., Cecil, L. D., Nelson, B. R., and Prat, O. P.:
PERSIANN-CDR: Daily precipitation climate data record from multisatellite observations for hydrological and climate studies, B. Am. Meteorol. Soc., 96, 69–83, https://doi.org/10.1175/BAMS-D-13-00068.1, 2015.
Chakravarti, I. M., Laha, R. G., and Roy, J.:
Handbook of Methods of Applied Statistics, Volume I: Techniques of Computation, Descriptive Methods, and Statistical Inference, John Wiley & Sons, Inc, 392–394, 1967.
Chen, D. and Dai, A.:
Precipitation Characteristics in the Community Atmosphere Model and Their Dependence on Model Physics and Resolution, J. Adv. Model. Earth Sy., 11, 2352–2374, https://doi.org/10.1029/2018MS001536, 2019.
Chen, D., Dai, A., and Hall, A.:
The Convective-To-Total Precipitation Ratio and the “Drizzling” Bias in Climate Models, J. Geophys. Res.-Atmos., 126, 1–17, https://doi.org/10.1029/2020JD034198, 2021.
Covey, C., Gleckler, P. J., Doutriaux, C., Williams, D. N., Dai, A., Fasullo, J., Trenberth, K., and Berg, A.:
Metrics for the Diurnal Cycle of Precipitation: Toward Routine Benchmarks for Climate Models, J. Climate, 29, 4461–4471, https://doi.org/10.1175/JCLI-D-15-0664.1, 2016.
Dai, A.:
Precipitation characteristics in eighteen coupled climate models, J. Climate, 19, 4605–4630, https://doi.org/10.1175/JCLI3884.1, 2006.
ESGF: Observations for Model Intercomparisons Project, ESGF [data set], https://esgf-node.llnl.gov/projects/obs4mips/ (last access: 1 July 2023), 2023a.
ESGF: ESGF@DOE/LLNL, ESGF [data set], https://esgf-node.llnl.gov/projects/esgf-llnl (last access: 1 July 2023), 2023b.
Eyring, V., Bony, S., Meehl, G. A., Senior, C. A., Stevens, B., Stouffer, R. J., and Taylor, K. E.:
Overview of the Coupled Model Intercomparison Project Phase 6 (CMIP6) experimental design and organization, Geosci. Model Dev., 9, 1937–1958, https://doi.org/10.5194/gmd-9-1937-2016, 2016.
Fiedler, S., Crueger, T., D'Agostino, R., Peters, K., Becker, T., Leutwyler, D., Paccini, L., Burdanowitz, J., Buehler, S. A., Cortes, A. U., Dauhut, T., Dommenget, D., Fraedrich, K., Jungandreas, L., Maher, N., Naumann, A. K., Rugenstein, M., Sakradzija, M., Schmidt, H., Sielmann, F., Stephan, C., Timmreck, C., Zhu, X., and Stevens, B.:
Simulated Tropical Precipitation Assessed across Three Major Phases of the Coupled Model Intercomparison Project (CMIP), Mon. Weather Rev., 148, 3653–3680, https://doi.org/10.1175/MWR-D-19-0404.1, 2020.
Gleckler, P., Doutriaux, C., Durack, P., Taylor, K., Zhang, Y., Williams, D., Mason, E., and Servonnat, J.:
A More Powerful Reality Test for Climate Models, Eos, 97, 20–24, https://doi.org/10.1029/2016EO051663, 2016.
Gleckler, P. J., Taylor, K. E., and Doutriaux, C.:
Performance metrics for climate models, J. Geophys. Res.-Atmos., 113, 1–20, https://doi.org/10.1029/2007JD008972, 2008.
Haarsma, R. J., Roberts, M. J., Vidale, P. L., Senior, C. A., Bellucci, A., Bao, Q., Chang, P., Corti, S., Fučkar, N. S., Guemas, V., von Hardenberg, J., Hazeleger, W., Kodama, C., Koenigk, T., Leung, L. R., Lu, J., Luo, J.-J., Mao, J., Mizielinski, M. S., Mizuta, R., Nobre, P., Satoh, M., Scoccimarro, E., Semmler, T., Small, J., and von Storch, J.-S.: High Resolution Model Intercomparison Project (HighResMIP v1.0) for CMIP6, Geosci. Model Dev., 9, 4185–4208, https://doi.org/10.5194/gmd-9-4185-2016, 2016.
Hersbach, H., Bell, B., Berrisford, P., Hirahara, S., Horányi, A., Muñoz‐Sabater, J., Nicolas, J., Peubey, C., Radu, R., Schepers, D., Simmons, A., Soci, C., Abdalla, S., Abellan, X., Balsamo, G., Bechtold, P., Biavati, G., Bidlot, J., Bonavita, M., Chiara, G., Dahlgren, P., Dee, D., Diamantakis, M., Dragani, R., Flemming, J., Forbes, R., Fuentes, M., Geer, A., Haimberger, L., Healy, S., Hogan, R., Hólm, E., Janisková, M., Keeley, S., Laloyaux, P., Lopez, P., Lupu, C., Radnoti, G., Rosnay, P., Rozum, I., Vamborg, F., Villaume, S., and Thépaut, J.:
The ERA5 global reanalysis, Q. J. Roy. Meteor. Soc., 146, 1999–2049, https://doi.org/10.1002/qj.3803, 2020.
Huffman, G. J., Adler, R. F., Morrissey, M. M., Bolvin, D. T., Curtis, S., Joyce, R., McGavock, B., and Susskind, J.:
Global Precipitation at One-Degree Daily Resolution from Multisatellite Observations, J. Hydrometeorol., 2, 36–50, https://doi.org/10.1175/1525-7541(2001)002<0036:GPAODD>2.0.CO;2, 2001.
Huffman, G. J., Bolvin, D. T., Nelkin, E. J., Wolff, D. B., Adler, R. F., Gu, G., Hong, Y., Bowman, K. P., and Stocker, E. F.:
The TRMM Multisatellite Precipitation Analysis (TMPA): Quasi-Global, Multiyear, Combined-Sensor Precipitation Estimates at Fine Scales, J. Hydrometeorol., 8, 38–55, https://doi.org/10.1175/JHM560.1, 2007.
Huffman, G. J., Bolvin, D. T., Braithwaite, D., Hsu, K.-L., Joyce, R. J., Kidd, C., Nelkin, E. J., Sorooshian, S., Stocker, E. F., Tan, J., Wolff, D. B., and Xie, P.:
Integrated Multi-satellite Retrievals for the Global Precipitation Measurement (GPM) Mission (IMERG), Adv. Glob. Change Res., 67, 343–353, 2020.
Iturbide, M., Gutiérrez, J. M., Alves, L. M., Bedia, J., Cerezo-Mota, R., Cimadevilla, E., Cofiño, A. S., Di Luca, A., Faria, S. H., Gorodetskaya, I. V., Hauser, M., Herrera, S., Hennessy, K., Hewitt, H. T., Jones, R. G., Krakovska, S., Manzanas, R., Martínez-Castro, D., Narisma, G. T., Nurhati, I. S., Pinto, I., Seneviratne, S. I., van den Hurk, B., and Vera, C. S.:
An update of IPCC climate reference regions for subcontinental analysis of climate model data: definition and aggregated datasets, Earth Syst. Sci. Data, 12, 2959–2970, https://doi.org/10.5194/essd-12-2959-2020, 2020.
Khodadoust Siuki, S., Saghafian, B., and Moazami, S.:
Comprehensive evaluation of 3-hourly TRMM and half-hourly GPM-IMERG satellite precipitation products, Int. J. Remote Sens., 38, 558–571, https://doi.org/10.1080/01431161.2016.1268735, 2017.
Kooperman, G. J., Pritchard, M. S., Burt, M. A., Branson, M. D., and Randall, D. A.:
Robust effects of cloud superparameterization on simulated daily rainfall intensity statistics across multiple versions of the Community Earth System Model, J. Adv. Model. Earth Sy., 8, 140–165, https://doi.org/10.1002/2015MS000574, 2016.
Kooperman, G. J., Pritchard, M. S., O'Brien, T. A., and Timmermans, B. W.:
Rainfall From Resolved Rather Than Parameterized Processes Better Represents the Present-Day and Climate Change Response of Moderate Rates in the Community Atmosphere Model, J. Adv. Model. Earth Sy., 10, 971–988, https://doi.org/10.1002/2017MS001188, 2018.
Lee, J., Gleckler, P., Ordonez, A., Ahn, M.-S., Ullrich, P., Vo, T., Boutte, J., Doutriaux, C., Durack, P., Shaheen, Z., Muryanto, L., Painter, J., and Krasting, J.: PCMDI/pcmdi_metrics: PMP Version 2.5.1 (v2.5.1), Zenodo [code], https://doi.org/10.5281/zenodo.7231033, 2022.
Leung, L. R., Boos, W. R., Catto, J. L., A. DeMott, C., Martin, G. M., Neelin, J. D., O’Brien, T. A., Xie, S., Feng, Z., Klingaman, N. P., Kuo, Y.-H., Lee, R. W., Martinez-Villalobos, C., Vishnu, S., Priestley, M. D. K., Tao, C., and Zhou, Y.: Exploratory Precipitation Metrics: Spatiotemporal Characteristics, Process-Oriented, and Phenomena-Based, J. Climate, 35, 3659–3686, https://doi.org/10.1175/JCLI-D-21-0590.1, 2022.
Lin, Y., Zhao, M., Ming, Y., Golaz, J.- C., Donner, L. J., Klein, S. A., Ramaswamy, V., and Xie, S.:
Precipitation Partitioning, Tropical Clouds, and Intraseasonal Variability in GFDL AM2, J. Climate, 26, 5453–5466, https://doi.org/10.1175/JCLI-D-12-00442.1, 2013.
Ma, H., Klein, S. A., Lee, J., Ahn, M., Tao, C., and Gleckler, P. J.:
Superior Daily and Sub-Daily Precipitation Statistics for Intense and Long-Lived Storms in Global Storm-Resolving Models, Geophys. Res. Lett., 49, e2021GL096759, https://doi.org/10.1029/2021GL096759, 2022.
MacQueen, J. B.:
Some methods for classification and analysis of multivariate observations, Statistical Laboratory of the University of California, Berkeley, 21 June– 18 July 1965 and 27 December 1965–7 January 1966, 5.1, 281–297, 1967.
Martinez-Villalobos, C. and Neelin, J. D.:
Why Do Precipitation Intensities Tend to Follow Gamma Distributions?, J. Atmos. Sci., 76, 3611–3631, https://doi.org/10.1175/JAS-D-18-0343.1, 2019.
Martinez-Villalobos, C., Neelin, J. D., and Pendergrass, A. G.:
Metrics for Evaluating CMIP6 Representation of Daily Precipitation Probability Distributions, J. Climate, 1–79, https://doi.org/10.1175/JCLI-D-21-0617.1, 2022.
Meehl, G. A., Boer, G. J., Covey, C., Latif, M., and Stouffer, R. J.:
The Coupled Model Intercomparison Project (CMIP), B. Am. Meteorol. Soc., 81, 313–318, https://doi.org/10.1175/1520-0477(2000)081<0313:TCMIPC>2.3.CO;2, 2000.
Meehl, G. A., Covey, C., McAvaney, B., Latif, M., and Stouffer, R. J.:
Overview of the Coupled Model Intercomparison Project, B. Am. Meteorol. Soc., 86, 89–96, 2005.
Meehl, G. A., Covey, C., Delworth, T., Latif, M., McAvaney, B., Mitchell, J. F. B., Stouffer, R. J., and Taylor, K. E.:
The WCRP CMIP3 Multimodel Dataset: A New Era in Climate Change Research, B. Am. Meteorol. Soc., 88, 1383–1394, https://doi.org/10.1175/BAMS-88-9-1383, 2007.
PCMDI: Benchmarking Simulated Precipitation, PCMDI [data set], https://pcmdi.llnl.gov/research/metrics/precip/, last access: 1 July 2023.
Pendergrass, A. G. and Deser, C.:
Climatological Characteristics of Typical Daily Precipitation, J. Climate, 30, 5985–6003, https://doi.org/10.1175/JCLI-D-16-0684.1, 2017.
Pendergrass, A. G. and Hartmann, D. L.:
Two Modes of Change of the Distribution of Rain, J. Climate, 27, 8357–8371, https://doi.org/10.1175/JCLI-D-14-00182.1, 2014.
Pendergrass, A. G. and Knutti, R.:
The Uneven Nature of Daily Precipitation and Its Change, Geophys. Res. Lett., 45, 11980–11988, https://doi.org/10.1029/2018GL080298, 2018.
Pendergrass, A. G., Gleckler, P. J., Leung, L. R., and Jakob, C.:
Benchmarking Simulated Precipitation in Earth System Models, B. Am. Meteorol. Soc., 101, E814–E816, https://doi.org/10.1175/BAMS-D-19-0318.1, 2020.
Perkins, S. E., Pitman, A. J., Holbrook, N. J., and McAneney, J.:
Evaluation of the AR4 Climate Models' Simulated Daily Maximum Temperature, Minimum Temperature, and Precipitation over Australia Using Probability Density Functions, J. Climate, 20, 4356–4376, https://doi.org/10.1175/JCLI4253.1, 2007.
Roca, R., Alexander, L. V., Potter, G., Bador, M., Jucá, R., Contractor, S., Bosilovich, M. G., and Cloché, S.:
FROGS: a daily 1∘ × 1∘ gridded precipitation database of rain gauge, satellite and reanalysis products, Earth Syst. Sci. Data, 11, 1017–1035, https://doi.org/10.5194/essd-11-1017-2019, 2019.
Satoh, M., Stevens, B., Judt, F., Khairoutdinov, M., Lin, S.-J., Putman, W. M., and Düben, P.: Global cloud resolving models, Curr Clim Change Rep., 5, 172–184, https://doi.org/10.1007/s40641-019-00131-0, 2019.
Stephens, M. A.:
EDF Statistics for Goodness of Fit and Some Comparisons, J. Am. Stat. Assoc., 69, 730–737, https://doi.org/10.2307/2286009, 1974.
Stevens, B., Satoh, M., Auger, L., Biercamp, J., Bretherton, C. S., Chen, X., Düben, P., Judt, F., Khairoutdinov, M., Klocke, D., Kodama, C., Kornblueh, L., Lin, S.-J., Neumann, P., Putman, W. M., Röber, N., Shibuya, R., Vanniere, B., Vidale, P. L., Wedi, N., and Zhou, L.: DYAMOND: the DYnamics of the Atmospheric general circulation Modeled On Non-hydrostatic Domains, Prog. Earth Planet. Sci., 6, 61, https://doi.org/10.1186/s40645-019-0304-z, 2019.
Sun, Y., Solomon, S., Dai, A., and Portmann, R. W.:
How Often Does It Rain?, J. Climate, 19, 916–934, https://doi.org/10.1175/JCLI3672.1, 2006.
Swenson, L. M. and Grotjahn, R.:
Using Self-Organizing Maps to Identify Coherent CONUS Precipitation Regions, J. Climate, 32, 7747–7761, https://doi.org/10.1175/JCLI-D-19-0352.1, 2019.
Tang, S., Gleckler, P., Xie, S., Lee, J., Ahn, M.- S., Covey, C., and Zhang, C.:
Evaluating Diurnal and Semi-Diurnal Cycle of Precipitation in CMIP6 Models Using Satellite- and Ground-Based Observations, J. Climate, 1–56, https://doi.org/10.1175/JCLI-D-20-0639.1, 2021.
Taylor, K. E., Stouffer, R. J., and Meehl, G. A.:
An overview of CMIP5 and the experiment design, B. Am. Meteorol. Soc., 93, 485–498, https://doi.org/10.1175/BAMS-D-11-00094.1, 2012.
Trenberth, K. E. and Zhang, Y.:
How Often Does It Really Rain?, B. Am. Meteorol. Soc., 99, 289–298, https://doi.org/10.1175/BAMS-D-17-0107.1, 2018.
Trenberth, K. E., Dai, A., Rasmussen, R. M., and Parsons, D. B.:
The Changing Character of Precipitation, B. Am. Meteorol. Soc., 84, 1205–1218, https://doi.org/10.1175/BAMS-84-9-1205, 2003.
Trenberth, K. E., Zhang, Y., and Gehne, M.:
Intermittency in Precipitation: Duration, Frequency, Intensity, and Amounts Using Hourly Data, J. Hydrometeorol., 18, 1393–1412, https://doi.org/10.1175/JHM-D-16-0263.1, 2017.
U.S. DOE:
Benchmarking Simulated Precipitation in Earth System Models Workshop Report, DOE/SC-0203, U.S. Department of Energy Office of Science, Biological and Environmental Research (BER) Program, Germantown, Maryland, USA, 2020.
Waliser, D., Gleckler, P. J., Ferraro, R., Taylor, K. E., Ames, S., Biard, J., Bosilovich, M. G., Brown, O., Chepfer, H., Cinquini, L., Durack, P. J., Eyring, V., Mathieu, P.-P., Lee, T., Pinnock, S., Potter, G. L., Rixen, M., Saunders, R., Schulz, J., Thépaut, J.-N., and Tuma, M.:
Observations for Model Intercomparison Project (Obs4MIPs): status for CMIP6, Geosci. Model Dev., 13, 2945–2958, https://doi.org/10.5194/gmd-13-2945-2020, 2020.
Wehner, M., Gleckler, P., and Lee, J.:
Characterization of long period return values of extreme daily temperature and precipitation in the CMIP6 models: Part 1, model evaluation, Weather and Climate Extremes, 30, 100283, https://doi.org/10.1016/j.wace.2020.100283, 2020.
Wei, G., Lü, H., Crow, W. T., Zhu, Y., Wang, J., and Su, J.:
Evaluation of Satellite-Based Precipitation Products from IMERG V04A and V03D, CMORPH and TMPA with Gauged Rainfall in Three Climatologic Zones in China, Remote Sens.-Basel, 10, 30, https://doi.org/10.3390/rs10010030, 2017.
Xie, P., Joyce, R., Wu, S., Yoo, S. H., Yarosh, Y., Sun, F., and Lin, R.:
Reprocessed, bias-corrected CMORPH global high-resolution precipitation estimates from 1998, J. Hydrometeorol., 18, 1617–1641, https://doi.org/10.1175/JHM-D-16-0168.1, 2017.
Zhang, C., Chen, X., Shao, H., Chen, S., Liu, T., Chen, C., Ding, Q., and Du, H.:
Evaluation and intercomparison of high-resolution satellite precipitation estimates-GPM, TRMM, and CMORPH in the Tianshan Mountain Area, Remote Sens.-Basel, 10, 1543, https://doi.org/10.3390/rs10101543, 2018.
Zhang, X., Alexander, L., Hegerl, G. C., Jones, P., Tank, A. K., Peterson, T. C., Trewin, B., and Zwiers, F. W.:
Indices for monitoring changes in extremes based on daily temperature and precipitation data, WIREs Clim. Change, 2, 851–870, https://doi.org/10.1002/wcc.147, 2011.
Short summary
We introduce a framework for regional-scale evaluation of simulated precipitation distributions with 62 climate reference regions and 10 metrics and apply it to evaluate CMIP5 and CMIP6 models against multiple satellite-based precipitation products. The common model biases identified in this study are mainly associated with the overestimated light precipitation and underestimated heavy precipitation. These biases persist from earlier-generation models and have been slightly improved in CMIP6.
We introduce a framework for regional-scale evaluation of simulated precipitation distributions...
