Articles | Volume 17, issue 8
https://doi.org/10.5194/gmd-17-3321-2024
© Author(s) 2024. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
https://doi.org/10.5194/gmd-17-3321-2024
© Author(s) 2024. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
Methods for assessment of models
| 
29 Apr 2024
Methods for assessment of models |
| 29 Apr 2024
| 29 Apr 2024
Bergen metrics: composite error metrics for assessing performance of climate models using EURO-CORDEX simulations
NORCE Norwegian Research Centre, Bjerknes Centre for Climate Research, Bergen, Norway
Priscilla A. Mooney
NORCE Norwegian Research Centre, Bjerknes Centre for Climate Research, Bergen, Norway
Carla A. Vivacqua
Department of Statistics, Universidade Federal do Rio Grande do Norte, Natal, Brazil
Related authors
No articles found.
Hannah Vickers, Priscilla Mooney, and Oskar Landgren
EGUsphere, https://doi.org/10.5194/egusphere-2025-2099, https://doi.org/10.5194/egusphere-2025-2099, 2025
This preprint is open for discussion and under review for The Cryosphere (TC).
Short summary
Short summary
Rain-on-snow (ROS) events are becoming a common feature in winter in Svalbard due to climate warming. Understanding how ROS events are changing and how they will change in the coming decades is crucial to minimise their impacts. Using atmospheric reanalyses and climate projections we found contrasting trends between coastal and inland areas, and that the most dramatic future changes in ROS will occur in glaciated areas which will have considerable consequences for Svalbards hydrology.
Xavier J. Levine, Ryan S. Williams, Gareth Marshall, Andrew Orr, Lise Seland Graff, Dörthe Handorf, Alexey Karpechko, Raphael Köhler, René R. Wijngaard, Nadine Johnston, Hanna Lee, Lars Nieradzik, and Priscilla A. Mooney
Earth Syst. Dynam., 15, 1161–1177, https://doi.org/10.5194/esd-15-1161-2024, https://doi.org/10.5194/esd-15-1161-2024, 2024
Short summary
Short summary
While the most recent climate projections agree that the Arctic is warming, differences remain in how much and in other climate variables such as precipitation. This presents a challenge for stakeholders who need to develop mitigation and adaptation strategies. We tackle this problem by using the storyline approach to generate four plausible and actionable realisations of end-of-century climate change for the Arctic, spanning its most likely range of variability.
Anne Sophie Daloz, Clemens Schwingshackl, Priscilla Mooney, Susanna Strada, Diana Rechid, Edouard L. Davin, Eleni Katragkou, Nathalie de Noblet-Ducoudré, Michal Belda, Tomas Halenka, Marcus Breil, Rita M. Cardoso, Peter Hoffmann, Daniela C. A. Lima, Ronny Meier, Pedro M. M. Soares, Giannis Sofiadis, Gustav Strandberg, Merja H. Toelle, and Marianne T. Lund
The Cryosphere, 16, 2403–2419, https://doi.org/10.5194/tc-16-2403-2022, https://doi.org/10.5194/tc-16-2403-2022, 2022
Short summary
Short summary
Snow plays a major role in the regulation of the Earth's surface temperature. Together with climate change, rising temperatures are already altering snow in many ways. In this context, it is crucial to better understand the ability of climate models to represent snow and snow processes. This work focuses on Europe and shows that the melting season in spring still represents a challenge for climate models and that more work is needed to accurately simulate snow–atmosphere interactions.
Priscilla A. Mooney, Diana Rechid, Edouard L. Davin, Eleni Katragkou, Natalie de Noblet-Ducoudré, Marcus Breil, Rita M. Cardoso, Anne Sophie Daloz, Peter Hoffmann, Daniela C. A. Lima, Ronny Meier, Pedro M. M. Soares, Giannis Sofiadis, Susanna Strada, Gustav Strandberg, Merja H. Toelle, and Marianne T. Lund
The Cryosphere, 16, 1383–1397, https://doi.org/10.5194/tc-16-1383-2022, https://doi.org/10.5194/tc-16-1383-2022, 2022
Short summary
Short summary
We use multiple regional climate models to show that afforestation in sub-polar and alpine regions reduces the radiative impact of snow albedo on the atmosphere, reduces snow cover, and delays the start of the snowmelt season. This is important for local communities that are highly reliant on snowpack for water resources and winter tourism. However, models disagree on the amount of change particularly when snow is melting. This shows that more research is needed on snow–vegetation interactions.
Hannah Ming Siu Vickers, Priscilla Mooney, Eirik Malnes, and Hanna Lee
The Cryosphere Discuss., https://doi.org/10.5194/tc-2022-57, https://doi.org/10.5194/tc-2022-57, 2022
Manuscript not accepted for further review
Short summary
Short summary
Rain-on-snow (ROS) events are becoming more frequent as a result of a warming climate, and can have significant impacts on nature and society. Accurate representation of ROS events is need to identify where impacts are greatest both now and in the future. We compare rain-on-snow climatologies from a climate model, ground and satellite radar observations and show how different methods can lead to contrasting conclusions and interpretation of the results should take into account their limitations.
Giannis Sofiadis, Eleni Katragkou, Edouard L. Davin, Diana Rechid, Nathalie de Noblet-Ducoudre, Marcus Breil, Rita M. Cardoso, Peter Hoffmann, Lisa Jach, Ronny Meier, Priscilla A. Mooney, Pedro M. M. Soares, Susanna Strada, Merja H. Tölle, and Kirsten Warrach Sagi
Geosci. Model Dev., 15, 595–616, https://doi.org/10.5194/gmd-15-595-2022, https://doi.org/10.5194/gmd-15-595-2022, 2022
Short summary
Short summary
Afforestation is currently promoted as a greenhouse gas mitigation strategy. In our study, we examine the differences in soil temperature and moisture between grounds covered either by forests or grass. The main conclusion emerged is that forest-covered grounds are cooler but drier than open lands in summer. Therefore, afforestation disrupts the seasonal cycle of soil temperature, which in turn could trigger changes in crucial chemical processes such as soil carbon sequestration.
Shunya Koseki, Priscilla A. Mooney, William Cabos, Miguel Ángel Gaertner, Alba de la Vara, and Juan Jesus González-Alemán
Nat. Hazards Earth Syst. Sci., 21, 53–71, https://doi.org/10.5194/nhess-21-53-2021, https://doi.org/10.5194/nhess-21-53-2021, 2021
Short summary
Short summary
This study investigated one case of a tropical-like cyclone over the Mediterranean Sea under present and future climate conditions with a regional climate model. A pseudo global warming (PGW) technique is employed to simulate the cyclone under future climate, and our simulation showed that the cyclone is moderately strengthened by warmer climate. Other PGW simulations where only ocean and atmosphere are warmed reveal the interesting results that both have counteracting effects on the cyclone.
Shunya Koseki and Priscilla A. Mooney
Hydrol. Earth Syst. Sci., 23, 2795–2812, https://doi.org/10.5194/hess-23-2795-2019, https://doi.org/10.5194/hess-23-2795-2019, 2019
Short summary
Short summary
This study revealed that Lake Malawi plays an important role for local precipitation in terms of spatial distribution and diurnal cycle in boreal summer (November to March). The diurnal cycle is detected by harmonics analysis and empirical orthogonal function analysis. An idealized simulation of WRF without Lake Malawi clearly showed that Lake Malawi is a source of local precipitation.
Related subject area
Atmospheric sciences
Impact of multiple radar wind profiler data assimilation on convective-scale short-term rainfall forecasts: OSSE studies over the Beijing–Tianjin–Hebei region
New submodel for emissions from Explosive Volcanic ERuptions (EVER v1.1) within the Modular Earth Submodel System (MESSy, version 2.55.1)
Quantifying the oscillatory evolution of simulated boundary-layer cloud fields using Gaussian process regression
Numerical investigations on the modelling of ultrafine particles in SSH-aerosol-v1.3a: size resolution and redistribution
The third Met Office Unified Model–JULES Regional Atmosphere and Land Configuration, RAL3
The sensitivity of aerosol data assimilation to vertical profiles: case study of dust storm assimilation with LOTOS-EUROS v2.2
Knowledge-inspired fusion strategies for the inference of PM2.5 values with a neural network
Tuning the ICON-A 2.6.4 climate model with machine-learning-based emulators and history matching
A novel method for quantifying the contribution of regional transport to PM2.5 in Beijing (2013–2020): combining machine learning with concentration-weighted trajectory analysis
Quantification of CO2 hotspot emissions from OCO-3 SAM CO2 satellite images using deep learning methods
Diagnosis of winter precipitation types using the spectral bin model (version 1DSBM-19M): comparison of five methods using ICE-POP 2018 field experiment data
Improving winter condition simulations in SURFEX-TEB v9.0 with a multi-layer snow model and ice
UA-ICON with the NWP physics package (version ua-icon-2.1): mean state and variability of the middle atmosphere
Integrated Methane Inversion (IMI) 2.0: an improved research and stakeholder tool for monitoring total methane emissions with high resolution worldwide using TROPOMI satellite observations
HTAP3 Fires: towards a multi-model, multi-pollutant study of fire impacts
Using a data-driven statistical model to better evaluate surface turbulent heat fluxes in weather and climate numerical models: a demonstration study
Pochva: a new hydro-thermal process model in soil, snow, and vegetation for application in atmosphere numerical models
ClimKern v1.2: a new Python package and kernel repository for calculating radiative feedbacks
Accounting for effects of coagulation and model uncertainties in particle number concentration estimates based on measurements from sampling lines – a Bayesian inversion approach with SLIC v1.0
Top-down CO emission estimates using TROPOMI CO data in the TM5-4DVAR (r1258) inverse modeling suit
The Multi-Compartment Hg Modeling and Analysis Project (MCHgMAP): mercury modeling to support international environmental policy
Similarity-based analysis of atmospheric organic compounds for machine learning applications
Porting the Meso-NH atmospheric model on different GPU architectures for the next generation of supercomputers (version MESONH-v55-OpenACC)
Estimation of aerosol and cloud radiative heating rate in the tropical stratosphere using a radiative kernel method
Evaluation of dust emission and land surface schemes in predicting a mega Asian dust storm over South Korea using WRF-Chem
Sensitivity studies of a four-dimensional local ensemble transform Kalman filter coupled with WRF-Chem version 3.9.1 for improving particulate matter simulation accuracy
A Bayesian method for predicting background radiation at environmental monitoring stations in local-scale networks
Inclusion of the ECMWF ecRad radiation scheme (v1.5.0) in the MAR (v3.14), regional evaluation for Belgium, and assessment of surface shortwave spectral fluxes at Uccle
Development of a fast radiative transfer model for ground-based microwave radiometers (ARMS-gb v1.0): validation and comparison to RTTOV-gb
Indian Institute of Tropical Meteorology (IITM) High-Resolution Global Forecast Model version 1: an attempt to resolve monsoon prediction deadlock
Cell-tracking-based framework for assessing nowcasting model skill in reproducing growth and decay of convective rainfall
NeuralMie (v1.0): an aerosol optics emulator
A REtrieval Method for optical and physical Aerosol Properties in the stratosphere (REMAPv1)
Simulation performance of planetary boundary layer schemes in WRF v4.3.1 for near-surface wind over the western Sichuan Basin: a single-site assessment
FootNet v1.0: development of a machine learning emulator of atmospheric transport
Updates and evaluation of NOAA's online-coupled air quality model version 7 (AQMv7) within the Unified Forecast System
Quantifying the analysis uncertainty for nowcasting application
Improving the ensemble square root filter (EnSRF) in the Community Inversion Framework: a case study with ICON-ART 2024.01
The MESSy DWARF (based on MESSy v2.55.2)
Generalized local fractions – a method for the calculation of sensitivities to emissions from multiple sources for chemically active species, illustrated using the EMEP MSC-W model (rv5.5)
SanDyPALM v1.0: Static and Dynamic Drivers for the PALM-4U Model to Facilitate Realistic Urban Microclimate Simulations
An enhanced emission module for the PALM model system 23.10 with application for PM10 emission from urban domestic heating
Identifying lightning processes in ERA5 soundings with deep learning
Sensitivity of predicted ultrafine particle size distributions in Europe to different nucleation rate parameterizations using PMCAMx-UF v2.2
Explaining neural networks for detection of tropical cyclones and atmospheric rivers in gridded atmospheric simulation data
Implementation of a dry deposition module (DEPAC v3.11) in a large eddy simulation code (DALES v4.4)
Accurate and fast prediction of radioactive pollution by Kriging coupled with Auto-Associative Models
Mitigating Hail Overforecasting in the 2-Moment Milbrandt-Yau Microphysics Scheme (v2.25.2_beta_04) in WRF (v4.5.1) by Incorporating the Graupel Spongy Wet Growth Process (MY2_GSWG v1.0)
PALACE v1.0: Paranal Airglow Line And Continuum Emission model
Accurate space-based NOx emission estimates with the flux divergence approach require fine-scale model information on local oxidation chemistry and profile shapes
Juan Zhao, Jianping Guo, and Xiaohui Zheng
Geosci. Model Dev., 18, 4075–4101, https://doi.org/10.5194/gmd-18-4075-2025, https://doi.org/10.5194/gmd-18-4075-2025, 2025
Short summary
Short summary
A series of observing system simulation experiments are conducted to assess the impact of multiple radar wind profiler (RWP) networks on convective-scale numerical weather prediction. Results from three southwest-type heavy rainfall cases in the Beijing–Tianjin–Hebei region suggest the added forecast skill of ridge and foothill networks associated with the Taihang Mountains over the existing RWP network. This research provides valuable guidance for designing optimal RWP networks in the region.
Matthias Kohl, Christoph Brühl, Jennifer Schallock, Holger Tost, Patrick Jöckel, Adrian Jost, Steffen Beirle, Michael Höpfner, and Andrea Pozzer
Geosci. Model Dev., 18, 3985–4007, https://doi.org/10.5194/gmd-18-3985-2025, https://doi.org/10.5194/gmd-18-3985-2025, 2025
Short summary
Short summary
SO2 from explosive volcanic eruptions reaching the stratosphere can oxidize and form sulfur aerosols, potentially persisting for several years. We developed a new submodel, Explosive Volcanic ERuptions (EVER), that seamlessly includes stratospheric volcanic SO2 emissions in global numerical simulations based on a novel standard historical model setup, successfully evaluated with satellite observations. Sensitivity studies on the Nabro eruption in 2011 evaluate different emission methods.
Gunho Loren Oh and Philip H. Austin
Geosci. Model Dev., 18, 3921–3940, https://doi.org/10.5194/gmd-18-3921-2025, https://doi.org/10.5194/gmd-18-3921-2025, 2025
Short summary
Short summary
It is difficult to study the behaviour of a cloud field due to internal fluctuations and observational noise. We perform a high-resolution simulation of the boundary-layer cloud field and introduce statistical and numerical techniques, including machine-learning models, to study the evolution of the cloud field, which shows a periodic behaviour. We aim to use the numerical techniques to identify the underlying behaviour within noisy observations.
Oscar Jacquot and Karine Sartelet
Geosci. Model Dev., 18, 3965–3984, https://doi.org/10.5194/gmd-18-3965-2025, https://doi.org/10.5194/gmd-18-3965-2025, 2025
Short summary
Short summary
Modelling the size distribution and the number concentration is important to represent ultrafine particles. A new analytic formulation is presented to compute coagulation partition coefficients, allowing us to lower the numerical diffusion associated with the resolution of aerosol dynamics. The significance of this effect is assessed in a 0D box model and over greater Paris with a chemistry transport model, using different size resolutions of the particle distribution.
Mike Bush, David L. A. Flack, Huw W. Lewis, Sylvia I. Bohnenstengel, Chris J. Short, Charmaine Franklin, Adrian P. Lock, Martin Best, Paul Field, Anne McCabe, Kwinten Van Weverberg, Segolene Berthou, Ian Boutle, Jennifer K. Brooke, Seb Cole, Shaun Cooper, Gareth Dow, John Edwards, Anke Finnenkoetter, Kalli Furtado, Kate Halladay, Kirsty Hanley, Margaret A. Hendry, Adrian Hill, Aravindakshan Jayakumar, Richard W. Jones, Humphrey Lean, Joshua C. K. Lee, Andy Malcolm, Marion Mittermaier, Saji Mohandas, Stuart Moore, Cyril Morcrette, Rachel North, Aurore Porson, Susan Rennie, Nigel Roberts, Belinda Roux, Claudio Sanchez, Chun-Hsu Su, Simon Tucker, Simon Vosper, David Walters, James Warner, Stuart Webster, Mark Weeks, Jonathan Wilkinson, Michael Whitall, Keith D. Williams, and Hugh Zhang
Geosci. Model Dev., 18, 3819–3855, https://doi.org/10.5194/gmd-18-3819-2025, https://doi.org/10.5194/gmd-18-3819-2025, 2025
Short summary
Short summary
RAL configurations define settings for the Unified Model atmosphere and Joint UK Land Environment Simulator. The third version of the Regional Atmosphere and Land (RAL3) science configuration for kilometre- and sub-kilometre-scale modelling represents a major advance compared to previous versions (RAL2) by delivering a common science definition for applications in tropical and mid-latitude regions. RAL3 has more realistic precipitation distributions and an improved representation of clouds and visibility.
Mijie Pang, Jianbing Jin, Ting Yang, Xi Chen, Arjo Segers, Batjargal Buyantogtokh, Yixuan Gu, Jiandong Li, Hai Xiang Lin, Hong Liao, and Wei Han
Geosci. Model Dev., 18, 3781–3798, https://doi.org/10.5194/gmd-18-3781-2025, https://doi.org/10.5194/gmd-18-3781-2025, 2025
Short summary
Short summary
Aerosol data assimilation has gained popularity as it combines the advantages of modelling and observation. However, few studies have addressed the challenges in the prior vertical structure. Different observations are assimilated to examine the sensitivity of assimilation to vertical structure. Results show that assimilation can optimize the dust field in general. However, if the prior introduces an incorrect structure, the assimilation can significantly deteriorate the integrity of the aerosol profile.
Matthieu Dabrowski, José Mennesson, Jérôme Riedi, Chaabane Djeraba, and Pierre Nabat
Geosci. Model Dev., 18, 3707–3733, https://doi.org/10.5194/gmd-18-3707-2025, https://doi.org/10.5194/gmd-18-3707-2025, 2025
Short summary
Short summary
This work focuses on the prediction of aerosol concentration values at the ground level, which are a strong indicator of air quality, using artificial neural networks. A study of different variables and their efficiency as inputs for these models is also proposed and reveals that the best results are obtained when using all of them. Comparison between network architectures and information fusion methods allows for the extraction of knowledge on the most efficient methods in the context of this study.
Pauline Bonnet, Lorenzo Pastori, Mierk Schwabe, Marco Giorgetta, Fernando Iglesias-Suarez, and Veronika Eyring
Geosci. Model Dev., 18, 3681–3706, https://doi.org/10.5194/gmd-18-3681-2025, https://doi.org/10.5194/gmd-18-3681-2025, 2025
Short summary
Short summary
Tuning a climate model means adjusting uncertain parameters in the model to best match observations like the global radiation balance and cloud cover. This is usually done by running many simulations of the model with different settings, which can be time-consuming and relies heavily on expert knowledge. To make this process faster and more objective, we developed a machine learning emulator to create a large ensemble and apply a method called history matching to find the best settings.
Kang Hu, Hong Liao, Dantong Liu, Jianbing Jin, Lei Chen, Siyuan Li, Yangzhou Wu, Changhao Wu, Shitong Zhao, Xiaotong Jiang, Ping Tian, Kai Bi, Ye Wang, and Delong Zhao
Geosci. Model Dev., 18, 3623–3634, https://doi.org/10.5194/gmd-18-3623-2025, https://doi.org/10.5194/gmd-18-3623-2025, 2025
Short summary
Short summary
This study combines machine learning with concentration-weighted trajectory analysis to quantify regional transport PM2.5. From 2013–2020, local emissions dominated Beijing's pollution events. The Air Pollution Prevention and Control Action Plan reduced regional transport pollution, but the eastern region showed the smallest decrease. Beijing should prioritize local emission reduction while considering the east region's contributions in future strategies.
Joffrey Dumont Le Brazidec, Pierre Vanderbecken, Alban Farchi, Grégoire Broquet, Gerrit Kuhlmann, and Marc Bocquet
Geosci. Model Dev., 18, 3607–3622, https://doi.org/10.5194/gmd-18-3607-2025, https://doi.org/10.5194/gmd-18-3607-2025, 2025
Short summary
Short summary
We developed a deep learning method to estimate CO2 emissions from power plants using satellite images. Trained and validated on simulated data, our model accurately predicts emissions despite challenges like cloud cover. When applied to real OCO3 satellite images, the results closely match reported emissions. This study shows that neural networks trained on simulations can effectively analyse real satellite data, offering a new way to monitor CO2 emissions from space.
Wonbae Bang, Jacob T. Carlin, Kwonil Kim, Alexander V. Ryzhkov, Guosheng Liu, and GyuWon Lee
Geosci. Model Dev., 18, 3559–3581, https://doi.org/10.5194/gmd-18-3559-2025, https://doi.org/10.5194/gmd-18-3559-2025, 2025
Short summary
Short summary
Microphysics model-based diagnosis, such as the spectral bin model (SBM), has recently been attempted to diagnose winter precipitation types. In this study, the accuracy of SBM-based precipitation type diagnosis is compared with other traditional methods. SBM has a relatively higher accuracy for dry-snow and wet-snow events, whereas it has lower accuracy for rain events. When the microphysics scheme in the SBM was optimized for the corresponding region, the accuracy for rain events improved.
Gabriel Colas, Valéry Masson, François Bouttier, Ludovic Bouilloud, Laura Pavan, and Virve Karsisto
Geosci. Model Dev., 18, 3453–3472, https://doi.org/10.5194/gmd-18-3453-2025, https://doi.org/10.5194/gmd-18-3453-2025, 2025
Short summary
Short summary
In winter, snow- and ice-covered artificial surfaces are important aspects of the urban climate. They may influence the magnitude of the urban heat island effect, but this is still unclear. In this study, we improved the representation of the snow and ice cover in the Town Energy Balance (TEB) urban climate model. Evaluations have shown that the results are promising for using TEB to study the climate of cold cities.
Markus Kunze, Christoph Zülicke, Tarique A. Siddiqui, Claudia C. Stephan, Yosuke Yamazaki, Claudia Stolle, Sebastian Borchert, and Hauke Schmidt
Geosci. Model Dev., 18, 3359–3385, https://doi.org/10.5194/gmd-18-3359-2025, https://doi.org/10.5194/gmd-18-3359-2025, 2025
Short summary
Short summary
We present the Icosahedral Nonhydrostatic (ICON) general circulation model with an upper-atmospheric extension with the physics package for numerical weather prediction (UA-ICON(NWP)). We optimized the parameters for the gravity wave parameterizations and achieved realistic modeling of the thermal and dynamic states of the mesopause regions. UA-ICON(NWP) now shows a realistic frequency of major sudden stratospheric warmings and well-represented solar tides in temperature.
Lucas A. Estrada, Daniel J. Varon, Melissa Sulprizio, Hannah Nesser, Zichong Chen, Nicholas Balasus, Sarah E. Hancock, Megan He, James D. East, Todd A. Mooring, Alexander Oort Alonso, Joannes D. Maasakkers, Ilse Aben, Sabour Baray, Kevin W. Bowman, John R. Worden, Felipe J. Cardoso-Saldaña, Emily Reidy, and Daniel J. Jacob
Geosci. Model Dev., 18, 3311–3330, https://doi.org/10.5194/gmd-18-3311-2025, https://doi.org/10.5194/gmd-18-3311-2025, 2025
Short summary
Short summary
Reducing emissions of methane, a powerful greenhouse gas, is a top policy concern for mitigating anthropogenic climate change. The Integrated Methane Inversion (IMI) is an advanced, cloud-based software that translates satellite observations into actionable emissions data. Here we present IMI version 2.0 with vastly expanded capabilities. These updates enable a wider range of scientific and stakeholder applications from individual basin to global scales with continuous emissions monitoring.
Cynthia H. Whaley, Tim Butler, Jose A. Adame, Rupal Ambulkar, Steve R. Arnold, Rebecca R. Buchholz, Benjamin Gaubert, Douglas S. Hamilton, Min Huang, Hayley Hung, Johannes W. Kaiser, Jacek W. Kaminski, Christoph Knote, Gerbrand Koren, Jean-Luc Kouassi, Meiyun Lin, Tianjia Liu, Jianmin Ma, Kasemsan Manomaiphiboon, Elisa Bergas Masso, Jessica L. McCarty, Mariano Mertens, Mark Parrington, Helene Peiro, Pallavi Saxena, Saurabh Sonwani, Vanisa Surapipith, Damaris Y. T. Tan, Wenfu Tang, Veerachai Tanpipat, Kostas Tsigaridis, Christine Wiedinmyer, Oliver Wild, Yuanyu Xie, and Paquita Zuidema
Geosci. Model Dev., 18, 3265–3309, https://doi.org/10.5194/gmd-18-3265-2025, https://doi.org/10.5194/gmd-18-3265-2025, 2025
Short summary
Short summary
The multi-model experiment design of the HTAP3 Fires project takes a multi-pollutant approach to improving our understanding of transboundary transport of wildland fire and agricultural burning emissions and their impacts. The experiments are designed with the goal of answering science policy questions related to fires. The options for the multi-model approach, including inputs, outputs, and model setup, are discussed, and the official recommendations for the project are presented.
Maurin Zouzoua, Sophie Bastin, Fabienne Lohou, Marie Lothon, Marjolaine Chiriaco, Mathilde Jome, Cécile Mallet, Laurent Barthes, and Guylaine Canut
Geosci. Model Dev., 18, 3211–3239, https://doi.org/10.5194/gmd-18-3211-2025, https://doi.org/10.5194/gmd-18-3211-2025, 2025
Short summary
Short summary
This study proposes using a statistical model to freeze errors due to differences in environmental forcing when evaluating the surface turbulent heat fluxes from numerical simulations with observations. The statistical model is first built with observations and then applied to the simulated environment to generate possibly observed fluxes. This novel method provides insight into differently evaluating the numerical formulation of turbulent heat fluxes with a long period of observational data.
Oxana Drofa
Geosci. Model Dev., 18, 3175–3209, https://doi.org/10.5194/gmd-18-3175-2025, https://doi.org/10.5194/gmd-18-3175-2025, 2025
Short summary
Short summary
This paper presents the result of many years of effort of the author, who developed an original mathematical numerical model of heat and moisture exchange processes in soil, vegetation, and snow. The author relied on her 30 years of research experience in atmospheric numerical modelling. The presented model is the fruit of the author's research on physical processes at the surface–atmosphere interface and their numerical approximation and aims at improving numerical weather forecasting and climate simulations.
Tyler P. Janoski, Ivan Mitevski, Ryan J. Kramer, Michael Previdi, and Lorenzo M. Polvani
Geosci. Model Dev., 18, 3065–3079, https://doi.org/10.5194/gmd-18-3065-2025, https://doi.org/10.5194/gmd-18-3065-2025, 2025
Short summary
Short summary
We developed ClimKern, a Python package and radiative kernel repository, to simplify calculating radiative feedbacks and make climate sensitivity studies more reproducible. Testing of ClimKern with sample climate model data reveals that radiative kernel choice may be more important than previously thought, especially in polar regions. Our work highlights the need for kernel sensitivity analyses to be included in future studies.
Matti Niskanen, Aku Seppänen, Henri Oikarinen, Miska Olin, Panu Karjalainen, Santtu Mikkonen, and Kari Lehtinen
Geosci. Model Dev., 18, 2983–3001, https://doi.org/10.5194/gmd-18-2983-2025, https://doi.org/10.5194/gmd-18-2983-2025, 2025
Short summary
Short summary
Particle size is a key factor determining the properties of aerosol particles which have a major influence on the climate and on human health. When measuring the particle sizes, however, sometimes the sampling lines that transfer the aerosol to the measurement device distort the size distribution, making the measurement unreliable. We propose a method to correct for the distortions and estimate the true particle sizes, improving measurement accuracy.
Johann Rasmus Nüß, Nikos Daskalakis, Fabian Günther Piwowarczyk, Angelos Gkouvousis, Oliver Schneising, Michael Buchwitz, Maria Kanakidou, Maarten C. Krol, and Mihalis Vrekoussis
Geosci. Model Dev., 18, 2861–2890, https://doi.org/10.5194/gmd-18-2861-2025, https://doi.org/10.5194/gmd-18-2861-2025, 2025
Short summary
Short summary
We estimate carbon monoxide emissions through inverse modeling, an approach where measurements of tracers in the atmosphere are fed to a model to calculate backwards in time (inverse) where the tracers came from. We introduce measurements from a new satellite instrument and show that, in most places globally, these on their own sufficiently constrain the emissions. This alleviates the need for additional datasets, which could shorten the delay for future carbon monoxide source estimates.
Ashu Dastoor, Hélène Angot, Johannes Bieser, Flora Brocza, Brock Edwards, Aryeh Feinberg, Xinbin Feng, Benjamin Geyman, Charikleia Gournia, Yipeng He, Ian M. Hedgecock, Ilia Ilyin, Jane Kirk, Che-Jen Lin, Igor Lehnherr, Robert Mason, David McLagan, Marilena Muntean, Peter Rafaj, Eric M. Roy, Andrei Ryjkov, Noelle E. Selin, Francesco De Simone, Anne L. Soerensen, Frits Steenhuisen, Oleg Travnikov, Shuxiao Wang, Xun Wang, Simon Wilson, Rosa Wu, Qingru Wu, Yanxu Zhang, Jun Zhou, Wei Zhu, and Scott Zolkos
Geosci. Model Dev., 18, 2747–2860, https://doi.org/10.5194/gmd-18-2747-2025, https://doi.org/10.5194/gmd-18-2747-2025, 2025
Short summary
Short summary
This paper introduces the Multi-Compartment Mercury (Hg) Modeling and Analysis Project (MCHgMAP) aimed at informing the effectiveness evaluations of two multilateral environmental agreements: the Minamata Convention on Mercury and the Convention on Long-Range Transboundary Air Pollution. The experimental design exploits a variety of models (atmospheric, land, oceanic ,and multimedia mass balance models) to assess the short- and long-term influences of anthropogenic Hg releases into the environment.
Hilda Sandström and Patrick Rinke
Geosci. Model Dev., 18, 2701–2724, https://doi.org/10.5194/gmd-18-2701-2025, https://doi.org/10.5194/gmd-18-2701-2025, 2025
Short summary
Short summary
Machine learning has the potential to aid the identification of organic molecules involved in aerosol formation. Yet, progress is stalled by a lack of curated atmospheric molecular datasets. Here, we compared atmospheric compounds with large molecular datasets used in machine learning and found minimal overlap with similarity algorithms. Our result underlines the need for collaborative efforts to curate atmospheric molecular data to facilitate machine learning models in atmospheric sciences.
Juan Escobar, Philippe Wautelet, Joris Pianezze, Florian Pantillon, Thibaut Dauhut, Christelle Barthe, and Jean-Pierre Chaboureau
Geosci. Model Dev., 18, 2679–2700, https://doi.org/10.5194/gmd-18-2679-2025, https://doi.org/10.5194/gmd-18-2679-2025, 2025
Short summary
Short summary
The Meso-NH weather research code is adapted for GPUs using OpenACC, leading to significant performance and energy efficiency improvements. Called MESONH-v55-OpenACC, it includes enhanced memory management, communication optimizations and a new solver. On the AMD MI250X Adastra platform, it achieved up to 6× speedup and 2.3× energy efficiency gain compared to CPUs. Storm simulations at 100 m resolution show positive results, positioning the code for future use on exascale supercomputers.
Jie Gao, Yi Huang, Jonathon S. Wright, Ke Li, Tao Geng, and Qiurun Yu
Geosci. Model Dev., 18, 2569–2586, https://doi.org/10.5194/gmd-18-2569-2025, https://doi.org/10.5194/gmd-18-2569-2025, 2025
Short summary
Short summary
The aerosol in the upper troposphere and stratosphere is highly variable, and its radiative effect is poorly understood. To estimate this effect, the radiative kernel is constructed and applied. The results show that the kernels can reproduce aerosol radiative effects and are expected to simulate stratospheric aerosol radiative effects. This approach reduces computational expense, is consistent with radiative model calculations, and can be applied to atmospheric models with speed requirements.
Ji Won Yoon, Seungyeon Lee, Ebony Lee, and Seon Ki Park
Geosci. Model Dev., 18, 2303–2328, https://doi.org/10.5194/gmd-18-2303-2025, https://doi.org/10.5194/gmd-18-2303-2025, 2025
Short summary
Short summary
This study evaluates the Weather Research and Forecasting Model (WRF) coupled with Chemistry (WRF-Chem) to predict a mega Asian dust storm (ADS) over South Korea on 28–29 March 2021. We assessed combinations of five dust emission and four land surface schemes by analyzing meteorological and air quality variables. The best scheme combination reduced the root mean square error (RMSE) for particulate matter 10 (PM10) by up to 29.6 %, demonstrating the highest performance.
Jianyu Lin, Tie Dai, Lifang Sheng, Weihang Zhang, Shangfei Hai, and Yawen Kong
Geosci. Model Dev., 18, 2231–2248, https://doi.org/10.5194/gmd-18-2231-2025, https://doi.org/10.5194/gmd-18-2231-2025, 2025
Short summary
Short summary
The effectiveness of this assimilation system and its sensitivity to the ensemble member size and length of the assimilation window are investigated. This study advances our understanding of the selection of basic parameters in the four-dimensional local ensemble transform Kalman filter assimilation system and the performance of ensemble simulation in a particulate-matter-polluted environment.
Jens Peter Karolus Wenceslaus Frankemölle, Johan Camps, Pieter De Meutter, and Johan Meyers
Geosci. Model Dev., 18, 1989–2003, https://doi.org/10.5194/gmd-18-1989-2025, https://doi.org/10.5194/gmd-18-1989-2025, 2025
Short summary
Short summary
To detect anomalous radioactivity in the environment, it is paramount that we understand the natural background level. In this work, we propose a statistical model to describe the most likely background level and the associated uncertainty in a network of dose rate detectors. We train, verify, and validate the model using real environmental data. Using the model, we show that we can correctly predict the background level in a subset of the detector network during a known
anomalous event.
Jean-François Grailet, Robin J. Hogan, Nicolas Ghilain, David Bolsée, Xavier Fettweis, and Marilaure Grégoire
Geosci. Model Dev., 18, 1965–1988, https://doi.org/10.5194/gmd-18-1965-2025, https://doi.org/10.5194/gmd-18-1965-2025, 2025
Short summary
Short summary
The MAR (Modèle Régional Atmosphérique) is a regional climate model used for weather forecasting and studying the climate over various regions. This paper presents an update of MAR thanks to which it can precisely decompose solar radiation, in particular in the UV (ultraviolet) and photosynthesis ranges, both being critical to human health and ecosystems. As a first application of this new capability, this paper presents a method for predicting UV indices with MAR.
Yi-Ning Shi, Jun Yang, Wei Han, Lujie Han, Jiajia Mao, Wanlin Kan, and Fuzhong Weng
Geosci. Model Dev., 18, 1947–1964, https://doi.org/10.5194/gmd-18-1947-2025, https://doi.org/10.5194/gmd-18-1947-2025, 2025
Short summary
Short summary
Direct assimilation of observations from ground-based microwave radiometers (GMRs) holds significant potential for improving forecast accuracy. Radiative transfer models (RTMs) play a crucial role in direct data assimilation. In this study, we introduce a new RTM, the Advanced Radiative Transfer Modeling System – Ground-Based (ARMS-gb), designed to simulate brightness temperatures observed by GMRs along with their Jacobians. Several enhancements have been incorporated to achieve higher accuracy.
R. Phani Murali Krishna, Siddharth Kumar, A. Gopinathan Prajeesh, Peter Bechtold, Nils Wedi, Kumar Roy, Malay Ganai, B. Revanth Reddy, Snehlata Tirkey, Tanmoy Goswami, Radhika Kanase, Sahadat Sarkar, Medha Deshpande, and Parthasarathi Mukhopadhyay
Geosci. Model Dev., 18, 1879–1894, https://doi.org/10.5194/gmd-18-1879-2025, https://doi.org/10.5194/gmd-18-1879-2025, 2025
Short summary
Short summary
The High-Resolution Global Forecast Model (HGFM) is an advanced iteration of the operational Global Forecast System (GFS) model. HGFM can produce forecasts at a spatial scale of ~6 km in tropics. It demonstrates improved accuracy in short- to medium-range weather prediction over the Indian region, with notable success in predicting extreme events. Further, the model will be entrusted to operational forecasting agencies after validation and testing.
Jenna Ritvanen, Seppo Pulkkinen, Dmitri Moisseev, and Daniele Nerini
Geosci. Model Dev., 18, 1851–1878, https://doi.org/10.5194/gmd-18-1851-2025, https://doi.org/10.5194/gmd-18-1851-2025, 2025
Short summary
Short summary
Nowcasting models struggle with the rapid evolution of heavy rain, and common verification methods are unable to describe how accurately the models predict the growth and decay of heavy rain. We propose a framework to assess model performance. In the framework, convective cells are identified and tracked in the forecasts and observations, and the model skill is then evaluated by comparing differences between forecast and observed cells. We demonstrate the framework with four open-source models.
Andrew Geiss and Po-Lun Ma
Geosci. Model Dev., 18, 1809–1827, https://doi.org/10.5194/gmd-18-1809-2025, https://doi.org/10.5194/gmd-18-1809-2025, 2025
Short summary
Short summary
Particles in the Earth's atmosphere strongly impact the planet's energy budget, and atmosphere simulations require accurate representation of their interaction with light. This work introduces two approaches to represent light scattering by small particles. The first is a scattering simulator based on Mie theory implemented in Python. The second is a neural network emulator that is more accurate than existing methods and is fast enough to be used in climate and weather simulations.
Andrin Jörimann, Timofei Sukhodolov, Beiping Luo, Gabriel Chiodo, Graham Mann, and Thomas Peter
EGUsphere, https://doi.org/10.5194/egusphere-2025-145, https://doi.org/10.5194/egusphere-2025-145, 2025
Short summary
Short summary
Aerosol particles in the stratosphere affect our climate. Climate models therefore need an accurate description of their properties and evolution. Satellites measure how strongly aerosol particles extinguish light passing through the stratosphere. We describe a method to use such aerosol extinction data to retrieve the number and sizes of the aerosol particles and calculate their optical effects. The resulting data sets for models are validated against ground-based and balloon observations.
Qin Wang, Bo Zeng, Gong Chen, and Yaoting Li
Geosci. Model Dev., 18, 1769–1784, https://doi.org/10.5194/gmd-18-1769-2025, https://doi.org/10.5194/gmd-18-1769-2025, 2025
Short summary
Short summary
This study evaluates the performance of four planetary boundary layer (PBL) schemes in near-surface wind fields over the Sichuan Basin, China. Using 112 sensitivity experiments with the Weather Research and Forecasting (WRF) model and focusing on 28 wind events, it is found that wind direction was less sensitive to the PBL schemes. The quasi-normal scale elimination (QNSE) scheme captured temporal variations best, while the Mellor–Yamada–Janjić (MYJ) scheme had the least error in wind speed.
Tai-Long He, Nikhil Dadheech, Tammy M. Thompson, and Alexander J. Turner
Geosci. Model Dev., 18, 1661–1671, https://doi.org/10.5194/gmd-18-1661-2025, https://doi.org/10.5194/gmd-18-1661-2025, 2025
Short summary
Short summary
It is computationally expensive to infer greenhouse gas (GHG) emissions using atmospheric observations. This is partly due to the detailed model used to represent atmospheric transport. We demonstrate how a machine learning (ML) model can be used to simulate high-resolution atmospheric transport. This type of ML model will help estimate GHG emissions using dense observations, which are becoming increasingly common with the proliferation of urban monitoring networks and geostationary satellites.
Wei Li, Beiming Tang, Patrick C. Campbell, Youhua Tang, Barry Baker, Zachary Moon, Daniel Tong, Jianping Huang, Kai Wang, Ivanka Stajner, and Raffaele Montuoro
Geosci. Model Dev., 18, 1635–1660, https://doi.org/10.5194/gmd-18-1635-2025, https://doi.org/10.5194/gmd-18-1635-2025, 2025
Short summary
Short summary
The study describes the updates of NOAA's current UFS-AQMv7 air quality forecast model by incorporating the latest scientific and structural changes in CMAQv5.4. An evaluation during the summer of 2023 shows that the updated model overall improves the simulation of MDA8 O3 by reducing the bias by 8%–12% in the contiguous US. PM2.5 predictions have mixed results due to wildfire, highlighting the need for future refinements.
Yanwei Zhu, Aitor Atencia, Markus Dabernig, and Yong Wang
Geosci. Model Dev., 18, 1545–1559, https://doi.org/10.5194/gmd-18-1545-2025, https://doi.org/10.5194/gmd-18-1545-2025, 2025
Short summary
Short summary
Most works have delved into convective weather nowcasting, and only a few works have discussed the nowcasting uncertainty for variables at the surface level. Hence, we proposed a method to estimate uncertainty. Generating appropriate noises associated with the characteristic of the error in analysis can simulate the uncertainty of nowcasting. This method can contribute to the estimation of near–surface analysis uncertainty in both nowcasting applications and ensemble nowcasting development.
Joël Thanwerdas, Antoine Berchet, Lionel Constantin, Aki Tsuruta, Michael Steiner, Friedemann Reum, Stephan Henne, and Dominik Brunner
Geosci. Model Dev., 18, 1505–1544, https://doi.org/10.5194/gmd-18-1505-2025, https://doi.org/10.5194/gmd-18-1505-2025, 2025
Short summary
Short summary
The Community Inversion Framework (CIF) brings together methods for estimating greenhouse gas fluxes from atmospheric observations. The initial ensemble method implemented in CIF was found to be incomplete and could hardly be compared to other ensemble methods employed in the inversion community. In this paper, we present and evaluate a new implementation of the ensemble mode, building upon the initial developments.
Astrid Kerkweg, Timo Kirfel, Duong H. Do, Sabine Griessbach, Patrick Jöckel, and Domenico Taraborrelli
Geosci. Model Dev., 18, 1265–1286, https://doi.org/10.5194/gmd-18-1265-2025, https://doi.org/10.5194/gmd-18-1265-2025, 2025
Short summary
Short summary
Normally, the Modular Earth Submodel System (MESSy) is linked to complete dynamic models to create chemical climate models. However, the modular concept of MESSy and the newly developed DWARF component presented here make it possible to create simplified models that contain only one or a few process descriptions. This is very useful for technical optimisation, such as porting to GPUs, and can be used to create less complex models, such as a chemical box model.
Peter Wind and Willem van Caspel
EGUsphere, https://doi.org/10.5194/egusphere-2024-3571, https://doi.org/10.5194/egusphere-2024-3571, 2025
Short summary
Short summary
This paper presents a numerical method to assess the origin of air pollution. Combined with a numerical air pollution transport and chemistry model, it can follow the contributions from a large number of emission sources. The result is a series of maps that give the relative contributions from for example all European countries at each point.
Julian Vogel, Sebastian Stadler, Ganesh Chockalingam, Afshin Afshari, Johanna Henning, and Matthias Winkler
EGUsphere, https://doi.org/10.5194/egusphere-2025-144, https://doi.org/10.5194/egusphere-2025-144, 2025
Short summary
Short summary
This study presents a toolkit to simplify input data creation for the urban microclimate model PALM-4U. It introduces novel methods to automate the use of open data sources. Our analysis of four test cases created from different geographic data sources shows variations in temperature, humidity, and wind speed, influenced by data quality. Validation indicates that the automated methods yield results comparable to expert-driven approaches, facilitating user-friendly urban climate modeling.
Edward C. Chan, Ilona J. Jäkel, Basit Khan, Martijn Schaap, Timothy M. Butler, Renate Forkel, and Sabine Banzhaf
Geosci. Model Dev., 18, 1119–1139, https://doi.org/10.5194/gmd-18-1119-2025, https://doi.org/10.5194/gmd-18-1119-2025, 2025
Short summary
Short summary
An enhanced emission module has been developed for the PALM model system, improving flexibility and scalability of emission source representation across different sectors. A model for parametrized domestic emissions has also been included, for which an idealized model run is conducted for particulate matter (PM10). The results show that, in addition to individual sources and diurnal variations in energy consumption, vertical transport and urban topology play a role in concentration distribution.
Gregor Ehrensperger, Thorsten Simon, Georg J. Mayr, and Tobias Hell
Geosci. Model Dev., 18, 1141–1153, https://doi.org/10.5194/gmd-18-1141-2025, https://doi.org/10.5194/gmd-18-1141-2025, 2025
Short summary
Short summary
As lightning is a brief and localized event, it is not explicitly resolved in atmospheric models. Instead, expert-based auxiliary descriptions are used to assess it. This study explores how AI can improve our understanding of lightning without relying on traditional expert knowledge. We reveal that AI independently identified the key factors known to experts as essential for lightning in the Alps region. This shows how knowledge discovery could be sped up in areas with limited expert knowledge.
David Patoulias, Kalliopi Florou, and Spyros N. Pandis
Geosci. Model Dev., 18, 1103–1118, https://doi.org/10.5194/gmd-18-1103-2025, https://doi.org/10.5194/gmd-18-1103-2025, 2025
Short summary
Short summary
The effect of the assumed atmospheric nucleation mechanism on particle number concentrations and size distribution was investigated. Two quite different mechanisms involving sulfuric acid and ammonia or a biogenic organic vapor gave quite similar results which were consistent with measurements at 26 measurement stations across Europe. The number of larger particles that serve as cloud condensation nuclei showed little sensitivity to the assumed nucleation mechanism.
Tim Radke, Susanne Fuchs, Christian Wilms, Iuliia Polkova, and Marc Rautenhaus
Geosci. Model Dev., 18, 1017–1039, https://doi.org/10.5194/gmd-18-1017-2025, https://doi.org/10.5194/gmd-18-1017-2025, 2025
Short summary
Short summary
In our study, we built upon previous work to investigate the patterns artificial intelligence (AI) learns to detect atmospheric features like tropical cyclones (TCs) and atmospheric rivers (ARs). As primary objective, we adopt a method to explain the AI used and investigate the plausibility of learned patterns. We find that plausible patterns are learned for both TCs and ARs. Hence, the chosen method is very useful for gaining confidence in the AI-based detection of atmospheric features.
Leon Geers, Ruud Janssen, Gudrun Thorkelsdottir, Jordi Vilà-Guerau de Arellano, and Martijn Schaap
EGUsphere, https://doi.org/10.5194/egusphere-2025-426, https://doi.org/10.5194/egusphere-2025-426, 2025
Short summary
Short summary
High-resolution data on reactive nitrogen deposition are needed to inform cost-effective policies. Here, we describe the implementation of a dry deposition module into a large eddy simulation code. With this model, we are able to represent the turbulent exchange of tracers at the hectometer resolution. The model calculates the dispersion and deposition of NOx and NH3 in great spatial detail, clearly showing the influence of local land use patterns.
Raphaël Périllat, Sylvain Girard, and Irène Korsakissok
EGUsphere, https://doi.org/10.5194/egusphere-2024-3838, https://doi.org/10.5194/egusphere-2024-3838, 2025
Short summary
Short summary
We developed a method to improve decision-making during nuclear crises by predicting the spread of radiation more efficiently. Existing approaches are often too slow, especially when analyzing complex data like radiation maps. Our method combines techniques to simplify these maps and predict them quickly using statistical tools. This approach could help authorities respond faster and more accurately in emergencies, reducing risks to the population and the environment.
Shaofeng Hua, Gang Chen, Baojun Chen, Mingshan Li, and Xin Xu
EGUsphere, https://doi.org/10.5194/egusphere-2024-3834, https://doi.org/10.5194/egusphere-2024-3834, 2025
Short summary
Short summary
Hail forecasting using numerical models remains a challenge. In this study, we found that the commonly used graupel-to-hail conversion parameterization method led to hail overforecasting in heavy rainfall cases where no hail was observed. By incorporating the spongy wet growth process, we successfully mitigated hail overforecasting. The modified scheme also produced hail in real hail events. This research contributes to a better understanding of hail formation.
Stefan Noll, Carsten Schmidt, Patrick Hannawald, Wolfgang Kausch, and Stefan Kimeswenger
EGUsphere, https://doi.org/10.5194/egusphere-2024-3512, https://doi.org/10.5194/egusphere-2024-3512, 2025
Short summary
Short summary
Non-thermal emission from chemical reactions in the Earth's middle und upper atmosphere strongly contributes to the brightness of the night sky below about 2.3 µm. The new Paranal Airglow Line and Continuum Emission model calculates the emission spectrum and its variability with an unprecedented accuracy. Relying on a large spectroscopic data set from astronomical spectrographs and theoretical molecular/atomic data, it is valuable for airglow research and astronomical observatories.
Felipe Cifuentes, Henk Eskes, Enrico Dammers, Charlotte Bryan, and Folkert Boersma
Geosci. Model Dev., 18, 621–649, https://doi.org/10.5194/gmd-18-621-2025, https://doi.org/10.5194/gmd-18-621-2025, 2025
Short summary
Short summary
We tested the capability of the flux divergence approach (FDA) to reproduce known NOx emissions using synthetic NO2 satellite column retrievals from high-resolution model simulations. The FDA accurately reproduced NOx emissions when column observations were limited to the boundary layer and when the variability of the NO2 lifetime, the NOx : NO2 ratio, and NO2 profile shapes were correctly modeled. This introduces strong model dependency, reducing the simplicity of the original FDA formulation.
Cited articles
Aggarwal, C. C., Hinneburg, A., and Keim, D. A.: On the surprising behavior of distance metrics in high dimensional space, in: International conference on database theory, Springer, Berlin, Heidelberg, 420–434, https://doi.org/10.1007/3-540-44503-X_27, 2001.
Ahmed, K., Sachindra, D. A., Shahid, S., Demirel, M. C., and Chung, E.-S.: Selection of multi-model ensemble of general circulation models for the simulation of precipitation and maximum and minimum temperature based on spatial assessment metrics, Hydrol. Earth Syst. Sci., 23, 4803–4824, https://doi.org/10.5194/hess-23-4803-2019, 2019.
Armstrong, J. S. and Collopy, F.: Error measures for generalizing about forecasting methods: Empirical comparisons, Int. J. Forecast., 8, 69–80, https://doi.org/10.1016/0169-2070(92)90008-W, 1992.
Baker, N. C. and Taylor, P. C.: A framework for evaluating climate model performance metrics, J. Climate, 29, 1773–1782, https://doi.org/10.1175/JCLI-D-15-0114.1, 2016.
Bell, B., Hersbach, H., Berrisford, P., Dahlgren, P., Horányi, A., Muñoz Sabater, J., Nicolas, J., Radu, R., Schepers, D., Simmons, A., Soci, C., and Thépaut, J.-N.: ERA5 monthly averaged data on pressure levels from 1950 to 1978 (preliminary version), Copernicus Climate Change Service (C3S) Climate Data Store (CDS) [data set], https://cds.climate.copernicus-climate.eu/cdsapp#!/dataset/reanalysis-era5-pressure-levels-monthly-means-preliminary-back-extension?tab=overview (last access: 16 April 2024), 2020.
Bellomo, K., Angeloni, M., Corti, S., and von Hardenberg, J.: Future climate change shaped by inter-model differences in Atlantic meridional overturning circulation response, Nat. Commun., 12, 1–10, https://doi.org/10.1038/s41467-021-24015-w, 2021.
Benestad, R. E., Mezghani, A., Lutz, J., Dobler, A., Parding, K. M., and Landgren, O. A.: Various ways of using empirical orthogonal functions for climate model evaluation, Geosci. Model Dev., 16, 2899–2913, https://doi.org/10.5194/gmd-16-2899-2023, 2023.
Boberg, F., Berg, P., Thejll, P., Gutowski, W. J., and Christensen, J. H.: Improved confidence in climate change projections of precipitation evaluated using daily statistics from the PRUDENCE ensemble, Clim. Dynam., 32, 1097–1106, https://doi.org/10.1007/s00382-008-0446-y, 2009.
Boberg, F., Berg, P., Thejll, P., Gutowski, W. J., and Christensen, J. H.: Improved confidence in climate change projections of precipitation further evaluated using daily statistics from ENSEMBLES models, Clim. Dynam., 35, 1509–1520, https://doi.org/10.1007/s00382-009-0683-8, 2010.
Chai, T. and Draxler, R. R.: Root mean square error (RMSE) or mean absolute error (MAE)? – Arguments against avoiding RMSE in the literature, Geosci. Model Dev., 7, 1247–1250, https://doi.org/10.5194/gmd-7-1247-2014, 2014.
Christensen, J. H. and Christensen, O. B.: A summary of the PRUDENCE model projections of changes in European climate by the end of this century, Climatic Change, 81, 7–30, https://doi.org/10.1007/s10584-006-9210-7, 2007.
Collier, N., Hoffman, F. M., Lawrence, D. M., Keppel-Aleks, G., Koven, C. D., Riley, W. J., and Randerson, J. T.: The International Land Model Benchmarking (ILAMB) system: design, theory, and implementation, J. Adv. Model. Earth Sy., 10, 2731–2754, https://doi.org/10.1029/2018MS001354, 2018.
Dembélé, M., Hrachowitz, M., Savenije, H. H., Mariéthoz, G., and Schaefli, B.: Improving the predictive skill of a distributed hydrological model by calibration on spatial patterns with multiple satellite data sets, Water Resour. Res., 56, e2019WR026085, https://doi.org/10.1029/2019WR026085, 2020.
Demirel, M. C., Mai, J., Mendiguren, G., Koch, J., Samaniego, L., and Stisen, S.: Combining satellite data and appropriate objective functions for improved spatial pattern performance of a distributed hydrologic model, Hydrol. Earth Syst. Sci., 22, 1299–1315, https://doi.org/10.5194/hess-22-1299-2018, 2018.
Flato, G., Marotzke, J., Abiodun, B., Braconnot, P., Chou, S. C., Collins, W., Cox, P., Driouech, F., Emori, S., Eyring, V., Forest, C., Gleckler, P., Guilyardi, E., Jakob, C., Kattsov, V., Reason, C., and Rummukainen, M.: Evaluation of climate models, in: Climate Change 2013: the physical science basis. Contribution of Working Group I to the Fifth Assessment Report of the Intergovernmental Panel on Climate Change, edited by: Stocker, T. F., Qin, D., Plattner, G.-K., Tignor, M., Allen, S. K., Boschung, J., Nauels, A., Xia, Y., Bex, V., and Midgley, P. M., Cambridge University Press, Cambridge, United Kingdom and New York, NY, USA, 741–866, https://www.ipcc.ch/site/assets/uploads/2018/02/WG1AR5_Chapter09_FINAL.pdf (last access: 16 April 2024), 2013.
Giot, O., Termonia, P., Degrauwe, D., De Troch, R., Caluwaerts, S., Smet, G., Berckmans, J., Deckmyn, A., De Cruz, L., De Meutter, P., Duerinckx, A., Gerard, L., Hamdi, R., Van den Bergh, J., Van Ginderachter, M., and Van Schaeybroeck, B.: Validation of the ALARO-0 model within the EURO-CORDEX framework, Geosci. Model Dev., 9, 1143–1152, https://doi.org/10.5194/gmd-9-1143-2016, 2016.
Gupta, H. V., Kling, H., Yilmaz, K. K., and Martinez, G. F.: Decomposition of the mean squared error and NSE performance criteria: Implications for improving hydrological modelling, J. Hydrol., 377, 80–91, https://doi.org/10.1016/j.jhydrol.2009.08.003, 2009.
He, X., Lei, X. D., and Dong, L. H.: How large is the difference in large-scale forest biomass estimations based on new climate-modified stand biomass models?, Ecol. Indic., 126, 107569, https://doi.org/10.1016/j.ecolind.2021.107569, 2021.
Hu, Z., Chen, X., Zhou, Q., Chen, D., and Li, J.: DISO: A rethink of Taylor diagram, Int. J. Climatol., 39, 2825–2832, https://doi.org/10.1002/joc.5972, 2019.
Hyndman, R. J. and Koehler, A. B.: Another look at measures of forecast accuracy, Int. J. Forecast., 22, 679–688, https://doi.org/10.1016/j.ijforecast.2006.03.001, 2006.
IPCC: Climate Change 2021: The Physical Science Basis. Contribution of Working Group I to the Sixth Assessment Report of the Intergovernmental Panel on Climate Change, edited by: Masson-Delmotte, V., Zhai, P., Pirani, A., Connors, S. L., Péan, C., Berger, S., Caud, N., Chen, Y., Goldfarb, L., Gomis, M. I., Huang, M., Leitzell, K., Lonnoy, E., Matthews, J. B. R., Maycock, T. K., Waterfield, T., Yelekçi, O., Yu, R., and Zhou, B., Cambridge University Press, https://report.ipcc.ch/ar6/wg1/IPCC_AR6_WGI_FullReport.pdf (last access: 16 April 2024), 2021a.
IPCC: Summary for Policymakers, in: Climate Change 2021: The Physical Science Basis. Contribution of Working Group I to the Sixth Assessment Report of the Intergovernmental Panel on Climate Change, edited by: Masson-Delmotte, V., Zhai, P., Pirani, A., Connors, S. L., Péan, C., Berger, S., Caud, N., Chen, Y., Goldfarb, L., Gomis, M. I., Huang, M., Leitzell, K., Lonnoy, E., Matthews, J. B. R., Maycock, T. K., Waterfield, T., Yelekçi, O., Yu, R., and Zhou, B., Cambridge University Press, https://www.ipcc.ch/report/ar6/wg1/downloads/report/IPCC_AR6_WGI_SPM.pdf (last access: 16 April 2024), 2021b.
Jackson, E. K., Roberts, W., Nelsen, B., Williams, G. P., Nelson, E. J., and Ames, D. P.: Introductory overview: Error metrics for hydrologic modelling – A review of common practices and an open source library to facilitate use and adoption, Environ. Modell. Softw., 119, 32–48, https://doi.org/10.1016/j.envsoft.2019.05.001, 2019.
Kalmár, T., Pieczka, I., and Pongrácz, R.: A sensitivity analysis of the different setups of the RegCM4.5 model for the Carpathian region, Int. J. Climatol., 41, E1180–E1201, https://doi.org/10.1002/joc.6761, 2021.
Kling, H., Fuchs, M., and Paulin, M.: Runoff conditions in the upper Danube basin under an ensemble of climate change scenarios, J. Hydrol., 424, 264–277, https://doi.org/10.1016/j.jhydrol.2012.01.011, 2012.
Kotlarski, S., Keuler, K., Christensen, O. B., Colette, A., Déqué, M., Gobiet, A., Goergen, K., Jacob, D., Lüthi, D., van Meijgaard, E., Nikulin, G., Schär, C., Teichmann, C., Vautard, R., Warrach-Sagi, K., and Wulfmeyer, V.: Regional climate modeling on European scales: a joint standard evaluation of the EURO-CORDEX RCM ensemble, Geosci. Model Dev., 7, 1297–1333, https://doi.org/10.5194/gmd-7-1297-2014, 2014.
Liemohn, M. W., Shane, A. D., Azari, A. R., Petersen, A. K., Swiger, B. M., and Mukhopadhyay, A.: RMSE is not enough: Guidelines to robust data-model comparisons for magnetospheric physics, J. Atmos. Sol.-Terr. Phys., 218, 105624, https://doi.org/10.1016/j.jastp.2021.105624, 2021.
Masanganise, J., Magodora, M., Mapuwei, T., and Basira, K.: An assessment of CMIP5 global climate model performance using probability density functions and a match metric method, Science Insights: An International Journal, 4, 1–8, 2014.
Mirkes, E. M., Allohibi, J., and Gorban, A.: Fractional norms and quasinorms do not help to overcome the curse of dimensionality, Entropy, 22, 1105, https://doi.org/10.48550/arXiv.2004.14230, 2020.
Mooney, P. A., Rechid, D., Davin, E. L., Katragkou, E., de Noblet-Ducoudré, N., Breil, M., Cardoso, R. M., Daloz, A. S., Hoffmann, P., Lima, D. C. A., Meier, R., Soares, P. M. M., Sofiadis, G., Strada, S., Strandberg, G., Toelle, M. H., and Lund, M. T.: Land–atmosphere interactions in sub-polar and alpine climates in the CORDEX Flagship Pilot Study Land Use and Climate Across Scales (LUCAS) models – Part 2: The role of changing vegetation, The Cryosphere, 16, 1383–1397, https://doi.org/10.5194/tc-16-1383-2022, 2022.
Murphy, A. H.: Skill scores based on the mean square error and their relationships to the correlation coefficient, Mon. Weather Rev., 116, 2417–2424, https://doi.org/10.1175/1520-0493(1988)116<2417:SSBOTM>2.0.CO;2, 1988.
Nash, J. E. and Sutcliffe, J. V.: River flow forecasting through conceptual models part I – A discussion of principles, J. Hydrol., 10, 282–290, https://doi.org/10.1016/0022-1694(70)90255-6, 1970.
Pachepsky, Y. A., Martinez, G., Pan, F., Wagener, T., and Nicholson, T.: Evaluating Hydrological Model Performance using Information Theory-based Metrics, Hydrol. Earth Syst. Sci. Discuss. [preprint], https://doi.org/10.5194/hess-2016-46, 2016.
Perkins, S. E., Pitman, A. J., Holbrook, N. J., and McAneney, J.: Evaluation of the AR4 Climate Models' Simulated Daily Maximum Temperature, Minimum Temperature, and Precipitation over Australia Using Probability Density Functions, J. Climate, 20, 4356–4376, https://doi.org/10.1175/JCLI4253.1, 2007.
Pitman, J.: Exchangeable and partially exchangeable random partitions, Probab. Theory Rel., 102, 145–158, https://doi.org/10.1007/BF01213386, 1995.
Randall, D. A., Wood, R. A., Bony, S., Colman, R., Fichefet, T., Fyfe, J., Kattsov, V., Pitman, A., Shukla, J., Srinivasan, J., Stouffer, R. J., Sumi, A., and Taylor, K. E.: Climate models and their evaluation, in: Climate Change 2007: The physical science basis, Contribution of Working Group I to the Fourth Assessment Report of the IPCC (FAR), Cambridge University Press, 589–662, 60, https://archive.ipcc.ch/publications_and_data/ar4/wg1/en/ch8.html (last access: 16 April 2024), 2007.
Reich, N. G., Lauer, S. A., Sakrejda, K., Iamsirithaworn, S., Hinjoy, S., Suangtho, P., Suthachana, S., Clapham, H. E., Salje, H., Cummings, D. A., and Lessler, J.: Challenges in real-time prediction of infectious disease: a case study of dengue in Thailand, PLoS Neglect. Trop. D., 10, e0004761, https://doi.org/10.1371/journal.pntd.0010883, 2016.
Richter, J. H., Butchart, N., Kawatani, Y., Bushell, A. C., Holt, L., Serva, F., Anstey, J., Simpson, I. R., Osprey, S., Hamilton, K., Braesicke, P., Cagnazzo, C., Chen C. C., Garcia, R. R., Gray, L. J., Kerzenmacher, T., Lott, F., McLandress, C., Naoe, H., Scinocca, J., Stockdale, T. N., Versick, S., Watanabe, S., Yoshida, K., and Yukimoto, S.: Response of the quasi-biennial oscillation to a warming climate in global climate models, Q. J. Roy. Meteor. Soc., 148, 1490–1518, https://doi.org/10.1002/qj.3749, 2022.
Roberts, N. M. and Lean, H. W.: Scale-Selective Verification of Rainfall Accumulations from High-Resolution Forecasts of Convective Events, Mon. Weather Rev., 136, 78–97, https://doi.org/10.1175/2007MWR2123.1, 2008.
Rupp, D. E., Abatzoglou, J. T., Hegewisch, K. C., and Mote, P. W.: Evaluation of CMIP5 20th century climate simulations for the Pacific Northwest USA, J. Geophys. Res.-Atmos., 118, 10884, https://doi.org/10.1002/jgrd.50843, 2013.
Samantaray, A.: Bergen Metric, Zenodo [code], https://doi.org/10.5281/zenodo.10518064, 2024.
Smiatek, G., Kunstmann, H., and Senatore A.: EURO-CORDEX regional climate model analysis for the Greater Alpine Region: Performance and expected future change, J. Geophys. Res.-Atmos., 121, 7710–7728, https://doi.org/10.1002/2015JD024727, 2016.
Taylor, K. E.: Summarizing multiple aspects of model performance in a single diagram, J. Geophys. Res.-Atmos., 106, 7183–7192, https://doi.org/10.1029/2000JD900719, 2001.
Torma, C. Z.: Detailed validation of EURO-CORDEX and Med-CORDEX regional climate model ensembles over the Carpathian Region, Időjárás/Quarterly Journal Of The Hungarian Meteorological Service, 123, 217–240, https://doi.org/10.28974/idojaras.2019.2.6, 2019.
van Noije, T., Bergman, T., Le Sager, P., O'Donnell, D., Makkonen, R., Gonçalves-Ageitos, M., Döscher, R., Fladrich, U., von Hardenberg, J., Keskinen, J.-P., Korhonen, H., Laakso, A., Myriokefalitakis, S., Ollinaho, P., Pérez García-Pando, C., Reerink, T., Schrödner, R., Wyser, K., and Yang, S.: EC-Earth3-AerChem: a global climate model with interactive aerosols and atmospheric chemistry participating in CMIP6, Geosci. Model Dev., 14, 5637–5668, https://doi.org/10.5194/gmd-14-5637-2021, 2021.
Vautard, R., Kadygrov, N., Iles, C., Boberg, F., Buonomo, E., Bülow, K., Coppola, E., Corre, L., van Meijgaard, E., Nogherotto, R., and Sandstad, M.: Evaluation of the large EURO-CORDEX regional climate model ensemble, J. Geophys. Res.-Atmos., 126, e2019JD032344, https://doi.org/10.1029/2019JD032344, 2021.
Wang, Z. and Bovik, A. C.: A universal image quality index, IEEE Signal Proc. Let., 9, 81–84, https://doi.org/10.1109/97.995823, 2002.
Watt-Meyer, O., Brenowitz, N. D., Clark, S. K., Henn, B., Kwa, A., McGibbon, J., Perkins, W. A., and Bretherton, C. S.: Correcting weather and climate models by machine learning nudged historical simulations, Geophys. Res. Lett., 48, e2021GL092555, https://doi.org/10.1029/2021GL092555, 2021.
Weber, R., Schek, H. J., and Blott, S.: A quantitative analysis and performance study for similarity-search methods in highdimensional spaces, in: VLDB, 98, 194–205, https://vldb.org/conf/1998/p194.pdf (last access: 16 April 2024), 1998.
Wȩglarczyk, S.: The interdependence and applicability of some statistical quality measures for hydrological models, J. Hydrol., 206, 98–103, https://doi.org/10.1016/S0022-1694(98)00094-8, 1998.
Wehner, M., Lee, J., Risser, M., Ullrich, P., Gleckler, P., and Collins, W. D.: Evaluation of extreme sub-daily precipitation in high-resolution global climate model simulations, Philos. T. Roy. Soc. A, 379, 20190545, https://doi.org/10.1098/rsta.2019.0545, 2021.
Willmott, C. J. and Matsuura, K.: Advantages of the mean absolute error (MAE) over the root mean square error (RMSE) in assessing average model performance, Clim. Res., 30, 79–82, 2005.
Wood, R. R., Lehner, F., Pendergrass, A. G., and Schlunegger, S.: Changes in precipitation variability across time scales in multiple global climate model large ensembles, Environ. Res. Lett., 16, 084022, https://doi.org/10.1088/1748-9326/ac10dd, 2021.
Yang, J., Ren, J., Sun, D., Xiao, X., Xia, J. C., Jin, C., and Li, X.: Understanding land surface temperature impact factors based on local climate zones, Sustain. Cities Soc., 69, 102818, https://doi.org/10.1016/j.scs.2021.102818, 2021.
Short summary
Any interpretation of climate model data requires a comprehensive evaluation of the model performance. Numerous error metrics exist for this purpose, and each focuses on a specific aspect of the relationship between reference and model data. Thus, a comprehensive evaluation demands the use of multiple error metrics. However, this can lead to confusion. We propose a clustering technique to reduce the number of error metrics needed and a composite error metric to simplify the interpretation.
Any interpretation of climate model data requires a comprehensive evaluation of the model...
