Articles | Volume 17, issue 8
https://doi.org/10.5194/gmd-17-3321-2024
© Author(s) 2024. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
https://doi.org/10.5194/gmd-17-3321-2024
© Author(s) 2024. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
Methods for assessment of models
| 
29 Apr 2024
Methods for assessment of models |
| 29 Apr 2024
| 29 Apr 2024
Bergen metrics: composite error metrics for assessing performance of climate models using EURO-CORDEX simulations
NORCE Norwegian Research Centre, Bjerknes Centre for Climate Research, Bergen, Norway
Priscilla A. Mooney
NORCE Norwegian Research Centre, Bjerknes Centre for Climate Research, Bergen, Norway
Carla A. Vivacqua
Department of Statistics, Universidade Federal do Rio Grande do Norte, Natal, Brazil
Related authors
No articles found.
Hannah Vickers, Priscilla Mooney, and Oskar Landgren
EGUsphere, https://doi.org/10.5194/egusphere-2025-2099, https://doi.org/10.5194/egusphere-2025-2099, 2025
This preprint is open for discussion and under review for The Cryosphere (TC).
Short summary
Short summary
Rain-on-snow (ROS) events are becoming a common feature in winter in Svalbard due to climate warming. Understanding how ROS events are changing and how they will change in the coming decades is crucial to minimise their impacts. Using atmospheric reanalyses and climate projections we found contrasting trends between coastal and inland areas, and that the most dramatic future changes in ROS will occur in glaciated areas which will have considerable consequences for Svalbards hydrology.
Xavier J. Levine, Ryan S. Williams, Gareth Marshall, Andrew Orr, Lise Seland Graff, Dörthe Handorf, Alexey Karpechko, Raphael Köhler, René R. Wijngaard, Nadine Johnston, Hanna Lee, Lars Nieradzik, and Priscilla A. Mooney
Earth Syst. Dynam., 15, 1161–1177, https://doi.org/10.5194/esd-15-1161-2024, https://doi.org/10.5194/esd-15-1161-2024, 2024
Short summary
Short summary
While the most recent climate projections agree that the Arctic is warming, differences remain in how much and in other climate variables such as precipitation. This presents a challenge for stakeholders who need to develop mitigation and adaptation strategies. We tackle this problem by using the storyline approach to generate four plausible and actionable realisations of end-of-century climate change for the Arctic, spanning its most likely range of variability.
Anne Sophie Daloz, Clemens Schwingshackl, Priscilla Mooney, Susanna Strada, Diana Rechid, Edouard L. Davin, Eleni Katragkou, Nathalie de Noblet-Ducoudré, Michal Belda, Tomas Halenka, Marcus Breil, Rita M. Cardoso, Peter Hoffmann, Daniela C. A. Lima, Ronny Meier, Pedro M. M. Soares, Giannis Sofiadis, Gustav Strandberg, Merja H. Toelle, and Marianne T. Lund
The Cryosphere, 16, 2403–2419, https://doi.org/10.5194/tc-16-2403-2022, https://doi.org/10.5194/tc-16-2403-2022, 2022
Short summary
Short summary
Snow plays a major role in the regulation of the Earth's surface temperature. Together with climate change, rising temperatures are already altering snow in many ways. In this context, it is crucial to better understand the ability of climate models to represent snow and snow processes. This work focuses on Europe and shows that the melting season in spring still represents a challenge for climate models and that more work is needed to accurately simulate snow–atmosphere interactions.
Priscilla A. Mooney, Diana Rechid, Edouard L. Davin, Eleni Katragkou, Natalie de Noblet-Ducoudré, Marcus Breil, Rita M. Cardoso, Anne Sophie Daloz, Peter Hoffmann, Daniela C. A. Lima, Ronny Meier, Pedro M. M. Soares, Giannis Sofiadis, Susanna Strada, Gustav Strandberg, Merja H. Toelle, and Marianne T. Lund
The Cryosphere, 16, 1383–1397, https://doi.org/10.5194/tc-16-1383-2022, https://doi.org/10.5194/tc-16-1383-2022, 2022
Short summary
Short summary
We use multiple regional climate models to show that afforestation in sub-polar and alpine regions reduces the radiative impact of snow albedo on the atmosphere, reduces snow cover, and delays the start of the snowmelt season. This is important for local communities that are highly reliant on snowpack for water resources and winter tourism. However, models disagree on the amount of change particularly when snow is melting. This shows that more research is needed on snow–vegetation interactions.
Hannah Ming Siu Vickers, Priscilla Mooney, Eirik Malnes, and Hanna Lee
The Cryosphere Discuss., https://doi.org/10.5194/tc-2022-57, https://doi.org/10.5194/tc-2022-57, 2022
Manuscript not accepted for further review
Short summary
Short summary
Rain-on-snow (ROS) events are becoming more frequent as a result of a warming climate, and can have significant impacts on nature and society. Accurate representation of ROS events is need to identify where impacts are greatest both now and in the future. We compare rain-on-snow climatologies from a climate model, ground and satellite radar observations and show how different methods can lead to contrasting conclusions and interpretation of the results should take into account their limitations.
Giannis Sofiadis, Eleni Katragkou, Edouard L. Davin, Diana Rechid, Nathalie de Noblet-Ducoudre, Marcus Breil, Rita M. Cardoso, Peter Hoffmann, Lisa Jach, Ronny Meier, Priscilla A. Mooney, Pedro M. M. Soares, Susanna Strada, Merja H. Tölle, and Kirsten Warrach Sagi
Geosci. Model Dev., 15, 595–616, https://doi.org/10.5194/gmd-15-595-2022, https://doi.org/10.5194/gmd-15-595-2022, 2022
Short summary
Short summary
Afforestation is currently promoted as a greenhouse gas mitigation strategy. In our study, we examine the differences in soil temperature and moisture between grounds covered either by forests or grass. The main conclusion emerged is that forest-covered grounds are cooler but drier than open lands in summer. Therefore, afforestation disrupts the seasonal cycle of soil temperature, which in turn could trigger changes in crucial chemical processes such as soil carbon sequestration.
Shunya Koseki, Priscilla A. Mooney, William Cabos, Miguel Ángel Gaertner, Alba de la Vara, and Juan Jesus González-Alemán
Nat. Hazards Earth Syst. Sci., 21, 53–71, https://doi.org/10.5194/nhess-21-53-2021, https://doi.org/10.5194/nhess-21-53-2021, 2021
Short summary
Short summary
This study investigated one case of a tropical-like cyclone over the Mediterranean Sea under present and future climate conditions with a regional climate model. A pseudo global warming (PGW) technique is employed to simulate the cyclone under future climate, and our simulation showed that the cyclone is moderately strengthened by warmer climate. Other PGW simulations where only ocean and atmosphere are warmed reveal the interesting results that both have counteracting effects on the cyclone.
Shunya Koseki and Priscilla A. Mooney
Hydrol. Earth Syst. Sci., 23, 2795–2812, https://doi.org/10.5194/hess-23-2795-2019, https://doi.org/10.5194/hess-23-2795-2019, 2019
Short summary
Short summary
This study revealed that Lake Malawi plays an important role for local precipitation in terms of spatial distribution and diurnal cycle in boreal summer (November to March). The diurnal cycle is detected by harmonics analysis and empirical orthogonal function analysis. An idealized simulation of WRF without Lake Malawi clearly showed that Lake Malawi is a source of local precipitation.
Related subject area
Atmospheric sciences
Accounting for effects of coagulation and model uncertainties in particle number concentration estimates based on measurements from sampling lines – a Bayesian inversion approach with SLIC v1.0
Top-down CO emission estimates using TROPOMI CO data in the TM5-4DVAR (r1258) inverse modeling suit
The Multi-Compartment Hg Modeling and Analysis Project (MCHgMAP): mercury modeling to support international environmental policy
Similarity-based analysis of atmospheric organic compounds for machine learning applications
Porting the Meso-NH atmospheric model on different GPU architectures for the next generation of supercomputers (version MESONH-v55-OpenACC)
Estimation of aerosol and cloud radiative heating rate in the tropical stratosphere using a radiative kernel method
Evaluation of dust emission and land surface schemes in predicting a mega Asian dust storm over South Korea using WRF-Chem
Sensitivity studies of a four-dimensional local ensemble transform Kalman filter coupled with WRF-Chem version 3.9.1 for improving particulate matter simulation accuracy
A Bayesian method for predicting background radiation at environmental monitoring stations in local-scale networks
Inclusion of the ECMWF ecRad radiation scheme (v1.5.0) in the MAR (v3.14), regional evaluation for Belgium, and assessment of surface shortwave spectral fluxes at Uccle
Development of a fast radiative transfer model for ground-based microwave radiometers (ARMS-gb v1.0): validation and comparison to RTTOV-gb
Indian Institute of Tropical Meteorology (IITM) High-Resolution Global Forecast Model version 1: an attempt to resolve monsoon prediction deadlock
Cell-tracking-based framework for assessing nowcasting model skill in reproducing growth and decay of convective rainfall
NeuralMie (v1.0): an aerosol optics emulator
Simulation performance of planetary boundary layer schemes in WRF v4.3.1 for near-surface wind over the western Sichuan Basin: a single-site assessment
FootNet v1.0: development of a machine learning emulator of atmospheric transport
Updates and evaluation of NOAA's online-coupled air quality model version 7 (AQMv7) within the Unified Forecast System
Quantifying the analysis uncertainty for nowcasting application
Improving the ensemble square root filter (EnSRF) in the Community Inversion Framework: a case study with ICON-ART 2024.01
The MESSy DWARF (based on MESSy v2.55.2)
An enhanced emission module for the PALM model system 23.10 with application for PM10 emission from urban domestic heating
Identifying lightning processes in ERA5 soundings with deep learning
Sensitivity of predicted ultrafine particle size distributions in Europe to different nucleation rate parameterizations using PMCAMx-UF v2.2
Explaining neural networks for detection of tropical cyclones and atmospheric rivers in gridded atmospheric simulation data
PALACE v1.0: Paranal Airglow Line And Continuum Emission model
Accurate space-based NOx emission estimates with the flux divergence approach require fine-scale model information on local oxidation chemistry and profile shapes
Exploring a high-level programming model for the NWP domain using ECMWF microphysics schemes
Quantifying uncertainties in satellite NO2 superobservations for data assimilation and model evaluation
ML-AMPSIT: Machine Learning-based Automated Multi-method Parameter Sensitivity and Importance analysis Tool
Coupling the urban canopy model TEB (SURFEXv9.0) with the radiation model SPARTACUS-Urbanv0.6.1 for more realistic urban radiative exchange calculation
Forecasting contrail climate forcing for flight planning and air traffic management applications: the CocipGrid model in pycontrails 0.51.0
Simulation of the heat mitigation potential of unsealing measures in cities by parameterizing grass grid pavers for urban microclimate modelling with ENVI-met (V5)
AI-NAOS: an AI-based nonspherical aerosol optical scheme for the chemical weather model GRAPES_Meso5.1/CUACE
Orbital-Radar v1.0.0: a tool to transform suborbital radar observations to synthetic EarthCARE cloud radar data
The Modular and Integrated Data Assimilation System at Environment and Climate Change Canada (MIDAS v3.9.1)
A new set of indicators for model evaluation complementing to FAIRMODE’s MQO
Modeling of polycyclic aromatic hydrocarbons (PAHs) from global to regional scales: model development (IAP-AACM_PAH v1.0) and investigation of health risks in 2013 and 2018 in China
LIMA (v2.0): A full two-moment cloud microphysical scheme for the mesoscale non-hydrostatic model Meso-NH v5-6
Least travel time ray tracer, version Two (LTT v2) adapted to the grid geometry of the OpenIFS atmospheric model
SLUCM+BEM (v1.0): a simple parameterisation for dynamic anthropogenic heat and electricity consumption in WRF-Urban (v4.3.2)
Carbon dioxide plume dispersion simulated at hectometer scale using DALES: model formulation and observational evaluation
NAQPMS-PDAF v2.0: a novel hybrid nonlinear data assimilation system for improved simulation of PM2.5 chemical components
Source-specific bias correction of US background and anthropogenic ozone modeled in CMAQ
Observational operator for fair model evaluation with ground NO2 measurements
Valid time shifting ensemble Kalman filter (VTS-EnKF) for dust storm forecasting
Development of the CMA-GFS-AERO 4D-Var assimilation system v1.0 – Part 1: System description
The third Met Office Unified Model-JULES Regional Atmosphere and Land Configuration, RAL3
Atmospheric moisture tracking with WAM2layers v3
An updated parameterization of the unstable atmospheric surface layer in the Weather Research and Forecasting (WRF) modeling system
The impact of cloud microphysics and ice nucleation on Southern Ocean clouds assessed with single-column modeling and instrument simulators
Matti Niskanen, Aku Seppänen, Henri Oikarinen, Miska Olin, Panu Karjalainen, Santtu Mikkonen, and Kari Lehtinen
Geosci. Model Dev., 18, 2983–3001, https://doi.org/10.5194/gmd-18-2983-2025, https://doi.org/10.5194/gmd-18-2983-2025, 2025
Short summary
Short summary
Particle size is a key factor determining the properties of aerosol particles which have a major influence on the climate and on human health. When measuring the particle sizes, however, sometimes the sampling lines that transfer the aerosol to the measurement device distort the size distribution, making the measurement unreliable. We propose a method to correct for the distortions and estimate the true particle sizes, improving measurement accuracy.
Johann Rasmus Nüß, Nikos Daskalakis, Fabian Günther Piwowarczyk, Angelos Gkouvousis, Oliver Schneising, Michael Buchwitz, Maria Kanakidou, Maarten C. Krol, and Mihalis Vrekoussis
Geosci. Model Dev., 18, 2861–2890, https://doi.org/10.5194/gmd-18-2861-2025, https://doi.org/10.5194/gmd-18-2861-2025, 2025
Short summary
Short summary
We estimate carbon monoxide emissions through inverse modeling, an approach where measurements of tracers in the atmosphere are fed to a model to calculate backwards in time (inverse) where the tracers came from. We introduce measurements from a new satellite instrument and show that, in most places globally, these on their own sufficiently constrain the emissions. This alleviates the need for additional datasets, which could shorten the delay for future carbon monoxide source estimates.
Ashu Dastoor, Hélène Angot, Johannes Bieser, Flora Brocza, Brock Edwards, Aryeh Feinberg, Xinbin Feng, Benjamin Geyman, Charikleia Gournia, Yipeng He, Ian M. Hedgecock, Ilia Ilyin, Jane Kirk, Che-Jen Lin, Igor Lehnherr, Robert Mason, David McLagan, Marilena Muntean, Peter Rafaj, Eric M. Roy, Andrei Ryjkov, Noelle E. Selin, Francesco De Simone, Anne L. Soerensen, Frits Steenhuisen, Oleg Travnikov, Shuxiao Wang, Xun Wang, Simon Wilson, Rosa Wu, Qingru Wu, Yanxu Zhang, Jun Zhou, Wei Zhu, and Scott Zolkos
Geosci. Model Dev., 18, 2747–2860, https://doi.org/10.5194/gmd-18-2747-2025, https://doi.org/10.5194/gmd-18-2747-2025, 2025
Short summary
Short summary
This paper introduces the Multi-Compartment Mercury (Hg) Modeling and Analysis Project (MCHgMAP) aimed at informing the effectiveness evaluations of two multilateral environmental agreements: the Minamata Convention on Mercury and the Convention on Long-Range Transboundary Air Pollution. The experimental design exploits a variety of models (atmospheric, land, oceanic ,and multimedia mass balance models) to assess the short- and long-term influences of anthropogenic Hg releases into the environment.
Hilda Sandström and Patrick Rinke
Geosci. Model Dev., 18, 2701–2724, https://doi.org/10.5194/gmd-18-2701-2025, https://doi.org/10.5194/gmd-18-2701-2025, 2025
Short summary
Short summary
Machine learning has the potential to aid the identification of organic molecules involved in aerosol formation. Yet, progress is stalled by a lack of curated atmospheric molecular datasets. Here, we compared atmospheric compounds with large molecular datasets used in machine learning and found minimal overlap with similarity algorithms. Our result underlines the need for collaborative efforts to curate atmospheric molecular data to facilitate machine learning models in atmospheric sciences.
Juan Escobar, Philippe Wautelet, Joris Pianezze, Florian Pantillon, Thibaut Dauhut, Christelle Barthe, and Jean-Pierre Chaboureau
Geosci. Model Dev., 18, 2679–2700, https://doi.org/10.5194/gmd-18-2679-2025, https://doi.org/10.5194/gmd-18-2679-2025, 2025
Short summary
Short summary
The Meso-NH weather research code is adapted for GPUs using OpenACC, leading to significant performance and energy efficiency improvements. Called MESONH-v55-OpenACC, it includes enhanced memory management, communication optimizations and a new solver. On the AMD MI250X Adastra platform, it achieved up to 6× speedup and 2.3× energy efficiency gain compared to CPUs. Storm simulations at 100 m resolution show positive results, positioning the code for future use on exascale supercomputers.
Jie Gao, Yi Huang, Jonathon S. Wright, Ke Li, Tao Geng, and Qiurun Yu
Geosci. Model Dev., 18, 2569–2586, https://doi.org/10.5194/gmd-18-2569-2025, https://doi.org/10.5194/gmd-18-2569-2025, 2025
Short summary
Short summary
The aerosol in the upper troposphere and stratosphere is highly variable, and its radiative effect is poorly understood. To estimate this effect, the radiative kernel is constructed and applied. The results show that the kernels can reproduce aerosol radiative effects and are expected to simulate stratospheric aerosol radiative effects. This approach reduces computational expense, is consistent with radiative model calculations, and can be applied to atmospheric models with speed requirements.
Ji Won Yoon, Seungyeon Lee, Ebony Lee, and Seon Ki Park
Geosci. Model Dev., 18, 2303–2328, https://doi.org/10.5194/gmd-18-2303-2025, https://doi.org/10.5194/gmd-18-2303-2025, 2025
Short summary
Short summary
This study evaluates the Weather Research and Forecasting Model (WRF) coupled with Chemistry (WRF-Chem) to predict a mega Asian dust storm (ADS) over South Korea on 28–29 March 2021. We assessed combinations of five dust emission and four land surface schemes by analyzing meteorological and air quality variables. The best scheme combination reduced the root mean square error (RMSE) for particulate matter 10 (PM10) by up to 29.6 %, demonstrating the highest performance.
Jianyu Lin, Tie Dai, Lifang Sheng, Weihang Zhang, Shangfei Hai, and Yawen Kong
Geosci. Model Dev., 18, 2231–2248, https://doi.org/10.5194/gmd-18-2231-2025, https://doi.org/10.5194/gmd-18-2231-2025, 2025
Short summary
Short summary
The effectiveness of this assimilation system and its sensitivity to the ensemble member size and length of the assimilation window are investigated. This study advances our understanding of the selection of basic parameters in the four-dimensional local ensemble transform Kalman filter assimilation system and the performance of ensemble simulation in a particulate-matter-polluted environment.
Jens Peter Karolus Wenceslaus Frankemölle, Johan Camps, Pieter De Meutter, and Johan Meyers
Geosci. Model Dev., 18, 1989–2003, https://doi.org/10.5194/gmd-18-1989-2025, https://doi.org/10.5194/gmd-18-1989-2025, 2025
Short summary
Short summary
To detect anomalous radioactivity in the environment, it is paramount that we understand the natural background level. In this work, we propose a statistical model to describe the most likely background level and the associated uncertainty in a network of dose rate detectors. We train, verify, and validate the model using real environmental data. Using the model, we show that we can correctly predict the background level in a subset of the detector network during a known
anomalous event.
Jean-François Grailet, Robin J. Hogan, Nicolas Ghilain, David Bolsée, Xavier Fettweis, and Marilaure Grégoire
Geosci. Model Dev., 18, 1965–1988, https://doi.org/10.5194/gmd-18-1965-2025, https://doi.org/10.5194/gmd-18-1965-2025, 2025
Short summary
Short summary
The MAR (Modèle Régional Atmosphérique) is a regional climate model used for weather forecasting and studying the climate over various regions. This paper presents an update of MAR thanks to which it can precisely decompose solar radiation, in particular in the UV (ultraviolet) and photosynthesis ranges, both being critical to human health and ecosystems. As a first application of this new capability, this paper presents a method for predicting UV indices with MAR.
Yi-Ning Shi, Jun Yang, Wei Han, Lujie Han, Jiajia Mao, Wanlin Kan, and Fuzhong Weng
Geosci. Model Dev., 18, 1947–1964, https://doi.org/10.5194/gmd-18-1947-2025, https://doi.org/10.5194/gmd-18-1947-2025, 2025
Short summary
Short summary
Direct assimilation of observations from ground-based microwave radiometers (GMRs) holds significant potential for improving forecast accuracy. Radiative transfer models (RTMs) play a crucial role in direct data assimilation. In this study, we introduce a new RTM, the Advanced Radiative Transfer Modeling System – Ground-Based (ARMS-gb), designed to simulate brightness temperatures observed by GMRs along with their Jacobians. Several enhancements have been incorporated to achieve higher accuracy.
R. Phani Murali Krishna, Siddharth Kumar, A. Gopinathan Prajeesh, Peter Bechtold, Nils Wedi, Kumar Roy, Malay Ganai, B. Revanth Reddy, Snehlata Tirkey, Tanmoy Goswami, Radhika Kanase, Sahadat Sarkar, Medha Deshpande, and Parthasarathi Mukhopadhyay
Geosci. Model Dev., 18, 1879–1894, https://doi.org/10.5194/gmd-18-1879-2025, https://doi.org/10.5194/gmd-18-1879-2025, 2025
Short summary
Short summary
The High-Resolution Global Forecast Model (HGFM) is an advanced iteration of the operational Global Forecast System (GFS) model. HGFM can produce forecasts at a spatial scale of ~6 km in tropics. It demonstrates improved accuracy in short- to medium-range weather prediction over the Indian region, with notable success in predicting extreme events. Further, the model will be entrusted to operational forecasting agencies after validation and testing.
Jenna Ritvanen, Seppo Pulkkinen, Dmitri Moisseev, and Daniele Nerini
Geosci. Model Dev., 18, 1851–1878, https://doi.org/10.5194/gmd-18-1851-2025, https://doi.org/10.5194/gmd-18-1851-2025, 2025
Short summary
Short summary
Nowcasting models struggle with the rapid evolution of heavy rain, and common verification methods are unable to describe how accurately the models predict the growth and decay of heavy rain. We propose a framework to assess model performance. In the framework, convective cells are identified and tracked in the forecasts and observations, and the model skill is then evaluated by comparing differences between forecast and observed cells. We demonstrate the framework with four open-source models.
Andrew Geiss and Po-Lun Ma
Geosci. Model Dev., 18, 1809–1827, https://doi.org/10.5194/gmd-18-1809-2025, https://doi.org/10.5194/gmd-18-1809-2025, 2025
Short summary
Short summary
Particles in the Earth's atmosphere strongly impact the planet's energy budget, and atmosphere simulations require accurate representation of their interaction with light. This work introduces two approaches to represent light scattering by small particles. The first is a scattering simulator based on Mie theory implemented in Python. The second is a neural network emulator that is more accurate than existing methods and is fast enough to be used in climate and weather simulations.
Qin Wang, Bo Zeng, Gong Chen, and Yaoting Li
Geosci. Model Dev., 18, 1769–1784, https://doi.org/10.5194/gmd-18-1769-2025, https://doi.org/10.5194/gmd-18-1769-2025, 2025
Short summary
Short summary
This study evaluates the performance of four planetary boundary layer (PBL) schemes in near-surface wind fields over the Sichuan Basin, China. Using 112 sensitivity experiments with the Weather Research and Forecasting (WRF) model and focusing on 28 wind events, it is found that wind direction was less sensitive to the PBL schemes. The quasi-normal scale elimination (QNSE) scheme captured temporal variations best, while the Mellor–Yamada–Janjić (MYJ) scheme had the least error in wind speed.
Tai-Long He, Nikhil Dadheech, Tammy M. Thompson, and Alexander J. Turner
Geosci. Model Dev., 18, 1661–1671, https://doi.org/10.5194/gmd-18-1661-2025, https://doi.org/10.5194/gmd-18-1661-2025, 2025
Short summary
Short summary
It is computationally expensive to infer greenhouse gas (GHG) emissions using atmospheric observations. This is partly due to the detailed model used to represent atmospheric transport. We demonstrate how a machine learning (ML) model can be used to simulate high-resolution atmospheric transport. This type of ML model will help estimate GHG emissions using dense observations, which are becoming increasingly common with the proliferation of urban monitoring networks and geostationary satellites.
Wei Li, Beiming Tang, Patrick C. Campbell, Youhua Tang, Barry Baker, Zachary Moon, Daniel Tong, Jianping Huang, Kai Wang, Ivanka Stajner, and Raffaele Montuoro
Geosci. Model Dev., 18, 1635–1660, https://doi.org/10.5194/gmd-18-1635-2025, https://doi.org/10.5194/gmd-18-1635-2025, 2025
Short summary
Short summary
The study describes the updates of NOAA's current UFS-AQMv7 air quality forecast model by incorporating the latest scientific and structural changes in CMAQv5.4. An evaluation during the summer of 2023 shows that the updated model overall improves the simulation of MDA8 O3 by reducing the bias by 8%–12% in the contiguous US. PM2.5 predictions have mixed results due to wildfire, highlighting the need for future refinements.
Yanwei Zhu, Aitor Atencia, Markus Dabernig, and Yong Wang
Geosci. Model Dev., 18, 1545–1559, https://doi.org/10.5194/gmd-18-1545-2025, https://doi.org/10.5194/gmd-18-1545-2025, 2025
Short summary
Short summary
Most works have delved into convective weather nowcasting, and only a few works have discussed the nowcasting uncertainty for variables at the surface level. Hence, we proposed a method to estimate uncertainty. Generating appropriate noises associated with the characteristic of the error in analysis can simulate the uncertainty of nowcasting. This method can contribute to the estimation of near–surface analysis uncertainty in both nowcasting applications and ensemble nowcasting development.
Joël Thanwerdas, Antoine Berchet, Lionel Constantin, Aki Tsuruta, Michael Steiner, Friedemann Reum, Stephan Henne, and Dominik Brunner
Geosci. Model Dev., 18, 1505–1544, https://doi.org/10.5194/gmd-18-1505-2025, https://doi.org/10.5194/gmd-18-1505-2025, 2025
Short summary
Short summary
The Community Inversion Framework (CIF) brings together methods for estimating greenhouse gas fluxes from atmospheric observations. The initial ensemble method implemented in CIF was found to be incomplete and could hardly be compared to other ensemble methods employed in the inversion community. In this paper, we present and evaluate a new implementation of the ensemble mode, building upon the initial developments.
Astrid Kerkweg, Timo Kirfel, Duong H. Do, Sabine Griessbach, Patrick Jöckel, and Domenico Taraborrelli
Geosci. Model Dev., 18, 1265–1286, https://doi.org/10.5194/gmd-18-1265-2025, https://doi.org/10.5194/gmd-18-1265-2025, 2025
Short summary
Short summary
Normally, the Modular Earth Submodel System (MESSy) is linked to complete dynamic models to create chemical climate models. However, the modular concept of MESSy and the newly developed DWARF component presented here make it possible to create simplified models that contain only one or a few process descriptions. This is very useful for technical optimisation, such as porting to GPUs, and can be used to create less complex models, such as a chemical box model.
Edward C. Chan, Ilona J. Jäkel, Basit Khan, Martijn Schaap, Timothy M. Butler, Renate Forkel, and Sabine Banzhaf
Geosci. Model Dev., 18, 1119–1139, https://doi.org/10.5194/gmd-18-1119-2025, https://doi.org/10.5194/gmd-18-1119-2025, 2025
Short summary
Short summary
An enhanced emission module has been developed for the PALM model system, improving flexibility and scalability of emission source representation across different sectors. A model for parametrized domestic emissions has also been included, for which an idealized model run is conducted for particulate matter (PM10). The results show that, in addition to individual sources and diurnal variations in energy consumption, vertical transport and urban topology play a role in concentration distribution.
Gregor Ehrensperger, Thorsten Simon, Georg J. Mayr, and Tobias Hell
Geosci. Model Dev., 18, 1141–1153, https://doi.org/10.5194/gmd-18-1141-2025, https://doi.org/10.5194/gmd-18-1141-2025, 2025
Short summary
Short summary
As lightning is a brief and localized event, it is not explicitly resolved in atmospheric models. Instead, expert-based auxiliary descriptions are used to assess it. This study explores how AI can improve our understanding of lightning without relying on traditional expert knowledge. We reveal that AI independently identified the key factors known to experts as essential for lightning in the Alps region. This shows how knowledge discovery could be sped up in areas with limited expert knowledge.
David Patoulias, Kalliopi Florou, and Spyros N. Pandis
Geosci. Model Dev., 18, 1103–1118, https://doi.org/10.5194/gmd-18-1103-2025, https://doi.org/10.5194/gmd-18-1103-2025, 2025
Short summary
Short summary
The effect of the assumed atmospheric nucleation mechanism on particle number concentrations and size distribution was investigated. Two quite different mechanisms involving sulfuric acid and ammonia or a biogenic organic vapor gave quite similar results which were consistent with measurements at 26 measurement stations across Europe. The number of larger particles that serve as cloud condensation nuclei showed little sensitivity to the assumed nucleation mechanism.
Tim Radke, Susanne Fuchs, Christian Wilms, Iuliia Polkova, and Marc Rautenhaus
Geosci. Model Dev., 18, 1017–1039, https://doi.org/10.5194/gmd-18-1017-2025, https://doi.org/10.5194/gmd-18-1017-2025, 2025
Short summary
Short summary
In our study, we built upon previous work to investigate the patterns artificial intelligence (AI) learns to detect atmospheric features like tropical cyclones (TCs) and atmospheric rivers (ARs). As primary objective, we adopt a method to explain the AI used and investigate the plausibility of learned patterns. We find that plausible patterns are learned for both TCs and ARs. Hence, the chosen method is very useful for gaining confidence in the AI-based detection of atmospheric features.
Stefan Noll, Carsten Schmidt, Patrick Hannawald, Wolfgang Kausch, and Stefan Kimeswenger
EGUsphere, https://doi.org/10.5194/egusphere-2024-3512, https://doi.org/10.5194/egusphere-2024-3512, 2025
Short summary
Short summary
Non-thermal emission from chemical reactions in the Earth's middle und upper atmosphere strongly contributes to the brightness of the night sky below about 2.3 µm. The new Paranal Airglow Line and Continuum Emission model calculates the emission spectrum and its variability with an unprecedented accuracy. Relying on a large spectroscopic data set from astronomical spectrographs and theoretical molecular/atomic data, it is valuable for airglow research and astronomical observatories.
Felipe Cifuentes, Henk Eskes, Enrico Dammers, Charlotte Bryan, and Folkert Boersma
Geosci. Model Dev., 18, 621–649, https://doi.org/10.5194/gmd-18-621-2025, https://doi.org/10.5194/gmd-18-621-2025, 2025
Short summary
Short summary
We tested the capability of the flux divergence approach (FDA) to reproduce known NOx emissions using synthetic NO2 satellite column retrievals from high-resolution model simulations. The FDA accurately reproduced NOx emissions when column observations were limited to the boundary layer and when the variability of the NO2 lifetime, the NOx : NO2 ratio, and NO2 profile shapes were correctly modeled. This introduces strong model dependency, reducing the simplicity of the original FDA formulation.
Stefano Ubbiali, Christian Kühnlein, Christoph Schär, Linda Schlemmer, Thomas C. Schulthess, Michael Staneker, and Heini Wernli
Geosci. Model Dev., 18, 529–546, https://doi.org/10.5194/gmd-18-529-2025, https://doi.org/10.5194/gmd-18-529-2025, 2025
Short summary
Short summary
We explore a high-level programming model for porting numerical weather prediction (NWP) model codes to graphics processing units (GPUs). We present a Python rewrite with the domain-specific library GT4Py (GridTools for Python) of two renowned cloud microphysics schemes and the associated tangent-linear and adjoint algorithms. We find excellent portability, competitive GPU performance, robust execution on diverse computing architectures, and enhanced code maintainability and user productivity.
Pieter Rijsdijk, Henk Eskes, Arlene Dingemans, K. Folkert Boersma, Takashi Sekiya, Kazuyuki Miyazaki, and Sander Houweling
Geosci. Model Dev., 18, 483–509, https://doi.org/10.5194/gmd-18-483-2025, https://doi.org/10.5194/gmd-18-483-2025, 2025
Short summary
Short summary
Clustering high-resolution satellite observations into superobservations improves model validation and data assimilation applications. In our paper, we derive quantitative uncertainties for satellite NO2 column observations based on knowledge of the retrievals, including a detailed analysis of spatial error correlations and representativity errors. The superobservations and uncertainty estimates are tested in a global chemical data assimilation system and are found to improve the forecasts.
Dario Di Santo, Cenlin He, Fei Chen, and Lorenzo Giovannini
Geosci. Model Dev., 18, 433–459, https://doi.org/10.5194/gmd-18-433-2025, https://doi.org/10.5194/gmd-18-433-2025, 2025
Short summary
Short summary
This paper presents the Machine Learning-based Automated Multi-method Parameter Sensitivity and Importance analysis Tool (ML-AMPSIT), a computationally efficient tool that uses machine learning algorithms for sensitivity analysis in atmospheric models. It is tested with the Weather Research and Forecasting (WRF) model coupled with the Noah-Multiparameterization (Noah-MP) land surface model to investigate sea breeze circulation sensitivity to vegetation-related parameters.
Robert Schoetter, Robin James Hogan, Cyril Caliot, and Valéry Masson
Geosci. Model Dev., 18, 405–431, https://doi.org/10.5194/gmd-18-405-2025, https://doi.org/10.5194/gmd-18-405-2025, 2025
Short summary
Short summary
Radiation is relevant to the atmospheric impact on people and infrastructure in cities as it can influence the urban heat island, building energy consumption, and human thermal comfort. A new urban radiation model, assuming a more realistic form of urban morphology, is coupled to the urban climate model Town Energy Balance (TEB). The new TEB is evaluated with a reference radiation model for a variety of urban morphologies, and an improvement in the simulated radiative observables is found.
Zebediah Engberg, Roger Teoh, Tristan Abbott, Thomas Dean, Marc E. J. Stettler, and Marc L. Shapiro
Geosci. Model Dev., 18, 253–286, https://doi.org/10.5194/gmd-18-253-2025, https://doi.org/10.5194/gmd-18-253-2025, 2025
Short summary
Short summary
Contrails forming in some atmospheric conditions may persist and become strongly warming cirrus, while in other conditions may be neutral or cooling. We develop a contrail forecast model to predict contrail climate forcing for any arbitrary point in space and time and explore integration into flight planning and air traffic management. This approach enables contrail interventions to target high-probability high-climate-impact regions and reduce unintended consequences of contrail management.
Nils Eingrüber, Alina Domm, Wolfgang Korres, and Karl Schneider
Geosci. Model Dev., 18, 141–160, https://doi.org/10.5194/gmd-18-141-2025, https://doi.org/10.5194/gmd-18-141-2025, 2025
Short summary
Short summary
Climate change adaptation measures like unsealings can reduce urban heat stress. As grass grid pavers have never been parameterized for microclimate model simulations with ENVI-met, a new parameterization was developed based on field measurements. To analyse the cooling potential, scenario analyses were performed for a densely developed area in Cologne. Statistically significant average cooling effects of up to −11.1 K were found for surface temperature and up to −2.9 K for 1 m air temperature.
Xuan Wang, Lei Bi, Hong Wang, Yaqiang Wang, Wei Han, Xueshun Shen, and Xiaoye Zhang
Geosci. Model Dev., 18, 117–139, https://doi.org/10.5194/gmd-18-117-2025, https://doi.org/10.5194/gmd-18-117-2025, 2025
Short summary
Short summary
The Artificial-Intelligence-based Nonspherical Aerosol Optical Scheme (AI-NAOS) was developed to improve the estimation of the aerosol direct radiation effect and was coupled online with a chemical weather model. The AI-NAOS scheme considers black carbon as fractal aggregates and soil dust as super-spheroids, encapsulated with hygroscopic aerosols. Real-case simulations emphasize the necessity of accurately representing nonspherical and inhomogeneous aerosols in chemical weather models.
Lukas Pfitzenmaier, Pavlos Kollias, Nils Risse, Imke Schirmacher, Bernat Puigdomenech Treserras, and Katia Lamer
Geosci. Model Dev., 18, 101–115, https://doi.org/10.5194/gmd-18-101-2025, https://doi.org/10.5194/gmd-18-101-2025, 2025
Short summary
Short summary
The Python tool Orbital-Radar transfers suborbital radar data (ground-based, airborne, and forward-simulated numerical weather prediction model) into synthetic spaceborne cloud profiling radar data, mimicking platform-specific instrument characteristics, e.g. EarthCARE or CloudSat. The tool's novelty lies in simulating characteristic errors and instrument noise. Thus, existing data sets are transferred into synthetic observations and can be used for satellite calibration–validation studies.
Mark Buehner, Jean-Francois Caron, Ervig Lapalme, Alain Caya, Ping Du, Yves Rochon, Sergey Skachko, Maziar Bani Shahabadi, Sylvain Heilliette, Martin Deshaies-Jacques, Weiguang Chang, and Michael Sitwell
Geosci. Model Dev., 18, 1–18, https://doi.org/10.5194/gmd-18-1-2025, https://doi.org/10.5194/gmd-18-1-2025, 2025
Short summary
Short summary
The Modular and Integrated Data Assimilation System (MIDAS) software is described. The flexible design of MIDAS enables both deterministic and ensemble prediction applications for the atmosphere and several other Earth system components. It is currently used for all main operational weather prediction systems in Canada and also for sea ice and sea surface temperature analysis. The use of MIDAS for multiple Earth system components will facilitate future research on coupled data assimilation.
Alexander de Meij, Cornelis Cuvelier, Philippe Thunis, and Enrico Pisoni
EGUsphere, https://doi.org/10.5194/egusphere-2024-3690, https://doi.org/10.5194/egusphere-2024-3690, 2025
Short summary
Short summary
We assess the relevance and utility indicators developed within FAIRMODE by evaluating 9 CAMS models in calculated air pollutant values. For NO2, the results highlight difficulties at traffic stations. For PM2.5 and PM10 the bias and Winter-Summer gradients reveal issues. O3 evaluation shows that e.g. seasonal gradients are useful. Overall, the indicators provide valuable insights into model limitations, yet there is a need to reconsider the strictness of some indicators for certain pollutants.
Zichen Wu, Xueshun Chen, Zifa Wang, Huansheng Chen, Zhe Wang, Qing Mu, Lin Wu, Wending Wang, Xiao Tang, Jie Li, Ying Li, Qizhong Wu, Yang Wang, Zhiyin Zou, and Zijian Jiang
Geosci. Model Dev., 17, 8885–8907, https://doi.org/10.5194/gmd-17-8885-2024, https://doi.org/10.5194/gmd-17-8885-2024, 2024
Short summary
Short summary
We developed a model to simulate polycyclic aromatic hydrocarbons (PAHs) from global to regional scales. The model can reproduce PAH distribution well. The concentration of BaP (indicator species for PAHs) could exceed the target values of 1 ng m-3 over some areas (e.g., in central Europe, India, and eastern China). The change in BaP is lower than that in PM2.5 from 2013 to 2018. China still faces significant potential health risks posed by BaP although the Action Plan has been implemented.
Marie Taufour, Jean-Pierre Pinty, Christelle Barthe, Benoît Vié, and Chien Wang
Geosci. Model Dev., 17, 8773–8798, https://doi.org/10.5194/gmd-17-8773-2024, https://doi.org/10.5194/gmd-17-8773-2024, 2024
Short summary
Short summary
We have developed a complete two-moment version of the LIMA (Liquid Ice Multiple Aerosols) microphysics scheme. We have focused on collection processes, where the hydrometeor number transfer is often estimated in proportion to the mass transfer. The impact of these parameterizations on a convective system and the prospects for more realistic estimates of secondary parameters (reflectivity, hydrometeor size) are shown in a first test on an idealized case.
Maksym Vasiuta, Angel Navarro Trastoy, Sanam Motlaghzadeh, Lauri Tuppi, Torsten Mayer-Gürr, and Heikki Järvinen
Geosci. Model Dev. Discuss., https://doi.org/10.5194/gmd-2024-136, https://doi.org/10.5194/gmd-2024-136, 2024
Revised manuscript accepted for GMD
Short summary
Short summary
Propagation of electromagnetic signals in the Earth's neutral atmosphere inflicts errors in space geodetic observations. To model these errors as accurately as possible, it is necessary to use a signal ray tracing algorithm which is informed of the state of the atmosphere. We developed such algorithm and tested it by modelling errors in GNSS network observations. Our algorithm's main advantage is loss-less utilization of atmospheric information provided by numerical weather prediction models.
Yuya Takane, Yukihiro Kikegawa, Ko Nakajima, and Hiroyuki Kusaka
Geosci. Model Dev., 17, 8639–8664, https://doi.org/10.5194/gmd-17-8639-2024, https://doi.org/10.5194/gmd-17-8639-2024, 2024
Short summary
Short summary
A new parameterisation for dynamic anthropogenic heat and electricity consumption is described. The model reproduced the temporal variation in and spatial distributions of electricity consumption and temperature well in summer and winter. The partial air conditioning was the most critical factor, significantly affecting the value of anthropogenic heat emission.
Arseniy Karagodin-Doyennel, Fredrik Jansson, Bart van Stratum, Hugo Denier van der Gon, Jordi Vilà-Guerau de Arellano, and Sander Houweling
EGUsphere, https://doi.org/10.5194/egusphere-2024-3721, https://doi.org/10.5194/egusphere-2024-3721, 2024
Short summary
Short summary
We introduce a new simulation platform based on the Dutch Large-Eddy Simulation (DALES) to simulate carbon dioxide (CO2) emissions and their dispersion in the turbulent environments with hectometer resolution. This model incorporates both anthropogenic emission inventory and ecosystem exchanges. Simulation results for the main urban area in the Netherlands demonstrate a strong potential of DALES to enhance CO2 emission modeling, which is important for refining their reduction strategies.
Hongyi Li, Ting Yang, Lars Nerger, Dawei Zhang, Di Zhang, Guigang Tang, Haibo Wang, Yele Sun, Pingqing Fu, Hang Su, and Zifa Wang
Geosci. Model Dev., 17, 8495–8519, https://doi.org/10.5194/gmd-17-8495-2024, https://doi.org/10.5194/gmd-17-8495-2024, 2024
Short summary
Short summary
To accurately characterize the spatiotemporal distribution of particulate matter <2.5 µm chemical components, we developed the Nested Air Quality Prediction Model System with the Parallel Data Assimilation Framework (NAQPMS-PDAF) v2.0 for chemical components with non-Gaussian and nonlinear properties. NAQPMS-PDAF v2.0 has better computing efficiency, excels when used with a small ensemble size, and can significantly improve the simulation performance of chemical components.
T. Nash Skipper, Christian Hogrefe, Barron H. Henderson, Rohit Mathur, Kristen M. Foley, and Armistead G. Russell
Geosci. Model Dev., 17, 8373–8397, https://doi.org/10.5194/gmd-17-8373-2024, https://doi.org/10.5194/gmd-17-8373-2024, 2024
Short summary
Short summary
Chemical transport model simulations are combined with ozone observations to estimate the bias in ozone attributable to US anthropogenic sources and individual sources of US background ozone: natural sources, non-US anthropogenic sources, and stratospheric ozone. Results indicate a positive bias correlated with US anthropogenic emissions during summer in the eastern US and a negative bias correlated with stratospheric ozone during spring.
Li Fang, Jianbing Jin, Arjo Segers, Ke Li, Ji Xia, Wei Han, Baojie Li, Hai Xiang Lin, Lei Zhu, Song Liu, and Hong Liao
Geosci. Model Dev., 17, 8267–8282, https://doi.org/10.5194/gmd-17-8267-2024, https://doi.org/10.5194/gmd-17-8267-2024, 2024
Short summary
Short summary
Model evaluations against ground observations are usually unfair. The former simulates mean status over coarse grids and the latter the surrounding atmosphere. To solve this, we proposed the new land-use-based representative (LUBR) operator that considers intra-grid variance. The LUBR operator is validated to provide insights that align with satellite measurements. The results highlight the importance of considering fine-scale urban–rural differences when comparing models and observation.
Mijie Pang, Jianbing Jin, Arjo Segers, Huiya Jiang, Wei Han, Batjargal Buyantogtokh, Ji Xia, Li Fang, Jiandong Li, Hai Xiang Lin, and Hong Liao
Geosci. Model Dev., 17, 8223–8242, https://doi.org/10.5194/gmd-17-8223-2024, https://doi.org/10.5194/gmd-17-8223-2024, 2024
Short summary
Short summary
The ensemble Kalman filter (EnKF) improves dust storm forecasts but faces challenges with position errors. The valid time shifting EnKF (VTS-EnKF) addresses this by adjusting for position errors, enhancing accuracy in forecasting dust storms, as proven in tests on 2021 events, even with smaller ensembles and time intervals.
Yongzhu Liu, Xiaoye Zhang, Wei Han, Chao Wang, Wenxing Jia, Deying Wang, Zhaorong Zhuang, and Xueshun Shen
Geosci. Model Dev. Discuss., https://doi.org/10.5194/gmd-2024-148, https://doi.org/10.5194/gmd-2024-148, 2024
Revised manuscript accepted for GMD
Short summary
Short summary
In order to investigate the feedbacks of chemical data assimilation on meteorological forecasts, we developed a strongly coupled chemistry meteorology four-dimensional variational (4D-Var) assimilation system, CMA-GFS-AERO 4D-Var, based on the framework of the incremental analysis scheme of the CMA-GFS operational global numerical weather model. The results show that assimilating BC observations can generate analysis increments not only for BC but also for atmospheric variables.
Mike Bush, David L. A. Flack, Huw W. Lewis, Sylvia I. Bohnenstengel, Chris J. Short, Charmaine Franklin, Adrian P. Lock, Martin Best, Paul Field, Anne McCabe, Kwinten Van Weverberg, Segolene Berthou, Ian Boutle, Jennifer K. Brooke, Seb Cole, Shaun Cooper, Gareth Dow, John Edwards, Anke Finnenkoetter, Kalli Furtado, Kate Halladay, Kirsty Hanley, Margaret A. Hendry, Adrian Hill, Aravindakshan Jayakumar, Richard W. Jones, Humphrey Lean, Joshua C. K. Lee, Andy Malcolm, Marion Mittermaier, Saji Mohandas, Stuart Moore, Cyril Morcrette, Rachel North, Aurore Porson, Susan Rennie, Nigel Roberts, Belinda Roux, Claudio Sanchez, Chun-Hsu Su, Simon Tucker, Simon Vosper, David Walters, James Warner, Stuart Webster, Mark Weeks, Jonathan Wilkinson, Michael Whitall, Keith D. Williams, and Hugh Zhang
Geosci. Model Dev. Discuss., https://doi.org/10.5194/gmd-2024-201, https://doi.org/10.5194/gmd-2024-201, 2024
Revised manuscript accepted for GMD
Short summary
Short summary
RAL configurations define settings for the Unified Model atmosphere and Joint UK Land Environment Simulator. The third version of the Regional Atmosphere and Land (RAL3) science configuration for kilometre and sub-km scale modelling represents a major advance compared to previous versions (RAL2) by delivering a common science definition for applications in tropical and mid-latitude regions. RAL3 has more realistic precipitation distributions and improved representation of clouds and visibility.
Peter Kalverla, Imme Benedict, Chris Weijenborg, and Ruud J. van der Ent
EGUsphere, https://doi.org/10.5194/egusphere-2024-3401, https://doi.org/10.5194/egusphere-2024-3401, 2024
Short summary
Short summary
We introduce a new version of WAM2layers, a computer program that tracks how the weather brings water from one place to another. It uses data from weather and climate models, whose resolution is steadily increasing. Processing the latest data became a challenge, and the updates presented here ensure that WAM2layers runs smoothly again. We also made it easier to use the program and to understand its source code. This makes it more transparent and reliable, and easier to maintain.
Prabhakar Namdev, Maithili Sharan, Piyush Srivastava, and Saroj Kanta Mishra
Geosci. Model Dev., 17, 8093–8114, https://doi.org/10.5194/gmd-17-8093-2024, https://doi.org/10.5194/gmd-17-8093-2024, 2024
Short summary
Short summary
Inadequate representation of surface–atmosphere interaction processes is a major source of uncertainty in numerical weather prediction models. Here, an effort has been made to improve the Weather Research and Forecasting (WRF) model version 4.2.2 by introducing a unique theoretical framework under convective conditions. In addition, to enhance the potential applicability of the WRF modeling system, various commonly used similarity functions under convective conditions have also been installed.
Andrew Gettelman, Richard Forbes, Roger Marchand, Chih-Chieh Chen, and Mark Fielding
Geosci. Model Dev., 17, 8069–8092, https://doi.org/10.5194/gmd-17-8069-2024, https://doi.org/10.5194/gmd-17-8069-2024, 2024
Short summary
Short summary
Supercooled liquid clouds (liquid clouds colder than 0°C) are common at higher latitudes (especially over the Southern Ocean) and are critical for constraining climate projections. We compare a single-column version of a weather model to observations with two different cloud schemes and find that both the dynamical environment and atmospheric aerosols are important for reproducing observations.
Cited articles
Aggarwal, C. C., Hinneburg, A., and Keim, D. A.: On the surprising behavior of distance metrics in high dimensional space, in: International conference on database theory, Springer, Berlin, Heidelberg, 420–434, https://doi.org/10.1007/3-540-44503-X_27, 2001.
Ahmed, K., Sachindra, D. A., Shahid, S., Demirel, M. C., and Chung, E.-S.: Selection of multi-model ensemble of general circulation models for the simulation of precipitation and maximum and minimum temperature based on spatial assessment metrics, Hydrol. Earth Syst. Sci., 23, 4803–4824, https://doi.org/10.5194/hess-23-4803-2019, 2019.
Armstrong, J. S. and Collopy, F.: Error measures for generalizing about forecasting methods: Empirical comparisons, Int. J. Forecast., 8, 69–80, https://doi.org/10.1016/0169-2070(92)90008-W, 1992.
Baker, N. C. and Taylor, P. C.: A framework for evaluating climate model performance metrics, J. Climate, 29, 1773–1782, https://doi.org/10.1175/JCLI-D-15-0114.1, 2016.
Bell, B., Hersbach, H., Berrisford, P., Dahlgren, P., Horányi, A., Muñoz Sabater, J., Nicolas, J., Radu, R., Schepers, D., Simmons, A., Soci, C., and Thépaut, J.-N.: ERA5 monthly averaged data on pressure levels from 1950 to 1978 (preliminary version), Copernicus Climate Change Service (C3S) Climate Data Store (CDS) [data set], https://cds.climate.copernicus-climate.eu/cdsapp#!/dataset/reanalysis-era5-pressure-levels-monthly-means-preliminary-back-extension?tab=overview (last access: 16 April 2024), 2020.
Bellomo, K., Angeloni, M., Corti, S., and von Hardenberg, J.: Future climate change shaped by inter-model differences in Atlantic meridional overturning circulation response, Nat. Commun., 12, 1–10, https://doi.org/10.1038/s41467-021-24015-w, 2021.
Benestad, R. E., Mezghani, A., Lutz, J., Dobler, A., Parding, K. M., and Landgren, O. A.: Various ways of using empirical orthogonal functions for climate model evaluation, Geosci. Model Dev., 16, 2899–2913, https://doi.org/10.5194/gmd-16-2899-2023, 2023.
Boberg, F., Berg, P., Thejll, P., Gutowski, W. J., and Christensen, J. H.: Improved confidence in climate change projections of precipitation evaluated using daily statistics from the PRUDENCE ensemble, Clim. Dynam., 32, 1097–1106, https://doi.org/10.1007/s00382-008-0446-y, 2009.
Boberg, F., Berg, P., Thejll, P., Gutowski, W. J., and Christensen, J. H.: Improved confidence in climate change projections of precipitation further evaluated using daily statistics from ENSEMBLES models, Clim. Dynam., 35, 1509–1520, https://doi.org/10.1007/s00382-009-0683-8, 2010.
Chai, T. and Draxler, R. R.: Root mean square error (RMSE) or mean absolute error (MAE)? – Arguments against avoiding RMSE in the literature, Geosci. Model Dev., 7, 1247–1250, https://doi.org/10.5194/gmd-7-1247-2014, 2014.
Christensen, J. H. and Christensen, O. B.: A summary of the PRUDENCE model projections of changes in European climate by the end of this century, Climatic Change, 81, 7–30, https://doi.org/10.1007/s10584-006-9210-7, 2007.
Collier, N., Hoffman, F. M., Lawrence, D. M., Keppel-Aleks, G., Koven, C. D., Riley, W. J., and Randerson, J. T.: The International Land Model Benchmarking (ILAMB) system: design, theory, and implementation, J. Adv. Model. Earth Sy., 10, 2731–2754, https://doi.org/10.1029/2018MS001354, 2018.
Dembélé, M., Hrachowitz, M., Savenije, H. H., Mariéthoz, G., and Schaefli, B.: Improving the predictive skill of a distributed hydrological model by calibration on spatial patterns with multiple satellite data sets, Water Resour. Res., 56, e2019WR026085, https://doi.org/10.1029/2019WR026085, 2020.
Demirel, M. C., Mai, J., Mendiguren, G., Koch, J., Samaniego, L., and Stisen, S.: Combining satellite data and appropriate objective functions for improved spatial pattern performance of a distributed hydrologic model, Hydrol. Earth Syst. Sci., 22, 1299–1315, https://doi.org/10.5194/hess-22-1299-2018, 2018.
Flato, G., Marotzke, J., Abiodun, B., Braconnot, P., Chou, S. C., Collins, W., Cox, P., Driouech, F., Emori, S., Eyring, V., Forest, C., Gleckler, P., Guilyardi, E., Jakob, C., Kattsov, V., Reason, C., and Rummukainen, M.: Evaluation of climate models, in: Climate Change 2013: the physical science basis. Contribution of Working Group I to the Fifth Assessment Report of the Intergovernmental Panel on Climate Change, edited by: Stocker, T. F., Qin, D., Plattner, G.-K., Tignor, M., Allen, S. K., Boschung, J., Nauels, A., Xia, Y., Bex, V., and Midgley, P. M., Cambridge University Press, Cambridge, United Kingdom and New York, NY, USA, 741–866, https://www.ipcc.ch/site/assets/uploads/2018/02/WG1AR5_Chapter09_FINAL.pdf (last access: 16 April 2024), 2013.
Giot, O., Termonia, P., Degrauwe, D., De Troch, R., Caluwaerts, S., Smet, G., Berckmans, J., Deckmyn, A., De Cruz, L., De Meutter, P., Duerinckx, A., Gerard, L., Hamdi, R., Van den Bergh, J., Van Ginderachter, M., and Van Schaeybroeck, B.: Validation of the ALARO-0 model within the EURO-CORDEX framework, Geosci. Model Dev., 9, 1143–1152, https://doi.org/10.5194/gmd-9-1143-2016, 2016.
Gupta, H. V., Kling, H., Yilmaz, K. K., and Martinez, G. F.: Decomposition of the mean squared error and NSE performance criteria: Implications for improving hydrological modelling, J. Hydrol., 377, 80–91, https://doi.org/10.1016/j.jhydrol.2009.08.003, 2009.
He, X., Lei, X. D., and Dong, L. H.: How large is the difference in large-scale forest biomass estimations based on new climate-modified stand biomass models?, Ecol. Indic., 126, 107569, https://doi.org/10.1016/j.ecolind.2021.107569, 2021.
Hu, Z., Chen, X., Zhou, Q., Chen, D., and Li, J.: DISO: A rethink of Taylor diagram, Int. J. Climatol., 39, 2825–2832, https://doi.org/10.1002/joc.5972, 2019.
Hyndman, R. J. and Koehler, A. B.: Another look at measures of forecast accuracy, Int. J. Forecast., 22, 679–688, https://doi.org/10.1016/j.ijforecast.2006.03.001, 2006.
IPCC: Climate Change 2021: The Physical Science Basis. Contribution of Working Group I to the Sixth Assessment Report of the Intergovernmental Panel on Climate Change, edited by: Masson-Delmotte, V., Zhai, P., Pirani, A., Connors, S. L., Péan, C., Berger, S., Caud, N., Chen, Y., Goldfarb, L., Gomis, M. I., Huang, M., Leitzell, K., Lonnoy, E., Matthews, J. B. R., Maycock, T. K., Waterfield, T., Yelekçi, O., Yu, R., and Zhou, B., Cambridge University Press, https://report.ipcc.ch/ar6/wg1/IPCC_AR6_WGI_FullReport.pdf (last access: 16 April 2024), 2021a.
IPCC: Summary for Policymakers, in: Climate Change 2021: The Physical Science Basis. Contribution of Working Group I to the Sixth Assessment Report of the Intergovernmental Panel on Climate Change, edited by: Masson-Delmotte, V., Zhai, P., Pirani, A., Connors, S. L., Péan, C., Berger, S., Caud, N., Chen, Y., Goldfarb, L., Gomis, M. I., Huang, M., Leitzell, K., Lonnoy, E., Matthews, J. B. R., Maycock, T. K., Waterfield, T., Yelekçi, O., Yu, R., and Zhou, B., Cambridge University Press, https://www.ipcc.ch/report/ar6/wg1/downloads/report/IPCC_AR6_WGI_SPM.pdf (last access: 16 April 2024), 2021b.
Jackson, E. K., Roberts, W., Nelsen, B., Williams, G. P., Nelson, E. J., and Ames, D. P.: Introductory overview: Error metrics for hydrologic modelling – A review of common practices and an open source library to facilitate use and adoption, Environ. Modell. Softw., 119, 32–48, https://doi.org/10.1016/j.envsoft.2019.05.001, 2019.
Kalmár, T., Pieczka, I., and Pongrácz, R.: A sensitivity analysis of the different setups of the RegCM4.5 model for the Carpathian region, Int. J. Climatol., 41, E1180–E1201, https://doi.org/10.1002/joc.6761, 2021.
Kling, H., Fuchs, M., and Paulin, M.: Runoff conditions in the upper Danube basin under an ensemble of climate change scenarios, J. Hydrol., 424, 264–277, https://doi.org/10.1016/j.jhydrol.2012.01.011, 2012.
Kotlarski, S., Keuler, K., Christensen, O. B., Colette, A., Déqué, M., Gobiet, A., Goergen, K., Jacob, D., Lüthi, D., van Meijgaard, E., Nikulin, G., Schär, C., Teichmann, C., Vautard, R., Warrach-Sagi, K., and Wulfmeyer, V.: Regional climate modeling on European scales: a joint standard evaluation of the EURO-CORDEX RCM ensemble, Geosci. Model Dev., 7, 1297–1333, https://doi.org/10.5194/gmd-7-1297-2014, 2014.
Liemohn, M. W., Shane, A. D., Azari, A. R., Petersen, A. K., Swiger, B. M., and Mukhopadhyay, A.: RMSE is not enough: Guidelines to robust data-model comparisons for magnetospheric physics, J. Atmos. Sol.-Terr. Phys., 218, 105624, https://doi.org/10.1016/j.jastp.2021.105624, 2021.
Masanganise, J., Magodora, M., Mapuwei, T., and Basira, K.: An assessment of CMIP5 global climate model performance using probability density functions and a match metric method, Science Insights: An International Journal, 4, 1–8, 2014.
Mirkes, E. M., Allohibi, J., and Gorban, A.: Fractional norms and quasinorms do not help to overcome the curse of dimensionality, Entropy, 22, 1105, https://doi.org/10.48550/arXiv.2004.14230, 2020.
Mooney, P. A., Rechid, D., Davin, E. L., Katragkou, E., de Noblet-Ducoudré, N., Breil, M., Cardoso, R. M., Daloz, A. S., Hoffmann, P., Lima, D. C. A., Meier, R., Soares, P. M. M., Sofiadis, G., Strada, S., Strandberg, G., Toelle, M. H., and Lund, M. T.: Land–atmosphere interactions in sub-polar and alpine climates in the CORDEX Flagship Pilot Study Land Use and Climate Across Scales (LUCAS) models – Part 2: The role of changing vegetation, The Cryosphere, 16, 1383–1397, https://doi.org/10.5194/tc-16-1383-2022, 2022.
Murphy, A. H.: Skill scores based on the mean square error and their relationships to the correlation coefficient, Mon. Weather Rev., 116, 2417–2424, https://doi.org/10.1175/1520-0493(1988)116<2417:SSBOTM>2.0.CO;2, 1988.
Nash, J. E. and Sutcliffe, J. V.: River flow forecasting through conceptual models part I – A discussion of principles, J. Hydrol., 10, 282–290, https://doi.org/10.1016/0022-1694(70)90255-6, 1970.
Pachepsky, Y. A., Martinez, G., Pan, F., Wagener, T., and Nicholson, T.: Evaluating Hydrological Model Performance using Information Theory-based Metrics, Hydrol. Earth Syst. Sci. Discuss. [preprint], https://doi.org/10.5194/hess-2016-46, 2016.
Perkins, S. E., Pitman, A. J., Holbrook, N. J., and McAneney, J.: Evaluation of the AR4 Climate Models' Simulated Daily Maximum Temperature, Minimum Temperature, and Precipitation over Australia Using Probability Density Functions, J. Climate, 20, 4356–4376, https://doi.org/10.1175/JCLI4253.1, 2007.
Pitman, J.: Exchangeable and partially exchangeable random partitions, Probab. Theory Rel., 102, 145–158, https://doi.org/10.1007/BF01213386, 1995.
Randall, D. A., Wood, R. A., Bony, S., Colman, R., Fichefet, T., Fyfe, J., Kattsov, V., Pitman, A., Shukla, J., Srinivasan, J., Stouffer, R. J., Sumi, A., and Taylor, K. E.: Climate models and their evaluation, in: Climate Change 2007: The physical science basis, Contribution of Working Group I to the Fourth Assessment Report of the IPCC (FAR), Cambridge University Press, 589–662, 60, https://archive.ipcc.ch/publications_and_data/ar4/wg1/en/ch8.html (last access: 16 April 2024), 2007.
Reich, N. G., Lauer, S. A., Sakrejda, K., Iamsirithaworn, S., Hinjoy, S., Suangtho, P., Suthachana, S., Clapham, H. E., Salje, H., Cummings, D. A., and Lessler, J.: Challenges in real-time prediction of infectious disease: a case study of dengue in Thailand, PLoS Neglect. Trop. D., 10, e0004761, https://doi.org/10.1371/journal.pntd.0010883, 2016.
Richter, J. H., Butchart, N., Kawatani, Y., Bushell, A. C., Holt, L., Serva, F., Anstey, J., Simpson, I. R., Osprey, S., Hamilton, K., Braesicke, P., Cagnazzo, C., Chen C. C., Garcia, R. R., Gray, L. J., Kerzenmacher, T., Lott, F., McLandress, C., Naoe, H., Scinocca, J., Stockdale, T. N., Versick, S., Watanabe, S., Yoshida, K., and Yukimoto, S.: Response of the quasi-biennial oscillation to a warming climate in global climate models, Q. J. Roy. Meteor. Soc., 148, 1490–1518, https://doi.org/10.1002/qj.3749, 2022.
Roberts, N. M. and Lean, H. W.: Scale-Selective Verification of Rainfall Accumulations from High-Resolution Forecasts of Convective Events, Mon. Weather Rev., 136, 78–97, https://doi.org/10.1175/2007MWR2123.1, 2008.
Rupp, D. E., Abatzoglou, J. T., Hegewisch, K. C., and Mote, P. W.: Evaluation of CMIP5 20th century climate simulations for the Pacific Northwest USA, J. Geophys. Res.-Atmos., 118, 10884, https://doi.org/10.1002/jgrd.50843, 2013.
Samantaray, A.: Bergen Metric, Zenodo [code], https://doi.org/10.5281/zenodo.10518064, 2024.
Smiatek, G., Kunstmann, H., and Senatore A.: EURO-CORDEX regional climate model analysis for the Greater Alpine Region: Performance and expected future change, J. Geophys. Res.-Atmos., 121, 7710–7728, https://doi.org/10.1002/2015JD024727, 2016.
Taylor, K. E.: Summarizing multiple aspects of model performance in a single diagram, J. Geophys. Res.-Atmos., 106, 7183–7192, https://doi.org/10.1029/2000JD900719, 2001.
Torma, C. Z.: Detailed validation of EURO-CORDEX and Med-CORDEX regional climate model ensembles over the Carpathian Region, Időjárás/Quarterly Journal Of The Hungarian Meteorological Service, 123, 217–240, https://doi.org/10.28974/idojaras.2019.2.6, 2019.
van Noije, T., Bergman, T., Le Sager, P., O'Donnell, D., Makkonen, R., Gonçalves-Ageitos, M., Döscher, R., Fladrich, U., von Hardenberg, J., Keskinen, J.-P., Korhonen, H., Laakso, A., Myriokefalitakis, S., Ollinaho, P., Pérez García-Pando, C., Reerink, T., Schrödner, R., Wyser, K., and Yang, S.: EC-Earth3-AerChem: a global climate model with interactive aerosols and atmospheric chemistry participating in CMIP6, Geosci. Model Dev., 14, 5637–5668, https://doi.org/10.5194/gmd-14-5637-2021, 2021.
Vautard, R., Kadygrov, N., Iles, C., Boberg, F., Buonomo, E., Bülow, K., Coppola, E., Corre, L., van Meijgaard, E., Nogherotto, R., and Sandstad, M.: Evaluation of the large EURO-CORDEX regional climate model ensemble, J. Geophys. Res.-Atmos., 126, e2019JD032344, https://doi.org/10.1029/2019JD032344, 2021.
Wang, Z. and Bovik, A. C.: A universal image quality index, IEEE Signal Proc. Let., 9, 81–84, https://doi.org/10.1109/97.995823, 2002.
Watt-Meyer, O., Brenowitz, N. D., Clark, S. K., Henn, B., Kwa, A., McGibbon, J., Perkins, W. A., and Bretherton, C. S.: Correcting weather and climate models by machine learning nudged historical simulations, Geophys. Res. Lett., 48, e2021GL092555, https://doi.org/10.1029/2021GL092555, 2021.
Weber, R., Schek, H. J., and Blott, S.: A quantitative analysis and performance study for similarity-search methods in highdimensional spaces, in: VLDB, 98, 194–205, https://vldb.org/conf/1998/p194.pdf (last access: 16 April 2024), 1998.
Wȩglarczyk, S.: The interdependence and applicability of some statistical quality measures for hydrological models, J. Hydrol., 206, 98–103, https://doi.org/10.1016/S0022-1694(98)00094-8, 1998.
Wehner, M., Lee, J., Risser, M., Ullrich, P., Gleckler, P., and Collins, W. D.: Evaluation of extreme sub-daily precipitation in high-resolution global climate model simulations, Philos. T. Roy. Soc. A, 379, 20190545, https://doi.org/10.1098/rsta.2019.0545, 2021.
Willmott, C. J. and Matsuura, K.: Advantages of the mean absolute error (MAE) over the root mean square error (RMSE) in assessing average model performance, Clim. Res., 30, 79–82, 2005.
Wood, R. R., Lehner, F., Pendergrass, A. G., and Schlunegger, S.: Changes in precipitation variability across time scales in multiple global climate model large ensembles, Environ. Res. Lett., 16, 084022, https://doi.org/10.1088/1748-9326/ac10dd, 2021.
Yang, J., Ren, J., Sun, D., Xiao, X., Xia, J. C., Jin, C., and Li, X.: Understanding land surface temperature impact factors based on local climate zones, Sustain. Cities Soc., 69, 102818, https://doi.org/10.1016/j.scs.2021.102818, 2021.
Short summary
Any interpretation of climate model data requires a comprehensive evaluation of the model performance. Numerous error metrics exist for this purpose, and each focuses on a specific aspect of the relationship between reference and model data. Thus, a comprehensive evaluation demands the use of multiple error metrics. However, this can lead to confusion. We propose a clustering technique to reduce the number of error metrics needed and a composite error metric to simplify the interpretation.
Any interpretation of climate model data requires a comprehensive evaluation of the model...
