Articles | Volume 17, issue 8
https://doi.org/10.5194/gmd-17-3321-2024
© Author(s) 2024. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
https://doi.org/10.5194/gmd-17-3321-2024
© Author(s) 2024. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
Methods for assessment of models
| 
29 Apr 2024
Methods for assessment of models |
| 29 Apr 2024
| 29 Apr 2024
Bergen metrics: composite error metrics for assessing performance of climate models using EURO-CORDEX simulations
NORCE Norwegian Research Centre, Bjerknes Centre for Climate Research, Bergen, Norway
Priscilla A. Mooney
NORCE Norwegian Research Centre, Bjerknes Centre for Climate Research, Bergen, Norway
Carla A. Vivacqua
Department of Statistics, Universidade Federal do Rio Grande do Norte, Natal, Brazil
Related authors
No articles found.
Xavier Levine, Ryan Williams, Gareth Marshall, Andrew Orr, Lise Seland Graff, Dörthe Handorf, Alexey Karpechko, Raphael Köhler, René Wijngaard, Nadine Johnston, Hanna Lee, Lars Nieradzik, and Priscilla Mooney
EGUsphere, https://doi.org/10.5194/egusphere-2023-2741, https://doi.org/10.5194/egusphere-2023-2741, 2023
Short summary
Short summary
While the most recent climate projections agree that the Arctic is warming, there remains differences in how much and in other climate variables such as precipitation. This presents a challenge for stakeholders who need to develop mitigation and adaptation strategies. We tackle this problem by using the storyline approach to generate four plausible and actionable realisations of end-of-century climate change for the Arctic, spanning its most likely range of variability.
Anne Sophie Daloz, Clemens Schwingshackl, Priscilla Mooney, Susanna Strada, Diana Rechid, Edouard L. Davin, Eleni Katragkou, Nathalie de Noblet-Ducoudré, Michal Belda, Tomas Halenka, Marcus Breil, Rita M. Cardoso, Peter Hoffmann, Daniela C. A. Lima, Ronny Meier, Pedro M. M. Soares, Giannis Sofiadis, Gustav Strandberg, Merja H. Toelle, and Marianne T. Lund
The Cryosphere, 16, 2403–2419, https://doi.org/10.5194/tc-16-2403-2022, https://doi.org/10.5194/tc-16-2403-2022, 2022
Short summary
Short summary
Snow plays a major role in the regulation of the Earth's surface temperature. Together with climate change, rising temperatures are already altering snow in many ways. In this context, it is crucial to better understand the ability of climate models to represent snow and snow processes. This work focuses on Europe and shows that the melting season in spring still represents a challenge for climate models and that more work is needed to accurately simulate snow–atmosphere interactions.
Priscilla A. Mooney, Diana Rechid, Edouard L. Davin, Eleni Katragkou, Natalie de Noblet-Ducoudré, Marcus Breil, Rita M. Cardoso, Anne Sophie Daloz, Peter Hoffmann, Daniela C. A. Lima, Ronny Meier, Pedro M. M. Soares, Giannis Sofiadis, Susanna Strada, Gustav Strandberg, Merja H. Toelle, and Marianne T. Lund
The Cryosphere, 16, 1383–1397, https://doi.org/10.5194/tc-16-1383-2022, https://doi.org/10.5194/tc-16-1383-2022, 2022
Short summary
Short summary
We use multiple regional climate models to show that afforestation in sub-polar and alpine regions reduces the radiative impact of snow albedo on the atmosphere, reduces snow cover, and delays the start of the snowmelt season. This is important for local communities that are highly reliant on snowpack for water resources and winter tourism. However, models disagree on the amount of change particularly when snow is melting. This shows that more research is needed on snow–vegetation interactions.
Hannah Ming Siu Vickers, Priscilla Mooney, Eirik Malnes, and Hanna Lee
The Cryosphere Discuss., https://doi.org/10.5194/tc-2022-57, https://doi.org/10.5194/tc-2022-57, 2022
Manuscript not accepted for further review
Short summary
Short summary
Rain-on-snow (ROS) events are becoming more frequent as a result of a warming climate, and can have significant impacts on nature and society. Accurate representation of ROS events is need to identify where impacts are greatest both now and in the future. We compare rain-on-snow climatologies from a climate model, ground and satellite radar observations and show how different methods can lead to contrasting conclusions and interpretation of the results should take into account their limitations.
Giannis Sofiadis, Eleni Katragkou, Edouard L. Davin, Diana Rechid, Nathalie de Noblet-Ducoudre, Marcus Breil, Rita M. Cardoso, Peter Hoffmann, Lisa Jach, Ronny Meier, Priscilla A. Mooney, Pedro M. M. Soares, Susanna Strada, Merja H. Tölle, and Kirsten Warrach Sagi
Geosci. Model Dev., 15, 595–616, https://doi.org/10.5194/gmd-15-595-2022, https://doi.org/10.5194/gmd-15-595-2022, 2022
Short summary
Short summary
Afforestation is currently promoted as a greenhouse gas mitigation strategy. In our study, we examine the differences in soil temperature and moisture between grounds covered either by forests or grass. The main conclusion emerged is that forest-covered grounds are cooler but drier than open lands in summer. Therefore, afforestation disrupts the seasonal cycle of soil temperature, which in turn could trigger changes in crucial chemical processes such as soil carbon sequestration.
Shunya Koseki, Priscilla A. Mooney, William Cabos, Miguel Ángel Gaertner, Alba de la Vara, and Juan Jesus González-Alemán
Nat. Hazards Earth Syst. Sci., 21, 53–71, https://doi.org/10.5194/nhess-21-53-2021, https://doi.org/10.5194/nhess-21-53-2021, 2021
Short summary
Short summary
This study investigated one case of a tropical-like cyclone over the Mediterranean Sea under present and future climate conditions with a regional climate model. A pseudo global warming (PGW) technique is employed to simulate the cyclone under future climate, and our simulation showed that the cyclone is moderately strengthened by warmer climate. Other PGW simulations where only ocean and atmosphere are warmed reveal the interesting results that both have counteracting effects on the cyclone.
Shunya Koseki and Priscilla A. Mooney
Hydrol. Earth Syst. Sci., 23, 2795–2812, https://doi.org/10.5194/hess-23-2795-2019, https://doi.org/10.5194/hess-23-2795-2019, 2019
Short summary
Short summary
This study revealed that Lake Malawi plays an important role for local precipitation in terms of spatial distribution and diurnal cycle in boreal summer (November to March). The diurnal cycle is detected by harmonics analysis and empirical orthogonal function analysis. An idealized simulation of WRF without Lake Malawi clearly showed that Lake Malawi is a source of local precipitation.
Related subject area
Atmospheric sciences
Can TROPOMI NO2 satellite data be used to track the drop in and resurgence of NOx emissions in Germany between 2019–2021 using the multi-source plume method (MSPM)?
A spatiotemporally separated framework for reconstructing the sources of atmospheric radionuclide releases
A parameterization scheme for the floating wind farm in a coupled atmosphere–wave model (COAWST v3.7)
RoadSurf 1.1: open-source road weather model library
Calibrating and validating the Integrated Valuation of Ecosystem Services and Tradeoffs (InVEST) urban cooling model: case studies in France and the United States
The ddeq Python library for point source quantification from remote sensing images (version 1.0)
Incorporating Oxygen Isotopes of Oxidized Reactive Nitrogen in the Regional Atmospheric Chemistry Mechanism, version 2 (ICOIN-RACM2)
A general comprehensive evaluation method for cross-scale precipitation forecasts
Implementation of a Simple Actuator Disk for Large-Eddy Simulation in the Weather Research and Forecasting Model (WRF-SADLES v1.2) for wind turbine wake simulation
WRF-PDAF v1.0: implementation and application of an online localized ensemble data assimilation framework
Implementation and evaluation of diabatic advection in the Lagrangian transport model MPTRAC 2.6
An improved and extended parameterization of the CO2 15 µm cooling in the middle and upper atmosphere (CO2_cool_fort-1.0)
Development of a multiphase chemical mechanism to improve secondary organic aerosol formation in CAABA/MECCA (version 4.7.0)
Application of regional meteorology and air quality models based on the microprocessor without interlocked piped stages (MIPS) and LoongArch CPU platforms
Investigating ground-level ozone pollution in semi-arid and arid regions of Arizona using WRF-Chem v4.4 modeling
An objective identification technique for potential vorticity structures associated with African easterly waves
Importance of microphysical settings for climate forcing by stratospheric SO2 injections as modeled by SOCOL-AERv2
Assessment of surface ozone products from downscaled CAMS reanalysis and CAMS daily forecast using urban air quality monitoring stations in Iran
Open boundary conditions for atmospheric large-eddy simulations and their implementation in DALES4.4
Efficient and stable coupling of the SuperdropNet deep-learning-based cloud microphysics (v0.1.0) with the ICON climate and weather model (v2.6.5)
Three-dimensional variational assimilation with a multivariate background error covariance for the Model for Prediction Across Scales – Atmosphere with the Joint Effort for Data assimilation Integration (JEDI-MPAS 2.0.0-beta)
FUME 2.0 – Flexible Universal processor for Modeling Emissions
DEUCE v1.0: a neural network for probabilistic precipitation nowcasting with aleatoric and epistemic uncertainties
Evaluation of multi-season convection-permitting atmosphere – mixed-layer ocean simulations of the Maritime Continent
Investigating the impact of coupling HARMONIE-WINS50 (cy43) meteorology to LOTOS-EUROS (v2.2.002) on a simulation of NO2 concentrations over the Netherlands
Balloon drift estimation and improved position estimates for radiosondes
Emission ensemble approach to improve the development of multi-scale emission inventories
What is the relative impact of nudging and online coupling on meteorological variables, pollutant concentrations and aerosol optical properties?
Diagnosing drivers of PM2.5 simulation biases in China from meteorology, chemical composition, and emission sources using an efficient machine learning method
Validation and analysis of the Polair3D v1.11 chemical transport model over Quebec
Assimilation of GNSS tropospheric gradients into the Weather Research and Forecasting (WRF) model version 4.4.1
Identifying atmospheric rivers and their poleward latent heat transport with generalizable neural networks: ARCNNv1
Assessing acetone for the GISS ModelE2.1 Earth system model
A dynamic approach to three-dimensional radiative transfer in subkilometer-scale numerical weather prediction models: the dynamic TenStream solver v1.0
Evaluation and development of surface layer scheme representation of temperature inversions over boreal forests in Arctic wintertime conditions
Modelling wind farm effects in HARMONIE–AROME (cycle 43.2.2) – Part 1: Implementation and evaluation
Analytical and adaptable initial conditions for dry and moist baroclinic waves in the global hydrostatic model OpenIFS (CY43R3)
Challenges of constructing and selecting the “perfect” boundary conditions for the large-eddy simulation model PALM
A machine learning approach for evaluating Southern Ocean cloud radiative biases in a global atmosphere model
Decision Support System version 1.0 (DSS v1.0) for air quality management in Delhi, India
How non-equilibrium aerosol chemistry impacts particle acidity: the GMXe AERosol CHEMistry (GMXe–AERCHEM, v1.0) sub-submodel of MESSy
A grid model for vertical correction of precipitable water vapor over the Chinese mainland and surrounding areas using random forest
MEXPLORER 1.0.0 – a mechanism explorer for analysis and visualization of chemical reaction pathways based on graph theory
Evaluating CHASER V4.0 global formaldehyde (HCHO) simulations using satellite, aircraft, and ground-based remote sensing observations
Advances and prospects of deep learning for medium-range extreme weather forecasting
An overview of the Western United States Dynamically Downscaled Dataset (WUS-D3)
cloudbandPy 1.0: an automated algorithm for the detection of tropical–extratropical cloud bands
PyRTlib: an educational Python-based library for non-scattering atmospheric microwave radiative transfer computations
TAMS: A Tracking, Classifying, and Variable-Assigning Algorithm for Mesoscale Convective Systems in Simulated and Satellite-Derived Datasets
Deep learning applied to CO2 power plant emissions quantification using simulated satellite images
Enrico Dammers, Janot Tokaya, Christian Mielke, Kevin Hausmann, Debora Griffin, Chris McLinden, Henk Eskes, and Renske Timmermans
Geosci. Model Dev., 17, 4983–5007, https://doi.org/10.5194/gmd-17-4983-2024, https://doi.org/10.5194/gmd-17-4983-2024, 2024
Short summary
Short summary
Nitrogen dioxide (NOx) is produced by sources such as industry and traffic and is directly linked to negative impacts on health and the environment. The current construction of emission inventories to keep track of NOx emissions is slow and time-consuming. Satellite measurements provide a way to quickly and independently estimate emissions. In this study, we apply a consistent methodology to derive NOx emissions over Germany and illustrate the value of having such a method for fast projections.
Yuhan Xu, Sheng Fang, Xinwen Dong, and Shuhan Zhuang
Geosci. Model Dev., 17, 4961–4982, https://doi.org/10.5194/gmd-17-4961-2024, https://doi.org/10.5194/gmd-17-4961-2024, 2024
Short summary
Short summary
Recent atmospheric radionuclide leakages from unknown sources have posed a new challenge in nuclear emergency assessment. Reconstruction via environmental observations is the only feasible way to identify sources, but simultaneous reconstruction of the source location and release rate yields high uncertainties. We propose a spatiotemporally separated reconstruction strategy that avoids these uncertainties and outperforms state-of-the-art methods with respect to accuracy and uncertainty ranges.
Shaokun Deng, Shengmu Yang, Shengli Chen, Daoyi Chen, Xuefeng Yang, and Shanshan Cui
Geosci. Model Dev., 17, 4891–4909, https://doi.org/10.5194/gmd-17-4891-2024, https://doi.org/10.5194/gmd-17-4891-2024, 2024
Short summary
Short summary
Global offshore wind power development is moving from offshore to deeper waters, where floating offshore wind turbines have an advantage over bottom-fixed turbines. However, current wind farm parameterization schemes in mesoscale models are not applicable to floating turbines. We propose a floating wind farm parameterization scheme that accounts for the attenuation of the significant wave height by floating turbines. The results indicate that it has a significant effect on the power output.
Virve Eveliina Karsisto
Geosci. Model Dev., 17, 4837–4853, https://doi.org/10.5194/gmd-17-4837-2024, https://doi.org/10.5194/gmd-17-4837-2024, 2024
Short summary
Short summary
RoadSurf is an open-source library that contains functions from the Finnish Meteorological Institute’s road weather model. The evaluation of the library shows that it is well suited for making road surface temperature forecasts. The evaluation was done by making forecasts for about 400 road weather stations in Finland with the library. Accurate forecasts help road authorities perform salting and plowing operations at the right time and keep roads safe for drivers.
Perrine Hamel, Martí Bosch, Léa Tardieu, Aude Lemonsu, Cécile de Munck, Chris Nootenboom, Vincent Viguié, Eric Lonsdorf, James A. Douglass, and Richard P. Sharp
Geosci. Model Dev., 17, 4755–4771, https://doi.org/10.5194/gmd-17-4755-2024, https://doi.org/10.5194/gmd-17-4755-2024, 2024
Short summary
Short summary
The InVEST Urban Cooling model estimates the cooling effect of vegetation in cities. We further developed an algorithm to facilitate model calibration and evaluation. Applying the algorithm to case studies in France and in the United States, we found that nighttime air temperature estimates compare well with reference datasets. Estimated change in temperature from a land cover scenario compares well with an alternative model estimate, supporting the use of the model for urban planning decisions.
Gerrit Kuhlmann, Erik Koene, Sandro Meier, Diego Santaren, Grégoire Broquet, Frédéric Chevallier, Janne Hakkarainen, Janne Nurmela, Laia Amorós, Johanna Tamminen, and Dominik Brunner
Geosci. Model Dev., 17, 4773–4789, https://doi.org/10.5194/gmd-17-4773-2024, https://doi.org/10.5194/gmd-17-4773-2024, 2024
Short summary
Short summary
We present a Python software library for data-driven emission quantification (ddeq). It can be used to determine the emissions of hot spots (cities, power plants and industry) from remote sensing images using different methods. ddeq can be extended for new datasets and methods, providing a powerful community tool for users and developers. The application of the methods is shown using Jupyter notebooks included in the library.
Wendell W. Walters, Masayuki Takeuchi, Nga L. Ng, and Meredith G. Hastings
Geosci. Model Dev., 17, 4673–4687, https://doi.org/10.5194/gmd-17-4673-2024, https://doi.org/10.5194/gmd-17-4673-2024, 2024
Short summary
Short summary
The study introduces a novel chemical mechanism for explicitly tracking oxygen isotope transfer in oxidized reactive nitrogen and odd oxygen using the Regional Atmospheric Chemistry Mechanism, version 2. This model enhances our ability to simulate and compare oxygen isotope compositions of reactive nitrogen, revealing insights into oxidation chemistry. The approach shows promise for improving atmospheric chemistry models and tropospheric oxidation capacity predictions.
Bing Zhang, Mingjian Zeng, Anning Huang, Zhengkun Qin, Couhua Liu, Wenru Shi, Xin Li, Kefeng Zhu, Chunlei Gu, and Jialing Zhou
Geosci. Model Dev., 17, 4579–4601, https://doi.org/10.5194/gmd-17-4579-2024, https://doi.org/10.5194/gmd-17-4579-2024, 2024
Short summary
Short summary
By directly analyzing the proximity of precipitation forecasts and observations, a precipitation accuracy score (PAS) method was constructed. This method does not utilize a traditional contingency-table-based classification verification; however, it can replace the threat score (TS), equitable threat score (ETS), and other skill score methods, and it can be used to calculate the accuracy of numerical models or quantitative precipitation forecasts.
Hai Bui, Mostafa Bakhoday-Paskyabi, and Mohammadreza Mohammadpour-Penchah
Geosci. Model Dev., 17, 4447–4465, https://doi.org/10.5194/gmd-17-4447-2024, https://doi.org/10.5194/gmd-17-4447-2024, 2024
Short summary
Short summary
We developed a new wind turbine wake model, the Simple Actuator Disc for Large Eddy Simulation (SADLES), integrated with the widely used Weather Research and Forecasting (WRF) model. WRF-SADLES accurately simulates wind turbine wakes at resolutions of a few dozen meters, aligning well with idealized simulations and observational measurements. This makes WRF-SADLES a promising tool for wind energy research, offering a balance between accuracy, computational efficiency, and ease of implementation.
Changliang Shao and Lars Nerger
Geosci. Model Dev., 17, 4433–4445, https://doi.org/10.5194/gmd-17-4433-2024, https://doi.org/10.5194/gmd-17-4433-2024, 2024
Short summary
Short summary
This paper introduces and evaluates WRF-PDAF, a fully online-coupled ensemble data assimilation (DA) system. A key advantage of the WRF-PDAF configuration is its ability to concurrently integrate all ensemble states, eliminating the need for time-consuming distribution and collection of ensembles during the coupling communication. The extra time required for DA amounts to only 20.6 % per cycle. Twin experiment results underscore the effectiveness of the WRF-PDAF system.
Jan Clemens, Lars Hoffmann, Bärbel Vogel, Sabine Grießbach, and Nicole Thomas
Geosci. Model Dev., 17, 4467–4493, https://doi.org/10.5194/gmd-17-4467-2024, https://doi.org/10.5194/gmd-17-4467-2024, 2024
Short summary
Short summary
Lagrangian transport models simulate the transport of air masses in the atmosphere. For example, one model (CLaMS) is well suited to calculating transport as it uses a special coordinate system and special vertical wind. However, it only runs inefficiently on modern supercomputers. Hence, we have implemented the benefits of CLaMS into a new model (MPTRAC), which is already highly efficient on modern supercomputers. Finally, in extensive tests, we showed that CLaMS and MPTRAC agree very well.
Manuel López-Puertas, Federico Fabiano, Victor Fomichev, Bernd Funke, and Daniel R. Marsh
Geosci. Model Dev., 17, 4401–4432, https://doi.org/10.5194/gmd-17-4401-2024, https://doi.org/10.5194/gmd-17-4401-2024, 2024
Short summary
Short summary
The radiative infrared cooling of CO2 in the middle atmosphere is crucial for computing its thermal structure. It requires one however to include non-local thermodynamic equilibrium processes which are computationally very expensive, which cannot be afforded by climate models. In this work, we present an updated, efficient, accurate and very fast (~50 µs) parameterization of that cooling able to cope with CO2 abundances from half the pre-industrial values to 10 times the current abundance.
Felix Wieser, Rolf Sander, Changmin Cho, Hendrik Fuchs, Thorsten Hohaus, Anna Novelli, Ralf Tillmann, and Domenico Taraborrelli
Geosci. Model Dev., 17, 4311–4330, https://doi.org/10.5194/gmd-17-4311-2024, https://doi.org/10.5194/gmd-17-4311-2024, 2024
Short summary
Short summary
The chemistry scheme of the atmospheric box model CAABA/MECCA is expanded to achieve an improved aerosol formation from emitted organic compounds. In addition to newly added reactions, temperature-dependent partitioning of all new species between the gas and aqueous phases is estimated and included in the pre-existing scheme. Sensitivity runs show an overestimation of key compounds from isoprene, which can be explained by a lack of aqueous-phase degradation reactions and box model limitations.
Zehua Bai, Qizhong Wu, Kai Cao, Yiming Sun, and Huaqiong Cheng
Geosci. Model Dev., 17, 4383–4399, https://doi.org/10.5194/gmd-17-4383-2024, https://doi.org/10.5194/gmd-17-4383-2024, 2024
Short summary
Short summary
There is relatively limited research on the application of scientific computing on RISC CPU platforms. The MIPS architecture CPUs, a type of RISC CPUs, have distinct advantages in energy efficiency and scalability. The air quality modeling system can run stably on the MIPS and LoongArch platforms, and the experiment results verify the stability of scientific computing on the platforms. The work provides a technical foundation for the scientific application based on MIPS and LoongArch.
Yafang Guo, Chayan Roychoudhury, Mohammad Amin Mirrezaei, Rajesh Kumar, Armin Sorooshian, and Avelino F. Arellano
Geosci. Model Dev., 17, 4331–4353, https://doi.org/10.5194/gmd-17-4331-2024, https://doi.org/10.5194/gmd-17-4331-2024, 2024
Short summary
Short summary
This research focuses on surface ozone (O3) pollution in Arizona, a historically air-quality-challenged arid and semi-arid region in the US. The unique characteristics of this kind of region, e.g., intense heat, minimal moisture, and persistent desert shrubs, play a vital role in comprehending O3 exceedances. Using the WRF-Chem model, we analyzed O3 levels in the pre-monsoon month, revealing the model's skill in capturing diurnal and MDA8 O3 levels.
Christoph Fischer, Andreas H. Fink, Elmar Schömer, Marc Rautenhaus, and Michael Riemer
Geosci. Model Dev., 17, 4213–4228, https://doi.org/10.5194/gmd-17-4213-2024, https://doi.org/10.5194/gmd-17-4213-2024, 2024
Short summary
Short summary
This study presents a method for identifying and tracking 3-D potential vorticity structures within African easterly waves (AEWs). Each identified structure is characterized by descriptors, including its 3-D position and orientation, which have been validated through composite comparisons. A trough-centric perspective on the descriptors reveals the evolution and distinct characteristics of AEWs. These descriptors serve as valuable statistical inputs for the study of AEW-related phenomena.
Sandro Vattioni, Andrea Stenke, Beiping Luo, Gabriel Chiodo, Timofei Sukhodolov, Elia Wunderlin, and Thomas Peter
Geosci. Model Dev., 17, 4181–4197, https://doi.org/10.5194/gmd-17-4181-2024, https://doi.org/10.5194/gmd-17-4181-2024, 2024
Short summary
Short summary
We investigate the sensitivity of aerosol size distributions in the presence of strong SO2 injections for climate interventions or after volcanic eruptions to the call sequence and frequency of the routines for nucleation and condensation in sectional aerosol models with operator splitting. Using the aerosol–chemistry–climate model SOCOL-AERv2, we show that the radiative and chemical outputs are sensitive to these settings at high H2SO4 supersaturations and how to obtain reliable results.
Najmeh Kaffashzadeh and Abbas-Ali Aliakbari Bidokhti
Geosci. Model Dev., 17, 4155–4179, https://doi.org/10.5194/gmd-17-4155-2024, https://doi.org/10.5194/gmd-17-4155-2024, 2024
Short summary
Short summary
This paper assesses the capability of two state-of-the-art global datasets in simulating surface ozone over Iran using a new methodology. It is found that the global model data need to be downscaled for regulatory purposes or policy applications at local scales. The method can be useful not only for the evaluation but also for the prediction of other chemical species, such as aerosols.
Franciscus Liqui Lung, Christian Jakob, A. Pier Siebesma, and Fredrik Jansson
Geosci. Model Dev., 17, 4053–4076, https://doi.org/10.5194/gmd-17-4053-2024, https://doi.org/10.5194/gmd-17-4053-2024, 2024
Short summary
Short summary
Traditionally, high-resolution atmospheric models employ periodic boundary conditions, which limit simulations to domains without horizontal variations. In this research open boundary conditions are developed to replace the periodic boundary conditions. The implementation is tested in a controlled setup, and the results show minimal disturbances. Using these boundary conditions, high-resolution models can be forced by a coarser model to study atmospheric phenomena in realistic background states.
Caroline Arnold, Shivani Sharma, Tobias Weigel, and David S. Greenberg
Geosci. Model Dev., 17, 4017–4029, https://doi.org/10.5194/gmd-17-4017-2024, https://doi.org/10.5194/gmd-17-4017-2024, 2024
Short summary
Short summary
In atmospheric models, rain formation is simplified to be computationally efficient. We trained a machine learning model, SuperdropNet, to emulate warm-rain formation based on super-droplet simulations. Here, we couple SuperdropNet with an atmospheric model in a warm-bubble experiment and find that the coupled simulation runs stable and produces reasonable results, making SuperdropNet a viable ML proxy for droplet simulations. We also present a comprehensive benchmark for coupling architectures.
Byoung-Joo Jung, Benjamin Ménétrier, Chris Snyder, Zhiquan Liu, Jonathan J. Guerrette, Junmei Ban, Ivette Hernández Baños, Yonggang G. Yu, and William C. Skamarock
Geosci. Model Dev., 17, 3879–3895, https://doi.org/10.5194/gmd-17-3879-2024, https://doi.org/10.5194/gmd-17-3879-2024, 2024
Short summary
Short summary
We describe the multivariate static background error covariance (B) for the JEDI-MPAS 3D-Var data assimilation system. With tuned B parameters, the multivariate B gives physically balanced analysis increment fields in the single-observation test framework. In the month-long cycling experiment with a global 60 km mesh, 3D-Var with static B performs stably. Due to its simple workflow and minimal computational requirements, JEDI-MPAS 3D-Var can be useful for the research community.
Michal Belda, Nina Benešová, Jaroslav Resler, Peter Huszár, Ondřej Vlček, Pavel Krč, Jan Karlický, Pavel Juruš, and Kryštof Eben
Geosci. Model Dev., 17, 3867–3878, https://doi.org/10.5194/gmd-17-3867-2024, https://doi.org/10.5194/gmd-17-3867-2024, 2024
Short summary
Short summary
For modeling atmospheric chemistry, it is necessary to provide data on emissions of pollutants. These can come from various sources and in various forms, and preprocessing of the data to be ingestible by chemistry models can be quite challenging. We developed the FUME processor to use a database layer that internally transforms all input data into a rigid structure, facilitating further processing to allow for emission processing from the continental to the street scale.
Bent Harnist, Seppo Pulkkinen, and Terhi Mäkinen
Geosci. Model Dev., 17, 3839–3866, https://doi.org/10.5194/gmd-17-3839-2024, https://doi.org/10.5194/gmd-17-3839-2024, 2024
Short summary
Short summary
Probabilistic precipitation nowcasting (local forecasting for 0–6 h) is crucial for reducing damage from events like flash floods. For this goal, we propose the DEUCE neural-network-based model which uses data and model uncertainties to generate an ensemble of potential precipitation development scenarios for the next hour. Trained and evaluated with Finnish precipitation composites, DEUCE was found to produce more skillful and reliable nowcasts than established models.
Emma Howard, Steven Woolnough, Nicholas Klingaman, Daniel Shipley, Claudio Sanchez, Simon C. Peatman, Cathryn E. Birch, and Adrian J. Matthews
Geosci. Model Dev., 17, 3815–3837, https://doi.org/10.5194/gmd-17-3815-2024, https://doi.org/10.5194/gmd-17-3815-2024, 2024
Short summary
Short summary
This paper describes a coupled atmosphere–mixed-layer ocean simulation setup that will be used to study weather processes in Southeast Asia. The set-up has been used to compare high-resolution simulations, which are able to partially resolve storms, to coarser simulations, which cannot. We compare the model performance at representing variability of rainfall and sea surface temperatures across length scales between the coarse and fine models.
Andrés Yarce Botero, Michiel van Weele, Arjo Segers, Pier Siebesma, and Henk Eskes
Geosci. Model Dev., 17, 3765–3781, https://doi.org/10.5194/gmd-17-3765-2024, https://doi.org/10.5194/gmd-17-3765-2024, 2024
Short summary
Short summary
HARMONIE WINS50 reanalysis data with 0.025° × 0.025° resolution from 2019 to 2021 were coupled with the LOTOS-EUROS Chemical Transport Model. HARMONIE and ECMWF meteorology configurations against Cabauw observations (52.0° N, 4.9° W) were evaluated as simulated NO2 concentrations with ground-level sensors. Differences in crucial meteorological input parameters (boundary layer height, vertical diffusion coefficient) between the hydrostatic and non-hydrostatic models were analysed.
Ulrich Voggenberger, Leopold Haimberger, Federico Ambrogi, and Paul Poli
Geosci. Model Dev., 17, 3783–3799, https://doi.org/10.5194/gmd-17-3783-2024, https://doi.org/10.5194/gmd-17-3783-2024, 2024
Short summary
Short summary
This paper presents a method for calculating balloon drift from historical radiosonde ascent data. The drift can reach distances of several hundred kilometres and is often neglected. Verification shows the beneficial impact of the more accurate balloon position on model assimilation. The method is not limited to radiosondes but would also work for dropsondes, ozonesondes, or any other in situ sonde carried by the wind in the pre-GNSS era, provided the necessary information is available.
Philippe Thunis, Jeroen Kuenen, Enrico Pisoni, Bertrand Bessagnet, Manjola Banja, Lech Gawuc, Karol Szymankiewicz, Diego Guizardi, Monica Crippa, Susana Lopez-Aparicio, Marc Guevara, Alexander De Meij, Sabine Schindlbacher, and Alain Clappier
Geosci. Model Dev., 17, 3631–3643, https://doi.org/10.5194/gmd-17-3631-2024, https://doi.org/10.5194/gmd-17-3631-2024, 2024
Short summary
Short summary
An ensemble emission inventory is created with the aim of monitoring the status and progress made with the development of EU-wide inventories. This emission ensemble serves as a common benchmark for the screening and allows for the comparison of more than two inventories at a time. Because the emission “truth” is unknown, the approach does not tell which inventory is the closest to reality, but it identifies inconsistencies that require special attention.
Laurent Menut, Bertrand Bessagnet, Arineh Cholakian, Guillaume Siour, Sylvain Mailler, and Romain Pennel
Geosci. Model Dev., 17, 3645–3665, https://doi.org/10.5194/gmd-17-3645-2024, https://doi.org/10.5194/gmd-17-3645-2024, 2024
Short summary
Short summary
This study is about the modelling of the atmospheric composition in Europe during the summer of 2022, when massive wildfires were observed. It is a sensitivity study dedicated to the relative impacts of two modelling processes that are able to modify the meteorology used for the calculation of the atmospheric chemistry and transport of pollutants.
Shuai Wang, Mengyuan Zhang, Yueqi Gao, Peng Wang, Qingyan Fu, and Hongliang Zhang
Geosci. Model Dev., 17, 3617–3629, https://doi.org/10.5194/gmd-17-3617-2024, https://doi.org/10.5194/gmd-17-3617-2024, 2024
Short summary
Short summary
Numerical models are widely used in air pollution modeling but suffer from significant biases. The machine learning model designed in this study shows high efficiency in identifying such biases. Meteorology (relative humidity and cloud cover), chemical composition (secondary organic components and dust aerosols), and emission sources (residential activities) are diagnosed as the main drivers of bias in modeling PM2.5, a typical air pollutant. The results will help to improve numerical models.
Shoma Yamanouchi, Shayamilla Mahagammulla Gamage, Sara Torbatian, Jad Zalzal, Laura Minet, Audrey Smargiassi, Ying Liu, Ling Liu, Forood Azargoshasbi, Jinwoong Kim, Youngseob Kim, Daniel Yazgi, and Marianne Hatzopoulou
Geosci. Model Dev., 17, 3579–3597, https://doi.org/10.5194/gmd-17-3579-2024, https://doi.org/10.5194/gmd-17-3579-2024, 2024
Short summary
Short summary
Air pollution is a major health hazard, and chemical transport models (CTMs) are valuable tools that aid in our understanding of the risks of air pollution at both local and regional scales. In this study, the Polair3D CTM of the Polyphemus air quality modeling platform was set up over Quebec, Canada, to assess the model’s capability in predicting key air pollutant species over the region, at seasonal temporal scales and at regional spatial scales.
Rohith Thundathil, Florian Zus, Galina Dick, and Jens Wickert
Geosci. Model Dev., 17, 3599–3616, https://doi.org/10.5194/gmd-17-3599-2024, https://doi.org/10.5194/gmd-17-3599-2024, 2024
Short summary
Short summary
Global Navigation Satellite Systems (GNSS) provides moisture observations through its densely distributed ground station network. In this research, we assimilate a new type of observation called tropospheric gradient observations, which has never been incorporated into a weather model. We develop a forward operator for gradient-based observations and conduct an assimilation impact study. The study shows significant improvements in the model's humidity fields.
Ankur Mahesh, Travis A. O'Brien, Burlen Loring, Abdelrahman Elbashandy, William Boos, and William D. Collins
Geosci. Model Dev., 17, 3533–3557, https://doi.org/10.5194/gmd-17-3533-2024, https://doi.org/10.5194/gmd-17-3533-2024, 2024
Short summary
Short summary
Atmospheric rivers (ARs) are extreme weather events that can alleviate drought or cause billions of US dollars in flood damage. We train convolutional neural networks (CNNs) to detect ARs with an estimate of the uncertainty. We present a framework to generalize these CNNs to a variety of datasets of past, present, and future climate. Using a simplified simulation of the Earth's atmosphere, we validate the CNNs. We explore the role of ARs in maintaining energy balance in the Earth system.
Alexandra Rivera, Kostas Tsigaridis, Gregory Faluvegi, and Drew Shindell
Geosci. Model Dev., 17, 3487–3505, https://doi.org/10.5194/gmd-17-3487-2024, https://doi.org/10.5194/gmd-17-3487-2024, 2024
Short summary
Short summary
This paper describes and evaluates an improvement to the representation of acetone in the GISS ModelE2.1 Earth system model. We simulate acetone's concentration and transport across the atmosphere as well as its dependence on chemistry, the ocean, and various global emissions. Comparisons of our model’s estimates to past modeling studies and field measurements have shown encouraging results. Ultimately, this paper contributes to a broader understanding of acetone's role in the atmosphere.
Richard Maier, Fabian Jakub, Claudia Emde, Mihail Manev, Aiko Voigt, and Bernhard Mayer
Geosci. Model Dev., 17, 3357–3383, https://doi.org/10.5194/gmd-17-3357-2024, https://doi.org/10.5194/gmd-17-3357-2024, 2024
Short summary
Short summary
Based on the TenStream solver, we present a new method to accelerate 3D radiative transfer towards the speed of currently used 1D solvers. Using a shallow-cumulus-cloud time series, we evaluate the performance of this new solver in terms of both speed and accuracy. Compared to a 3D benchmark simulation, we show that our new solver is able to determine much more accurate irradiances and heating rates than a 1D δ-Eddington solver, even when operated with a similar computational demand.
Julia Maillard, Jean-Christophe Raut, and François Ravetta
Geosci. Model Dev., 17, 3303–3320, https://doi.org/10.5194/gmd-17-3303-2024, https://doi.org/10.5194/gmd-17-3303-2024, 2024
Short summary
Short summary
Atmospheric models struggle to reproduce the strong temperature inversions in the vicinity of the surface over forested areas in the Arctic winter. In this paper, we develop modified simplified versions of surface layer schemes widely used by the community. Our modifications are used to correct the fact that original schemes place strong limits on the turbulent collapse, leading to a lower surface temperature gradient at low wind speeds. Modified versions show a better performance.
Jana Fischereit, Henrik Vedel, Xiaoli Guo Larsén, Natalie E. Theeuwes, Gregor Giebel, and Eigil Kaas
Geosci. Model Dev., 17, 2855–2875, https://doi.org/10.5194/gmd-17-2855-2024, https://doi.org/10.5194/gmd-17-2855-2024, 2024
Short summary
Short summary
Wind farms impact local wind and turbulence. To incorporate these effects in weather forecasting, the explicit wake parameterization (EWP) is added to the forecasting model HARMONIE–AROME. We evaluate EWP using flight data above and downstream of wind farms, comparing it with an alternative wind farm parameterization and another weather model. Results affirm the correct implementation of EWP, emphasizing the necessity of accounting for wind farm effects in accurate weather forecasting.
Clément Bouvier, Daan van den Broek, Madeleine Ekblom, and Victoria A. Sinclair
Geosci. Model Dev., 17, 2961–2986, https://doi.org/10.5194/gmd-17-2961-2024, https://doi.org/10.5194/gmd-17-2961-2024, 2024
Short summary
Short summary
An analytical initial background state has been developed for moist baroclinic wave simulation on an aquaplanet and implemented into OpenIFS. Seven parameters can be controlled, which are used to generate the background states and the development of baroclinic waves. The meteorological and numerical stability has been assessed. Resulting baroclinic waves have proven to be realistic and sensitive to the jet's width.
Jelena Radović, Michal Belda, Jaroslav Resler, Kryštof Eben, Martin Bureš, Jan Geletič, Pavel Krč, Hynek Řezníček, and Vladimír Fuka
Geosci. Model Dev., 17, 2901–2927, https://doi.org/10.5194/gmd-17-2901-2024, https://doi.org/10.5194/gmd-17-2901-2024, 2024
Short summary
Short summary
Boundary conditions are of crucial importance for numerical model (e.g., PALM) validation studies and have a large influence on the model results, especially when studying the atmosphere of real, complex, and densely built urban environments. Our experiments with different driving conditions for the large-eddy simulation model PALM show its strong dependency on boundary conditions, which is important for the proper separation of errors coming from the boundary conditions and the model itself.
Sonya L. Fiddes, Marc D. Mallet, Alain Protat, Matthew T. Woodhouse, Simon P. Alexander, and Kalli Furtado
Geosci. Model Dev., 17, 2641–2662, https://doi.org/10.5194/gmd-17-2641-2024, https://doi.org/10.5194/gmd-17-2641-2024, 2024
Short summary
Short summary
In this study we present an evaluation that considers complex, non-linear systems in a holistic manner. This study uses XGBoost, a machine learning algorithm, to predict the simulated Southern Ocean shortwave radiation bias in the ACCESS model using cloud property biases as predictors. We then used a novel feature importance analysis to quantify the role that each cloud bias plays in predicting the radiative bias, laying the foundation for advanced Earth system model evaluation and development.
Gaurav Govardhan, Sachin D. Ghude, Rajesh Kumar, Sumit Sharma, Preeti Gunwani, Chinmay Jena, Prafull Yadav, Shubhangi Ingle, Sreyashi Debnath, Pooja Pawar, Prodip Acharja, Rajmal Jat, Gayatry Kalita, Rupal Ambulkar, Santosh Kulkarni, Akshara Kaginalkar, Vijay K. Soni, Ravi S. Nanjundiah, and Madhavan Rajeevan
Geosci. Model Dev., 17, 2617–2640, https://doi.org/10.5194/gmd-17-2617-2024, https://doi.org/10.5194/gmd-17-2617-2024, 2024
Short summary
Short summary
A newly developed air quality forecasting framework, Decision Support System (DSS), for air quality management in Delhi, India, provides source attribution with numerous emission reduction scenarios besides forecasts. DSS shows that during post-monsoon and winter seasons, Delhi and its neighboring districts contribute to 30 %–40 % each to pollution in Delhi. On average, a 40 % reduction in the emissions in Delhi and the surrounding districts would result in a 24 % reduction in Delhi's pollution.
Simon Rosanka, Holger Tost, Rolf Sander, Patrick Jöckel, Astrid Kerkweg, and Domenico Taraborrelli
Geosci. Model Dev., 17, 2597–2615, https://doi.org/10.5194/gmd-17-2597-2024, https://doi.org/10.5194/gmd-17-2597-2024, 2024
Short summary
Short summary
The capabilities of the Modular Earth Submodel System (MESSy) are extended to account for non-equilibrium aqueous-phase chemistry in the representation of deliquescent aerosols. When applying the new development in a global simulation, we find that MESSy's bias in modelling routinely observed reduced inorganic aerosol mass concentrations, especially in the United States. Furthermore, the representation of fine-aerosol pH is particularly improved in the marine boundary layer.
Junyu Li, Yuxin Wang, Lilong Liu, Yibin Yao, Liangke Huang, and Feijuan Li
Geosci. Model Dev., 17, 2569–2581, https://doi.org/10.5194/gmd-17-2569-2024, https://doi.org/10.5194/gmd-17-2569-2024, 2024
Short summary
Short summary
In this study, we have developed a model (RF-PWV) to characterize precipitable water vapor (PWV) variation with altitude in the study area. RF-PWV can significantly reduce errors in vertical correction, enhance PWV fusion product accuracy, and provide insights into PWV vertical distribution, thereby contributing to climate research.
Rolf Sander
Geosci. Model Dev., 17, 2419–2425, https://doi.org/10.5194/gmd-17-2419-2024, https://doi.org/10.5194/gmd-17-2419-2024, 2024
Short summary
Short summary
The open-source software MEXPLORER 1.0.0 is presented here. The program can be used to analyze, reduce, and visualize complex chemical reaction mechanisms. The mathematics behind the tool is based on graph theory: chemical species are represented as vertices, and reactions as edges. MEXPLORER is a community model published under the GNU General Public License.
Hossain Mohammed Syedul Hoque, Kengo Sudo, Hitoshi Irie, Yanfeng He, and Md Firoz Khan
EGUsphere, https://doi.org/10.22541/essoar.169903618.82717612/v2, https://doi.org/10.22541/essoar.169903618.82717612/v2, 2024
Short summary
Short summary
Using multi-platform observations, we validated global formaldehyde (HCHO) simulations from a chemistry transport model. HCHO is a crucial intermediate of the chemical catalytic cycle that governs the ozone formation in the troposphere. The model was capable of replicating the observed spatiotemporal variability in HCHO. In a few cases, the model capability was limited. This is attributed to the uncertainties in the observations and the model parameters.
Leonardo Olivetti and Gabriele Messori
Geosci. Model Dev., 17, 2347–2358, https://doi.org/10.5194/gmd-17-2347-2024, https://doi.org/10.5194/gmd-17-2347-2024, 2024
Short summary
Short summary
In the last decades, weather forecasting up to 15 d into the future has been dominated by physics-based numerical models. Recently, deep learning models have challenged this paradigm. However, the latter models may struggle when forecasting weather extremes. In this article, we argue for deep learning models specifically designed to handle extreme events, and we propose a foundational framework to develop such models.
Stefan Rahimi, Lei Huang, Jesse Norris, Alex Hall, Naomi Goldenson, Will Krantz, Benjamin Bass, Chad Thackeray, Henry Lin, Di Chen, Eli Dennis, Ethan Collins, Zachary J. Lebo, Emily Slinskey, Sara Graves, Surabhi Biyani, Bowen Wang, Stephen Cropper, and the UCLA Center for Climate Science Team
Geosci. Model Dev., 17, 2265–2286, https://doi.org/10.5194/gmd-17-2265-2024, https://doi.org/10.5194/gmd-17-2265-2024, 2024
Short summary
Short summary
Here, we project future climate across the western United States through the end of the 21st century using a regional climate model, embedded within 16 latest-generation global climate models, to provide the community with a high-resolution physically based ensemble of climate data for use at local scales. Strengths and weaknesses of the data are frankly discussed as we overview the downscaled dataset.
Romain Pilon and Daniela I. V. Domeisen
Geosci. Model Dev., 17, 2247–2264, https://doi.org/10.5194/gmd-17-2247-2024, https://doi.org/10.5194/gmd-17-2247-2024, 2024
Short summary
Short summary
This paper introduces a new method for detecting atmospheric cloud bands to identify long convective cloud bands that extend from the tropics to the midlatitudes. The algorithm allows for easy use and enables researchers to study the life cycle and climatology of cloud bands and associated rainfall. This method provides insights into the large-scale processes involved in cloud band formation and their connections between different regions, as well as differences across ocean basins.
Salvatore Larosa, Domenico Cimini, Donatello Gallucci, Saverio Teodosio Nilo, and Filomena Romano
Geosci. Model Dev., 17, 2053–2076, https://doi.org/10.5194/gmd-17-2053-2024, https://doi.org/10.5194/gmd-17-2053-2024, 2024
Short summary
Short summary
PyRTlib is an attractive educational tool because it provides a flexible and user-friendly way to broadly simulate how electromagnetic radiation travels through the atmosphere as it interacts with atmospheric constituents (such as gases, aerosols, and hydrometeors). PyRTlib is a so-called radiative transfer model; these are commonly used to simulate and understand remote sensing observations from ground-based, airborne, or satellite instruments.
Kelly M. Núñez Ocasio and Zachary L. Moon
EGUsphere, https://doi.org/10.5194/egusphere-2024-259, https://doi.org/10.5194/egusphere-2024-259, 2024
Short summary
Short summary
TAMS is an open-source mesoscale convective system tracking and classifying Python-based package that can be used to study observed and simulated systems. Each step of the algorithm is described in this paper with examples showing how to make use of visualization and post-processing tools within the package. A unique and valuable feature of this tracker is its support for unstructured grids in the identification stage and grid-independent tracking.
Joffrey Dumont Le Brazidec, Pierre Vanderbecken, Alban Farchi, Grégoire Broquet, Gerrit Kuhlmann, and Marc Bocquet
Geosci. Model Dev., 17, 1995–2014, https://doi.org/10.5194/gmd-17-1995-2024, https://doi.org/10.5194/gmd-17-1995-2024, 2024
Short summary
Short summary
Our research presents an innovative approach to estimating power plant CO2 emissions from satellite images of the corresponding plumes such as those from the forthcoming CO2M satellite constellation. The exploitation of these images is challenging due to noise and meteorological uncertainties. To overcome these obstacles, we use a deep learning neural network trained on simulated CO2 images. Our method outperforms alternatives, providing a positive perspective for the analysis of CO2M images.
Cited articles
Aggarwal, C. C., Hinneburg, A., and Keim, D. A.: On the surprising behavior of distance metrics in high dimensional space, in: International conference on database theory, Springer, Berlin, Heidelberg, 420–434, https://doi.org/10.1007/3-540-44503-X_27, 2001.
Ahmed, K., Sachindra, D. A., Shahid, S., Demirel, M. C., and Chung, E.-S.: Selection of multi-model ensemble of general circulation models for the simulation of precipitation and maximum and minimum temperature based on spatial assessment metrics, Hydrol. Earth Syst. Sci., 23, 4803–4824, https://doi.org/10.5194/hess-23-4803-2019, 2019.
Armstrong, J. S. and Collopy, F.: Error measures for generalizing about forecasting methods: Empirical comparisons, Int. J. Forecast., 8, 69–80, https://doi.org/10.1016/0169-2070(92)90008-W, 1992.
Baker, N. C. and Taylor, P. C.: A framework for evaluating climate model performance metrics, J. Climate, 29, 1773–1782, https://doi.org/10.1175/JCLI-D-15-0114.1, 2016.
Bell, B., Hersbach, H., Berrisford, P., Dahlgren, P., Horányi, A., Muñoz Sabater, J., Nicolas, J., Radu, R., Schepers, D., Simmons, A., Soci, C., and Thépaut, J.-N.: ERA5 monthly averaged data on pressure levels from 1950 to 1978 (preliminary version), Copernicus Climate Change Service (C3S) Climate Data Store (CDS) [data set], https://cds.climate.copernicus-climate.eu/cdsapp#!/dataset/reanalysis-era5-pressure-levels-monthly-means-preliminary-back-extension?tab=overview (last access: 16 April 2024), 2020.
Bellomo, K., Angeloni, M., Corti, S., and von Hardenberg, J.: Future climate change shaped by inter-model differences in Atlantic meridional overturning circulation response, Nat. Commun., 12, 1–10, https://doi.org/10.1038/s41467-021-24015-w, 2021.
Benestad, R. E., Mezghani, A., Lutz, J., Dobler, A., Parding, K. M., and Landgren, O. A.: Various ways of using empirical orthogonal functions for climate model evaluation, Geosci. Model Dev., 16, 2899–2913, https://doi.org/10.5194/gmd-16-2899-2023, 2023.
Boberg, F., Berg, P., Thejll, P., Gutowski, W. J., and Christensen, J. H.: Improved confidence in climate change projections of precipitation evaluated using daily statistics from the PRUDENCE ensemble, Clim. Dynam., 32, 1097–1106, https://doi.org/10.1007/s00382-008-0446-y, 2009.
Boberg, F., Berg, P., Thejll, P., Gutowski, W. J., and Christensen, J. H.: Improved confidence in climate change projections of precipitation further evaluated using daily statistics from ENSEMBLES models, Clim. Dynam., 35, 1509–1520, https://doi.org/10.1007/s00382-009-0683-8, 2010.
Chai, T. and Draxler, R. R.: Root mean square error (RMSE) or mean absolute error (MAE)? – Arguments against avoiding RMSE in the literature, Geosci. Model Dev., 7, 1247–1250, https://doi.org/10.5194/gmd-7-1247-2014, 2014.
Christensen, J. H. and Christensen, O. B.: A summary of the PRUDENCE model projections of changes in European climate by the end of this century, Climatic Change, 81, 7–30, https://doi.org/10.1007/s10584-006-9210-7, 2007.
Collier, N., Hoffman, F. M., Lawrence, D. M., Keppel-Aleks, G., Koven, C. D., Riley, W. J., and Randerson, J. T.: The International Land Model Benchmarking (ILAMB) system: design, theory, and implementation, J. Adv. Model. Earth Sy., 10, 2731–2754, https://doi.org/10.1029/2018MS001354, 2018.
Dembélé, M., Hrachowitz, M., Savenije, H. H., Mariéthoz, G., and Schaefli, B.: Improving the predictive skill of a distributed hydrological model by calibration on spatial patterns with multiple satellite data sets, Water Resour. Res., 56, e2019WR026085, https://doi.org/10.1029/2019WR026085, 2020.
Demirel, M. C., Mai, J., Mendiguren, G., Koch, J., Samaniego, L., and Stisen, S.: Combining satellite data and appropriate objective functions for improved spatial pattern performance of a distributed hydrologic model, Hydrol. Earth Syst. Sci., 22, 1299–1315, https://doi.org/10.5194/hess-22-1299-2018, 2018.
Flato, G., Marotzke, J., Abiodun, B., Braconnot, P., Chou, S. C., Collins, W., Cox, P., Driouech, F., Emori, S., Eyring, V., Forest, C., Gleckler, P., Guilyardi, E., Jakob, C., Kattsov, V., Reason, C., and Rummukainen, M.: Evaluation of climate models, in: Climate Change 2013: the physical science basis. Contribution of Working Group I to the Fifth Assessment Report of the Intergovernmental Panel on Climate Change, edited by: Stocker, T. F., Qin, D., Plattner, G.-K., Tignor, M., Allen, S. K., Boschung, J., Nauels, A., Xia, Y., Bex, V., and Midgley, P. M., Cambridge University Press, Cambridge, United Kingdom and New York, NY, USA, 741–866, https://www.ipcc.ch/site/assets/uploads/2018/02/WG1AR5_Chapter09_FINAL.pdf (last access: 16 April 2024), 2013.
Giot, O., Termonia, P., Degrauwe, D., De Troch, R., Caluwaerts, S., Smet, G., Berckmans, J., Deckmyn, A., De Cruz, L., De Meutter, P., Duerinckx, A., Gerard, L., Hamdi, R., Van den Bergh, J., Van Ginderachter, M., and Van Schaeybroeck, B.: Validation of the ALARO-0 model within the EURO-CORDEX framework, Geosci. Model Dev., 9, 1143–1152, https://doi.org/10.5194/gmd-9-1143-2016, 2016.
Gupta, H. V., Kling, H., Yilmaz, K. K., and Martinez, G. F.: Decomposition of the mean squared error and NSE performance criteria: Implications for improving hydrological modelling, J. Hydrol., 377, 80–91, https://doi.org/10.1016/j.jhydrol.2009.08.003, 2009.
He, X., Lei, X. D., and Dong, L. H.: How large is the difference in large-scale forest biomass estimations based on new climate-modified stand biomass models?, Ecol. Indic., 126, 107569, https://doi.org/10.1016/j.ecolind.2021.107569, 2021.
Hu, Z., Chen, X., Zhou, Q., Chen, D., and Li, J.: DISO: A rethink of Taylor diagram, Int. J. Climatol., 39, 2825–2832, https://doi.org/10.1002/joc.5972, 2019.
Hyndman, R. J. and Koehler, A. B.: Another look at measures of forecast accuracy, Int. J. Forecast., 22, 679–688, https://doi.org/10.1016/j.ijforecast.2006.03.001, 2006.
IPCC: Climate Change 2021: The Physical Science Basis. Contribution of Working Group I to the Sixth Assessment Report of the Intergovernmental Panel on Climate Change, edited by: Masson-Delmotte, V., Zhai, P., Pirani, A., Connors, S. L., Péan, C., Berger, S., Caud, N., Chen, Y., Goldfarb, L., Gomis, M. I., Huang, M., Leitzell, K., Lonnoy, E., Matthews, J. B. R., Maycock, T. K., Waterfield, T., Yelekçi, O., Yu, R., and Zhou, B., Cambridge University Press, https://report.ipcc.ch/ar6/wg1/IPCC_AR6_WGI_FullReport.pdf (last access: 16 April 2024), 2021a.
IPCC: Summary for Policymakers, in: Climate Change 2021: The Physical Science Basis. Contribution of Working Group I to the Sixth Assessment Report of the Intergovernmental Panel on Climate Change, edited by: Masson-Delmotte, V., Zhai, P., Pirani, A., Connors, S. L., Péan, C., Berger, S., Caud, N., Chen, Y., Goldfarb, L., Gomis, M. I., Huang, M., Leitzell, K., Lonnoy, E., Matthews, J. B. R., Maycock, T. K., Waterfield, T., Yelekçi, O., Yu, R., and Zhou, B., Cambridge University Press, https://www.ipcc.ch/report/ar6/wg1/downloads/report/IPCC_AR6_WGI_SPM.pdf (last access: 16 April 2024), 2021b.
Jackson, E. K., Roberts, W., Nelsen, B., Williams, G. P., Nelson, E. J., and Ames, D. P.: Introductory overview: Error metrics for hydrologic modelling – A review of common practices and an open source library to facilitate use and adoption, Environ. Modell. Softw., 119, 32–48, https://doi.org/10.1016/j.envsoft.2019.05.001, 2019.
Kalmár, T., Pieczka, I., and Pongrácz, R.: A sensitivity analysis of the different setups of the RegCM4.5 model for the Carpathian region, Int. J. Climatol., 41, E1180–E1201, https://doi.org/10.1002/joc.6761, 2021.
Kling, H., Fuchs, M., and Paulin, M.: Runoff conditions in the upper Danube basin under an ensemble of climate change scenarios, J. Hydrol., 424, 264–277, https://doi.org/10.1016/j.jhydrol.2012.01.011, 2012.
Kotlarski, S., Keuler, K., Christensen, O. B., Colette, A., Déqué, M., Gobiet, A., Goergen, K., Jacob, D., Lüthi, D., van Meijgaard, E., Nikulin, G., Schär, C., Teichmann, C., Vautard, R., Warrach-Sagi, K., and Wulfmeyer, V.: Regional climate modeling on European scales: a joint standard evaluation of the EURO-CORDEX RCM ensemble, Geosci. Model Dev., 7, 1297–1333, https://doi.org/10.5194/gmd-7-1297-2014, 2014.
Liemohn, M. W., Shane, A. D., Azari, A. R., Petersen, A. K., Swiger, B. M., and Mukhopadhyay, A.: RMSE is not enough: Guidelines to robust data-model comparisons for magnetospheric physics, J. Atmos. Sol.-Terr. Phys., 218, 105624, https://doi.org/10.1016/j.jastp.2021.105624, 2021.
Masanganise, J., Magodora, M., Mapuwei, T., and Basira, K.: An assessment of CMIP5 global climate model performance using probability density functions and a match metric method, Science Insights: An International Journal, 4, 1–8, 2014.
Mirkes, E. M., Allohibi, J., and Gorban, A.: Fractional norms and quasinorms do not help to overcome the curse of dimensionality, Entropy, 22, 1105, https://doi.org/10.48550/arXiv.2004.14230, 2020.
Mooney, P. A., Rechid, D., Davin, E. L., Katragkou, E., de Noblet-Ducoudré, N., Breil, M., Cardoso, R. M., Daloz, A. S., Hoffmann, P., Lima, D. C. A., Meier, R., Soares, P. M. M., Sofiadis, G., Strada, S., Strandberg, G., Toelle, M. H., and Lund, M. T.: Land–atmosphere interactions in sub-polar and alpine climates in the CORDEX Flagship Pilot Study Land Use and Climate Across Scales (LUCAS) models – Part 2: The role of changing vegetation, The Cryosphere, 16, 1383–1397, https://doi.org/10.5194/tc-16-1383-2022, 2022.
Murphy, A. H.: Skill scores based on the mean square error and their relationships to the correlation coefficient, Mon. Weather Rev., 116, 2417–2424, https://doi.org/10.1175/1520-0493(1988)116<2417:SSBOTM>2.0.CO;2, 1988.
Nash, J. E. and Sutcliffe, J. V.: River flow forecasting through conceptual models part I – A discussion of principles, J. Hydrol., 10, 282–290, https://doi.org/10.1016/0022-1694(70)90255-6, 1970.
Pachepsky, Y. A., Martinez, G., Pan, F., Wagener, T., and Nicholson, T.: Evaluating Hydrological Model Performance using Information Theory-based Metrics, Hydrol. Earth Syst. Sci. Discuss. [preprint], https://doi.org/10.5194/hess-2016-46, 2016.
Perkins, S. E., Pitman, A. J., Holbrook, N. J., and McAneney, J.: Evaluation of the AR4 Climate Models' Simulated Daily Maximum Temperature, Minimum Temperature, and Precipitation over Australia Using Probability Density Functions, J. Climate, 20, 4356–4376, https://doi.org/10.1175/JCLI4253.1, 2007.
Pitman, J.: Exchangeable and partially exchangeable random partitions, Probab. Theory Rel., 102, 145–158, https://doi.org/10.1007/BF01213386, 1995.
Randall, D. A., Wood, R. A., Bony, S., Colman, R., Fichefet, T., Fyfe, J., Kattsov, V., Pitman, A., Shukla, J., Srinivasan, J., Stouffer, R. J., Sumi, A., and Taylor, K. E.: Climate models and their evaluation, in: Climate Change 2007: The physical science basis, Contribution of Working Group I to the Fourth Assessment Report of the IPCC (FAR), Cambridge University Press, 589–662, 60, https://archive.ipcc.ch/publications_and_data/ar4/wg1/en/ch8.html (last access: 16 April 2024), 2007.
Reich, N. G., Lauer, S. A., Sakrejda, K., Iamsirithaworn, S., Hinjoy, S., Suangtho, P., Suthachana, S., Clapham, H. E., Salje, H., Cummings, D. A., and Lessler, J.: Challenges in real-time prediction of infectious disease: a case study of dengue in Thailand, PLoS Neglect. Trop. D., 10, e0004761, https://doi.org/10.1371/journal.pntd.0010883, 2016.
Richter, J. H., Butchart, N., Kawatani, Y., Bushell, A. C., Holt, L., Serva, F., Anstey, J., Simpson, I. R., Osprey, S., Hamilton, K., Braesicke, P., Cagnazzo, C., Chen C. C., Garcia, R. R., Gray, L. J., Kerzenmacher, T., Lott, F., McLandress, C., Naoe, H., Scinocca, J., Stockdale, T. N., Versick, S., Watanabe, S., Yoshida, K., and Yukimoto, S.: Response of the quasi-biennial oscillation to a warming climate in global climate models, Q. J. Roy. Meteor. Soc., 148, 1490–1518, https://doi.org/10.1002/qj.3749, 2022.
Roberts, N. M. and Lean, H. W.: Scale-Selective Verification of Rainfall Accumulations from High-Resolution Forecasts of Convective Events, Mon. Weather Rev., 136, 78–97, https://doi.org/10.1175/2007MWR2123.1, 2008.
Rupp, D. E., Abatzoglou, J. T., Hegewisch, K. C., and Mote, P. W.: Evaluation of CMIP5 20th century climate simulations for the Pacific Northwest USA, J. Geophys. Res.-Atmos., 118, 10884, https://doi.org/10.1002/jgrd.50843, 2013.
Samantaray, A.: Bergen Metric, Zenodo [code], https://doi.org/10.5281/zenodo.10518064, 2024.
Smiatek, G., Kunstmann, H., and Senatore A.: EURO-CORDEX regional climate model analysis for the Greater Alpine Region: Performance and expected future change, J. Geophys. Res.-Atmos., 121, 7710–7728, https://doi.org/10.1002/2015JD024727, 2016.
Taylor, K. E.: Summarizing multiple aspects of model performance in a single diagram, J. Geophys. Res.-Atmos., 106, 7183–7192, https://doi.org/10.1029/2000JD900719, 2001.
Torma, C. Z.: Detailed validation of EURO-CORDEX and Med-CORDEX regional climate model ensembles over the Carpathian Region, Időjárás/Quarterly Journal Of The Hungarian Meteorological Service, 123, 217–240, https://doi.org/10.28974/idojaras.2019.2.6, 2019.
van Noije, T., Bergman, T., Le Sager, P., O'Donnell, D., Makkonen, R., Gonçalves-Ageitos, M., Döscher, R., Fladrich, U., von Hardenberg, J., Keskinen, J.-P., Korhonen, H., Laakso, A., Myriokefalitakis, S., Ollinaho, P., Pérez García-Pando, C., Reerink, T., Schrödner, R., Wyser, K., and Yang, S.: EC-Earth3-AerChem: a global climate model with interactive aerosols and atmospheric chemistry participating in CMIP6, Geosci. Model Dev., 14, 5637–5668, https://doi.org/10.5194/gmd-14-5637-2021, 2021.
Vautard, R., Kadygrov, N., Iles, C., Boberg, F., Buonomo, E., Bülow, K., Coppola, E., Corre, L., van Meijgaard, E., Nogherotto, R., and Sandstad, M.: Evaluation of the large EURO-CORDEX regional climate model ensemble, J. Geophys. Res.-Atmos., 126, e2019JD032344, https://doi.org/10.1029/2019JD032344, 2021.
Wang, Z. and Bovik, A. C.: A universal image quality index, IEEE Signal Proc. Let., 9, 81–84, https://doi.org/10.1109/97.995823, 2002.
Watt-Meyer, O., Brenowitz, N. D., Clark, S. K., Henn, B., Kwa, A., McGibbon, J., Perkins, W. A., and Bretherton, C. S.: Correcting weather and climate models by machine learning nudged historical simulations, Geophys. Res. Lett., 48, e2021GL092555, https://doi.org/10.1029/2021GL092555, 2021.
Weber, R., Schek, H. J., and Blott, S.: A quantitative analysis and performance study for similarity-search methods in highdimensional spaces, in: VLDB, 98, 194–205, https://vldb.org/conf/1998/p194.pdf (last access: 16 April 2024), 1998.
Wȩglarczyk, S.: The interdependence and applicability of some statistical quality measures for hydrological models, J. Hydrol., 206, 98–103, https://doi.org/10.1016/S0022-1694(98)00094-8, 1998.
Wehner, M., Lee, J., Risser, M., Ullrich, P., Gleckler, P., and Collins, W. D.: Evaluation of extreme sub-daily precipitation in high-resolution global climate model simulations, Philos. T. Roy. Soc. A, 379, 20190545, https://doi.org/10.1098/rsta.2019.0545, 2021.
Willmott, C. J. and Matsuura, K.: Advantages of the mean absolute error (MAE) over the root mean square error (RMSE) in assessing average model performance, Clim. Res., 30, 79–82, 2005.
Wood, R. R., Lehner, F., Pendergrass, A. G., and Schlunegger, S.: Changes in precipitation variability across time scales in multiple global climate model large ensembles, Environ. Res. Lett., 16, 084022, https://doi.org/10.1088/1748-9326/ac10dd, 2021.
Yang, J., Ren, J., Sun, D., Xiao, X., Xia, J. C., Jin, C., and Li, X.: Understanding land surface temperature impact factors based on local climate zones, Sustain. Cities Soc., 69, 102818, https://doi.org/10.1016/j.scs.2021.102818, 2021.
Short summary
Any interpretation of climate model data requires a comprehensive evaluation of the model performance. Numerous error metrics exist for this purpose, and each focuses on a specific aspect of the relationship between reference and model data. Thus, a comprehensive evaluation demands the use of multiple error metrics. However, this can lead to confusion. We propose a clustering technique to reduce the number of error metrics needed and a composite error metric to simplify the interpretation.
Any interpretation of climate model data requires a comprehensive evaluation of the model...
