Articles | Volume 17, issue 8
https://doi.org/10.5194/gmd-17-3321-2024
© Author(s) 2024. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
https://doi.org/10.5194/gmd-17-3321-2024
© Author(s) 2024. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
Methods for assessment of models
| 
29 Apr 2024
Methods for assessment of models |
| 29 Apr 2024
| 29 Apr 2024
Bergen metrics: composite error metrics for assessing performance of climate models using EURO-CORDEX simulations
NORCE Norwegian Research Centre, Bjerknes Centre for Climate Research, Bergen, Norway
Priscilla A. Mooney
NORCE Norwegian Research Centre, Bjerknes Centre for Climate Research, Bergen, Norway
Carla A. Vivacqua
Department of Statistics, Universidade Federal do Rio Grande do Norte, Natal, Brazil
Related authors
No articles found.
Xavier J. Levine, Ryan S. Williams, Gareth Marshall, Andrew Orr, Lise Seland Graff, Dörthe Handorf, Alexey Karpechko, Raphael Köhler, René R. Wijngaard, Nadine Johnston, Hanna Lee, Lars Nieradzik, and Priscilla A. Mooney
Earth Syst. Dynam., 15, 1161–1177, https://doi.org/10.5194/esd-15-1161-2024, https://doi.org/10.5194/esd-15-1161-2024, 2024
Short summary
Short summary
While the most recent climate projections agree that the Arctic is warming, differences remain in how much and in other climate variables such as precipitation. This presents a challenge for stakeholders who need to develop mitigation and adaptation strategies. We tackle this problem by using the storyline approach to generate four plausible and actionable realisations of end-of-century climate change for the Arctic, spanning its most likely range of variability.
Anne Sophie Daloz, Clemens Schwingshackl, Priscilla Mooney, Susanna Strada, Diana Rechid, Edouard L. Davin, Eleni Katragkou, Nathalie de Noblet-Ducoudré, Michal Belda, Tomas Halenka, Marcus Breil, Rita M. Cardoso, Peter Hoffmann, Daniela C. A. Lima, Ronny Meier, Pedro M. M. Soares, Giannis Sofiadis, Gustav Strandberg, Merja H. Toelle, and Marianne T. Lund
The Cryosphere, 16, 2403–2419, https://doi.org/10.5194/tc-16-2403-2022, https://doi.org/10.5194/tc-16-2403-2022, 2022
Short summary
Short summary
Snow plays a major role in the regulation of the Earth's surface temperature. Together with climate change, rising temperatures are already altering snow in many ways. In this context, it is crucial to better understand the ability of climate models to represent snow and snow processes. This work focuses on Europe and shows that the melting season in spring still represents a challenge for climate models and that more work is needed to accurately simulate snow–atmosphere interactions.
Priscilla A. Mooney, Diana Rechid, Edouard L. Davin, Eleni Katragkou, Natalie de Noblet-Ducoudré, Marcus Breil, Rita M. Cardoso, Anne Sophie Daloz, Peter Hoffmann, Daniela C. A. Lima, Ronny Meier, Pedro M. M. Soares, Giannis Sofiadis, Susanna Strada, Gustav Strandberg, Merja H. Toelle, and Marianne T. Lund
The Cryosphere, 16, 1383–1397, https://doi.org/10.5194/tc-16-1383-2022, https://doi.org/10.5194/tc-16-1383-2022, 2022
Short summary
Short summary
We use multiple regional climate models to show that afforestation in sub-polar and alpine regions reduces the radiative impact of snow albedo on the atmosphere, reduces snow cover, and delays the start of the snowmelt season. This is important for local communities that are highly reliant on snowpack for water resources and winter tourism. However, models disagree on the amount of change particularly when snow is melting. This shows that more research is needed on snow–vegetation interactions.
Hannah Ming Siu Vickers, Priscilla Mooney, Eirik Malnes, and Hanna Lee
The Cryosphere Discuss., https://doi.org/10.5194/tc-2022-57, https://doi.org/10.5194/tc-2022-57, 2022
Manuscript not accepted for further review
Short summary
Short summary
Rain-on-snow (ROS) events are becoming more frequent as a result of a warming climate, and can have significant impacts on nature and society. Accurate representation of ROS events is need to identify where impacts are greatest both now and in the future. We compare rain-on-snow climatologies from a climate model, ground and satellite radar observations and show how different methods can lead to contrasting conclusions and interpretation of the results should take into account their limitations.
Giannis Sofiadis, Eleni Katragkou, Edouard L. Davin, Diana Rechid, Nathalie de Noblet-Ducoudre, Marcus Breil, Rita M. Cardoso, Peter Hoffmann, Lisa Jach, Ronny Meier, Priscilla A. Mooney, Pedro M. M. Soares, Susanna Strada, Merja H. Tölle, and Kirsten Warrach Sagi
Geosci. Model Dev., 15, 595–616, https://doi.org/10.5194/gmd-15-595-2022, https://doi.org/10.5194/gmd-15-595-2022, 2022
Short summary
Short summary
Afforestation is currently promoted as a greenhouse gas mitigation strategy. In our study, we examine the differences in soil temperature and moisture between grounds covered either by forests or grass. The main conclusion emerged is that forest-covered grounds are cooler but drier than open lands in summer. Therefore, afforestation disrupts the seasonal cycle of soil temperature, which in turn could trigger changes in crucial chemical processes such as soil carbon sequestration.
Shunya Koseki, Priscilla A. Mooney, William Cabos, Miguel Ángel Gaertner, Alba de la Vara, and Juan Jesus González-Alemán
Nat. Hazards Earth Syst. Sci., 21, 53–71, https://doi.org/10.5194/nhess-21-53-2021, https://doi.org/10.5194/nhess-21-53-2021, 2021
Short summary
Short summary
This study investigated one case of a tropical-like cyclone over the Mediterranean Sea under present and future climate conditions with a regional climate model. A pseudo global warming (PGW) technique is employed to simulate the cyclone under future climate, and our simulation showed that the cyclone is moderately strengthened by warmer climate. Other PGW simulations where only ocean and atmosphere are warmed reveal the interesting results that both have counteracting effects on the cyclone.
Shunya Koseki and Priscilla A. Mooney
Hydrol. Earth Syst. Sci., 23, 2795–2812, https://doi.org/10.5194/hess-23-2795-2019, https://doi.org/10.5194/hess-23-2795-2019, 2019
Short summary
Short summary
This study revealed that Lake Malawi plays an important role for local precipitation in terms of spatial distribution and diurnal cycle in boreal summer (November to March). The diurnal cycle is detected by harmonics analysis and empirical orthogonal function analysis. An idealized simulation of WRF without Lake Malawi clearly showed that Lake Malawi is a source of local precipitation.
Related subject area
Atmospheric sciences
Exploring the footprint representation of microwave radiance observations in an Arctic limited-area data assimilation system
Analysis of model error in forecast errors of extended atmospheric Lorenz 05 systems and the ECMWF system
Description and validation of Vehicular Emissions from Road Traffic (VERT) 1.0, an R-based framework for estimating road transport emissions from traffic flows
AeroMix v1.0.1: a Python package for modeling aerosol optical properties and mixing states
Impact of ITCZ width on global climate: ITCZ-MIP
Deep-learning-driven simulations of boundary layer clouds over the Southern Great Plains
Mixed-precision computing in the GRIST dynamical core for weather and climate modelling
A conservative immersed boundary method for the multi-physics urban large-eddy simulation model uDALES v2.0
RCEMIP-II: mock-Walker simulations as phase II of the radiative–convective equilibrium model intercomparison project
Objective identification of meteorological fronts and climatologies from ERA-Interim and ERA5
TAMS: a tracking, classifying, and variable-assigning algorithm for mesoscale convective systems in simulated and satellite-derived datasets
Development of the adjoint of the unified tropospheric–stratospheric chemistry extension (UCX) in GEOS-Chem adjoint v36
New explicit formulae for the settling speed of prolate spheroids in the atmosphere: theoretical background and implementation in AerSett v2.0.2
ZJU-AERO V0.5: an Accurate and Efficient Radar Operator designed for CMA-GFS/MESO with the capability to simulate non-spherical hydrometeors
The Year of Polar Prediction site Model Intercomparison Project (YOPPsiteMIP) phase 1: project overview and Arctic winter forecast evaluation
Evaluating CHASER V4.0 global formaldehyde (HCHO) simulations using satellite, aircraft, and ground-based remote-sensing observations
Global variable-resolution simulations of extreme precipitation over Henan, China, in 2021 with MPAS-Atmosphere v7.3
The CHIMERE chemistry-transport model v2023r1
tobac v1.5: introducing fast 3D tracking, splits and mergers, and other enhancements for identifying and analysing meteorological phenomena
Merged Observatory Data Files (MODFs): an integrated observational data product supporting process-oriented investigations and diagnostics
Simulation of marine stratocumulus using the super-droplet method: numerical convergence and comparison to a double-moment bulk scheme using SCALE-SDM 5.2.6-2.3.1
WRF-Comfort: simulating microscale variability in outdoor heat stress at the city scale with a mesoscale model
Representing effects of surface heterogeneity in a multi-plume eddy diffusivity mass flux boundary layer parameterization
Can TROPOMI NO2 satellite data be used to track the drop in and resurgence of NOx emissions in Germany between 2019–2021 using the multi-source plume method (MSPM)?
A spatiotemporally separated framework for reconstructing the sources of atmospheric radionuclide releases
A parameterization scheme for the floating wind farm in a coupled atmosphere–wave model (COAWST v3.7)
RoadSurf 1.1: open-source road weather model library
Calibrating and validating the Integrated Valuation of Ecosystem Services and Tradeoffs (InVEST) urban cooling model: case studies in France and the United States
The ddeq Python library for point source quantification from remote sensing images (version 1.0)
Incorporating Oxygen Isotopes of Oxidized Reactive Nitrogen in the Regional Atmospheric Chemistry Mechanism, version 2 (ICOIN-RACM2)
A general comprehensive evaluation method for cross-scale precipitation forecasts
Implementation of a Simple Actuator Disk for Large-Eddy Simulation in the Weather Research and Forecasting Model (WRF-SADLES v1.2) for wind turbine wake simulation
WRF-PDAF v1.0: implementation and application of an online localized ensemble data assimilation framework
Implementation and evaluation of diabatic advection in the Lagrangian transport model MPTRAC 2.6
An improved and extended parameterization of the CO2 15 µm cooling in the middle and upper atmosphere (CO2_cool_fort-1.0)
Development of a multiphase chemical mechanism to improve secondary organic aerosol formation in CAABA/MECCA (version 4.7.0)
Application of regional meteorology and air quality models based on the microprocessor without interlocked piped stages (MIPS) and LoongArch CPU platforms
Investigating ground-level ozone pollution in semi-arid and arid regions of Arizona using WRF-Chem v4.4 modeling
An objective identification technique for potential vorticity structures associated with African easterly waves
Importance of microphysical settings for climate forcing by stratospheric SO2 injections as modeled by SOCOL-AERv2
Assessment of surface ozone products from downscaled CAMS reanalysis and CAMS daily forecast using urban air quality monitoring stations in Iran
Open boundary conditions for atmospheric large-eddy simulations and their implementation in DALES4.4
Efficient and stable coupling of the SuperdropNet deep-learning-based cloud microphysics (v0.1.0) with the ICON climate and weather model (v2.6.5)
Three-dimensional variational assimilation with a multivariate background error covariance for the Model for Prediction Across Scales – Atmosphere with the Joint Effort for Data assimilation Integration (JEDI-MPAS 2.0.0-beta)
FUME 2.0 – Flexible Universal processor for Modeling Emissions
DEUCE v1.0: a neural network for probabilistic precipitation nowcasting with aleatoric and epistemic uncertainties
Evaluation of multi-season convection-permitting atmosphere – mixed-layer ocean simulations of the Maritime Continent
RASCAL v1.0.0: An Open Source Tool for Climatological Time Series Reconstruction and Extension
Selecting CMIP6 GCMs for CORDEX Dynamical Downscaling over Southeast Asia Using a Standardised Benchmarking Framework
Investigating the impact of coupling HARMONIE-WINS50 (cy43) meteorology to LOTOS-EUROS (v2.2.002) on a simulation of NO2 concentrations over the Netherlands
Máté Mile, Stephanie Guedj, and Roger Randriamampianina
Geosci. Model Dev., 17, 6571–6587, https://doi.org/10.5194/gmd-17-6571-2024, https://doi.org/10.5194/gmd-17-6571-2024, 2024
Short summary
Short summary
Satellite observations provide crucial information about atmospheric constituents in a global distribution that helps to better predict the weather over sparsely observed regions like the Arctic. However, the use of satellite data is usually conservative and imperfect. In this study, a better spatial representation of satellite observations is discussed and explored by a so-called footprint function or operator, highlighting its added value through a case study and diagnostics.
Hynek Bednář and Holger Kantz
Geosci. Model Dev., 17, 6489–6511, https://doi.org/10.5194/gmd-17-6489-2024, https://doi.org/10.5194/gmd-17-6489-2024, 2024
Short summary
Short summary
The forecast error growth of atmospheric phenomena is caused by initial and model errors. When studying the initial error growth, it may turn out that small-scale phenomena, which contribute little to the forecast product, significantly affect the ability to predict this product. With a negative result, we investigate in the extended Lorenz (2005) system whether omitting these phenomena will improve predictability. A theory explaining and describing this behavior is developed.
Giorgio Veratti, Alessandro Bigi, Sergio Teggi, and Grazia Ghermandi
Geosci. Model Dev., 17, 6465–6487, https://doi.org/10.5194/gmd-17-6465-2024, https://doi.org/10.5194/gmd-17-6465-2024, 2024
Short summary
Short summary
In this study, we present VERT (Vehicular Emissions from Road Traffic), an R package designed to estimate transport emissions using traffic estimates and vehicle fleet composition data. Compared to other tools available in the literature, VERT stands out for its user-friendly configuration and flexibility of user input. Case studies demonstrate its accuracy in both urban and regional contexts, making it a valuable tool for air quality management and transport scenario planning.
Sam P. Raj, Puna Ram Sinha, Rohit Srivastava, Srinivas Bikkina, and Damu Bala Subrahamanyam
Geosci. Model Dev., 17, 6379–6399, https://doi.org/10.5194/gmd-17-6379-2024, https://doi.org/10.5194/gmd-17-6379-2024, 2024
Short summary
Short summary
A Python successor to the aerosol module of the OPAC model, named AeroMix, has been developed, with enhanced capabilities to better represent real atmospheric aerosol mixing scenarios. AeroMix’s performance in modeling aerosol mixing states has been evaluated against field measurements, substantiating its potential as a versatile aerosol optical model framework for next-generation algorithms to infer aerosol mixing states and chemical composition.
Angeline G. Pendergrass, Michael P. Byrne, Oliver Watt-Meyer, Penelope Maher, and Mark J. Webb
Geosci. Model Dev., 17, 6365–6378, https://doi.org/10.5194/gmd-17-6365-2024, https://doi.org/10.5194/gmd-17-6365-2024, 2024
Short summary
Short summary
The width of the tropical rain belt affects many aspects of our climate, yet we do not understand what controls it. To better understand it, we present a method to change it in numerical model experiments. We show that the method works well in four different models. The behavior of the width is unexpectedly simple in some ways, such as how strong the winds are as it changes, but in other ways, it is more complicated, especially how temperature increases with carbon dioxide.
Tianning Su and Yunyan Zhang
Geosci. Model Dev., 17, 6319–6336, https://doi.org/10.5194/gmd-17-6319-2024, https://doi.org/10.5194/gmd-17-6319-2024, 2024
Short summary
Short summary
Using 2 decades of field observations over the Southern Great Plains, this study developed a deep-learning model to simulate the complex dynamics of boundary layer clouds. The deep-learning model can serve as the cloud parameterization within reanalysis frameworks, offering insights into improving the simulation of low clouds. By quantifying biases due to various meteorological factors and parameterizations, this deep-learning-driven approach helps bridge the observation–modeling divide.
Siyuan Chen, Yi Zhang, Yiming Wang, Zhuang Liu, Xiaohan Li, and Wei Xue
Geosci. Model Dev., 17, 6301–6318, https://doi.org/10.5194/gmd-17-6301-2024, https://doi.org/10.5194/gmd-17-6301-2024, 2024
Short summary
Short summary
This study explores strategies and techniques for implementing mixed-precision code optimization within an atmosphere model dynamical core. The coded equation terms in the governing equations that are sensitive (or insensitive) to the precision level have been identified. The performance of mixed-precision computing in weather and climate simulations was analyzed.
Sam O. Owens, Dipanjan Majumdar, Chris E. Wilson, Paul Bartholomew, and Maarten van Reeuwijk
Geosci. Model Dev., 17, 6277–6300, https://doi.org/10.5194/gmd-17-6277-2024, https://doi.org/10.5194/gmd-17-6277-2024, 2024
Short summary
Short summary
Designing cities that are resilient, sustainable, and beneficial to health requires an understanding of urban climate and air quality. This article presents an upgrade to the multi-physics numerical model uDALES, which can simulate microscale airflow, heat transfer, and pollutant dispersion in urban environments. This upgrade enables it to resolve realistic urban geometries more accurately and to take advantage of the resources available on current and future high-performance computing systems.
Allison A. Wing, Levi G. Silvers, and Kevin A. Reed
Geosci. Model Dev., 17, 6195–6225, https://doi.org/10.5194/gmd-17-6195-2024, https://doi.org/10.5194/gmd-17-6195-2024, 2024
Short summary
Short summary
This paper presents the experimental design for a model intercomparison project to study tropical clouds and climate. It is a follow-up from a prior project that used a simplified framework for tropical climate. The new project adds one new component – a specified pattern of sea surface temperatures as the lower boundary condition. We provide example results from one cloud-resolving model and one global climate model and test the sensitivity to the experimental parameters.
Philip G. Sansom and Jennifer L. Catto
Geosci. Model Dev., 17, 6137–6151, https://doi.org/10.5194/gmd-17-6137-2024, https://doi.org/10.5194/gmd-17-6137-2024, 2024
Short summary
Short summary
Weather fronts bring a lot of rain and strong winds to many regions of the mid-latitudes. We have developed an updated method of identifying these fronts in gridded data that can be used on new datasets with small grid spacing. The method can be easily applied to different datasets due to the use of open-source software for its development and shows improvements over similar previous methods. We present an updated estimate of the average frequency of fronts over the past 40 years.
Kelly M. Núñez Ocasio and Zachary L. Moon
Geosci. Model Dev., 17, 6035–6049, https://doi.org/10.5194/gmd-17-6035-2024, https://doi.org/10.5194/gmd-17-6035-2024, 2024
Short summary
Short summary
TAMS is an open-source Python-based package for tracking and classifying mesoscale convective systems that can be used to study observed and simulated systems. Each step of the algorithm is described in this paper with examples showing how to make use of visualization and post-processing tools within the package. A unique and valuable feature of this tracker is its support for unstructured grids in the identification stage and grid-independent tracking.
Irene C. Dedoussi, Daven K. Henze, Sebastian D. Eastham, Raymond L. Speth, and Steven R. H. Barrett
Geosci. Model Dev., 17, 5689–5703, https://doi.org/10.5194/gmd-17-5689-2024, https://doi.org/10.5194/gmd-17-5689-2024, 2024
Short summary
Short summary
Atmospheric model gradients provide a meaningful tool for better understanding the underlying atmospheric processes. Adjoint modeling enables computationally efficient gradient calculations. We present the adjoint of the GEOS-Chem unified chemistry extension (UCX). With this development, the GEOS-Chem adjoint model can capture stratospheric ozone and other processes jointly with tropospheric processes. We apply it to characterize the Antarctic ozone depletion potential of active halogen species.
Sylvain Mailler, Sotirios Mallios, Arineh Cholakian, Vassilis Amiridis, Laurent Menut, and Romain Pennel
Geosci. Model Dev., 17, 5641–5655, https://doi.org/10.5194/gmd-17-5641-2024, https://doi.org/10.5194/gmd-17-5641-2024, 2024
Short summary
Short summary
We propose two explicit expressions to calculate the settling speed of solid atmospheric particles with prolate spheroidal shapes. The first formulation is based on theoretical arguments only, while the second one is based on computational fluid dynamics calculations. We show that the first method is suitable for virtually all atmospheric aerosols, provided their shape can be adequately described as a prolate spheroid, and we provide an implementation of the first method in AerSett v2.0.2.
Hejun Xie, Lei Bi, and Wei Han
Geosci. Model Dev., 17, 5657–5688, https://doi.org/10.5194/gmd-17-5657-2024, https://doi.org/10.5194/gmd-17-5657-2024, 2024
Short summary
Short summary
A radar operator plays a crucial role in utilizing radar observations to enhance numerical weather forecasts. However, developing an advanced radar operator is challenging due to various complexities associated with the wave scattering by non-spherical hydrometeors, radar beam propagation, and multiple platforms. In this study, we introduce a novel radar operator named the Accurate and Efficient Radar Operator developed by ZheJiang University (ZJU-AERO) which boasts several unique features.
Jonathan J. Day, Gunilla Svensson, Barbara Casati, Taneil Uttal, Siri-Jodha Khalsa, Eric Bazile, Elena Akish, Niramson Azouz, Lara Ferrighi, Helmut Frank, Michael Gallagher, Øystein Godøy, Leslie M. Hartten, Laura X. Huang, Jareth Holt, Massimo Di Stefano, Irene Suomi, Zen Mariani, Sara Morris, Ewan O'Connor, Roberta Pirazzini, Teresa Remes, Rostislav Fadeev, Amy Solomon, Johanna Tjernström, and Mikhail Tolstykh
Geosci. Model Dev., 17, 5511–5543, https://doi.org/10.5194/gmd-17-5511-2024, https://doi.org/10.5194/gmd-17-5511-2024, 2024
Short summary
Short summary
The YOPP site Model Intercomparison Project (YOPPsiteMIP), which was designed to facilitate enhanced weather forecast evaluation in polar regions, is discussed here, focussing on describing the archive of forecast data and presenting a multi-model evaluation at Arctic supersites during February and March 2018. The study highlights an underestimation in boundary layer temperature variance that is common across models and a related inability to forecast cold extremes at several of the sites.
Hossain Mohammed Syedul Hoque, Kengo Sudo, Hitoshi Irie, Yanfeng He, and Md Firoz Khan
Geosci. Model Dev., 17, 5545–5571, https://doi.org/10.5194/gmd-17-5545-2024, https://doi.org/10.5194/gmd-17-5545-2024, 2024
Short summary
Short summary
Using multi-platform observations, we validated global formaldehyde (HCHO) simulations from a chemistry transport model. HCHO is a crucial intermediate in the chemical catalytic cycle that governs the ozone formation in the troposphere. The model was capable of replicating the observed spatiotemporal variability in HCHO. In a few cases, the model's capability was limited. This is attributed to the uncertainties in the observations and the model parameters.
Zijun Liu, Li Dong, Zongxu Qiu, Xingrong Li, Huiling Yuan, Dongmei Meng, Xiaobin Qiu, Dingyuan Liang, and Yafei Wang
Geosci. Model Dev., 17, 5477–5496, https://doi.org/10.5194/gmd-17-5477-2024, https://doi.org/10.5194/gmd-17-5477-2024, 2024
Short summary
Short summary
In this study, we completed a series of simulations with MPAS-Atmosphere (version 7.3) to study the extreme precipitation event of Henan, China, during 20–22 July 2021. We found the different performance of two built-in parameterization scheme suites (mesoscale and convection-permitting suites) with global quasi-uniform and variable-resolution meshes. This study holds significant implications for advancing the understanding of the scale-aware capability of MPAS-Atmosphere.
Laurent Menut, Arineh Cholakian, Romain Pennel, Guillaume Siour, Sylvain Mailler, Myrto Valari, Lya Lugon, and Yann Meurdesoif
Geosci. Model Dev., 17, 5431–5457, https://doi.org/10.5194/gmd-17-5431-2024, https://doi.org/10.5194/gmd-17-5431-2024, 2024
Short summary
Short summary
A new version of the CHIMERE model is presented. This version contains both computational and physico-chemical changes. The computational changes make it easy to choose the variables to be extracted as a result, including values of maximum sub-hourly concentrations. Performance tests show that the model is 1.5 to 2 times faster than the previous version for the same setup. Processes such as turbulence, transport schemes and dry deposition have been modified and updated.
G. Alexander Sokolowsky, Sean W. Freeman, William K. Jones, Julia Kukulies, Fabian Senf, Peter J. Marinescu, Max Heikenfeld, Kelcy N. Brunner, Eric C. Bruning, Scott M. Collis, Robert C. Jackson, Gabrielle R. Leung, Nils Pfeifer, Bhupendra A. Raut, Stephen M. Saleeby, Philip Stier, and Susan C. van den Heever
Geosci. Model Dev., 17, 5309–5330, https://doi.org/10.5194/gmd-17-5309-2024, https://doi.org/10.5194/gmd-17-5309-2024, 2024
Short summary
Short summary
Building on previous analysis tools developed for atmospheric science, the original release of the Tracking and Object-Based Analysis (tobac) Python package, v1.2, was open-source, modular, and insensitive to the type of gridded input data. Here, we present the latest version of tobac, v1.5, which substantially improves scientific capabilities and computational efficiency from the previous version. These enhancements permit new uses for tobac in atmospheric science and potentially other fields.
Taneil Uttal, Leslie M. Hartten, Siri Jodha Khalsa, Barbara Casati, Gunilla Svensson, Jonathan Day, Jareth Holt, Elena Akish, Sara Morris, Ewan O'Connor, Roberta Pirazzini, Laura X. Huang, Robert Crawford, Zen Mariani, Øystein Godøy, Johanna A. K. Tjernström, Giri Prakash, Nicki Hickmon, Marion Maturilli, and Christopher J. Cox
Geosci. Model Dev., 17, 5225–5247, https://doi.org/10.5194/gmd-17-5225-2024, https://doi.org/10.5194/gmd-17-5225-2024, 2024
Short summary
Short summary
A Merged Observatory Data File (MODF) format to systematically collate complex atmosphere, ocean, and terrestrial data sets collected by multiple instruments during field campaigns is presented. The MODF format is also designed to be applied to model output data, yielding format-matching Merged Model Data Files (MMDFs). MODFs plus MMDFs will augment and accelerate the synergistic use of model results with observational data to increase understanding and predictive skill.
Chongzhi Yin, Shin-ichiro Shima, Lulin Xue, and Chunsong Lu
Geosci. Model Dev., 17, 5167–5189, https://doi.org/10.5194/gmd-17-5167-2024, https://doi.org/10.5194/gmd-17-5167-2024, 2024
Short summary
Short summary
We investigate numerical convergence properties of a particle-based numerical cloud microphysics model (SDM) and a double-moment bulk scheme for simulating a marine stratocumulus case, compare their results with model intercomparison project results, and present possible explanations for the different results of the SDM and the bulk scheme. Aerosol processes can be accurately simulated using SDM, and this may be an important factor affecting the behavior and morphology of marine stratocumulus.
Alberto Martilli, Negin Nazarian, E. Scott Krayenhoff, Jacob Lachapelle, Jiachen Lu, Esther Rivas, Alejandro Rodriguez-Sanchez, Beatriz Sanchez, and José Luis Santiago
Geosci. Model Dev., 17, 5023–5039, https://doi.org/10.5194/gmd-17-5023-2024, https://doi.org/10.5194/gmd-17-5023-2024, 2024
Short summary
Short summary
Here, we present a model that quantifies the thermal stress and its microscale variability at a city scale with a mesoscale model. This tool can have multiple applications, from early warnings of extreme heat to the vulnerable population to the evaluation of the effectiveness of heat mitigation strategies. It is the first model that includes information on microscale variability in a mesoscale model, something that is essential for fully evaluating heat stress.
Nathan P. Arnold
Geosci. Model Dev., 17, 5041–5056, https://doi.org/10.5194/gmd-17-5041-2024, https://doi.org/10.5194/gmd-17-5041-2024, 2024
Short summary
Short summary
Earth system models often represent the land surface at smaller scales than the atmosphere, but surface–atmosphere coupling uses only aggregated surface properties. This study presents a method to allow heterogeneous surface properties to modify boundary layer updrafts. The method is tested in single column experiments. Updraft properties are found to reasonably covary with surface conditions, and simulated boundary layer variability is enhanced over more heterogeneous land surfaces.
Enrico Dammers, Janot Tokaya, Christian Mielke, Kevin Hausmann, Debora Griffin, Chris McLinden, Henk Eskes, and Renske Timmermans
Geosci. Model Dev., 17, 4983–5007, https://doi.org/10.5194/gmd-17-4983-2024, https://doi.org/10.5194/gmd-17-4983-2024, 2024
Short summary
Short summary
Nitrogen dioxide (NOx) is produced by sources such as industry and traffic and is directly linked to negative impacts on health and the environment. The current construction of emission inventories to keep track of NOx emissions is slow and time-consuming. Satellite measurements provide a way to quickly and independently estimate emissions. In this study, we apply a consistent methodology to derive NOx emissions over Germany and illustrate the value of having such a method for fast projections.
Yuhan Xu, Sheng Fang, Xinwen Dong, and Shuhan Zhuang
Geosci. Model Dev., 17, 4961–4982, https://doi.org/10.5194/gmd-17-4961-2024, https://doi.org/10.5194/gmd-17-4961-2024, 2024
Short summary
Short summary
Recent atmospheric radionuclide leakages from unknown sources have posed a new challenge in nuclear emergency assessment. Reconstruction via environmental observations is the only feasible way to identify sources, but simultaneous reconstruction of the source location and release rate yields high uncertainties. We propose a spatiotemporally separated reconstruction strategy that avoids these uncertainties and outperforms state-of-the-art methods with respect to accuracy and uncertainty ranges.
Shaokun Deng, Shengmu Yang, Shengli Chen, Daoyi Chen, Xuefeng Yang, and Shanshan Cui
Geosci. Model Dev., 17, 4891–4909, https://doi.org/10.5194/gmd-17-4891-2024, https://doi.org/10.5194/gmd-17-4891-2024, 2024
Short summary
Short summary
Global offshore wind power development is moving from offshore to deeper waters, where floating offshore wind turbines have an advantage over bottom-fixed turbines. However, current wind farm parameterization schemes in mesoscale models are not applicable to floating turbines. We propose a floating wind farm parameterization scheme that accounts for the attenuation of the significant wave height by floating turbines. The results indicate that it has a significant effect on the power output.
Virve Eveliina Karsisto
Geosci. Model Dev., 17, 4837–4853, https://doi.org/10.5194/gmd-17-4837-2024, https://doi.org/10.5194/gmd-17-4837-2024, 2024
Short summary
Short summary
RoadSurf is an open-source library that contains functions from the Finnish Meteorological Institute’s road weather model. The evaluation of the library shows that it is well suited for making road surface temperature forecasts. The evaluation was done by making forecasts for about 400 road weather stations in Finland with the library. Accurate forecasts help road authorities perform salting and plowing operations at the right time and keep roads safe for drivers.
Perrine Hamel, Martí Bosch, Léa Tardieu, Aude Lemonsu, Cécile de Munck, Chris Nootenboom, Vincent Viguié, Eric Lonsdorf, James A. Douglass, and Richard P. Sharp
Geosci. Model Dev., 17, 4755–4771, https://doi.org/10.5194/gmd-17-4755-2024, https://doi.org/10.5194/gmd-17-4755-2024, 2024
Short summary
Short summary
The InVEST Urban Cooling model estimates the cooling effect of vegetation in cities. We further developed an algorithm to facilitate model calibration and evaluation. Applying the algorithm to case studies in France and in the United States, we found that nighttime air temperature estimates compare well with reference datasets. Estimated change in temperature from a land cover scenario compares well with an alternative model estimate, supporting the use of the model for urban planning decisions.
Gerrit Kuhlmann, Erik Koene, Sandro Meier, Diego Santaren, Grégoire Broquet, Frédéric Chevallier, Janne Hakkarainen, Janne Nurmela, Laia Amorós, Johanna Tamminen, and Dominik Brunner
Geosci. Model Dev., 17, 4773–4789, https://doi.org/10.5194/gmd-17-4773-2024, https://doi.org/10.5194/gmd-17-4773-2024, 2024
Short summary
Short summary
We present a Python software library for data-driven emission quantification (ddeq). It can be used to determine the emissions of hot spots (cities, power plants and industry) from remote sensing images using different methods. ddeq can be extended for new datasets and methods, providing a powerful community tool for users and developers. The application of the methods is shown using Jupyter notebooks included in the library.
Wendell W. Walters, Masayuki Takeuchi, Nga L. Ng, and Meredith G. Hastings
Geosci. Model Dev., 17, 4673–4687, https://doi.org/10.5194/gmd-17-4673-2024, https://doi.org/10.5194/gmd-17-4673-2024, 2024
Short summary
Short summary
The study introduces a novel chemical mechanism for explicitly tracking oxygen isotope transfer in oxidized reactive nitrogen and odd oxygen using the Regional Atmospheric Chemistry Mechanism, version 2. This model enhances our ability to simulate and compare oxygen isotope compositions of reactive nitrogen, revealing insights into oxidation chemistry. The approach shows promise for improving atmospheric chemistry models and tropospheric oxidation capacity predictions.
Bing Zhang, Mingjian Zeng, Anning Huang, Zhengkun Qin, Couhua Liu, Wenru Shi, Xin Li, Kefeng Zhu, Chunlei Gu, and Jialing Zhou
Geosci. Model Dev., 17, 4579–4601, https://doi.org/10.5194/gmd-17-4579-2024, https://doi.org/10.5194/gmd-17-4579-2024, 2024
Short summary
Short summary
By directly analyzing the proximity of precipitation forecasts and observations, a precipitation accuracy score (PAS) method was constructed. This method does not utilize a traditional contingency-table-based classification verification; however, it can replace the threat score (TS), equitable threat score (ETS), and other skill score methods, and it can be used to calculate the accuracy of numerical models or quantitative precipitation forecasts.
Hai Bui, Mostafa Bakhoday-Paskyabi, and Mohammadreza Mohammadpour-Penchah
Geosci. Model Dev., 17, 4447–4465, https://doi.org/10.5194/gmd-17-4447-2024, https://doi.org/10.5194/gmd-17-4447-2024, 2024
Short summary
Short summary
We developed a new wind turbine wake model, the Simple Actuator Disc for Large Eddy Simulation (SADLES), integrated with the widely used Weather Research and Forecasting (WRF) model. WRF-SADLES accurately simulates wind turbine wakes at resolutions of a few dozen meters, aligning well with idealized simulations and observational measurements. This makes WRF-SADLES a promising tool for wind energy research, offering a balance between accuracy, computational efficiency, and ease of implementation.
Changliang Shao and Lars Nerger
Geosci. Model Dev., 17, 4433–4445, https://doi.org/10.5194/gmd-17-4433-2024, https://doi.org/10.5194/gmd-17-4433-2024, 2024
Short summary
Short summary
This paper introduces and evaluates WRF-PDAF, a fully online-coupled ensemble data assimilation (DA) system. A key advantage of the WRF-PDAF configuration is its ability to concurrently integrate all ensemble states, eliminating the need for time-consuming distribution and collection of ensembles during the coupling communication. The extra time required for DA amounts to only 20.6 % per cycle. Twin experiment results underscore the effectiveness of the WRF-PDAF system.
Jan Clemens, Lars Hoffmann, Bärbel Vogel, Sabine Grießbach, and Nicole Thomas
Geosci. Model Dev., 17, 4467–4493, https://doi.org/10.5194/gmd-17-4467-2024, https://doi.org/10.5194/gmd-17-4467-2024, 2024
Short summary
Short summary
Lagrangian transport models simulate the transport of air masses in the atmosphere. For example, one model (CLaMS) is well suited to calculating transport as it uses a special coordinate system and special vertical wind. However, it only runs inefficiently on modern supercomputers. Hence, we have implemented the benefits of CLaMS into a new model (MPTRAC), which is already highly efficient on modern supercomputers. Finally, in extensive tests, we showed that CLaMS and MPTRAC agree very well.
Manuel López-Puertas, Federico Fabiano, Victor Fomichev, Bernd Funke, and Daniel R. Marsh
Geosci. Model Dev., 17, 4401–4432, https://doi.org/10.5194/gmd-17-4401-2024, https://doi.org/10.5194/gmd-17-4401-2024, 2024
Short summary
Short summary
The radiative infrared cooling of CO2 in the middle atmosphere is crucial for computing its thermal structure. It requires one however to include non-local thermodynamic equilibrium processes which are computationally very expensive, which cannot be afforded by climate models. In this work, we present an updated, efficient, accurate and very fast (~50 µs) parameterization of that cooling able to cope with CO2 abundances from half the pre-industrial values to 10 times the current abundance.
Felix Wieser, Rolf Sander, Changmin Cho, Hendrik Fuchs, Thorsten Hohaus, Anna Novelli, Ralf Tillmann, and Domenico Taraborrelli
Geosci. Model Dev., 17, 4311–4330, https://doi.org/10.5194/gmd-17-4311-2024, https://doi.org/10.5194/gmd-17-4311-2024, 2024
Short summary
Short summary
The chemistry scheme of the atmospheric box model CAABA/MECCA is expanded to achieve an improved aerosol formation from emitted organic compounds. In addition to newly added reactions, temperature-dependent partitioning of all new species between the gas and aqueous phases is estimated and included in the pre-existing scheme. Sensitivity runs show an overestimation of key compounds from isoprene, which can be explained by a lack of aqueous-phase degradation reactions and box model limitations.
Zehua Bai, Qizhong Wu, Kai Cao, Yiming Sun, and Huaqiong Cheng
Geosci. Model Dev., 17, 4383–4399, https://doi.org/10.5194/gmd-17-4383-2024, https://doi.org/10.5194/gmd-17-4383-2024, 2024
Short summary
Short summary
There is relatively limited research on the application of scientific computing on RISC CPU platforms. The MIPS architecture CPUs, a type of RISC CPUs, have distinct advantages in energy efficiency and scalability. The air quality modeling system can run stably on the MIPS and LoongArch platforms, and the experiment results verify the stability of scientific computing on the platforms. The work provides a technical foundation for the scientific application based on MIPS and LoongArch.
Yafang Guo, Chayan Roychoudhury, Mohammad Amin Mirrezaei, Rajesh Kumar, Armin Sorooshian, and Avelino F. Arellano
Geosci. Model Dev., 17, 4331–4353, https://doi.org/10.5194/gmd-17-4331-2024, https://doi.org/10.5194/gmd-17-4331-2024, 2024
Short summary
Short summary
This research focuses on surface ozone (O3) pollution in Arizona, a historically air-quality-challenged arid and semi-arid region in the US. The unique characteristics of this kind of region, e.g., intense heat, minimal moisture, and persistent desert shrubs, play a vital role in comprehending O3 exceedances. Using the WRF-Chem model, we analyzed O3 levels in the pre-monsoon month, revealing the model's skill in capturing diurnal and MDA8 O3 levels.
Christoph Fischer, Andreas H. Fink, Elmar Schömer, Marc Rautenhaus, and Michael Riemer
Geosci. Model Dev., 17, 4213–4228, https://doi.org/10.5194/gmd-17-4213-2024, https://doi.org/10.5194/gmd-17-4213-2024, 2024
Short summary
Short summary
This study presents a method for identifying and tracking 3-D potential vorticity structures within African easterly waves (AEWs). Each identified structure is characterized by descriptors, including its 3-D position and orientation, which have been validated through composite comparisons. A trough-centric perspective on the descriptors reveals the evolution and distinct characteristics of AEWs. These descriptors serve as valuable statistical inputs for the study of AEW-related phenomena.
Sandro Vattioni, Andrea Stenke, Beiping Luo, Gabriel Chiodo, Timofei Sukhodolov, Elia Wunderlin, and Thomas Peter
Geosci. Model Dev., 17, 4181–4197, https://doi.org/10.5194/gmd-17-4181-2024, https://doi.org/10.5194/gmd-17-4181-2024, 2024
Short summary
Short summary
We investigate the sensitivity of aerosol size distributions in the presence of strong SO2 injections for climate interventions or after volcanic eruptions to the call sequence and frequency of the routines for nucleation and condensation in sectional aerosol models with operator splitting. Using the aerosol–chemistry–climate model SOCOL-AERv2, we show that the radiative and chemical outputs are sensitive to these settings at high H2SO4 supersaturations and how to obtain reliable results.
Najmeh Kaffashzadeh and Abbas-Ali Aliakbari Bidokhti
Geosci. Model Dev., 17, 4155–4179, https://doi.org/10.5194/gmd-17-4155-2024, https://doi.org/10.5194/gmd-17-4155-2024, 2024
Short summary
Short summary
This paper assesses the capability of two state-of-the-art global datasets in simulating surface ozone over Iran using a new methodology. It is found that the global model data need to be downscaled for regulatory purposes or policy applications at local scales. The method can be useful not only for the evaluation but also for the prediction of other chemical species, such as aerosols.
Franciscus Liqui Lung, Christian Jakob, A. Pier Siebesma, and Fredrik Jansson
Geosci. Model Dev., 17, 4053–4076, https://doi.org/10.5194/gmd-17-4053-2024, https://doi.org/10.5194/gmd-17-4053-2024, 2024
Short summary
Short summary
Traditionally, high-resolution atmospheric models employ periodic boundary conditions, which limit simulations to domains without horizontal variations. In this research open boundary conditions are developed to replace the periodic boundary conditions. The implementation is tested in a controlled setup, and the results show minimal disturbances. Using these boundary conditions, high-resolution models can be forced by a coarser model to study atmospheric phenomena in realistic background states.
Caroline Arnold, Shivani Sharma, Tobias Weigel, and David S. Greenberg
Geosci. Model Dev., 17, 4017–4029, https://doi.org/10.5194/gmd-17-4017-2024, https://doi.org/10.5194/gmd-17-4017-2024, 2024
Short summary
Short summary
In atmospheric models, rain formation is simplified to be computationally efficient. We trained a machine learning model, SuperdropNet, to emulate warm-rain formation based on super-droplet simulations. Here, we couple SuperdropNet with an atmospheric model in a warm-bubble experiment and find that the coupled simulation runs stable and produces reasonable results, making SuperdropNet a viable ML proxy for droplet simulations. We also present a comprehensive benchmark for coupling architectures.
Byoung-Joo Jung, Benjamin Ménétrier, Chris Snyder, Zhiquan Liu, Jonathan J. Guerrette, Junmei Ban, Ivette Hernández Baños, Yonggang G. Yu, and William C. Skamarock
Geosci. Model Dev., 17, 3879–3895, https://doi.org/10.5194/gmd-17-3879-2024, https://doi.org/10.5194/gmd-17-3879-2024, 2024
Short summary
Short summary
We describe the multivariate static background error covariance (B) for the JEDI-MPAS 3D-Var data assimilation system. With tuned B parameters, the multivariate B gives physically balanced analysis increment fields in the single-observation test framework. In the month-long cycling experiment with a global 60 km mesh, 3D-Var with static B performs stably. Due to its simple workflow and minimal computational requirements, JEDI-MPAS 3D-Var can be useful for the research community.
Michal Belda, Nina Benešová, Jaroslav Resler, Peter Huszár, Ondřej Vlček, Pavel Krč, Jan Karlický, Pavel Juruš, and Kryštof Eben
Geosci. Model Dev., 17, 3867–3878, https://doi.org/10.5194/gmd-17-3867-2024, https://doi.org/10.5194/gmd-17-3867-2024, 2024
Short summary
Short summary
For modeling atmospheric chemistry, it is necessary to provide data on emissions of pollutants. These can come from various sources and in various forms, and preprocessing of the data to be ingestible by chemistry models can be quite challenging. We developed the FUME processor to use a database layer that internally transforms all input data into a rigid structure, facilitating further processing to allow for emission processing from the continental to the street scale.
Bent Harnist, Seppo Pulkkinen, and Terhi Mäkinen
Geosci. Model Dev., 17, 3839–3866, https://doi.org/10.5194/gmd-17-3839-2024, https://doi.org/10.5194/gmd-17-3839-2024, 2024
Short summary
Short summary
Probabilistic precipitation nowcasting (local forecasting for 0–6 h) is crucial for reducing damage from events like flash floods. For this goal, we propose the DEUCE neural-network-based model which uses data and model uncertainties to generate an ensemble of potential precipitation development scenarios for the next hour. Trained and evaluated with Finnish precipitation composites, DEUCE was found to produce more skillful and reliable nowcasts than established models.
Emma Howard, Steven Woolnough, Nicholas Klingaman, Daniel Shipley, Claudio Sanchez, Simon C. Peatman, Cathryn E. Birch, and Adrian J. Matthews
Geosci. Model Dev., 17, 3815–3837, https://doi.org/10.5194/gmd-17-3815-2024, https://doi.org/10.5194/gmd-17-3815-2024, 2024
Short summary
Short summary
This paper describes a coupled atmosphere–mixed-layer ocean simulation setup that will be used to study weather processes in Southeast Asia. The set-up has been used to compare high-resolution simulations, which are able to partially resolve storms, to coarser simulations, which cannot. We compare the model performance at representing variability of rainfall and sea surface temperatures across length scales between the coarse and fine models.
Álvaro González-Cervera and Luis Durán
EGUsphere, https://doi.org/10.5194/egusphere-2024-958, https://doi.org/10.5194/egusphere-2024-958, 2024
Short summary
Short summary
RASCAL is an open-source Python tool designed for reconstructing daily climate observations, especially in regions with complex local phenomena. It merges large-scale weather patterns with local weather using the Analog Method. Evaluations in central Spain show that RASCAL outperforms ERA20C reanalysis in reconstructing precipitation and temperature. RASCAL offers opportunities of broad scientific applications, from short-term forecasts to local-scale climate change scenarios.
Phuong Loan Nguyen, Lisa V. Alexander, Marcus J. Thatcher, Son C. H. Truong, Rachael N. Isphording, and John L. McGregor
Geosci. Model Dev. Discuss., https://doi.org/10.5194/gmd-2024-84, https://doi.org/10.5194/gmd-2024-84, 2024
Revised manuscript accepted for GMD
Short summary
Short summary
We apply a comprehensive approach to select a subset of CMIP6 that is suitable for dynamical downscaling over Southeast Asia by considering model performance, model independence, data availability, and future climate change spread. The standardised benchmarking framework is applied to identify a subset of models through two stages of assessment: statistical-based and process-based metrics. We finalize a sub-set of two independent models for dynamical downscaling over Southeast Asia.
Andrés Yarce Botero, Michiel van Weele, Arjo Segers, Pier Siebesma, and Henk Eskes
Geosci. Model Dev., 17, 3765–3781, https://doi.org/10.5194/gmd-17-3765-2024, https://doi.org/10.5194/gmd-17-3765-2024, 2024
Short summary
Short summary
HARMONIE WINS50 reanalysis data with 0.025° × 0.025° resolution from 2019 to 2021 were coupled with the LOTOS-EUROS Chemical Transport Model. HARMONIE and ECMWF meteorology configurations against Cabauw observations (52.0° N, 4.9° W) were evaluated as simulated NO2 concentrations with ground-level sensors. Differences in crucial meteorological input parameters (boundary layer height, vertical diffusion coefficient) between the hydrostatic and non-hydrostatic models were analysed.
Cited articles
Aggarwal, C. C., Hinneburg, A., and Keim, D. A.: On the surprising behavior of distance metrics in high dimensional space, in: International conference on database theory, Springer, Berlin, Heidelberg, 420–434, https://doi.org/10.1007/3-540-44503-X_27, 2001.
Ahmed, K., Sachindra, D. A., Shahid, S., Demirel, M. C., and Chung, E.-S.: Selection of multi-model ensemble of general circulation models for the simulation of precipitation and maximum and minimum temperature based on spatial assessment metrics, Hydrol. Earth Syst. Sci., 23, 4803–4824, https://doi.org/10.5194/hess-23-4803-2019, 2019.
Armstrong, J. S. and Collopy, F.: Error measures for generalizing about forecasting methods: Empirical comparisons, Int. J. Forecast., 8, 69–80, https://doi.org/10.1016/0169-2070(92)90008-W, 1992.
Baker, N. C. and Taylor, P. C.: A framework for evaluating climate model performance metrics, J. Climate, 29, 1773–1782, https://doi.org/10.1175/JCLI-D-15-0114.1, 2016.
Bell, B., Hersbach, H., Berrisford, P., Dahlgren, P., Horányi, A., Muñoz Sabater, J., Nicolas, J., Radu, R., Schepers, D., Simmons, A., Soci, C., and Thépaut, J.-N.: ERA5 monthly averaged data on pressure levels from 1950 to 1978 (preliminary version), Copernicus Climate Change Service (C3S) Climate Data Store (CDS) [data set], https://cds.climate.copernicus-climate.eu/cdsapp#!/dataset/reanalysis-era5-pressure-levels-monthly-means-preliminary-back-extension?tab=overview (last access: 16 April 2024), 2020.
Bellomo, K., Angeloni, M., Corti, S., and von Hardenberg, J.: Future climate change shaped by inter-model differences in Atlantic meridional overturning circulation response, Nat. Commun., 12, 1–10, https://doi.org/10.1038/s41467-021-24015-w, 2021.
Benestad, R. E., Mezghani, A., Lutz, J., Dobler, A., Parding, K. M., and Landgren, O. A.: Various ways of using empirical orthogonal functions for climate model evaluation, Geosci. Model Dev., 16, 2899–2913, https://doi.org/10.5194/gmd-16-2899-2023, 2023.
Boberg, F., Berg, P., Thejll, P., Gutowski, W. J., and Christensen, J. H.: Improved confidence in climate change projections of precipitation evaluated using daily statistics from the PRUDENCE ensemble, Clim. Dynam., 32, 1097–1106, https://doi.org/10.1007/s00382-008-0446-y, 2009.
Boberg, F., Berg, P., Thejll, P., Gutowski, W. J., and Christensen, J. H.: Improved confidence in climate change projections of precipitation further evaluated using daily statistics from ENSEMBLES models, Clim. Dynam., 35, 1509–1520, https://doi.org/10.1007/s00382-009-0683-8, 2010.
Chai, T. and Draxler, R. R.: Root mean square error (RMSE) or mean absolute error (MAE)? – Arguments against avoiding RMSE in the literature, Geosci. Model Dev., 7, 1247–1250, https://doi.org/10.5194/gmd-7-1247-2014, 2014.
Christensen, J. H. and Christensen, O. B.: A summary of the PRUDENCE model projections of changes in European climate by the end of this century, Climatic Change, 81, 7–30, https://doi.org/10.1007/s10584-006-9210-7, 2007.
Collier, N., Hoffman, F. M., Lawrence, D. M., Keppel-Aleks, G., Koven, C. D., Riley, W. J., and Randerson, J. T.: The International Land Model Benchmarking (ILAMB) system: design, theory, and implementation, J. Adv. Model. Earth Sy., 10, 2731–2754, https://doi.org/10.1029/2018MS001354, 2018.
Dembélé, M., Hrachowitz, M., Savenije, H. H., Mariéthoz, G., and Schaefli, B.: Improving the predictive skill of a distributed hydrological model by calibration on spatial patterns with multiple satellite data sets, Water Resour. Res., 56, e2019WR026085, https://doi.org/10.1029/2019WR026085, 2020.
Demirel, M. C., Mai, J., Mendiguren, G., Koch, J., Samaniego, L., and Stisen, S.: Combining satellite data and appropriate objective functions for improved spatial pattern performance of a distributed hydrologic model, Hydrol. Earth Syst. Sci., 22, 1299–1315, https://doi.org/10.5194/hess-22-1299-2018, 2018.
Flato, G., Marotzke, J., Abiodun, B., Braconnot, P., Chou, S. C., Collins, W., Cox, P., Driouech, F., Emori, S., Eyring, V., Forest, C., Gleckler, P., Guilyardi, E., Jakob, C., Kattsov, V., Reason, C., and Rummukainen, M.: Evaluation of climate models, in: Climate Change 2013: the physical science basis. Contribution of Working Group I to the Fifth Assessment Report of the Intergovernmental Panel on Climate Change, edited by: Stocker, T. F., Qin, D., Plattner, G.-K., Tignor, M., Allen, S. K., Boschung, J., Nauels, A., Xia, Y., Bex, V., and Midgley, P. M., Cambridge University Press, Cambridge, United Kingdom and New York, NY, USA, 741–866, https://www.ipcc.ch/site/assets/uploads/2018/02/WG1AR5_Chapter09_FINAL.pdf (last access: 16 April 2024), 2013.
Giot, O., Termonia, P., Degrauwe, D., De Troch, R., Caluwaerts, S., Smet, G., Berckmans, J., Deckmyn, A., De Cruz, L., De Meutter, P., Duerinckx, A., Gerard, L., Hamdi, R., Van den Bergh, J., Van Ginderachter, M., and Van Schaeybroeck, B.: Validation of the ALARO-0 model within the EURO-CORDEX framework, Geosci. Model Dev., 9, 1143–1152, https://doi.org/10.5194/gmd-9-1143-2016, 2016.
Gupta, H. V., Kling, H., Yilmaz, K. K., and Martinez, G. F.: Decomposition of the mean squared error and NSE performance criteria: Implications for improving hydrological modelling, J. Hydrol., 377, 80–91, https://doi.org/10.1016/j.jhydrol.2009.08.003, 2009.
He, X., Lei, X. D., and Dong, L. H.: How large is the difference in large-scale forest biomass estimations based on new climate-modified stand biomass models?, Ecol. Indic., 126, 107569, https://doi.org/10.1016/j.ecolind.2021.107569, 2021.
Hu, Z., Chen, X., Zhou, Q., Chen, D., and Li, J.: DISO: A rethink of Taylor diagram, Int. J. Climatol., 39, 2825–2832, https://doi.org/10.1002/joc.5972, 2019.
Hyndman, R. J. and Koehler, A. B.: Another look at measures of forecast accuracy, Int. J. Forecast., 22, 679–688, https://doi.org/10.1016/j.ijforecast.2006.03.001, 2006.
IPCC: Climate Change 2021: The Physical Science Basis. Contribution of Working Group I to the Sixth Assessment Report of the Intergovernmental Panel on Climate Change, edited by: Masson-Delmotte, V., Zhai, P., Pirani, A., Connors, S. L., Péan, C., Berger, S., Caud, N., Chen, Y., Goldfarb, L., Gomis, M. I., Huang, M., Leitzell, K., Lonnoy, E., Matthews, J. B. R., Maycock, T. K., Waterfield, T., Yelekçi, O., Yu, R., and Zhou, B., Cambridge University Press, https://report.ipcc.ch/ar6/wg1/IPCC_AR6_WGI_FullReport.pdf (last access: 16 April 2024), 2021a.
IPCC: Summary for Policymakers, in: Climate Change 2021: The Physical Science Basis. Contribution of Working Group I to the Sixth Assessment Report of the Intergovernmental Panel on Climate Change, edited by: Masson-Delmotte, V., Zhai, P., Pirani, A., Connors, S. L., Péan, C., Berger, S., Caud, N., Chen, Y., Goldfarb, L., Gomis, M. I., Huang, M., Leitzell, K., Lonnoy, E., Matthews, J. B. R., Maycock, T. K., Waterfield, T., Yelekçi, O., Yu, R., and Zhou, B., Cambridge University Press, https://www.ipcc.ch/report/ar6/wg1/downloads/report/IPCC_AR6_WGI_SPM.pdf (last access: 16 April 2024), 2021b.
Jackson, E. K., Roberts, W., Nelsen, B., Williams, G. P., Nelson, E. J., and Ames, D. P.: Introductory overview: Error metrics for hydrologic modelling – A review of common practices and an open source library to facilitate use and adoption, Environ. Modell. Softw., 119, 32–48, https://doi.org/10.1016/j.envsoft.2019.05.001, 2019.
Kalmár, T., Pieczka, I., and Pongrácz, R.: A sensitivity analysis of the different setups of the RegCM4.5 model for the Carpathian region, Int. J. Climatol., 41, E1180–E1201, https://doi.org/10.1002/joc.6761, 2021.
Kling, H., Fuchs, M., and Paulin, M.: Runoff conditions in the upper Danube basin under an ensemble of climate change scenarios, J. Hydrol., 424, 264–277, https://doi.org/10.1016/j.jhydrol.2012.01.011, 2012.
Kotlarski, S., Keuler, K., Christensen, O. B., Colette, A., Déqué, M., Gobiet, A., Goergen, K., Jacob, D., Lüthi, D., van Meijgaard, E., Nikulin, G., Schär, C., Teichmann, C., Vautard, R., Warrach-Sagi, K., and Wulfmeyer, V.: Regional climate modeling on European scales: a joint standard evaluation of the EURO-CORDEX RCM ensemble, Geosci. Model Dev., 7, 1297–1333, https://doi.org/10.5194/gmd-7-1297-2014, 2014.
Liemohn, M. W., Shane, A. D., Azari, A. R., Petersen, A. K., Swiger, B. M., and Mukhopadhyay, A.: RMSE is not enough: Guidelines to robust data-model comparisons for magnetospheric physics, J. Atmos. Sol.-Terr. Phys., 218, 105624, https://doi.org/10.1016/j.jastp.2021.105624, 2021.
Masanganise, J., Magodora, M., Mapuwei, T., and Basira, K.: An assessment of CMIP5 global climate model performance using probability density functions and a match metric method, Science Insights: An International Journal, 4, 1–8, 2014.
Mirkes, E. M., Allohibi, J., and Gorban, A.: Fractional norms and quasinorms do not help to overcome the curse of dimensionality, Entropy, 22, 1105, https://doi.org/10.48550/arXiv.2004.14230, 2020.
Mooney, P. A., Rechid, D., Davin, E. L., Katragkou, E., de Noblet-Ducoudré, N., Breil, M., Cardoso, R. M., Daloz, A. S., Hoffmann, P., Lima, D. C. A., Meier, R., Soares, P. M. M., Sofiadis, G., Strada, S., Strandberg, G., Toelle, M. H., and Lund, M. T.: Land–atmosphere interactions in sub-polar and alpine climates in the CORDEX Flagship Pilot Study Land Use and Climate Across Scales (LUCAS) models – Part 2: The role of changing vegetation, The Cryosphere, 16, 1383–1397, https://doi.org/10.5194/tc-16-1383-2022, 2022.
Murphy, A. H.: Skill scores based on the mean square error and their relationships to the correlation coefficient, Mon. Weather Rev., 116, 2417–2424, https://doi.org/10.1175/1520-0493(1988)116<2417:SSBOTM>2.0.CO;2, 1988.
Nash, J. E. and Sutcliffe, J. V.: River flow forecasting through conceptual models part I – A discussion of principles, J. Hydrol., 10, 282–290, https://doi.org/10.1016/0022-1694(70)90255-6, 1970.
Pachepsky, Y. A., Martinez, G., Pan, F., Wagener, T., and Nicholson, T.: Evaluating Hydrological Model Performance using Information Theory-based Metrics, Hydrol. Earth Syst. Sci. Discuss. [preprint], https://doi.org/10.5194/hess-2016-46, 2016.
Perkins, S. E., Pitman, A. J., Holbrook, N. J., and McAneney, J.: Evaluation of the AR4 Climate Models' Simulated Daily Maximum Temperature, Minimum Temperature, and Precipitation over Australia Using Probability Density Functions, J. Climate, 20, 4356–4376, https://doi.org/10.1175/JCLI4253.1, 2007.
Pitman, J.: Exchangeable and partially exchangeable random partitions, Probab. Theory Rel., 102, 145–158, https://doi.org/10.1007/BF01213386, 1995.
Randall, D. A., Wood, R. A., Bony, S., Colman, R., Fichefet, T., Fyfe, J., Kattsov, V., Pitman, A., Shukla, J., Srinivasan, J., Stouffer, R. J., Sumi, A., and Taylor, K. E.: Climate models and their evaluation, in: Climate Change 2007: The physical science basis, Contribution of Working Group I to the Fourth Assessment Report of the IPCC (FAR), Cambridge University Press, 589–662, 60, https://archive.ipcc.ch/publications_and_data/ar4/wg1/en/ch8.html (last access: 16 April 2024), 2007.
Reich, N. G., Lauer, S. A., Sakrejda, K., Iamsirithaworn, S., Hinjoy, S., Suangtho, P., Suthachana, S., Clapham, H. E., Salje, H., Cummings, D. A., and Lessler, J.: Challenges in real-time prediction of infectious disease: a case study of dengue in Thailand, PLoS Neglect. Trop. D., 10, e0004761, https://doi.org/10.1371/journal.pntd.0010883, 2016.
Richter, J. H., Butchart, N., Kawatani, Y., Bushell, A. C., Holt, L., Serva, F., Anstey, J., Simpson, I. R., Osprey, S., Hamilton, K., Braesicke, P., Cagnazzo, C., Chen C. C., Garcia, R. R., Gray, L. J., Kerzenmacher, T., Lott, F., McLandress, C., Naoe, H., Scinocca, J., Stockdale, T. N., Versick, S., Watanabe, S., Yoshida, K., and Yukimoto, S.: Response of the quasi-biennial oscillation to a warming climate in global climate models, Q. J. Roy. Meteor. Soc., 148, 1490–1518, https://doi.org/10.1002/qj.3749, 2022.
Roberts, N. M. and Lean, H. W.: Scale-Selective Verification of Rainfall Accumulations from High-Resolution Forecasts of Convective Events, Mon. Weather Rev., 136, 78–97, https://doi.org/10.1175/2007MWR2123.1, 2008.
Rupp, D. E., Abatzoglou, J. T., Hegewisch, K. C., and Mote, P. W.: Evaluation of CMIP5 20th century climate simulations for the Pacific Northwest USA, J. Geophys. Res.-Atmos., 118, 10884, https://doi.org/10.1002/jgrd.50843, 2013.
Samantaray, A.: Bergen Metric, Zenodo [code], https://doi.org/10.5281/zenodo.10518064, 2024.
Smiatek, G., Kunstmann, H., and Senatore A.: EURO-CORDEX regional climate model analysis for the Greater Alpine Region: Performance and expected future change, J. Geophys. Res.-Atmos., 121, 7710–7728, https://doi.org/10.1002/2015JD024727, 2016.
Taylor, K. E.: Summarizing multiple aspects of model performance in a single diagram, J. Geophys. Res.-Atmos., 106, 7183–7192, https://doi.org/10.1029/2000JD900719, 2001.
Torma, C. Z.: Detailed validation of EURO-CORDEX and Med-CORDEX regional climate model ensembles over the Carpathian Region, Időjárás/Quarterly Journal Of The Hungarian Meteorological Service, 123, 217–240, https://doi.org/10.28974/idojaras.2019.2.6, 2019.
van Noije, T., Bergman, T., Le Sager, P., O'Donnell, D., Makkonen, R., Gonçalves-Ageitos, M., Döscher, R., Fladrich, U., von Hardenberg, J., Keskinen, J.-P., Korhonen, H., Laakso, A., Myriokefalitakis, S., Ollinaho, P., Pérez García-Pando, C., Reerink, T., Schrödner, R., Wyser, K., and Yang, S.: EC-Earth3-AerChem: a global climate model with interactive aerosols and atmospheric chemistry participating in CMIP6, Geosci. Model Dev., 14, 5637–5668, https://doi.org/10.5194/gmd-14-5637-2021, 2021.
Vautard, R., Kadygrov, N., Iles, C., Boberg, F., Buonomo, E., Bülow, K., Coppola, E., Corre, L., van Meijgaard, E., Nogherotto, R., and Sandstad, M.: Evaluation of the large EURO-CORDEX regional climate model ensemble, J. Geophys. Res.-Atmos., 126, e2019JD032344, https://doi.org/10.1029/2019JD032344, 2021.
Wang, Z. and Bovik, A. C.: A universal image quality index, IEEE Signal Proc. Let., 9, 81–84, https://doi.org/10.1109/97.995823, 2002.
Watt-Meyer, O., Brenowitz, N. D., Clark, S. K., Henn, B., Kwa, A., McGibbon, J., Perkins, W. A., and Bretherton, C. S.: Correcting weather and climate models by machine learning nudged historical simulations, Geophys. Res. Lett., 48, e2021GL092555, https://doi.org/10.1029/2021GL092555, 2021.
Weber, R., Schek, H. J., and Blott, S.: A quantitative analysis and performance study for similarity-search methods in highdimensional spaces, in: VLDB, 98, 194–205, https://vldb.org/conf/1998/p194.pdf (last access: 16 April 2024), 1998.
Wȩglarczyk, S.: The interdependence and applicability of some statistical quality measures for hydrological models, J. Hydrol., 206, 98–103, https://doi.org/10.1016/S0022-1694(98)00094-8, 1998.
Wehner, M., Lee, J., Risser, M., Ullrich, P., Gleckler, P., and Collins, W. D.: Evaluation of extreme sub-daily precipitation in high-resolution global climate model simulations, Philos. T. Roy. Soc. A, 379, 20190545, https://doi.org/10.1098/rsta.2019.0545, 2021.
Willmott, C. J. and Matsuura, K.: Advantages of the mean absolute error (MAE) over the root mean square error (RMSE) in assessing average model performance, Clim. Res., 30, 79–82, 2005.
Wood, R. R., Lehner, F., Pendergrass, A. G., and Schlunegger, S.: Changes in precipitation variability across time scales in multiple global climate model large ensembles, Environ. Res. Lett., 16, 084022, https://doi.org/10.1088/1748-9326/ac10dd, 2021.
Yang, J., Ren, J., Sun, D., Xiao, X., Xia, J. C., Jin, C., and Li, X.: Understanding land surface temperature impact factors based on local climate zones, Sustain. Cities Soc., 69, 102818, https://doi.org/10.1016/j.scs.2021.102818, 2021.
Short summary
Any interpretation of climate model data requires a comprehensive evaluation of the model performance. Numerous error metrics exist for this purpose, and each focuses on a specific aspect of the relationship between reference and model data. Thus, a comprehensive evaluation demands the use of multiple error metrics. However, this can lead to confusion. We propose a clustering technique to reduce the number of error metrics needed and a composite error metric to simplify the interpretation.
Any interpretation of climate model data requires a comprehensive evaluation of the model...
