Articles | Volume 17, issue 11
https://doi.org/10.5194/gmd-17-4579-2024
© Author(s) 2024. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
https://doi.org/10.5194/gmd-17-4579-2024
© Author(s) 2024. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
Methods for assessment of models
| 
10 Jun 2024
Methods for assessment of models |
| 10 Jun 2024
| 10 Jun 2024
A general comprehensive evaluation method for cross-scale precipitation forecasts
Bing Zhang
Key Laboratory of Transportation Meteorology of China Meteorological Administration, Nanjing Joint Institute for Atmospheric Sciences, Nanjing 210041, China
Mingjian Zeng
CORRESPONDING AUTHOR
Key Laboratory of Transportation Meteorology of China Meteorological Administration, Nanjing Joint Institute for Atmospheric Sciences, Nanjing 210041, China
School of Atmospheric Sciences, Nanjing University, Nanjing 210023, China
Zhengkun Qin
School of Atmospheric Sciences, Nanjing University of Information Science and Technology, Nanjing 210044, China
Joint Center of Data Assimilation Research and Applications, Nanjing University of Information Science and Technology, Nanjing 210044, China
Couhua Liu
National Meteorological Centre, Beijing 100081, China
Wenru Shi
Key Laboratory of Transportation Meteorology of China Meteorological Administration, Nanjing Joint Institute for Atmospheric Sciences, Nanjing 210041, China
Key Laboratory of Transportation Meteorology of China Meteorological Administration, Nanjing Joint Institute for Atmospheric Sciences, Nanjing 210041, China
Kefeng Zhu
Key Laboratory of Transportation Meteorology of China Meteorological Administration, Nanjing Joint Institute for Atmospheric Sciences, Nanjing 210041, China
Chunlei Gu
School of Atmospheric Sciences, Nanjing University, Nanjing 210023, China
Jialing Zhou
Key Laboratory of Transportation Meteorology of China Meteorological Administration, Nanjing Joint Institute for Atmospheric Sciences, Nanjing 210041, China
Related authors
Xiaoyong Zhuge, Xiaolei Zou, Lu Yu, Xin Li, Mingjian Zeng, Yilun Chen, Bing Zhang, Bin Yao, Fei Tang, Fengjiao Chen, and Wanlin Kan
Earth Syst. Sci. Data, 16, 1747–1769, https://doi.org/10.5194/essd-16-1747-2024, https://doi.org/10.5194/essd-16-1747-2024, 2024
Short summary
Short summary
The Himawari-8/9 level-2 operational cloud product has a low spatial resolution and is available only during the daytime. To supplement this official dataset, a new dataset named the NJIAS Himawari-8/9 Cloud Feature Dataset (HCFD) was constructed. The NJIAS HCFD provides a comprehensive description of cloud features over the East Asia and west North Pacific regions for the years 2016–2022 by 30 retrieved cloud variables. The NJIAS HCFD has been demonstrated to outperform the official dataset.
Xiaoyong Zhuge, Xiaolei Zou, Lu Yu, Xin Li, Mingjian Zeng, Yilun Chen, Bing Zhang, Bin Yao, Fei Tang, Fengjiao Chen, and Wanlin Kan
Earth Syst. Sci. Data, 16, 1747–1769, https://doi.org/10.5194/essd-16-1747-2024, https://doi.org/10.5194/essd-16-1747-2024, 2024
Short summary
Short summary
The Himawari-8/9 level-2 operational cloud product has a low spatial resolution and is available only during the daytime. To supplement this official dataset, a new dataset named the NJIAS Himawari-8/9 Cloud Feature Dataset (HCFD) was constructed. The NJIAS HCFD provides a comprehensive description of cloud features over the East Asia and west North Pacific regions for the years 2016–2022 by 30 retrieved cloud variables. The NJIAS HCFD has been demonstrated to outperform the official dataset.
Tingfeng Wu, Boqiang Qin, Anning Huang, Yongwei Sheng, Shunxin Feng, and Céline Casenave
Geosci. Model Dev., 15, 745–769, https://doi.org/10.5194/gmd-15-745-2022, https://doi.org/10.5194/gmd-15-745-2022, 2022
Short summary
Short summary
Most hydrodynamic models were initially developed based in marine environments. They cannot be directly applied to large lakes. Based on field observations and numerical experiments of a large shallow lake, we developed a hydrodynamic model by adopting new schemes of wind stress, wind waves, and turbulence for large lakes. Our model can greatly improve the simulation of lake currents. This study will be a reminder to limnologists to prudently use ocean models to study lake hydrodynamics.
Tongwen Wu, Rucong Yu, Yixiong Lu, Weihua Jie, Yongjie Fang, Jie Zhang, Li Zhang, Xiaoge Xin, Laurent Li, Zaizhi Wang, Yiming Liu, Fang Zhang, Fanghua Wu, Min Chu, Jianglong Li, Weiping Li, Yanwu Zhang, Xueli Shi, Wenyan Zhou, Junchen Yao, Xiangwen Liu, He Zhao, Jinghui Yan, Min Wei, Wei Xue, Anning Huang, Yaocun Zhang, Yu Zhang, Qi Shu, and Aixue Hu
Geosci. Model Dev., 14, 2977–3006, https://doi.org/10.5194/gmd-14-2977-2021, https://doi.org/10.5194/gmd-14-2977-2021, 2021
Short summary
Short summary
This paper presents the high-resolution version of the Beijing Climate Center (BCC) Climate System Model, BCC-CSM2-HR, and describes its climate simulation performance including the atmospheric temperature and wind; precipitation; and the tropical climate phenomena such as TC, MJO, QBO, and ENSO. BCC-CSM2-HR is our model version contributing to the HighResMIP. We focused on its updates and differential characteristics from its predecessor, the medium-resolution version BCC-CSM2-MR.
Tongwen Wu, Yixiong Lu, Yongjie Fang, Xiaoge Xin, Laurent Li, Weiping Li, Weihua Jie, Jie Zhang, Yiming Liu, Li Zhang, Fang Zhang, Yanwu Zhang, Fanghua Wu, Jianglong Li, Min Chu, Zaizhi Wang, Xueli Shi, Xiangwen Liu, Min Wei, Anning Huang, Yaocun Zhang, and Xiaohong Liu
Geosci. Model Dev., 12, 1573–1600, https://doi.org/10.5194/gmd-12-1573-2019, https://doi.org/10.5194/gmd-12-1573-2019, 2019
Short summary
Short summary
This work presents advancements of the BCC model transition from CMIP5 to CMIP6, especially in the model resolution and its physics. Compared with BCC CMIP5 models, the BCC CMIP6 model shows significant improvements in historical simulations in many aspects including tropospheric air temperature and circulation at global and regional scales in East Asia, climate variability at different timescales (QBO, MJO, and diurnal cycle of precipitation), and the long-term trend of global air temperature.
Lei Shu, Min Xie, Da Gao, Tijian Wang, Dexian Fang, Qian Liu, Anning Huang, and Liwen Peng
Atmos. Chem. Phys., 17, 12871–12891, https://doi.org/10.5194/acp-17-12871-2017, https://doi.org/10.5194/acp-17-12871-2017, 2017
Short summary
Short summary
Based on 1-year in situ monitoring data of 16 cities, this paper can enhance the understanding of the pollution characteristics of particles (PM2.5 and PM10) in the Yangtze River Delta region, China. Based on NCEP reanalysis data, the establishment of the potential links between different levels of particle pollution and predominant synoptic patterns can provide an insightful view on formulating pollution control and mitigation strategies.
Min Xie, Lei Shu, Tijian Wang, Da Gao, Shu Li, Bingliang Zhuang, Anning Huang, Dexian Fang, Yong Han, Mengmeng Li, Pulong Chen, Zhijun Liu, Zheng Wu, and Hua Lu
Atmos. Chem. Phys. Discuss., https://doi.org/10.5194/acp-2017-500, https://doi.org/10.5194/acp-2017-500, 2017
Preprint withdrawn
Short summary
Short summary
The spatial distribution of aerosol can be affected by monsoon circulation. With the aid of a EAWM index, the stong and the weak EAWM years are identified. The long-term trend of weakening EAWM may potentially increase the aerosol loading in YRD, BTH and SCB but decrease AOD in PRD. By using RegCCMS, we further prove that the intensity of EAWM has great impacts on the spatial distribution of aerosols. The change pattern is mainly decided by the change of aerosols in lower troposphere.
Related subject area
Atmospheric sciences
Implementation of a Simple Actuator Disk for Large-Eddy Simulation in the Weather Research and Forecasting Model (WRF-SADLES v1.2) for wind turbine wake simulation
WRF-PDAF v1.0: implementation and application of an online localized ensemble data assimilation framework
Implementation and evaluation of diabatic advection in the Lagrangian transport model MPTRAC 2.6
An improved and extended parameterization of the CO2 15 µm cooling in the middle and upper atmosphere (CO2_cool_fort-1.0)
Development of a multiphase chemical mechanism to improve secondary organic aerosol formation in CAABA/MECCA (version 4.7.0)
Application of regional meteorology and air quality models based on the microprocessor without interlocked piped stages (MIPS) and LoongArch CPU platforms
Investigating ground-level ozone pollution in semi-arid and arid regions of Arizona using WRF-Chem v4.4 modeling
An objective identification technique for potential vorticity structures associated with African easterly waves
Importance of microphysical settings for climate forcing by stratospheric SO2 injections as modeled by SOCOL-AERv2
Assessment of surface ozone products from downscaled CAMS reanalysis and CAMS daily forecast using urban air quality monitoring stations in Iran
Open boundary conditions for atmospheric large-eddy simulations and their implementation in DALES4.4
Efficient and stable coupling of the SuperdropNet deep-learning-based cloud microphysics (v0.1.0) with the ICON climate and weather model (v2.6.5)
Three-dimensional variational assimilation with a multivariate background error covariance for the Model for Prediction Across Scales – Atmosphere with the Joint Effort for Data assimilation Integration (JEDI-MPAS 2.0.0-beta)
FUME 2.0 – Flexible Universal processor for Modeling Emissions
DEUCE v1.0: a neural network for probabilistic precipitation nowcasting with aleatoric and epistemic uncertainties
Evaluation of multi-season convection-permitting atmosphere – mixed-layer ocean simulations of the Maritime Continent
Investigating the impact of coupling HARMONIE-WINS50 (cy43) meteorology to LOTOS-EUROS (v2.2.002) on a simulation of NO2 concentrations over the Netherlands
Balloon drift estimation and improved position estimates for radiosondes
Emission ensemble approach to improve the development of multi-scale emission inventories
What is the relative impact of nudging and online coupling on meteorological variables, pollutant concentrations and aerosol optical properties?
Diagnosing drivers of PM2.5 simulation biases in China from meteorology, chemical composition, and emission sources using an efficient machine learning method
Validation and analysis of the Polair3D v1.11 chemical transport model over Quebec
Assimilation of GNSS tropospheric gradients into the Weather Research and Forecasting (WRF) model version 4.4.1
Identifying atmospheric rivers and their poleward latent heat transport with generalizable neural networks: ARCNNv1
Assessing acetone for the GISS ModelE2.1 Earth system model
Bergen metrics: composite error metrics for assessing performance of climate models using EURO-CORDEX simulations
A dynamic approach to three-dimensional radiative transfer in subkilometer-scale numerical weather prediction models: the dynamic TenStream solver v1.0
Evaluation and development of surface layer scheme representation of temperature inversions over boreal forests in Arctic wintertime conditions
Modelling wind farm effects in HARMONIE–AROME (cycle 43.2.2) – Part 1: Implementation and evaluation
Analytical and adaptable initial conditions for dry and moist baroclinic waves in the global hydrostatic model OpenIFS (CY43R3)
Challenges of constructing and selecting the “perfect” boundary conditions for the large-eddy simulation model PALM
A machine learning approach for evaluating Southern Ocean cloud radiative biases in a global atmosphere model
Decision Support System version 1.0 (DSS v1.0) for air quality management in Delhi, India
How non-equilibrium aerosol chemistry impacts particle acidity: the GMXe AERosol CHEMistry (GMXe–AERCHEM, v1.0) sub-submodel of MESSy
A grid model for vertical correction of precipitable water vapor over the Chinese mainland and surrounding areas using random forest
MEXPLORER 1.0.0 – a mechanism explorer for analysis and visualization of chemical reaction pathways based on graph theory
Evaluating CHASER V4.0 global formaldehyde (HCHO) simulations using satellite, aircraft, and ground-based remote sensing observations
Advances and prospects of deep learning for medium-range extreme weather forecasting
An overview of the Western United States Dynamically Downscaled Dataset (WUS-D3)
cloudbandPy 1.0: an automated algorithm for the detection of tropical–extratropical cloud bands
PyRTlib: an educational Python-based library for non-scattering atmospheric microwave radiative transfer computations
Deep learning applied to CO2 power plant emissions quantification using simulated satellite images
Sensitivity of the WRF-Chem v4.4 simulations of ozone and formaldehyde and their precursors to multiple bottom-up emission inventories over East Asia during the KORUS-AQ 2016 field campaign
Optimising urban measurement networks for CO2 flux estimation: a high-resolution observing system simulation experiment using GRAMM/GRAL
Assessment of climate biases in OpenIFS version 43r3 across model horizontal resolutions and time steps
High-resolution multi-scaling of outdoor human thermal comfort and its intra-urban variability based on machine learning
Effects of vertical grid spacing on the climate simulated in the ICON-Sapphire global storm-resolving model
Development of the tangent linear and adjoint models of the global online chemical transport model MPAS-CO2 v7.3
Impacts of updated reaction kinetics on the global GEOS-Chem simulation of atmospheric chemistry
Spatial spin-up of precipitation in limited-area convection-permitting simulations over North America using the CRCM6/GEM5.0 model
Hai Bui, Mostafa Bakhoday-Paskyabi, and Mohammadreza Mohammadpour-Penchah
Geosci. Model Dev., 17, 4447–4465, https://doi.org/10.5194/gmd-17-4447-2024, https://doi.org/10.5194/gmd-17-4447-2024, 2024
Short summary
Short summary
We developed a new wind turbine wake model, the Simple Actuator Disc for Large Eddy Simulation (SADLES), integrated with the widely used Weather Research and Forecasting (WRF) model. WRF-SADLES accurately simulates wind turbine wakes at resolutions of a few dozen meters, aligning well with idealized simulations and observational measurements. This makes WRF-SADLES a promising tool for wind energy research, offering a balance between accuracy, computational efficiency, and ease of implementation.
Changliang Shao and Lars Nerger
Geosci. Model Dev., 17, 4433–4445, https://doi.org/10.5194/gmd-17-4433-2024, https://doi.org/10.5194/gmd-17-4433-2024, 2024
Short summary
Short summary
This paper introduces and evaluates WRF-PDAF, a fully online-coupled ensemble data assimilation (DA) system. A key advantage of the WRF-PDAF configuration is its ability to concurrently integrate all ensemble states, eliminating the need for time-consuming distribution and collection of ensembles during the coupling communication. The extra time required for DA amounts to only 20.6 % per cycle. Twin experiment results underscore the effectiveness of the WRF-PDAF system.
Jan Clemens, Lars Hoffmann, Bärbel Vogel, Sabine Grießbach, and Nicole Thomas
Geosci. Model Dev., 17, 4467–4493, https://doi.org/10.5194/gmd-17-4467-2024, https://doi.org/10.5194/gmd-17-4467-2024, 2024
Short summary
Short summary
Lagrangian transport models simulate the transport of air masses in the atmosphere. For example, one model (CLaMS) is well suited to calculating transport as it uses a special coordinate system and special vertical wind. However, it only runs inefficiently on modern supercomputers. Hence, we have implemented the benefits of CLaMS into a new model (MPTRAC), which is already highly efficient on modern supercomputers. Finally, in extensive tests, we showed that CLaMS and MPTRAC agree very well.
Manuel López-Puertas, Federico Fabiano, Victor Fomichev, Bernd Funke, and Daniel R. Marsh
Geosci. Model Dev., 17, 4401–4432, https://doi.org/10.5194/gmd-17-4401-2024, https://doi.org/10.5194/gmd-17-4401-2024, 2024
Short summary
Short summary
The radiative infrared cooling of CO2 in the middle atmosphere is crucial for computing its thermal structure. It requires one however to include non-local thermodynamic equilibrium processes which are computationally very expensive, which cannot be afforded by climate models. In this work, we present an updated, efficient, accurate and very fast (~50 µs) parameterization of that cooling able to cope with CO2 abundances from half the pre-industrial values to 10 times the current abundance.
Felix Wieser, Rolf Sander, Changmin Cho, Hendrik Fuchs, Thorsten Hohaus, Anna Novelli, Ralf Tillmann, and Domenico Taraborrelli
Geosci. Model Dev., 17, 4311–4330, https://doi.org/10.5194/gmd-17-4311-2024, https://doi.org/10.5194/gmd-17-4311-2024, 2024
Short summary
Short summary
The chemistry scheme of the atmospheric box model CAABA/MECCA is expanded to achieve an improved aerosol formation from emitted organic compounds. In addition to newly added reactions, temperature-dependent partitioning of all new species between the gas and aqueous phases is estimated and included in the pre-existing scheme. Sensitivity runs show an overestimation of key compounds from isoprene, which can be explained by a lack of aqueous-phase degradation reactions and box model limitations.
Zehua Bai, Qizhong Wu, Kai Cao, Yiming Sun, and Huaqiong Cheng
Geosci. Model Dev., 17, 4383–4399, https://doi.org/10.5194/gmd-17-4383-2024, https://doi.org/10.5194/gmd-17-4383-2024, 2024
Short summary
Short summary
There is relatively limited research on the application of scientific computing on RISC CPU platforms. The MIPS architecture CPUs, a type of RISC CPUs, have distinct advantages in energy efficiency and scalability. The air quality modeling system can run stably on the MIPS and LoongArch platforms, and the experiment results verify the stability of scientific computing on the platforms. The work provides a technical foundation for the scientific application based on MIPS and LoongArch.
Yafang Guo, Chayan Roychoudhury, Mohammad Amin Mirrezaei, Rajesh Kumar, Armin Sorooshian, and Avelino F. Arellano
Geosci. Model Dev., 17, 4331–4353, https://doi.org/10.5194/gmd-17-4331-2024, https://doi.org/10.5194/gmd-17-4331-2024, 2024
Short summary
Short summary
This research focuses on surface ozone (O3) pollution in Arizona, a historically air-quality-challenged arid and semi-arid region in the US. The unique characteristics of this kind of region, e.g., intense heat, minimal moisture, and persistent desert shrubs, play a vital role in comprehending O3 exceedances. Using the WRF-Chem model, we analyzed O3 levels in the pre-monsoon month, revealing the model's skill in capturing diurnal and MDA8 O3 levels.
Christoph Fischer, Andreas H. Fink, Elmar Schömer, Marc Rautenhaus, and Michael Riemer
Geosci. Model Dev., 17, 4213–4228, https://doi.org/10.5194/gmd-17-4213-2024, https://doi.org/10.5194/gmd-17-4213-2024, 2024
Short summary
Short summary
This study presents a method for identifying and tracking 3-D potential vorticity structures within African easterly waves (AEWs). Each identified structure is characterized by descriptors, including its 3-D position and orientation, which have been validated through composite comparisons. A trough-centric perspective on the descriptors reveals the evolution and distinct characteristics of AEWs. These descriptors serve as valuable statistical inputs for the study of AEW-related phenomena.
Sandro Vattioni, Andrea Stenke, Beiping Luo, Gabriel Chiodo, Timofei Sukhodolov, Elia Wunderlin, and Thomas Peter
Geosci. Model Dev., 17, 4181–4197, https://doi.org/10.5194/gmd-17-4181-2024, https://doi.org/10.5194/gmd-17-4181-2024, 2024
Short summary
Short summary
We investigate the sensitivity of aerosol size distributions in the presence of strong SO2 injections for climate interventions or after volcanic eruptions to the call sequence and frequency of the routines for nucleation and condensation in sectional aerosol models with operator splitting. Using the aerosol–chemistry–climate model SOCOL-AERv2, we show that the radiative and chemical outputs are sensitive to these settings at high H2SO4 supersaturations and how to obtain reliable results.
Najmeh Kaffashzadeh and Abbas-Ali Aliakbari Bidokhti
Geosci. Model Dev., 17, 4155–4179, https://doi.org/10.5194/gmd-17-4155-2024, https://doi.org/10.5194/gmd-17-4155-2024, 2024
Short summary
Short summary
This paper assesses the capability of two state-of-the-art global datasets in simulating surface ozone over Iran using a new methodology. It is found that the global model data need to be downscaled for regulatory purposes or policy applications at local scales. The method can be useful not only for the evaluation but also for the prediction of other chemical species, such as aerosols.
Franciscus Liqui Lung, Christian Jakob, A. Pier Siebesma, and Fredrik Jansson
Geosci. Model Dev., 17, 4053–4076, https://doi.org/10.5194/gmd-17-4053-2024, https://doi.org/10.5194/gmd-17-4053-2024, 2024
Short summary
Short summary
Traditionally, high-resolution atmospheric models employ periodic boundary conditions, which limit simulations to domains without horizontal variations. In this research open boundary conditions are developed to replace the periodic boundary conditions. The implementation is tested in a controlled setup, and the results show minimal disturbances. Using these boundary conditions, high-resolution models can be forced by a coarser model to study atmospheric phenomena in realistic background states.
Caroline Arnold, Shivani Sharma, Tobias Weigel, and David S. Greenberg
Geosci. Model Dev., 17, 4017–4029, https://doi.org/10.5194/gmd-17-4017-2024, https://doi.org/10.5194/gmd-17-4017-2024, 2024
Short summary
Short summary
In atmospheric models, rain formation is simplified to be computationally efficient. We trained a machine learning model, SuperdropNet, to emulate warm-rain formation based on super-droplet simulations. Here, we couple SuperdropNet with an atmospheric model in a warm-bubble experiment and find that the coupled simulation runs stable and produces reasonable results, making SuperdropNet a viable ML proxy for droplet simulations. We also present a comprehensive benchmark for coupling architectures.
Byoung-Joo Jung, Benjamin Ménétrier, Chris Snyder, Zhiquan Liu, Jonathan J. Guerrette, Junmei Ban, Ivette Hernández Baños, Yonggang G. Yu, and William C. Skamarock
Geosci. Model Dev., 17, 3879–3895, https://doi.org/10.5194/gmd-17-3879-2024, https://doi.org/10.5194/gmd-17-3879-2024, 2024
Short summary
Short summary
We describe the multivariate static background error covariance (B) for the JEDI-MPAS 3D-Var data assimilation system. With tuned B parameters, the multivariate B gives physically balanced analysis increment fields in the single-observation test framework. In the month-long cycling experiment with a global 60 km mesh, 3D-Var with static B performs stably. Due to its simple workflow and minimal computational requirements, JEDI-MPAS 3D-Var can be useful for the research community.
Michal Belda, Nina Benešová, Jaroslav Resler, Peter Huszár, Ondřej Vlček, Pavel Krč, Jan Karlický, Pavel Juruš, and Kryštof Eben
Geosci. Model Dev., 17, 3867–3878, https://doi.org/10.5194/gmd-17-3867-2024, https://doi.org/10.5194/gmd-17-3867-2024, 2024
Short summary
Short summary
For modeling atmospheric chemistry, it is necessary to provide data on emissions of pollutants. These can come from various sources and in various forms, and preprocessing of the data to be ingestible by chemistry models can be quite challenging. We developed the FUME processor to use a database layer that internally transforms all input data into a rigid structure, facilitating further processing to allow for emission processing from the continental to the street scale.
Bent Harnist, Seppo Pulkkinen, and Terhi Mäkinen
Geosci. Model Dev., 17, 3839–3866, https://doi.org/10.5194/gmd-17-3839-2024, https://doi.org/10.5194/gmd-17-3839-2024, 2024
Short summary
Short summary
Probabilistic precipitation nowcasting (local forecasting for 0–6 h) is crucial for reducing damage from events like flash floods. For this goal, we propose the DEUCE neural-network-based model which uses data and model uncertainties to generate an ensemble of potential precipitation development scenarios for the next hour. Trained and evaluated with Finnish precipitation composites, DEUCE was found to produce more skillful and reliable nowcasts than established models.
Emma Howard, Steven Woolnough, Nicholas Klingaman, Daniel Shipley, Claudio Sanchez, Simon C. Peatman, Cathryn E. Birch, and Adrian J. Matthews
Geosci. Model Dev., 17, 3815–3837, https://doi.org/10.5194/gmd-17-3815-2024, https://doi.org/10.5194/gmd-17-3815-2024, 2024
Short summary
Short summary
This paper describes a coupled atmosphere–mixed-layer ocean simulation setup that will be used to study weather processes in Southeast Asia. The set-up has been used to compare high-resolution simulations, which are able to partially resolve storms, to coarser simulations, which cannot. We compare the model performance at representing variability of rainfall and sea surface temperatures across length scales between the coarse and fine models.
Andrés Yarce Botero, Michiel van Weele, Arjo Segers, Pier Siebesma, and Henk Eskes
Geosci. Model Dev., 17, 3765–3781, https://doi.org/10.5194/gmd-17-3765-2024, https://doi.org/10.5194/gmd-17-3765-2024, 2024
Short summary
Short summary
HARMONIE WINS50 reanalysis data with 0.025° × 0.025° resolution from 2019 to 2021 were coupled with the LOTOS-EUROS Chemical Transport Model. HARMONIE and ECMWF meteorology configurations against Cabauw observations (52.0° N, 4.9° W) were evaluated as simulated NO2 concentrations with ground-level sensors. Differences in crucial meteorological input parameters (boundary layer height, vertical diffusion coefficient) between the hydrostatic and non-hydrostatic models were analysed.
Ulrich Voggenberger, Leopold Haimberger, Federico Ambrogi, and Paul Poli
Geosci. Model Dev., 17, 3783–3799, https://doi.org/10.5194/gmd-17-3783-2024, https://doi.org/10.5194/gmd-17-3783-2024, 2024
Short summary
Short summary
This paper presents a method for calculating balloon drift from historical radiosonde ascent data. The drift can reach distances of several hundred kilometres and is often neglected. Verification shows the beneficial impact of the more accurate balloon position on model assimilation. The method is not limited to radiosondes but would also work for dropsondes, ozonesondes, or any other in situ sonde carried by the wind in the pre-GNSS era, provided the necessary information is available.
Philippe Thunis, Jeroen Kuenen, Enrico Pisoni, Bertrand Bessagnet, Manjola Banja, Lech Gawuc, Karol Szymankiewicz, Diego Guizardi, Monica Crippa, Susana Lopez-Aparicio, Marc Guevara, Alexander De Meij, Sabine Schindlbacher, and Alain Clappier
Geosci. Model Dev., 17, 3631–3643, https://doi.org/10.5194/gmd-17-3631-2024, https://doi.org/10.5194/gmd-17-3631-2024, 2024
Short summary
Short summary
An ensemble emission inventory is created with the aim of monitoring the status and progress made with the development of EU-wide inventories. This emission ensemble serves as a common benchmark for the screening and allows for the comparison of more than two inventories at a time. Because the emission “truth” is unknown, the approach does not tell which inventory is the closest to reality, but it identifies inconsistencies that require special attention.
Laurent Menut, Bertrand Bessagnet, Arineh Cholakian, Guillaume Siour, Sylvain Mailler, and Romain Pennel
Geosci. Model Dev., 17, 3645–3665, https://doi.org/10.5194/gmd-17-3645-2024, https://doi.org/10.5194/gmd-17-3645-2024, 2024
Short summary
Short summary
This study is about the modelling of the atmospheric composition in Europe during the summer of 2022, when massive wildfires were observed. It is a sensitivity study dedicated to the relative impacts of two modelling processes that are able to modify the meteorology used for the calculation of the atmospheric chemistry and transport of pollutants.
Shuai Wang, Mengyuan Zhang, Yueqi Gao, Peng Wang, Qingyan Fu, and Hongliang Zhang
Geosci. Model Dev., 17, 3617–3629, https://doi.org/10.5194/gmd-17-3617-2024, https://doi.org/10.5194/gmd-17-3617-2024, 2024
Short summary
Short summary
Numerical models are widely used in air pollution modeling but suffer from significant biases. The machine learning model designed in this study shows high efficiency in identifying such biases. Meteorology (relative humidity and cloud cover), chemical composition (secondary organic components and dust aerosols), and emission sources (residential activities) are diagnosed as the main drivers of bias in modeling PM2.5, a typical air pollutant. The results will help to improve numerical models.
Shoma Yamanouchi, Shayamilla Mahagammulla Gamage, Sara Torbatian, Jad Zalzal, Laura Minet, Audrey Smargiassi, Ying Liu, Ling Liu, Forood Azargoshasbi, Jinwoong Kim, Youngseob Kim, Daniel Yazgi, and Marianne Hatzopoulou
Geosci. Model Dev., 17, 3579–3597, https://doi.org/10.5194/gmd-17-3579-2024, https://doi.org/10.5194/gmd-17-3579-2024, 2024
Short summary
Short summary
Air pollution is a major health hazard, and chemical transport models (CTMs) are valuable tools that aid in our understanding of the risks of air pollution at both local and regional scales. In this study, the Polair3D CTM of the Polyphemus air quality modeling platform was set up over Quebec, Canada, to assess the model’s capability in predicting key air pollutant species over the region, at seasonal temporal scales and at regional spatial scales.
Rohith Thundathil, Florian Zus, Galina Dick, and Jens Wickert
Geosci. Model Dev., 17, 3599–3616, https://doi.org/10.5194/gmd-17-3599-2024, https://doi.org/10.5194/gmd-17-3599-2024, 2024
Short summary
Short summary
Global Navigation Satellite Systems (GNSS) provides moisture observations through its densely distributed ground station network. In this research, we assimilate a new type of observation called tropospheric gradient observations, which has never been incorporated into a weather model. We develop a forward operator for gradient-based observations and conduct an assimilation impact study. The study shows significant improvements in the model's humidity fields.
Ankur Mahesh, Travis A. O'Brien, Burlen Loring, Abdelrahman Elbashandy, William Boos, and William D. Collins
Geosci. Model Dev., 17, 3533–3557, https://doi.org/10.5194/gmd-17-3533-2024, https://doi.org/10.5194/gmd-17-3533-2024, 2024
Short summary
Short summary
Atmospheric rivers (ARs) are extreme weather events that can alleviate drought or cause billions of US dollars in flood damage. We train convolutional neural networks (CNNs) to detect ARs with an estimate of the uncertainty. We present a framework to generalize these CNNs to a variety of datasets of past, present, and future climate. Using a simplified simulation of the Earth's atmosphere, we validate the CNNs. We explore the role of ARs in maintaining energy balance in the Earth system.
Alexandra Rivera, Kostas Tsigaridis, Gregory Faluvegi, and Drew Shindell
Geosci. Model Dev., 17, 3487–3505, https://doi.org/10.5194/gmd-17-3487-2024, https://doi.org/10.5194/gmd-17-3487-2024, 2024
Short summary
Short summary
This paper describes and evaluates an improvement to the representation of acetone in the GISS ModelE2.1 Earth system model. We simulate acetone's concentration and transport across the atmosphere as well as its dependence on chemistry, the ocean, and various global emissions. Comparisons of our model’s estimates to past modeling studies and field measurements have shown encouraging results. Ultimately, this paper contributes to a broader understanding of acetone's role in the atmosphere.
Alok K. Samantaray, Priscilla A. Mooney, and Carla A. Vivacqua
Geosci. Model Dev., 17, 3321–3339, https://doi.org/10.5194/gmd-17-3321-2024, https://doi.org/10.5194/gmd-17-3321-2024, 2024
Short summary
Short summary
Any interpretation of climate model data requires a comprehensive evaluation of the model performance. Numerous error metrics exist for this purpose, and each focuses on a specific aspect of the relationship between reference and model data. Thus, a comprehensive evaluation demands the use of multiple error metrics. However, this can lead to confusion. We propose a clustering technique to reduce the number of error metrics needed and a composite error metric to simplify the interpretation.
Richard Maier, Fabian Jakub, Claudia Emde, Mihail Manev, Aiko Voigt, and Bernhard Mayer
Geosci. Model Dev., 17, 3357–3383, https://doi.org/10.5194/gmd-17-3357-2024, https://doi.org/10.5194/gmd-17-3357-2024, 2024
Short summary
Short summary
Based on the TenStream solver, we present a new method to accelerate 3D radiative transfer towards the speed of currently used 1D solvers. Using a shallow-cumulus-cloud time series, we evaluate the performance of this new solver in terms of both speed and accuracy. Compared to a 3D benchmark simulation, we show that our new solver is able to determine much more accurate irradiances and heating rates than a 1D δ-Eddington solver, even when operated with a similar computational demand.
Julia Maillard, Jean-Christophe Raut, and François Ravetta
Geosci. Model Dev., 17, 3303–3320, https://doi.org/10.5194/gmd-17-3303-2024, https://doi.org/10.5194/gmd-17-3303-2024, 2024
Short summary
Short summary
Atmospheric models struggle to reproduce the strong temperature inversions in the vicinity of the surface over forested areas in the Arctic winter. In this paper, we develop modified simplified versions of surface layer schemes widely used by the community. Our modifications are used to correct the fact that original schemes place strong limits on the turbulent collapse, leading to a lower surface temperature gradient at low wind speeds. Modified versions show a better performance.
Jana Fischereit, Henrik Vedel, Xiaoli Guo Larsén, Natalie E. Theeuwes, Gregor Giebel, and Eigil Kaas
Geosci. Model Dev., 17, 2855–2875, https://doi.org/10.5194/gmd-17-2855-2024, https://doi.org/10.5194/gmd-17-2855-2024, 2024
Short summary
Short summary
Wind farms impact local wind and turbulence. To incorporate these effects in weather forecasting, the explicit wake parameterization (EWP) is added to the forecasting model HARMONIE–AROME. We evaluate EWP using flight data above and downstream of wind farms, comparing it with an alternative wind farm parameterization and another weather model. Results affirm the correct implementation of EWP, emphasizing the necessity of accounting for wind farm effects in accurate weather forecasting.
Clément Bouvier, Daan van den Broek, Madeleine Ekblom, and Victoria A. Sinclair
Geosci. Model Dev., 17, 2961–2986, https://doi.org/10.5194/gmd-17-2961-2024, https://doi.org/10.5194/gmd-17-2961-2024, 2024
Short summary
Short summary
An analytical initial background state has been developed for moist baroclinic wave simulation on an aquaplanet and implemented into OpenIFS. Seven parameters can be controlled, which are used to generate the background states and the development of baroclinic waves. The meteorological and numerical stability has been assessed. Resulting baroclinic waves have proven to be realistic and sensitive to the jet's width.
Jelena Radović, Michal Belda, Jaroslav Resler, Kryštof Eben, Martin Bureš, Jan Geletič, Pavel Krč, Hynek Řezníček, and Vladimír Fuka
Geosci. Model Dev., 17, 2901–2927, https://doi.org/10.5194/gmd-17-2901-2024, https://doi.org/10.5194/gmd-17-2901-2024, 2024
Short summary
Short summary
Boundary conditions are of crucial importance for numerical model (e.g., PALM) validation studies and have a large influence on the model results, especially when studying the atmosphere of real, complex, and densely built urban environments. Our experiments with different driving conditions for the large-eddy simulation model PALM show its strong dependency on boundary conditions, which is important for the proper separation of errors coming from the boundary conditions and the model itself.
Sonya L. Fiddes, Marc D. Mallet, Alain Protat, Matthew T. Woodhouse, Simon P. Alexander, and Kalli Furtado
Geosci. Model Dev., 17, 2641–2662, https://doi.org/10.5194/gmd-17-2641-2024, https://doi.org/10.5194/gmd-17-2641-2024, 2024
Short summary
Short summary
In this study we present an evaluation that considers complex, non-linear systems in a holistic manner. This study uses XGBoost, a machine learning algorithm, to predict the simulated Southern Ocean shortwave radiation bias in the ACCESS model using cloud property biases as predictors. We then used a novel feature importance analysis to quantify the role that each cloud bias plays in predicting the radiative bias, laying the foundation for advanced Earth system model evaluation and development.
Gaurav Govardhan, Sachin D. Ghude, Rajesh Kumar, Sumit Sharma, Preeti Gunwani, Chinmay Jena, Prafull Yadav, Shubhangi Ingle, Sreyashi Debnath, Pooja Pawar, Prodip Acharja, Rajmal Jat, Gayatry Kalita, Rupal Ambulkar, Santosh Kulkarni, Akshara Kaginalkar, Vijay K. Soni, Ravi S. Nanjundiah, and Madhavan Rajeevan
Geosci. Model Dev., 17, 2617–2640, https://doi.org/10.5194/gmd-17-2617-2024, https://doi.org/10.5194/gmd-17-2617-2024, 2024
Short summary
Short summary
A newly developed air quality forecasting framework, Decision Support System (DSS), for air quality management in Delhi, India, provides source attribution with numerous emission reduction scenarios besides forecasts. DSS shows that during post-monsoon and winter seasons, Delhi and its neighboring districts contribute to 30 %–40 % each to pollution in Delhi. On average, a 40 % reduction in the emissions in Delhi and the surrounding districts would result in a 24 % reduction in Delhi's pollution.
Simon Rosanka, Holger Tost, Rolf Sander, Patrick Jöckel, Astrid Kerkweg, and Domenico Taraborrelli
Geosci. Model Dev., 17, 2597–2615, https://doi.org/10.5194/gmd-17-2597-2024, https://doi.org/10.5194/gmd-17-2597-2024, 2024
Short summary
Short summary
The capabilities of the Modular Earth Submodel System (MESSy) are extended to account for non-equilibrium aqueous-phase chemistry in the representation of deliquescent aerosols. When applying the new development in a global simulation, we find that MESSy's bias in modelling routinely observed reduced inorganic aerosol mass concentrations, especially in the United States. Furthermore, the representation of fine-aerosol pH is particularly improved in the marine boundary layer.
Junyu Li, Yuxin Wang, Lilong Liu, Yibin Yao, Liangke Huang, and Feijuan Li
Geosci. Model Dev., 17, 2569–2581, https://doi.org/10.5194/gmd-17-2569-2024, https://doi.org/10.5194/gmd-17-2569-2024, 2024
Short summary
Short summary
In this study, we have developed a model (RF-PWV) to characterize precipitable water vapor (PWV) variation with altitude in the study area. RF-PWV can significantly reduce errors in vertical correction, enhance PWV fusion product accuracy, and provide insights into PWV vertical distribution, thereby contributing to climate research.
Rolf Sander
Geosci. Model Dev., 17, 2419–2425, https://doi.org/10.5194/gmd-17-2419-2024, https://doi.org/10.5194/gmd-17-2419-2024, 2024
Short summary
Short summary
The open-source software MEXPLORER 1.0.0 is presented here. The program can be used to analyze, reduce, and visualize complex chemical reaction mechanisms. The mathematics behind the tool is based on graph theory: chemical species are represented as vertices, and reactions as edges. MEXPLORER is a community model published under the GNU General Public License.
Hossain Mohammed Syedul Hoque, Kengo Sudo, Hitoshi Irie, Yanfeng He, and Md Firoz Khan
EGUsphere, https://doi.org/10.22541/essoar.169903618.82717612/v2, https://doi.org/10.22541/essoar.169903618.82717612/v2, 2024
Short summary
Short summary
Using multi-platform observations, we validated global formaldehyde (HCHO) simulations from a chemistry transport model. HCHO is a crucial intermediate of the chemical catalytic cycle that governs the ozone formation in the troposphere. The model was capable of replicating the observed spatiotemporal variability in HCHO. In a few cases, the model capability was limited. This is attributed to the uncertainties in the observations and the model parameters.
Leonardo Olivetti and Gabriele Messori
Geosci. Model Dev., 17, 2347–2358, https://doi.org/10.5194/gmd-17-2347-2024, https://doi.org/10.5194/gmd-17-2347-2024, 2024
Short summary
Short summary
In the last decades, weather forecasting up to 15 d into the future has been dominated by physics-based numerical models. Recently, deep learning models have challenged this paradigm. However, the latter models may struggle when forecasting weather extremes. In this article, we argue for deep learning models specifically designed to handle extreme events, and we propose a foundational framework to develop such models.
Stefan Rahimi, Lei Huang, Jesse Norris, Alex Hall, Naomi Goldenson, Will Krantz, Benjamin Bass, Chad Thackeray, Henry Lin, Di Chen, Eli Dennis, Ethan Collins, Zachary J. Lebo, Emily Slinskey, Sara Graves, Surabhi Biyani, Bowen Wang, Stephen Cropper, and the UCLA Center for Climate Science Team
Geosci. Model Dev., 17, 2265–2286, https://doi.org/10.5194/gmd-17-2265-2024, https://doi.org/10.5194/gmd-17-2265-2024, 2024
Short summary
Short summary
Here, we project future climate across the western United States through the end of the 21st century using a regional climate model, embedded within 16 latest-generation global climate models, to provide the community with a high-resolution physically based ensemble of climate data for use at local scales. Strengths and weaknesses of the data are frankly discussed as we overview the downscaled dataset.
Romain Pilon and Daniela I. V. Domeisen
Geosci. Model Dev., 17, 2247–2264, https://doi.org/10.5194/gmd-17-2247-2024, https://doi.org/10.5194/gmd-17-2247-2024, 2024
Short summary
Short summary
This paper introduces a new method for detecting atmospheric cloud bands to identify long convective cloud bands that extend from the tropics to the midlatitudes. The algorithm allows for easy use and enables researchers to study the life cycle and climatology of cloud bands and associated rainfall. This method provides insights into the large-scale processes involved in cloud band formation and their connections between different regions, as well as differences across ocean basins.
Salvatore Larosa, Domenico Cimini, Donatello Gallucci, Saverio Teodosio Nilo, and Filomena Romano
Geosci. Model Dev., 17, 2053–2076, https://doi.org/10.5194/gmd-17-2053-2024, https://doi.org/10.5194/gmd-17-2053-2024, 2024
Short summary
Short summary
PyRTlib is an attractive educational tool because it provides a flexible and user-friendly way to broadly simulate how electromagnetic radiation travels through the atmosphere as it interacts with atmospheric constituents (such as gases, aerosols, and hydrometeors). PyRTlib is a so-called radiative transfer model; these are commonly used to simulate and understand remote sensing observations from ground-based, airborne, or satellite instruments.
Joffrey Dumont Le Brazidec, Pierre Vanderbecken, Alban Farchi, Grégoire Broquet, Gerrit Kuhlmann, and Marc Bocquet
Geosci. Model Dev., 17, 1995–2014, https://doi.org/10.5194/gmd-17-1995-2024, https://doi.org/10.5194/gmd-17-1995-2024, 2024
Short summary
Short summary
Our research presents an innovative approach to estimating power plant CO2 emissions from satellite images of the corresponding plumes such as those from the forthcoming CO2M satellite constellation. The exploitation of these images is challenging due to noise and meteorological uncertainties. To overcome these obstacles, we use a deep learning neural network trained on simulated CO2 images. Our method outperforms alternatives, providing a positive perspective for the analysis of CO2M images.
Kyoung-Min Kim, Si-Wan Kim, Seunghwan Seo, Donald R. Blake, Seogju Cho, James H. Crawford, Louisa K. Emmons, Alan Fried, Jay R. Herman, Jinkyu Hong, Jinsang Jung, Gabriele G. Pfister, Andrew J. Weinheimer, Jung-Hun Woo, and Qiang Zhang
Geosci. Model Dev., 17, 1931–1955, https://doi.org/10.5194/gmd-17-1931-2024, https://doi.org/10.5194/gmd-17-1931-2024, 2024
Short summary
Short summary
Three emission inventories were evaluated for East Asia using data acquired during a field campaign in 2016. The inventories successfully reproduced the daily variations of ozone and nitrogen dioxide. However, the spatial distributions of model ozone did not fully agree with the observations. Additionally, all simulations underestimated carbon monoxide and volatile organic compound (VOC) levels. Increasing VOC emissions over South Korea resulted in improved ozone simulations.
Sanam Noreen Vardag and Robert Maiwald
Geosci. Model Dev., 17, 1885–1902, https://doi.org/10.5194/gmd-17-1885-2024, https://doi.org/10.5194/gmd-17-1885-2024, 2024
Short summary
Short summary
We use the atmospheric transport model GRAMM/GRAL in a Bayesian inversion to estimate urban CO2 emissions on a neighbourhood scale. We analyse the effect of varying number, precision and location of CO2 sensors for CO2 flux estimation. We further test the inclusion of co-emitted species and correlation in the inversion. The study showcases the general usefulness of GRAMM/GRAL in measurement network design.
Abhishek Savita, Joakim Kjellsson, Robin Pilch Kedzierski, Mojib Latif, Tabea Rahm, Sebastian Wahl, and Wonsun Park
Geosci. Model Dev., 17, 1813–1829, https://doi.org/10.5194/gmd-17-1813-2024, https://doi.org/10.5194/gmd-17-1813-2024, 2024
Short summary
Short summary
The OpenIFS model is used to examine the impact of horizontal resolutions (HR) and model time steps. We find that the surface wind biases over the oceans, in particular the Southern Ocean, are sensitive to the model time step and HR, with the HR having the smallest biases. When using a coarse-resolution model with a shorter time step, a similar improvement is also found. Climate biases can be reduced in the OpenIFS model at a cheaper cost by reducing the time step rather than increasing the HR.
Ferdinand Briegel, Jonas Wehrle, Dirk Schindler, and Andreas Christen
Geosci. Model Dev., 17, 1667–1688, https://doi.org/10.5194/gmd-17-1667-2024, https://doi.org/10.5194/gmd-17-1667-2024, 2024
Short summary
Short summary
We present a new approach to model heat stress in cities using artificial intelligence (AI). We show that the AI model is fast in terms of prediction but accurate when evaluated with measurements. The fast-predictive AI model enables several new potential applications, including heat stress prediction and warning; downscaling of potential future climates; evaluation of adaptation effectiveness; and, more fundamentally, development of guidelines to support urban planning and policymaking.
Hauke Schmidt, Sebastian Rast, Jiawei Bao, Amrit Cassim, Shih-Wei Fang, Diego Jimenez-de la Cuesta, Paul Keil, Lukas Kluft, Clarissa Kroll, Theresa Lang, Ulrike Niemeier, Andrea Schneidereit, Andrew I. L. Williams, and Bjorn Stevens
Geosci. Model Dev., 17, 1563–1584, https://doi.org/10.5194/gmd-17-1563-2024, https://doi.org/10.5194/gmd-17-1563-2024, 2024
Short summary
Short summary
A recent development in numerical simulations of the global atmosphere is the increase in horizontal resolution to grid spacings of a few kilometers. However, the vertical grid spacing of these models has not been reduced at the same rate as the horizontal grid spacing. Here, we assess the effects of much finer vertical grid spacings, in particular the impacts on cloud quantities and the atmospheric energy balance.
Tao Zheng, Sha Feng, Jeffrey Steward, Xiaoxu Tian, David Baker, and Martin Baxter
Geosci. Model Dev., 17, 1543–1562, https://doi.org/10.5194/gmd-17-1543-2024, https://doi.org/10.5194/gmd-17-1543-2024, 2024
Short summary
Short summary
The tangent linear and adjoint models have been successfully implemented in the MPAS-CO2 system, which has undergone rigorous accuracy testing. This development lays the groundwork for a global carbon flux data assimilation system, which offers the flexibility of high-resolution focus on specific areas, while maintaining a coarser resolution elsewhere. This approach significantly reduces computational costs and is thus perfectly suited for future CO2 geostationery and imager satellites.
Kelvin H. Bates, Mathew J. Evans, Barron H. Henderson, and Daniel J. Jacob
Geosci. Model Dev., 17, 1511–1524, https://doi.org/10.5194/gmd-17-1511-2024, https://doi.org/10.5194/gmd-17-1511-2024, 2024
Short summary
Short summary
Accurate representation of rates and products of chemical reactions in atmospheric models is crucial for simulating concentrations of pollutants and climate forcers. We update the widely used GEOS-Chem atmospheric chemistry model with reaction parameters from recent compilations of experimental data and demonstrate the implications for key atmospheric chemical species. The updates decrease tropospheric CO mixing ratios and increase stratospheric nitrogen oxide mixing ratios, among other changes.
François Roberge, Alejandro Di Luca, René Laprise, Philippe Lucas-Picher, and Julie Thériault
Geosci. Model Dev., 17, 1497–1510, https://doi.org/10.5194/gmd-17-1497-2024, https://doi.org/10.5194/gmd-17-1497-2024, 2024
Short summary
Short summary
Our study addresses a challenge in dynamical downscaling using regional climate models, focusing on the lack of small-scale features near the boundaries. We introduce a method to identify this “spatial spin-up” in precipitation simulations. Results show spin-up distances up to 300 km, varying by season and driving variable. Double nesting with comprehensive variables (e.g. microphysical variables) offers advantages. Findings will help optimize simulations for better climate projections.
Cited articles
Ahijevych, D., Gilleland, E., Brown, B. G., and Ebert, E. E.: Application of spatial verification methods to idealized and NWP-gridded precipitation forecasts, Weather Forecast., 24, 1485–1497, https://doi.org/10.1175/2009WAF2222298.1, 2009.
Bi, B., Dai, K., Wang, Y., Fu, J., Cao, Y., and Liu, C.: Advances in techniques of quantitative precipitation forecast, J. Appl. Meteorol. Sci., 27, 534–549, https://doi.org/10.11898/1001-7313.20160503, 2016.
Casati, B., Wilson, L. J., Stephenson, D. B., Nurmi, P., Ghelli, A., Pocernich, M., Damrath, U., Ebert, E. E., Brown, B. G., and Mason, S.: Forecast verification: current status and future directions, Meteorol. Appl., 15, 3–18, https://doi.org/10.1002/met.52, 2008.
Chen, F., Chen, J., Wei, Q., Li, J., Liu, C., Yang, D., Zhao, B., and Zhang, Z.: A new verification method for heavy rainfall forecast based on predictability II: Verification method and test, Acta. Meteorol. Sin., 77, 28–42, https://doi.org/10.11676/qxxb2019.003, 2019.
Chen, H., Li, P., and Zhao, Y.: A review and outlook of verification and evaluation of precipitation forecast at convection-permitting resolution, Adv. Meteorol. Sci. Technol., 11, 155–164, https://doi.org/10.3969/j.issn.2095-1973.2021.03.018, 2021.
Donaldson, R. J., Dyer, R. M., and Krauss, M. J.: An objective evaluator of techniques for predicting severe weather events, Ninth Conference on Severe Local Storms, Norman, Oklahoma, United States of America, American Meteorological Society [preprint], 321–326, 1975.
Doolittle, M. H.: The verification of predictions, B. Philos. Soc. Washington, 7, 122–127, 1885.
Doolittle, M. H.: Association ratios, Bulletin of the Philosophical Society of Washington, 10, 83–87, 94–96, 1888.
Doswell III, C. A., Davies-Jones, R., and Keller, D. L.: On summary measures of skill in rare event forecasting based on contingency tables, Weather Forecast., 5, 576–585, https://doi.org/10.1175/1520-0434(1990)005<0576:OSMOSI>2.0.CO;2, 1990.
Ebert, E. E.: Fuzzy verification of high-resolution gridded forecasts: a review and proposed framework, Meteorol. Appl., 15, 51–64, https://doi.org/10.1002/met.25, 2008.
Finley, J. P.: Tornado predictions, Am. Meteorol. J., 1, 85–88, 1884.
Flueck, J. A.: A study of some measures of forecast verification, in: 10th Conf. Probability and Statistics in Atmospheric Science, Edmonton, Alberta, Canada, American Meteorological Society [preprint], 69–73, 1987.
Gandin, L. S., and Murphy, A. H.: Equitable scores for categorical forecasts, Mon. Weather Rev., 120, 361–370, https://doi.org/10.1175/1520-0493(1992)120<0361:ESSFCF>2.0.CO;2, 1992.
Gilbert, G. K.: Finley's tornado predictions, Am. Meteorol. J., 1, 166–172, 1884.
Gilleland, E., Ahijevych, D., Brown, B. G., Casati, B., and Ebert, E. E.: Intercomparison of Spatial Forecast Verification Methods. Weather Forecast., 24, 1416–1430, https://doi.org/10.1175/2009WAF2222269.1, 2009.
Gofa, F., Boucouvala, D., Louka, P., and Flocas, H. A.: Spatial verification approaches as a tool to evaluate the performance of high resolution precipitation forecasts, Atmos. Res., 208, 78–87, https://doi.org/10.1016/j.atmosres.2017.09.021, 2018.
Han, F., Tang, W., Zhou, C., Sheng, J., and Zhang, X.: Improving a precipitation nowcasting algorithm based on the SWAN system and related application assessment, Acta Meteorol. Sin., 81, 304–315, https://doi.org/10.11676/qxxb2023.20220066, 2023.
Hanssen, A. W. and Kuipers, W. J. A.: On the relationship between the frequency of rain and various meteorological parameters, Mededeelingen en Verhandelingen, 81, 2–15, 1965.
Hao, C., Yu, B., Dai, Y., Zhi, X., And Zhang, Y.: Statistical downscaling research on spatio-temporal distributions of summer precipitation across the Beijing region, Meteorol. Mon., 49, 843–854, https://doi.org/10.7519/j.issn.1000-0526.2023.050201, 2023.
Heidke, P.: Berechnung des erfolges und der güte der windstärkevorhersagen im sturmwarnungdienst, Geografika Annaler, 8, 301–349, 1926.
Liu, C., Lin, J., Dai, K., Cao, Y., and Wei, Q.: An evaluation method suitable for precipitation forecasts and services, Torrential Rain and Disasters, 41, 712–719, https://doi.org/10.12406/byzh.2021-203, 2022.
Liu, C., Dai, K., Lin, J., Wei, Q., Li N., Wang, B., Tang B., Guo Y., Zhu W., Tang J., and Zeng X.: Design and implementation of whole process evaluation program library of weather forecast, Meteorol. Mon., 49, 351–364, https://doi.org/10.7519/j.issn.1000-0526.2022.050902, 2023.
Liu, J., Ren, C., Zhao, Z., Chen, C., Wang, Y., and Cai, K.: Comparative analysis on verification of heavy rainfall forecasts in different regional models, Meteorol. Mon., 48, 1292–1302, https://doi.org/10.7519/j.issn.1000-0526.2022.050502, 2022.
Marzban, C.: Scalar measures of performance in rare-event situations, Weather Forecast., 13, 753–763, https://doi.org/10.1175/1520-0434(1998)013<0753:SMOPIR>2.0.CO;2, 1998.
Mason, I. B.: Dependence of the critical success index on sample climate and threshold probability, Aust. Meteorol. Mag., 37, 75–81, 1989.
Mason, I. B.: Binary events, in: Forecast verification: a practitioner's guide in atmospheric science, edited by: Jolliffe IT and Stephenson DB, John Wiley and Sons, Chichester, United Kingdom, 37–76, 2003.
Murphy, A. H.: The Finley affair: a signal event in the history of forecast verification, Weather Forecast., 11, 3–20, https://doi.org/10.1175/1520-0434(1996)011<0003:TFAASE>2.0.CO;2, 1996.
Murphy, A. H. and Daan, H.: Forecast evaluation, in: Probability, statistics, and decision making in the atmospheric sciences, edited by: Murphy, A. H. and Katz, R. W., Westview Press, Boulder, Colorado, United States of America, 379–437, 1985.
Palmer, W. C. and Allen, R. A.: Note on the accuracy of forecasts concerning the rain problem, U.S. Weather Bureau, 1–4, 1949.
Peirce, C. S.: The numerical measure of the success of prediction, Science, 4, 453–454, 1884.
Roberts, N. M. and Lean, H. W.: Scale-selective verification of rainfall accumulations from high-resolution forecasts of convective events, Mon. Weather Rev., 136, 78–97, https://doi.org/10.1175/2007MWR2123.1, 2008.
Schaefer, J. T.: The critical success index as an indicator of warning skill, Weather Forecast., 5, 570–575, https://doi.org/10.1175/1520-0434(1990)005<0570:TCSIAA>2.0.CO;2, 1990.
Shi, W., Li, X., Zeng, M., Zhang, B., Wang, H., Zhu, K., and Zhuge, X.: Multi-model comparison and high-resolution regional model forecast analysis for the “7⋅20” Zhengzhou severe heavy rain, T. Atmos. Sci., 44, 688–702, https://doi.org/10.13878/j.cnki.dqkxxb.20210823001, 2021.
Stephenson, D. B., Casati, B., Ferro, C. A. T., and Wilson, C. A.: The extreme dependency score: A non-vanishing measure for forecasts of rare events, Meteorol. Appl., 15, 41–50, https://doi.org/10.1002/met.53, 2008.
Su, A., Lü, X., Cui, L., Li, Z., Xi, L., and Li, H.: The Basic Observational Analysis of “7.20” Extreme Rainstorm in Zhengzhou, Torrential Rain and Disasters, 40, 445–454, https://doi.org/10.3969/j.issn.1004-9045.2021.05.001, 2021.
Tang, W., Zhou, Q., Liu, X., Zhu, W., and Mao, X.: Analysis on verification of national severe convective weather categorical forecasts, Meteorol. Mon., 43, 67–76, https://doi.org/10.7519/j.issn.1000-0526.2017.01.007, 2017.
Wang, X., Yang, H., Cui, C., Li, C., Qi, H., Du, M., Wang, J., and Wang, X.: Analysis of unusual climatic characteristics of precipitation and four typical extreme weather processes in China in 2021, Torrential Rain and Disasters, 41, 489–500, https://doi.org/10.12406/byzh.2022-045, 2022.
Wei, Q., Li, W., Peng, S., Xue, F., Zhao, S., Zhang, J., and Qi, D.: Development and application of national verification system in CMA, J. Appl. Meteorol. Sci., 30, 245–256, https://doi.org/10.11898/1001-7313.20190211, 2019.
Weygandt, S. S., Loughe, A. F., Benjamin, S. G., and Mahoney, J. L.: Scale sensitivities in model precipitation skill scores during IHOP, in: 22nd Conference Severe Local Storms, Hyannis, Massachusetts, United States of America, American Meteorological Society, 4–8 October 2004.
Wilks, D. S.: Statistical Methods in the Atmospheric Sciences, 2nd edn., Academic Press, 630 pp., 2006.
Yang, D., Gao, X., and Zhang, W.: Research and improvement of a new rainstorm forecast accuracy verification scheme, in: Proceedings of the 34th Annual Meeting of the Chinese Meteorological Society, S1 Disaster Weather Monitoring, Analysis and Forecast, 549–559, 2017.
Yang, Y., Yin, J., Wang, D., Liu, Y., Lu, Y., Zhang, W., and Xu, S.: ABM-based emergency evacuation modelling during urban pluvial floods: A “7.20” pluvial flood event study in Zhengzhou, Henan Province, Sci. China Earth Sci., 66, 282–291, https://doi.org/10.1007/s11430-022-1015-6, 2023.
Yates, E., Anquetin, S., Ducrocq, V., Creutin, J.-D., Ricard, D., and Chancibault, K.: Point and areal validation of forecast precipitation fields, Meteorol. Appl., 13, 1–20, https://doi.org/10.1017/S1350482705001921, 2006.
Zepeda-Arce, J., Foufoula-Georgiou, E., and Droegemeier, K. K.: Space-time rainfall organization and its role in validating quantitative precipitation forecasts, J. Geophys. Res., 105, 10129–10146, https://doi.org/10.1029/1999JD901087, 2000.
Zhang, B., Zeng, M., Huang, A., Qin, Z., Liu, C., Shi, W., Li, X., Zhu, K., Gu, C., and Zhou, J.: Software and Data for “A general comprehensive evaluation method for cross-scale precipitation forecasts”, Zenodo [code and data set], https://doi.org/10.5281/zenodo.10951799, 2024.
Zhang, Y., Yu, H., Zhang, M., Yang, Y., and Meng, Z.: Uncertainties and error growth in forecasting the record-breaking rainfall in Zhengzhou, Henan on 19–20 July 2021, Sci. China Earth Sci., 65, 1903–1920, https://doi.org/10.1007/s11430-022-9991-4, 2022.
Zhao, B. and Zhang, B.: Application of neighborhood spatial verification method on precipitation evaluation, Torrential Rain and Disasters, 37, 1–7, https://doi.org/10.3969/j.issn.1004-9045.2018.01.001, 2018.
Zhong, Q., Sun, Z., Chen, H., Li, J., and Shen, L.: Multi model forecast biases of the diurnal variations of intense rainfall in the Beijing-Tianjin-Hebei region, Sci. China Earth Sci., 65, 1490–1509, https://doi.org/10.1007/s11430-021-9905-4, 2022.
Short summary
By directly analyzing the proximity of precipitation forecasts and observations, a precipitation accuracy score (PAS) method was constructed. This method does not utilize a traditional contingency-table-based classification verification; however, it can replace the threat score (TS), equitable threat score (ETS), and other skill score methods, and it can be used to calculate the accuracy of numerical models or quantitative precipitation forecasts.
By directly analyzing the proximity of precipitation forecasts and observations, a precipitation...
