Articles | Volume 17, issue 11
https://doi.org/10.5194/gmd-17-4579-2024
© Author(s) 2024. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
https://doi.org/10.5194/gmd-17-4579-2024
© Author(s) 2024. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
Methods for assessment of models
| 
10 Jun 2024
Methods for assessment of models |
| 10 Jun 2024
| 10 Jun 2024
A general comprehensive evaluation method for cross-scale precipitation forecasts
Bing Zhang
Key Laboratory of Transportation Meteorology of China Meteorological Administration, Nanjing Joint Institute for Atmospheric Sciences, Nanjing 210041, China
Mingjian Zeng
CORRESPONDING AUTHOR
Key Laboratory of Transportation Meteorology of China Meteorological Administration, Nanjing Joint Institute for Atmospheric Sciences, Nanjing 210041, China
School of Atmospheric Sciences, Nanjing University, Nanjing 210023, China
Zhengkun Qin
School of Atmospheric Sciences, Nanjing University of Information Science and Technology, Nanjing 210044, China
Joint Center of Data Assimilation Research and Applications, Nanjing University of Information Science and Technology, Nanjing 210044, China
Couhua Liu
National Meteorological Centre, Beijing 100081, China
Wenru Shi
Key Laboratory of Transportation Meteorology of China Meteorological Administration, Nanjing Joint Institute for Atmospheric Sciences, Nanjing 210041, China
Key Laboratory of Transportation Meteorology of China Meteorological Administration, Nanjing Joint Institute for Atmospheric Sciences, Nanjing 210041, China
Kefeng Zhu
Key Laboratory of Transportation Meteorology of China Meteorological Administration, Nanjing Joint Institute for Atmospheric Sciences, Nanjing 210041, China
Chunlei Gu
School of Atmospheric Sciences, Nanjing University, Nanjing 210023, China
Jialing Zhou
Key Laboratory of Transportation Meteorology of China Meteorological Administration, Nanjing Joint Institute for Atmospheric Sciences, Nanjing 210041, China
Related authors
Xiaoyong Zhuge, Xiaolei Zou, Lu Yu, Xin Li, Mingjian Zeng, Yilun Chen, Bing Zhang, Bin Yao, Fei Tang, Fengjiao Chen, and Wanlin Kan
Earth Syst. Sci. Data, 16, 1747–1769, https://doi.org/10.5194/essd-16-1747-2024, https://doi.org/10.5194/essd-16-1747-2024, 2024
Short summary
Short summary
The Himawari-8/9 level-2 operational cloud product has a low spatial resolution and is available only during the daytime. To supplement this official dataset, a new dataset named the NJIAS Himawari-8/9 Cloud Feature Dataset (HCFD) was constructed. The NJIAS HCFD provides a comprehensive description of cloud features over the East Asia and west North Pacific regions for the years 2016–2022 by 30 retrieved cloud variables. The NJIAS HCFD has been demonstrated to outperform the official dataset.
Xiaoyong Zhuge, Xiaolei Zou, Lu Yu, Xin Li, Mingjian Zeng, Yilun Chen, Bing Zhang, Bin Yao, Fei Tang, Fengjiao Chen, and Wanlin Kan
Earth Syst. Sci. Data, 16, 1747–1769, https://doi.org/10.5194/essd-16-1747-2024, https://doi.org/10.5194/essd-16-1747-2024, 2024
Short summary
Short summary
The Himawari-8/9 level-2 operational cloud product has a low spatial resolution and is available only during the daytime. To supplement this official dataset, a new dataset named the NJIAS Himawari-8/9 Cloud Feature Dataset (HCFD) was constructed. The NJIAS HCFD provides a comprehensive description of cloud features over the East Asia and west North Pacific regions for the years 2016–2022 by 30 retrieved cloud variables. The NJIAS HCFD has been demonstrated to outperform the official dataset.
Tingfeng Wu, Boqiang Qin, Anning Huang, Yongwei Sheng, Shunxin Feng, and Céline Casenave
Geosci. Model Dev., 15, 745–769, https://doi.org/10.5194/gmd-15-745-2022, https://doi.org/10.5194/gmd-15-745-2022, 2022
Short summary
Short summary
Most hydrodynamic models were initially developed based in marine environments. They cannot be directly applied to large lakes. Based on field observations and numerical experiments of a large shallow lake, we developed a hydrodynamic model by adopting new schemes of wind stress, wind waves, and turbulence for large lakes. Our model can greatly improve the simulation of lake currents. This study will be a reminder to limnologists to prudently use ocean models to study lake hydrodynamics.
Tongwen Wu, Rucong Yu, Yixiong Lu, Weihua Jie, Yongjie Fang, Jie Zhang, Li Zhang, Xiaoge Xin, Laurent Li, Zaizhi Wang, Yiming Liu, Fang Zhang, Fanghua Wu, Min Chu, Jianglong Li, Weiping Li, Yanwu Zhang, Xueli Shi, Wenyan Zhou, Junchen Yao, Xiangwen Liu, He Zhao, Jinghui Yan, Min Wei, Wei Xue, Anning Huang, Yaocun Zhang, Yu Zhang, Qi Shu, and Aixue Hu
Geosci. Model Dev., 14, 2977–3006, https://doi.org/10.5194/gmd-14-2977-2021, https://doi.org/10.5194/gmd-14-2977-2021, 2021
Short summary
Short summary
This paper presents the high-resolution version of the Beijing Climate Center (BCC) Climate System Model, BCC-CSM2-HR, and describes its climate simulation performance including the atmospheric temperature and wind; precipitation; and the tropical climate phenomena such as TC, MJO, QBO, and ENSO. BCC-CSM2-HR is our model version contributing to the HighResMIP. We focused on its updates and differential characteristics from its predecessor, the medium-resolution version BCC-CSM2-MR.
Tongwen Wu, Yixiong Lu, Yongjie Fang, Xiaoge Xin, Laurent Li, Weiping Li, Weihua Jie, Jie Zhang, Yiming Liu, Li Zhang, Fang Zhang, Yanwu Zhang, Fanghua Wu, Jianglong Li, Min Chu, Zaizhi Wang, Xueli Shi, Xiangwen Liu, Min Wei, Anning Huang, Yaocun Zhang, and Xiaohong Liu
Geosci. Model Dev., 12, 1573–1600, https://doi.org/10.5194/gmd-12-1573-2019, https://doi.org/10.5194/gmd-12-1573-2019, 2019
Short summary
Short summary
This work presents advancements of the BCC model transition from CMIP5 to CMIP6, especially in the model resolution and its physics. Compared with BCC CMIP5 models, the BCC CMIP6 model shows significant improvements in historical simulations in many aspects including tropospheric air temperature and circulation at global and regional scales in East Asia, climate variability at different timescales (QBO, MJO, and diurnal cycle of precipitation), and the long-term trend of global air temperature.
Lei Shu, Min Xie, Da Gao, Tijian Wang, Dexian Fang, Qian Liu, Anning Huang, and Liwen Peng
Atmos. Chem. Phys., 17, 12871–12891, https://doi.org/10.5194/acp-17-12871-2017, https://doi.org/10.5194/acp-17-12871-2017, 2017
Short summary
Short summary
Based on 1-year in situ monitoring data of 16 cities, this paper can enhance the understanding of the pollution characteristics of particles (PM2.5 and PM10) in the Yangtze River Delta region, China. Based on NCEP reanalysis data, the establishment of the potential links between different levels of particle pollution and predominant synoptic patterns can provide an insightful view on formulating pollution control and mitigation strategies.
Min Xie, Lei Shu, Tijian Wang, Da Gao, Shu Li, Bingliang Zhuang, Anning Huang, Dexian Fang, Yong Han, Mengmeng Li, Pulong Chen, Zhijun Liu, Zheng Wu, and Hua Lu
Atmos. Chem. Phys. Discuss., https://doi.org/10.5194/acp-2017-500, https://doi.org/10.5194/acp-2017-500, 2017
Preprint withdrawn
Short summary
Short summary
The spatial distribution of aerosol can be affected by monsoon circulation. With the aid of a EAWM index, the stong and the weak EAWM years are identified. The long-term trend of weakening EAWM may potentially increase the aerosol loading in YRD, BTH and SCB but decrease AOD in PRD. By using RegCCMS, we further prove that the intensity of EAWM has great impacts on the spatial distribution of aerosols. The change pattern is mainly decided by the change of aerosols in lower troposphere.
Related subject area
Atmospheric sciences
Exploring the footprint representation of microwave radiance observations in an Arctic limited-area data assimilation system
Analysis of model error in forecast errors of extended atmospheric Lorenz 05 systems and the ECMWF system
Description and validation of Vehicular Emissions from Road Traffic (VERT) 1.0, an R-based framework for estimating road transport emissions from traffic flows
AeroMix v1.0.1: a Python package for modeling aerosol optical properties and mixing states
Impact of ITCZ width on global climate: ITCZ-MIP
Deep-learning-driven simulations of boundary layer clouds over the Southern Great Plains
Mixed-precision computing in the GRIST dynamical core for weather and climate modelling
A conservative immersed boundary method for the multi-physics urban large-eddy simulation model uDALES v2.0
RCEMIP-II: mock-Walker simulations as phase II of the radiative–convective equilibrium model intercomparison project
Objective identification of meteorological fronts and climatologies from ERA-Interim and ERA5
TAMS: a tracking, classifying, and variable-assigning algorithm for mesoscale convective systems in simulated and satellite-derived datasets
Development of the adjoint of the unified tropospheric–stratospheric chemistry extension (UCX) in GEOS-Chem adjoint v36
New explicit formulae for the settling speed of prolate spheroids in the atmosphere: theoretical background and implementation in AerSett v2.0.2
ZJU-AERO V0.5: an Accurate and Efficient Radar Operator designed for CMA-GFS/MESO with the capability to simulate non-spherical hydrometeors
The Year of Polar Prediction site Model Intercomparison Project (YOPPsiteMIP) phase 1: project overview and Arctic winter forecast evaluation
Evaluating CHASER V4.0 global formaldehyde (HCHO) simulations using satellite, aircraft, and ground-based remote-sensing observations
Global variable-resolution simulations of extreme precipitation over Henan, China, in 2021 with MPAS-Atmosphere v7.3
The CHIMERE chemistry-transport model v2023r1
tobac v1.5: introducing fast 3D tracking, splits and mergers, and other enhancements for identifying and analysing meteorological phenomena
Merged Observatory Data Files (MODFs): an integrated observational data product supporting process-oriented investigations and diagnostics
Simulation of marine stratocumulus using the super-droplet method: numerical convergence and comparison to a double-moment bulk scheme using SCALE-SDM 5.2.6-2.3.1
WRF-Comfort: simulating microscale variability in outdoor heat stress at the city scale with a mesoscale model
Representing effects of surface heterogeneity in a multi-plume eddy diffusivity mass flux boundary layer parameterization
Can TROPOMI NO2 satellite data be used to track the drop in and resurgence of NOx emissions in Germany between 2019–2021 using the multi-source plume method (MSPM)?
A spatiotemporally separated framework for reconstructing the sources of atmospheric radionuclide releases
A parameterization scheme for the floating wind farm in a coupled atmosphere–wave model (COAWST v3.7)
RoadSurf 1.1: open-source road weather model library
Calibrating and validating the Integrated Valuation of Ecosystem Services and Tradeoffs (InVEST) urban cooling model: case studies in France and the United States
The ddeq Python library for point source quantification from remote sensing images (version 1.0)
Incorporating Oxygen Isotopes of Oxidized Reactive Nitrogen in the Regional Atmospheric Chemistry Mechanism, version 2 (ICOIN-RACM2)
Implementation of a Simple Actuator Disk for Large-Eddy Simulation in the Weather Research and Forecasting Model (WRF-SADLES v1.2) for wind turbine wake simulation
WRF-PDAF v1.0: implementation and application of an online localized ensemble data assimilation framework
Implementation and evaluation of diabatic advection in the Lagrangian transport model MPTRAC 2.6
An improved and extended parameterization of the CO2 15 µm cooling in the middle and upper atmosphere (CO2_cool_fort-1.0)
Development of a multiphase chemical mechanism to improve secondary organic aerosol formation in CAABA/MECCA (version 4.7.0)
Application of regional meteorology and air quality models based on the microprocessor without interlocked piped stages (MIPS) and LoongArch CPU platforms
Investigating ground-level ozone pollution in semi-arid and arid regions of Arizona using WRF-Chem v4.4 modeling
An objective identification technique for potential vorticity structures associated with African easterly waves
Importance of microphysical settings for climate forcing by stratospheric SO2 injections as modeled by SOCOL-AERv2
Assessment of surface ozone products from downscaled CAMS reanalysis and CAMS daily forecast using urban air quality monitoring stations in Iran
Open boundary conditions for atmospheric large-eddy simulations and their implementation in DALES4.4
Efficient and stable coupling of the SuperdropNet deep-learning-based cloud microphysics (v0.1.0) with the ICON climate and weather model (v2.6.5)
Three-dimensional variational assimilation with a multivariate background error covariance for the Model for Prediction Across Scales – Atmosphere with the Joint Effort for Data assimilation Integration (JEDI-MPAS 2.0.0-beta)
FUME 2.0 – Flexible Universal processor for Modeling Emissions
DEUCE v1.0: a neural network for probabilistic precipitation nowcasting with aleatoric and epistemic uncertainties
Evaluation of multi-season convection-permitting atmosphere – mixed-layer ocean simulations of the Maritime Continent
RASCAL v1.0.0: An Open Source Tool for Climatological Time Series Reconstruction and Extension
Selecting CMIP6 GCMs for CORDEX Dynamical Downscaling over Southeast Asia Using a Standardised Benchmarking Framework
Investigating the impact of coupling HARMONIE-WINS50 (cy43) meteorology to LOTOS-EUROS (v2.2.002) on a simulation of NO2 concentrations over the Netherlands
Balloon drift estimation and improved position estimates for radiosondes
Máté Mile, Stephanie Guedj, and Roger Randriamampianina
Geosci. Model Dev., 17, 6571–6587, https://doi.org/10.5194/gmd-17-6571-2024, https://doi.org/10.5194/gmd-17-6571-2024, 2024
Short summary
Short summary
Satellite observations provide crucial information about atmospheric constituents in a global distribution that helps to better predict the weather over sparsely observed regions like the Arctic. However, the use of satellite data is usually conservative and imperfect. In this study, a better spatial representation of satellite observations is discussed and explored by a so-called footprint function or operator, highlighting its added value through a case study and diagnostics.
Hynek Bednář and Holger Kantz
Geosci. Model Dev., 17, 6489–6511, https://doi.org/10.5194/gmd-17-6489-2024, https://doi.org/10.5194/gmd-17-6489-2024, 2024
Short summary
Short summary
The forecast error growth of atmospheric phenomena is caused by initial and model errors. When studying the initial error growth, it may turn out that small-scale phenomena, which contribute little to the forecast product, significantly affect the ability to predict this product. With a negative result, we investigate in the extended Lorenz (2005) system whether omitting these phenomena will improve predictability. A theory explaining and describing this behavior is developed.
Giorgio Veratti, Alessandro Bigi, Sergio Teggi, and Grazia Ghermandi
Geosci. Model Dev., 17, 6465–6487, https://doi.org/10.5194/gmd-17-6465-2024, https://doi.org/10.5194/gmd-17-6465-2024, 2024
Short summary
Short summary
In this study, we present VERT (Vehicular Emissions from Road Traffic), an R package designed to estimate transport emissions using traffic estimates and vehicle fleet composition data. Compared to other tools available in the literature, VERT stands out for its user-friendly configuration and flexibility of user input. Case studies demonstrate its accuracy in both urban and regional contexts, making it a valuable tool for air quality management and transport scenario planning.
Sam P. Raj, Puna Ram Sinha, Rohit Srivastava, Srinivas Bikkina, and Damu Bala Subrahamanyam
Geosci. Model Dev., 17, 6379–6399, https://doi.org/10.5194/gmd-17-6379-2024, https://doi.org/10.5194/gmd-17-6379-2024, 2024
Short summary
Short summary
A Python successor to the aerosol module of the OPAC model, named AeroMix, has been developed, with enhanced capabilities to better represent real atmospheric aerosol mixing scenarios. AeroMix’s performance in modeling aerosol mixing states has been evaluated against field measurements, substantiating its potential as a versatile aerosol optical model framework for next-generation algorithms to infer aerosol mixing states and chemical composition.
Angeline G. Pendergrass, Michael P. Byrne, Oliver Watt-Meyer, Penelope Maher, and Mark J. Webb
Geosci. Model Dev., 17, 6365–6378, https://doi.org/10.5194/gmd-17-6365-2024, https://doi.org/10.5194/gmd-17-6365-2024, 2024
Short summary
Short summary
The width of the tropical rain belt affects many aspects of our climate, yet we do not understand what controls it. To better understand it, we present a method to change it in numerical model experiments. We show that the method works well in four different models. The behavior of the width is unexpectedly simple in some ways, such as how strong the winds are as it changes, but in other ways, it is more complicated, especially how temperature increases with carbon dioxide.
Tianning Su and Yunyan Zhang
Geosci. Model Dev., 17, 6319–6336, https://doi.org/10.5194/gmd-17-6319-2024, https://doi.org/10.5194/gmd-17-6319-2024, 2024
Short summary
Short summary
Using 2 decades of field observations over the Southern Great Plains, this study developed a deep-learning model to simulate the complex dynamics of boundary layer clouds. The deep-learning model can serve as the cloud parameterization within reanalysis frameworks, offering insights into improving the simulation of low clouds. By quantifying biases due to various meteorological factors and parameterizations, this deep-learning-driven approach helps bridge the observation–modeling divide.
Siyuan Chen, Yi Zhang, Yiming Wang, Zhuang Liu, Xiaohan Li, and Wei Xue
Geosci. Model Dev., 17, 6301–6318, https://doi.org/10.5194/gmd-17-6301-2024, https://doi.org/10.5194/gmd-17-6301-2024, 2024
Short summary
Short summary
This study explores strategies and techniques for implementing mixed-precision code optimization within an atmosphere model dynamical core. The coded equation terms in the governing equations that are sensitive (or insensitive) to the precision level have been identified. The performance of mixed-precision computing in weather and climate simulations was analyzed.
Sam O. Owens, Dipanjan Majumdar, Chris E. Wilson, Paul Bartholomew, and Maarten van Reeuwijk
Geosci. Model Dev., 17, 6277–6300, https://doi.org/10.5194/gmd-17-6277-2024, https://doi.org/10.5194/gmd-17-6277-2024, 2024
Short summary
Short summary
Designing cities that are resilient, sustainable, and beneficial to health requires an understanding of urban climate and air quality. This article presents an upgrade to the multi-physics numerical model uDALES, which can simulate microscale airflow, heat transfer, and pollutant dispersion in urban environments. This upgrade enables it to resolve realistic urban geometries more accurately and to take advantage of the resources available on current and future high-performance computing systems.
Allison A. Wing, Levi G. Silvers, and Kevin A. Reed
Geosci. Model Dev., 17, 6195–6225, https://doi.org/10.5194/gmd-17-6195-2024, https://doi.org/10.5194/gmd-17-6195-2024, 2024
Short summary
Short summary
This paper presents the experimental design for a model intercomparison project to study tropical clouds and climate. It is a follow-up from a prior project that used a simplified framework for tropical climate. The new project adds one new component – a specified pattern of sea surface temperatures as the lower boundary condition. We provide example results from one cloud-resolving model and one global climate model and test the sensitivity to the experimental parameters.
Philip G. Sansom and Jennifer L. Catto
Geosci. Model Dev., 17, 6137–6151, https://doi.org/10.5194/gmd-17-6137-2024, https://doi.org/10.5194/gmd-17-6137-2024, 2024
Short summary
Short summary
Weather fronts bring a lot of rain and strong winds to many regions of the mid-latitudes. We have developed an updated method of identifying these fronts in gridded data that can be used on new datasets with small grid spacing. The method can be easily applied to different datasets due to the use of open-source software for its development and shows improvements over similar previous methods. We present an updated estimate of the average frequency of fronts over the past 40 years.
Kelly M. Núñez Ocasio and Zachary L. Moon
Geosci. Model Dev., 17, 6035–6049, https://doi.org/10.5194/gmd-17-6035-2024, https://doi.org/10.5194/gmd-17-6035-2024, 2024
Short summary
Short summary
TAMS is an open-source Python-based package for tracking and classifying mesoscale convective systems that can be used to study observed and simulated systems. Each step of the algorithm is described in this paper with examples showing how to make use of visualization and post-processing tools within the package. A unique and valuable feature of this tracker is its support for unstructured grids in the identification stage and grid-independent tracking.
Irene C. Dedoussi, Daven K. Henze, Sebastian D. Eastham, Raymond L. Speth, and Steven R. H. Barrett
Geosci. Model Dev., 17, 5689–5703, https://doi.org/10.5194/gmd-17-5689-2024, https://doi.org/10.5194/gmd-17-5689-2024, 2024
Short summary
Short summary
Atmospheric model gradients provide a meaningful tool for better understanding the underlying atmospheric processes. Adjoint modeling enables computationally efficient gradient calculations. We present the adjoint of the GEOS-Chem unified chemistry extension (UCX). With this development, the GEOS-Chem adjoint model can capture stratospheric ozone and other processes jointly with tropospheric processes. We apply it to characterize the Antarctic ozone depletion potential of active halogen species.
Sylvain Mailler, Sotirios Mallios, Arineh Cholakian, Vassilis Amiridis, Laurent Menut, and Romain Pennel
Geosci. Model Dev., 17, 5641–5655, https://doi.org/10.5194/gmd-17-5641-2024, https://doi.org/10.5194/gmd-17-5641-2024, 2024
Short summary
Short summary
We propose two explicit expressions to calculate the settling speed of solid atmospheric particles with prolate spheroidal shapes. The first formulation is based on theoretical arguments only, while the second one is based on computational fluid dynamics calculations. We show that the first method is suitable for virtually all atmospheric aerosols, provided their shape can be adequately described as a prolate spheroid, and we provide an implementation of the first method in AerSett v2.0.2.
Hejun Xie, Lei Bi, and Wei Han
Geosci. Model Dev., 17, 5657–5688, https://doi.org/10.5194/gmd-17-5657-2024, https://doi.org/10.5194/gmd-17-5657-2024, 2024
Short summary
Short summary
A radar operator plays a crucial role in utilizing radar observations to enhance numerical weather forecasts. However, developing an advanced radar operator is challenging due to various complexities associated with the wave scattering by non-spherical hydrometeors, radar beam propagation, and multiple platforms. In this study, we introduce a novel radar operator named the Accurate and Efficient Radar Operator developed by ZheJiang University (ZJU-AERO) which boasts several unique features.
Jonathan J. Day, Gunilla Svensson, Barbara Casati, Taneil Uttal, Siri-Jodha Khalsa, Eric Bazile, Elena Akish, Niramson Azouz, Lara Ferrighi, Helmut Frank, Michael Gallagher, Øystein Godøy, Leslie M. Hartten, Laura X. Huang, Jareth Holt, Massimo Di Stefano, Irene Suomi, Zen Mariani, Sara Morris, Ewan O'Connor, Roberta Pirazzini, Teresa Remes, Rostislav Fadeev, Amy Solomon, Johanna Tjernström, and Mikhail Tolstykh
Geosci. Model Dev., 17, 5511–5543, https://doi.org/10.5194/gmd-17-5511-2024, https://doi.org/10.5194/gmd-17-5511-2024, 2024
Short summary
Short summary
The YOPP site Model Intercomparison Project (YOPPsiteMIP), which was designed to facilitate enhanced weather forecast evaluation in polar regions, is discussed here, focussing on describing the archive of forecast data and presenting a multi-model evaluation at Arctic supersites during February and March 2018. The study highlights an underestimation in boundary layer temperature variance that is common across models and a related inability to forecast cold extremes at several of the sites.
Hossain Mohammed Syedul Hoque, Kengo Sudo, Hitoshi Irie, Yanfeng He, and Md Firoz Khan
Geosci. Model Dev., 17, 5545–5571, https://doi.org/10.5194/gmd-17-5545-2024, https://doi.org/10.5194/gmd-17-5545-2024, 2024
Short summary
Short summary
Using multi-platform observations, we validated global formaldehyde (HCHO) simulations from a chemistry transport model. HCHO is a crucial intermediate in the chemical catalytic cycle that governs the ozone formation in the troposphere. The model was capable of replicating the observed spatiotemporal variability in HCHO. In a few cases, the model's capability was limited. This is attributed to the uncertainties in the observations and the model parameters.
Zijun Liu, Li Dong, Zongxu Qiu, Xingrong Li, Huiling Yuan, Dongmei Meng, Xiaobin Qiu, Dingyuan Liang, and Yafei Wang
Geosci. Model Dev., 17, 5477–5496, https://doi.org/10.5194/gmd-17-5477-2024, https://doi.org/10.5194/gmd-17-5477-2024, 2024
Short summary
Short summary
In this study, we completed a series of simulations with MPAS-Atmosphere (version 7.3) to study the extreme precipitation event of Henan, China, during 20–22 July 2021. We found the different performance of two built-in parameterization scheme suites (mesoscale and convection-permitting suites) with global quasi-uniform and variable-resolution meshes. This study holds significant implications for advancing the understanding of the scale-aware capability of MPAS-Atmosphere.
Laurent Menut, Arineh Cholakian, Romain Pennel, Guillaume Siour, Sylvain Mailler, Myrto Valari, Lya Lugon, and Yann Meurdesoif
Geosci. Model Dev., 17, 5431–5457, https://doi.org/10.5194/gmd-17-5431-2024, https://doi.org/10.5194/gmd-17-5431-2024, 2024
Short summary
Short summary
A new version of the CHIMERE model is presented. This version contains both computational and physico-chemical changes. The computational changes make it easy to choose the variables to be extracted as a result, including values of maximum sub-hourly concentrations. Performance tests show that the model is 1.5 to 2 times faster than the previous version for the same setup. Processes such as turbulence, transport schemes and dry deposition have been modified and updated.
G. Alexander Sokolowsky, Sean W. Freeman, William K. Jones, Julia Kukulies, Fabian Senf, Peter J. Marinescu, Max Heikenfeld, Kelcy N. Brunner, Eric C. Bruning, Scott M. Collis, Robert C. Jackson, Gabrielle R. Leung, Nils Pfeifer, Bhupendra A. Raut, Stephen M. Saleeby, Philip Stier, and Susan C. van den Heever
Geosci. Model Dev., 17, 5309–5330, https://doi.org/10.5194/gmd-17-5309-2024, https://doi.org/10.5194/gmd-17-5309-2024, 2024
Short summary
Short summary
Building on previous analysis tools developed for atmospheric science, the original release of the Tracking and Object-Based Analysis (tobac) Python package, v1.2, was open-source, modular, and insensitive to the type of gridded input data. Here, we present the latest version of tobac, v1.5, which substantially improves scientific capabilities and computational efficiency from the previous version. These enhancements permit new uses for tobac in atmospheric science and potentially other fields.
Taneil Uttal, Leslie M. Hartten, Siri Jodha Khalsa, Barbara Casati, Gunilla Svensson, Jonathan Day, Jareth Holt, Elena Akish, Sara Morris, Ewan O'Connor, Roberta Pirazzini, Laura X. Huang, Robert Crawford, Zen Mariani, Øystein Godøy, Johanna A. K. Tjernström, Giri Prakash, Nicki Hickmon, Marion Maturilli, and Christopher J. Cox
Geosci. Model Dev., 17, 5225–5247, https://doi.org/10.5194/gmd-17-5225-2024, https://doi.org/10.5194/gmd-17-5225-2024, 2024
Short summary
Short summary
A Merged Observatory Data File (MODF) format to systematically collate complex atmosphere, ocean, and terrestrial data sets collected by multiple instruments during field campaigns is presented. The MODF format is also designed to be applied to model output data, yielding format-matching Merged Model Data Files (MMDFs). MODFs plus MMDFs will augment and accelerate the synergistic use of model results with observational data to increase understanding and predictive skill.
Chongzhi Yin, Shin-ichiro Shima, Lulin Xue, and Chunsong Lu
Geosci. Model Dev., 17, 5167–5189, https://doi.org/10.5194/gmd-17-5167-2024, https://doi.org/10.5194/gmd-17-5167-2024, 2024
Short summary
Short summary
We investigate numerical convergence properties of a particle-based numerical cloud microphysics model (SDM) and a double-moment bulk scheme for simulating a marine stratocumulus case, compare their results with model intercomparison project results, and present possible explanations for the different results of the SDM and the bulk scheme. Aerosol processes can be accurately simulated using SDM, and this may be an important factor affecting the behavior and morphology of marine stratocumulus.
Alberto Martilli, Negin Nazarian, E. Scott Krayenhoff, Jacob Lachapelle, Jiachen Lu, Esther Rivas, Alejandro Rodriguez-Sanchez, Beatriz Sanchez, and José Luis Santiago
Geosci. Model Dev., 17, 5023–5039, https://doi.org/10.5194/gmd-17-5023-2024, https://doi.org/10.5194/gmd-17-5023-2024, 2024
Short summary
Short summary
Here, we present a model that quantifies the thermal stress and its microscale variability at a city scale with a mesoscale model. This tool can have multiple applications, from early warnings of extreme heat to the vulnerable population to the evaluation of the effectiveness of heat mitigation strategies. It is the first model that includes information on microscale variability in a mesoscale model, something that is essential for fully evaluating heat stress.
Nathan P. Arnold
Geosci. Model Dev., 17, 5041–5056, https://doi.org/10.5194/gmd-17-5041-2024, https://doi.org/10.5194/gmd-17-5041-2024, 2024
Short summary
Short summary
Earth system models often represent the land surface at smaller scales than the atmosphere, but surface–atmosphere coupling uses only aggregated surface properties. This study presents a method to allow heterogeneous surface properties to modify boundary layer updrafts. The method is tested in single column experiments. Updraft properties are found to reasonably covary with surface conditions, and simulated boundary layer variability is enhanced over more heterogeneous land surfaces.
Enrico Dammers, Janot Tokaya, Christian Mielke, Kevin Hausmann, Debora Griffin, Chris McLinden, Henk Eskes, and Renske Timmermans
Geosci. Model Dev., 17, 4983–5007, https://doi.org/10.5194/gmd-17-4983-2024, https://doi.org/10.5194/gmd-17-4983-2024, 2024
Short summary
Short summary
Nitrogen dioxide (NOx) is produced by sources such as industry and traffic and is directly linked to negative impacts on health and the environment. The current construction of emission inventories to keep track of NOx emissions is slow and time-consuming. Satellite measurements provide a way to quickly and independently estimate emissions. In this study, we apply a consistent methodology to derive NOx emissions over Germany and illustrate the value of having such a method for fast projections.
Yuhan Xu, Sheng Fang, Xinwen Dong, and Shuhan Zhuang
Geosci. Model Dev., 17, 4961–4982, https://doi.org/10.5194/gmd-17-4961-2024, https://doi.org/10.5194/gmd-17-4961-2024, 2024
Short summary
Short summary
Recent atmospheric radionuclide leakages from unknown sources have posed a new challenge in nuclear emergency assessment. Reconstruction via environmental observations is the only feasible way to identify sources, but simultaneous reconstruction of the source location and release rate yields high uncertainties. We propose a spatiotemporally separated reconstruction strategy that avoids these uncertainties and outperforms state-of-the-art methods with respect to accuracy and uncertainty ranges.
Shaokun Deng, Shengmu Yang, Shengli Chen, Daoyi Chen, Xuefeng Yang, and Shanshan Cui
Geosci. Model Dev., 17, 4891–4909, https://doi.org/10.5194/gmd-17-4891-2024, https://doi.org/10.5194/gmd-17-4891-2024, 2024
Short summary
Short summary
Global offshore wind power development is moving from offshore to deeper waters, where floating offshore wind turbines have an advantage over bottom-fixed turbines. However, current wind farm parameterization schemes in mesoscale models are not applicable to floating turbines. We propose a floating wind farm parameterization scheme that accounts for the attenuation of the significant wave height by floating turbines. The results indicate that it has a significant effect on the power output.
Virve Eveliina Karsisto
Geosci. Model Dev., 17, 4837–4853, https://doi.org/10.5194/gmd-17-4837-2024, https://doi.org/10.5194/gmd-17-4837-2024, 2024
Short summary
Short summary
RoadSurf is an open-source library that contains functions from the Finnish Meteorological Institute’s road weather model. The evaluation of the library shows that it is well suited for making road surface temperature forecasts. The evaluation was done by making forecasts for about 400 road weather stations in Finland with the library. Accurate forecasts help road authorities perform salting and plowing operations at the right time and keep roads safe for drivers.
Perrine Hamel, Martí Bosch, Léa Tardieu, Aude Lemonsu, Cécile de Munck, Chris Nootenboom, Vincent Viguié, Eric Lonsdorf, James A. Douglass, and Richard P. Sharp
Geosci. Model Dev., 17, 4755–4771, https://doi.org/10.5194/gmd-17-4755-2024, https://doi.org/10.5194/gmd-17-4755-2024, 2024
Short summary
Short summary
The InVEST Urban Cooling model estimates the cooling effect of vegetation in cities. We further developed an algorithm to facilitate model calibration and evaluation. Applying the algorithm to case studies in France and in the United States, we found that nighttime air temperature estimates compare well with reference datasets. Estimated change in temperature from a land cover scenario compares well with an alternative model estimate, supporting the use of the model for urban planning decisions.
Gerrit Kuhlmann, Erik Koene, Sandro Meier, Diego Santaren, Grégoire Broquet, Frédéric Chevallier, Janne Hakkarainen, Janne Nurmela, Laia Amorós, Johanna Tamminen, and Dominik Brunner
Geosci. Model Dev., 17, 4773–4789, https://doi.org/10.5194/gmd-17-4773-2024, https://doi.org/10.5194/gmd-17-4773-2024, 2024
Short summary
Short summary
We present a Python software library for data-driven emission quantification (ddeq). It can be used to determine the emissions of hot spots (cities, power plants and industry) from remote sensing images using different methods. ddeq can be extended for new datasets and methods, providing a powerful community tool for users and developers. The application of the methods is shown using Jupyter notebooks included in the library.
Wendell W. Walters, Masayuki Takeuchi, Nga L. Ng, and Meredith G. Hastings
Geosci. Model Dev., 17, 4673–4687, https://doi.org/10.5194/gmd-17-4673-2024, https://doi.org/10.5194/gmd-17-4673-2024, 2024
Short summary
Short summary
The study introduces a novel chemical mechanism for explicitly tracking oxygen isotope transfer in oxidized reactive nitrogen and odd oxygen using the Regional Atmospheric Chemistry Mechanism, version 2. This model enhances our ability to simulate and compare oxygen isotope compositions of reactive nitrogen, revealing insights into oxidation chemistry. The approach shows promise for improving atmospheric chemistry models and tropospheric oxidation capacity predictions.
Hai Bui, Mostafa Bakhoday-Paskyabi, and Mohammadreza Mohammadpour-Penchah
Geosci. Model Dev., 17, 4447–4465, https://doi.org/10.5194/gmd-17-4447-2024, https://doi.org/10.5194/gmd-17-4447-2024, 2024
Short summary
Short summary
We developed a new wind turbine wake model, the Simple Actuator Disc for Large Eddy Simulation (SADLES), integrated with the widely used Weather Research and Forecasting (WRF) model. WRF-SADLES accurately simulates wind turbine wakes at resolutions of a few dozen meters, aligning well with idealized simulations and observational measurements. This makes WRF-SADLES a promising tool for wind energy research, offering a balance between accuracy, computational efficiency, and ease of implementation.
Changliang Shao and Lars Nerger
Geosci. Model Dev., 17, 4433–4445, https://doi.org/10.5194/gmd-17-4433-2024, https://doi.org/10.5194/gmd-17-4433-2024, 2024
Short summary
Short summary
This paper introduces and evaluates WRF-PDAF, a fully online-coupled ensemble data assimilation (DA) system. A key advantage of the WRF-PDAF configuration is its ability to concurrently integrate all ensemble states, eliminating the need for time-consuming distribution and collection of ensembles during the coupling communication. The extra time required for DA amounts to only 20.6 % per cycle. Twin experiment results underscore the effectiveness of the WRF-PDAF system.
Jan Clemens, Lars Hoffmann, Bärbel Vogel, Sabine Grießbach, and Nicole Thomas
Geosci. Model Dev., 17, 4467–4493, https://doi.org/10.5194/gmd-17-4467-2024, https://doi.org/10.5194/gmd-17-4467-2024, 2024
Short summary
Short summary
Lagrangian transport models simulate the transport of air masses in the atmosphere. For example, one model (CLaMS) is well suited to calculating transport as it uses a special coordinate system and special vertical wind. However, it only runs inefficiently on modern supercomputers. Hence, we have implemented the benefits of CLaMS into a new model (MPTRAC), which is already highly efficient on modern supercomputers. Finally, in extensive tests, we showed that CLaMS and MPTRAC agree very well.
Manuel López-Puertas, Federico Fabiano, Victor Fomichev, Bernd Funke, and Daniel R. Marsh
Geosci. Model Dev., 17, 4401–4432, https://doi.org/10.5194/gmd-17-4401-2024, https://doi.org/10.5194/gmd-17-4401-2024, 2024
Short summary
Short summary
The radiative infrared cooling of CO2 in the middle atmosphere is crucial for computing its thermal structure. It requires one however to include non-local thermodynamic equilibrium processes which are computationally very expensive, which cannot be afforded by climate models. In this work, we present an updated, efficient, accurate and very fast (~50 µs) parameterization of that cooling able to cope with CO2 abundances from half the pre-industrial values to 10 times the current abundance.
Felix Wieser, Rolf Sander, Changmin Cho, Hendrik Fuchs, Thorsten Hohaus, Anna Novelli, Ralf Tillmann, and Domenico Taraborrelli
Geosci. Model Dev., 17, 4311–4330, https://doi.org/10.5194/gmd-17-4311-2024, https://doi.org/10.5194/gmd-17-4311-2024, 2024
Short summary
Short summary
The chemistry scheme of the atmospheric box model CAABA/MECCA is expanded to achieve an improved aerosol formation from emitted organic compounds. In addition to newly added reactions, temperature-dependent partitioning of all new species between the gas and aqueous phases is estimated and included in the pre-existing scheme. Sensitivity runs show an overestimation of key compounds from isoprene, which can be explained by a lack of aqueous-phase degradation reactions and box model limitations.
Zehua Bai, Qizhong Wu, Kai Cao, Yiming Sun, and Huaqiong Cheng
Geosci. Model Dev., 17, 4383–4399, https://doi.org/10.5194/gmd-17-4383-2024, https://doi.org/10.5194/gmd-17-4383-2024, 2024
Short summary
Short summary
There is relatively limited research on the application of scientific computing on RISC CPU platforms. The MIPS architecture CPUs, a type of RISC CPUs, have distinct advantages in energy efficiency and scalability. The air quality modeling system can run stably on the MIPS and LoongArch platforms, and the experiment results verify the stability of scientific computing on the platforms. The work provides a technical foundation for the scientific application based on MIPS and LoongArch.
Yafang Guo, Chayan Roychoudhury, Mohammad Amin Mirrezaei, Rajesh Kumar, Armin Sorooshian, and Avelino F. Arellano
Geosci. Model Dev., 17, 4331–4353, https://doi.org/10.5194/gmd-17-4331-2024, https://doi.org/10.5194/gmd-17-4331-2024, 2024
Short summary
Short summary
This research focuses on surface ozone (O3) pollution in Arizona, a historically air-quality-challenged arid and semi-arid region in the US. The unique characteristics of this kind of region, e.g., intense heat, minimal moisture, and persistent desert shrubs, play a vital role in comprehending O3 exceedances. Using the WRF-Chem model, we analyzed O3 levels in the pre-monsoon month, revealing the model's skill in capturing diurnal and MDA8 O3 levels.
Christoph Fischer, Andreas H. Fink, Elmar Schömer, Marc Rautenhaus, and Michael Riemer
Geosci. Model Dev., 17, 4213–4228, https://doi.org/10.5194/gmd-17-4213-2024, https://doi.org/10.5194/gmd-17-4213-2024, 2024
Short summary
Short summary
This study presents a method for identifying and tracking 3-D potential vorticity structures within African easterly waves (AEWs). Each identified structure is characterized by descriptors, including its 3-D position and orientation, which have been validated through composite comparisons. A trough-centric perspective on the descriptors reveals the evolution and distinct characteristics of AEWs. These descriptors serve as valuable statistical inputs for the study of AEW-related phenomena.
Sandro Vattioni, Andrea Stenke, Beiping Luo, Gabriel Chiodo, Timofei Sukhodolov, Elia Wunderlin, and Thomas Peter
Geosci. Model Dev., 17, 4181–4197, https://doi.org/10.5194/gmd-17-4181-2024, https://doi.org/10.5194/gmd-17-4181-2024, 2024
Short summary
Short summary
We investigate the sensitivity of aerosol size distributions in the presence of strong SO2 injections for climate interventions or after volcanic eruptions to the call sequence and frequency of the routines for nucleation and condensation in sectional aerosol models with operator splitting. Using the aerosol–chemistry–climate model SOCOL-AERv2, we show that the radiative and chemical outputs are sensitive to these settings at high H2SO4 supersaturations and how to obtain reliable results.
Najmeh Kaffashzadeh and Abbas-Ali Aliakbari Bidokhti
Geosci. Model Dev., 17, 4155–4179, https://doi.org/10.5194/gmd-17-4155-2024, https://doi.org/10.5194/gmd-17-4155-2024, 2024
Short summary
Short summary
This paper assesses the capability of two state-of-the-art global datasets in simulating surface ozone over Iran using a new methodology. It is found that the global model data need to be downscaled for regulatory purposes or policy applications at local scales. The method can be useful not only for the evaluation but also for the prediction of other chemical species, such as aerosols.
Franciscus Liqui Lung, Christian Jakob, A. Pier Siebesma, and Fredrik Jansson
Geosci. Model Dev., 17, 4053–4076, https://doi.org/10.5194/gmd-17-4053-2024, https://doi.org/10.5194/gmd-17-4053-2024, 2024
Short summary
Short summary
Traditionally, high-resolution atmospheric models employ periodic boundary conditions, which limit simulations to domains without horizontal variations. In this research open boundary conditions are developed to replace the periodic boundary conditions. The implementation is tested in a controlled setup, and the results show minimal disturbances. Using these boundary conditions, high-resolution models can be forced by a coarser model to study atmospheric phenomena in realistic background states.
Caroline Arnold, Shivani Sharma, Tobias Weigel, and David S. Greenberg
Geosci. Model Dev., 17, 4017–4029, https://doi.org/10.5194/gmd-17-4017-2024, https://doi.org/10.5194/gmd-17-4017-2024, 2024
Short summary
Short summary
In atmospheric models, rain formation is simplified to be computationally efficient. We trained a machine learning model, SuperdropNet, to emulate warm-rain formation based on super-droplet simulations. Here, we couple SuperdropNet with an atmospheric model in a warm-bubble experiment and find that the coupled simulation runs stable and produces reasonable results, making SuperdropNet a viable ML proxy for droplet simulations. We also present a comprehensive benchmark for coupling architectures.
Byoung-Joo Jung, Benjamin Ménétrier, Chris Snyder, Zhiquan Liu, Jonathan J. Guerrette, Junmei Ban, Ivette Hernández Baños, Yonggang G. Yu, and William C. Skamarock
Geosci. Model Dev., 17, 3879–3895, https://doi.org/10.5194/gmd-17-3879-2024, https://doi.org/10.5194/gmd-17-3879-2024, 2024
Short summary
Short summary
We describe the multivariate static background error covariance (B) for the JEDI-MPAS 3D-Var data assimilation system. With tuned B parameters, the multivariate B gives physically balanced analysis increment fields in the single-observation test framework. In the month-long cycling experiment with a global 60 km mesh, 3D-Var with static B performs stably. Due to its simple workflow and minimal computational requirements, JEDI-MPAS 3D-Var can be useful for the research community.
Michal Belda, Nina Benešová, Jaroslav Resler, Peter Huszár, Ondřej Vlček, Pavel Krč, Jan Karlický, Pavel Juruš, and Kryštof Eben
Geosci. Model Dev., 17, 3867–3878, https://doi.org/10.5194/gmd-17-3867-2024, https://doi.org/10.5194/gmd-17-3867-2024, 2024
Short summary
Short summary
For modeling atmospheric chemistry, it is necessary to provide data on emissions of pollutants. These can come from various sources and in various forms, and preprocessing of the data to be ingestible by chemistry models can be quite challenging. We developed the FUME processor to use a database layer that internally transforms all input data into a rigid structure, facilitating further processing to allow for emission processing from the continental to the street scale.
Bent Harnist, Seppo Pulkkinen, and Terhi Mäkinen
Geosci. Model Dev., 17, 3839–3866, https://doi.org/10.5194/gmd-17-3839-2024, https://doi.org/10.5194/gmd-17-3839-2024, 2024
Short summary
Short summary
Probabilistic precipitation nowcasting (local forecasting for 0–6 h) is crucial for reducing damage from events like flash floods. For this goal, we propose the DEUCE neural-network-based model which uses data and model uncertainties to generate an ensemble of potential precipitation development scenarios for the next hour. Trained and evaluated with Finnish precipitation composites, DEUCE was found to produce more skillful and reliable nowcasts than established models.
Emma Howard, Steven Woolnough, Nicholas Klingaman, Daniel Shipley, Claudio Sanchez, Simon C. Peatman, Cathryn E. Birch, and Adrian J. Matthews
Geosci. Model Dev., 17, 3815–3837, https://doi.org/10.5194/gmd-17-3815-2024, https://doi.org/10.5194/gmd-17-3815-2024, 2024
Short summary
Short summary
This paper describes a coupled atmosphere–mixed-layer ocean simulation setup that will be used to study weather processes in Southeast Asia. The set-up has been used to compare high-resolution simulations, which are able to partially resolve storms, to coarser simulations, which cannot. We compare the model performance at representing variability of rainfall and sea surface temperatures across length scales between the coarse and fine models.
Álvaro González-Cervera and Luis Durán
EGUsphere, https://doi.org/10.5194/egusphere-2024-958, https://doi.org/10.5194/egusphere-2024-958, 2024
Short summary
Short summary
RASCAL is an open-source Python tool designed for reconstructing daily climate observations, especially in regions with complex local phenomena. It merges large-scale weather patterns with local weather using the Analog Method. Evaluations in central Spain show that RASCAL outperforms ERA20C reanalysis in reconstructing precipitation and temperature. RASCAL offers opportunities of broad scientific applications, from short-term forecasts to local-scale climate change scenarios.
Phuong Loan Nguyen, Lisa V. Alexander, Marcus J. Thatcher, Son C. H. Truong, Rachael N. Isphording, and John L. McGregor
Geosci. Model Dev. Discuss., https://doi.org/10.5194/gmd-2024-84, https://doi.org/10.5194/gmd-2024-84, 2024
Revised manuscript accepted for GMD
Short summary
Short summary
We apply a comprehensive approach to select a subset of CMIP6 that is suitable for dynamical downscaling over Southeast Asia by considering model performance, model independence, data availability, and future climate change spread. The standardised benchmarking framework is applied to identify a subset of models through two stages of assessment: statistical-based and process-based metrics. We finalize a sub-set of two independent models for dynamical downscaling over Southeast Asia.
Andrés Yarce Botero, Michiel van Weele, Arjo Segers, Pier Siebesma, and Henk Eskes
Geosci. Model Dev., 17, 3765–3781, https://doi.org/10.5194/gmd-17-3765-2024, https://doi.org/10.5194/gmd-17-3765-2024, 2024
Short summary
Short summary
HARMONIE WINS50 reanalysis data with 0.025° × 0.025° resolution from 2019 to 2021 were coupled with the LOTOS-EUROS Chemical Transport Model. HARMONIE and ECMWF meteorology configurations against Cabauw observations (52.0° N, 4.9° W) were evaluated as simulated NO2 concentrations with ground-level sensors. Differences in crucial meteorological input parameters (boundary layer height, vertical diffusion coefficient) between the hydrostatic and non-hydrostatic models were analysed.
Ulrich Voggenberger, Leopold Haimberger, Federico Ambrogi, and Paul Poli
Geosci. Model Dev., 17, 3783–3799, https://doi.org/10.5194/gmd-17-3783-2024, https://doi.org/10.5194/gmd-17-3783-2024, 2024
Short summary
Short summary
This paper presents a method for calculating balloon drift from historical radiosonde ascent data. The drift can reach distances of several hundred kilometres and is often neglected. Verification shows the beneficial impact of the more accurate balloon position on model assimilation. The method is not limited to radiosondes but would also work for dropsondes, ozonesondes, or any other in situ sonde carried by the wind in the pre-GNSS era, provided the necessary information is available.
Cited articles
Ahijevych, D., Gilleland, E., Brown, B. G., and Ebert, E. E.: Application of spatial verification methods to idealized and NWP-gridded precipitation forecasts, Weather Forecast., 24, 1485–1497, https://doi.org/10.1175/2009WAF2222298.1, 2009.
Bi, B., Dai, K., Wang, Y., Fu, J., Cao, Y., and Liu, C.: Advances in techniques of quantitative precipitation forecast, J. Appl. Meteorol. Sci., 27, 534–549, https://doi.org/10.11898/1001-7313.20160503, 2016.
Casati, B., Wilson, L. J., Stephenson, D. B., Nurmi, P., Ghelli, A., Pocernich, M., Damrath, U., Ebert, E. E., Brown, B. G., and Mason, S.: Forecast verification: current status and future directions, Meteorol. Appl., 15, 3–18, https://doi.org/10.1002/met.52, 2008.
Chen, F., Chen, J., Wei, Q., Li, J., Liu, C., Yang, D., Zhao, B., and Zhang, Z.: A new verification method for heavy rainfall forecast based on predictability II: Verification method and test, Acta. Meteorol. Sin., 77, 28–42, https://doi.org/10.11676/qxxb2019.003, 2019.
Chen, H., Li, P., and Zhao, Y.: A review and outlook of verification and evaluation of precipitation forecast at convection-permitting resolution, Adv. Meteorol. Sci. Technol., 11, 155–164, https://doi.org/10.3969/j.issn.2095-1973.2021.03.018, 2021.
Donaldson, R. J., Dyer, R. M., and Krauss, M. J.: An objective evaluator of techniques for predicting severe weather events, Ninth Conference on Severe Local Storms, Norman, Oklahoma, United States of America, American Meteorological Society [preprint], 321–326, 1975.
Doolittle, M. H.: The verification of predictions, B. Philos. Soc. Washington, 7, 122–127, 1885.
Doolittle, M. H.: Association ratios, Bulletin of the Philosophical Society of Washington, 10, 83–87, 94–96, 1888.
Doswell III, C. A., Davies-Jones, R., and Keller, D. L.: On summary measures of skill in rare event forecasting based on contingency tables, Weather Forecast., 5, 576–585, https://doi.org/10.1175/1520-0434(1990)005<0576:OSMOSI>2.0.CO;2, 1990.
Ebert, E. E.: Fuzzy verification of high-resolution gridded forecasts: a review and proposed framework, Meteorol. Appl., 15, 51–64, https://doi.org/10.1002/met.25, 2008.
Finley, J. P.: Tornado predictions, Am. Meteorol. J., 1, 85–88, 1884.
Flueck, J. A.: A study of some measures of forecast verification, in: 10th Conf. Probability and Statistics in Atmospheric Science, Edmonton, Alberta, Canada, American Meteorological Society [preprint], 69–73, 1987.
Gandin, L. S., and Murphy, A. H.: Equitable scores for categorical forecasts, Mon. Weather Rev., 120, 361–370, https://doi.org/10.1175/1520-0493(1992)120<0361:ESSFCF>2.0.CO;2, 1992.
Gilbert, G. K.: Finley's tornado predictions, Am. Meteorol. J., 1, 166–172, 1884.
Gilleland, E., Ahijevych, D., Brown, B. G., Casati, B., and Ebert, E. E.: Intercomparison of Spatial Forecast Verification Methods. Weather Forecast., 24, 1416–1430, https://doi.org/10.1175/2009WAF2222269.1, 2009.
Gofa, F., Boucouvala, D., Louka, P., and Flocas, H. A.: Spatial verification approaches as a tool to evaluate the performance of high resolution precipitation forecasts, Atmos. Res., 208, 78–87, https://doi.org/10.1016/j.atmosres.2017.09.021, 2018.
Han, F., Tang, W., Zhou, C., Sheng, J., and Zhang, X.: Improving a precipitation nowcasting algorithm based on the SWAN system and related application assessment, Acta Meteorol. Sin., 81, 304–315, https://doi.org/10.11676/qxxb2023.20220066, 2023.
Hanssen, A. W. and Kuipers, W. J. A.: On the relationship between the frequency of rain and various meteorological parameters, Mededeelingen en Verhandelingen, 81, 2–15, 1965.
Hao, C., Yu, B., Dai, Y., Zhi, X., And Zhang, Y.: Statistical downscaling research on spatio-temporal distributions of summer precipitation across the Beijing region, Meteorol. Mon., 49, 843–854, https://doi.org/10.7519/j.issn.1000-0526.2023.050201, 2023.
Heidke, P.: Berechnung des erfolges und der güte der windstärkevorhersagen im sturmwarnungdienst, Geografika Annaler, 8, 301–349, 1926.
Liu, C., Lin, J., Dai, K., Cao, Y., and Wei, Q.: An evaluation method suitable for precipitation forecasts and services, Torrential Rain and Disasters, 41, 712–719, https://doi.org/10.12406/byzh.2021-203, 2022.
Liu, C., Dai, K., Lin, J., Wei, Q., Li N., Wang, B., Tang B., Guo Y., Zhu W., Tang J., and Zeng X.: Design and implementation of whole process evaluation program library of weather forecast, Meteorol. Mon., 49, 351–364, https://doi.org/10.7519/j.issn.1000-0526.2022.050902, 2023.
Liu, J., Ren, C., Zhao, Z., Chen, C., Wang, Y., and Cai, K.: Comparative analysis on verification of heavy rainfall forecasts in different regional models, Meteorol. Mon., 48, 1292–1302, https://doi.org/10.7519/j.issn.1000-0526.2022.050502, 2022.
Marzban, C.: Scalar measures of performance in rare-event situations, Weather Forecast., 13, 753–763, https://doi.org/10.1175/1520-0434(1998)013<0753:SMOPIR>2.0.CO;2, 1998.
Mason, I. B.: Dependence of the critical success index on sample climate and threshold probability, Aust. Meteorol. Mag., 37, 75–81, 1989.
Mason, I. B.: Binary events, in: Forecast verification: a practitioner's guide in atmospheric science, edited by: Jolliffe IT and Stephenson DB, John Wiley and Sons, Chichester, United Kingdom, 37–76, 2003.
Murphy, A. H.: The Finley affair: a signal event in the history of forecast verification, Weather Forecast., 11, 3–20, https://doi.org/10.1175/1520-0434(1996)011<0003:TFAASE>2.0.CO;2, 1996.
Murphy, A. H. and Daan, H.: Forecast evaluation, in: Probability, statistics, and decision making in the atmospheric sciences, edited by: Murphy, A. H. and Katz, R. W., Westview Press, Boulder, Colorado, United States of America, 379–437, 1985.
Palmer, W. C. and Allen, R. A.: Note on the accuracy of forecasts concerning the rain problem, U.S. Weather Bureau, 1–4, 1949.
Peirce, C. S.: The numerical measure of the success of prediction, Science, 4, 453–454, 1884.
Roberts, N. M. and Lean, H. W.: Scale-selective verification of rainfall accumulations from high-resolution forecasts of convective events, Mon. Weather Rev., 136, 78–97, https://doi.org/10.1175/2007MWR2123.1, 2008.
Schaefer, J. T.: The critical success index as an indicator of warning skill, Weather Forecast., 5, 570–575, https://doi.org/10.1175/1520-0434(1990)005<0570:TCSIAA>2.0.CO;2, 1990.
Shi, W., Li, X., Zeng, M., Zhang, B., Wang, H., Zhu, K., and Zhuge, X.: Multi-model comparison and high-resolution regional model forecast analysis for the “7⋅20” Zhengzhou severe heavy rain, T. Atmos. Sci., 44, 688–702, https://doi.org/10.13878/j.cnki.dqkxxb.20210823001, 2021.
Stephenson, D. B., Casati, B., Ferro, C. A. T., and Wilson, C. A.: The extreme dependency score: A non-vanishing measure for forecasts of rare events, Meteorol. Appl., 15, 41–50, https://doi.org/10.1002/met.53, 2008.
Su, A., Lü, X., Cui, L., Li, Z., Xi, L., and Li, H.: The Basic Observational Analysis of “7.20” Extreme Rainstorm in Zhengzhou, Torrential Rain and Disasters, 40, 445–454, https://doi.org/10.3969/j.issn.1004-9045.2021.05.001, 2021.
Tang, W., Zhou, Q., Liu, X., Zhu, W., and Mao, X.: Analysis on verification of national severe convective weather categorical forecasts, Meteorol. Mon., 43, 67–76, https://doi.org/10.7519/j.issn.1000-0526.2017.01.007, 2017.
Wang, X., Yang, H., Cui, C., Li, C., Qi, H., Du, M., Wang, J., and Wang, X.: Analysis of unusual climatic characteristics of precipitation and four typical extreme weather processes in China in 2021, Torrential Rain and Disasters, 41, 489–500, https://doi.org/10.12406/byzh.2022-045, 2022.
Wei, Q., Li, W., Peng, S., Xue, F., Zhao, S., Zhang, J., and Qi, D.: Development and application of national verification system in CMA, J. Appl. Meteorol. Sci., 30, 245–256, https://doi.org/10.11898/1001-7313.20190211, 2019.
Weygandt, S. S., Loughe, A. F., Benjamin, S. G., and Mahoney, J. L.: Scale sensitivities in model precipitation skill scores during IHOP, in: 22nd Conference Severe Local Storms, Hyannis, Massachusetts, United States of America, American Meteorological Society, 4–8 October 2004.
Wilks, D. S.: Statistical Methods in the Atmospheric Sciences, 2nd edn., Academic Press, 630 pp., 2006.
Yang, D., Gao, X., and Zhang, W.: Research and improvement of a new rainstorm forecast accuracy verification scheme, in: Proceedings of the 34th Annual Meeting of the Chinese Meteorological Society, S1 Disaster Weather Monitoring, Analysis and Forecast, 549–559, 2017.
Yang, Y., Yin, J., Wang, D., Liu, Y., Lu, Y., Zhang, W., and Xu, S.: ABM-based emergency evacuation modelling during urban pluvial floods: A “7.20” pluvial flood event study in Zhengzhou, Henan Province, Sci. China Earth Sci., 66, 282–291, https://doi.org/10.1007/s11430-022-1015-6, 2023.
Yates, E., Anquetin, S., Ducrocq, V., Creutin, J.-D., Ricard, D., and Chancibault, K.: Point and areal validation of forecast precipitation fields, Meteorol. Appl., 13, 1–20, https://doi.org/10.1017/S1350482705001921, 2006.
Zepeda-Arce, J., Foufoula-Georgiou, E., and Droegemeier, K. K.: Space-time rainfall organization and its role in validating quantitative precipitation forecasts, J. Geophys. Res., 105, 10129–10146, https://doi.org/10.1029/1999JD901087, 2000.
Zhang, B., Zeng, M., Huang, A., Qin, Z., Liu, C., Shi, W., Li, X., Zhu, K., Gu, C., and Zhou, J.: Software and Data for “A general comprehensive evaluation method for cross-scale precipitation forecasts”, Zenodo [code and data set], https://doi.org/10.5281/zenodo.10951799, 2024.
Zhang, Y., Yu, H., Zhang, M., Yang, Y., and Meng, Z.: Uncertainties and error growth in forecasting the record-breaking rainfall in Zhengzhou, Henan on 19–20 July 2021, Sci. China Earth Sci., 65, 1903–1920, https://doi.org/10.1007/s11430-022-9991-4, 2022.
Zhao, B. and Zhang, B.: Application of neighborhood spatial verification method on precipitation evaluation, Torrential Rain and Disasters, 37, 1–7, https://doi.org/10.3969/j.issn.1004-9045.2018.01.001, 2018.
Zhong, Q., Sun, Z., Chen, H., Li, J., and Shen, L.: Multi model forecast biases of the diurnal variations of intense rainfall in the Beijing-Tianjin-Hebei region, Sci. China Earth Sci., 65, 1490–1509, https://doi.org/10.1007/s11430-021-9905-4, 2022.
Short summary
By directly analyzing the proximity of precipitation forecasts and observations, a precipitation accuracy score (PAS) method was constructed. This method does not utilize a traditional contingency-table-based classification verification; however, it can replace the threat score (TS), equitable threat score (ETS), and other skill score methods, and it can be used to calculate the accuracy of numerical models or quantitative precipitation forecasts.
By directly analyzing the proximity of precipitation forecasts and observations, a precipitation...
