Articles | Volume 16, issue 13
Methods for assessment of models
13 Jul 2023
Methods for assessment of models |  | 13 Jul 2023

Evaluating precipitation distributions at regional scales: a benchmarking framework and application to CMIP5 and 6 models

Min-Seop Ahn, Paul A. Ullrich, Peter J. Gleckler, Jiwoo Lee, Ana C. Ordonez, and Angeline G. Pendergrass

Related authors

Impact of ITCZ width on global climate: ITCZ-MIP
Angeline G. Pendergrass, Michael P. Byrne, Oliver Watt-Meyer, Penelope Maher, and Mark J. Webb
Geosci. Model Dev. Discuss.,,, 2024
Preprint under review for GMD
Short summary
rSHUD v2.0: advancing the Simulator for Hydrologic Unstructured Domains and unstructured hydrological modeling in the R environment
Lele Shu, Paul Ullrich, Xianhong Meng, Christopher Duffy, Hao Chen, and Zhaoguo Li
Geosci. Model Dev., 17, 497–527,,, 2024
Short summary
Objective Evaluation of Earth System Models: PCMDI Metrics Package (PMP) version 3
Jiwoo Lee, Peter J. Gleckler, Min-Seop Ahn, Ana Ordonez, Paul A. Ullrich, Kenneth R. Sperber, Karl E. Taylor, Yann Y. Planton, Eric Guilyardi, Paul Durack, Celine Bonfils, Mark D. Zelinka, Li-Wei Chao, Bo Dong, Charles Doutriaux, Chengzhu Zhang, Tom Vo, Jason Boutte, Michael F. Wehner, Angeline G. Pendergrass, Daehyun Kim, Zeyu Xue, Andrew T. Wittenberg, and John Krasting
EGUsphere,,, 2023
Short summary
The fully coupled regionally refined model of E3SM version 2: overview of the atmosphere, land, and river results
Qi Tang, Jean-Christophe Golaz, Luke P. Van Roekel, Mark A. Taylor, Wuyin Lin, Benjamin R. Hillman, Paul A. Ullrich, Andrew M. Bradley, Oksana Guba, Jonathan D. Wolfe, Tian Zhou, Kai Zhang, Xue Zheng, Yunyan Zhang, Meng Zhang, Mingxuan Wu, Hailong Wang, Cheng Tao, Balwinder Singh, Alan M. Rhoades, Yi Qin, Hong-Yi Li, Yan Feng, Yuying Zhang, Chengzhu Zhang, Charles S. Zender, Shaocheng Xie, Erika L. Roesler, Andrew F. Roberts, Azamat Mametjanov, Mathew E. Maltrud, Noel D. Keen, Robert L. Jacob, Christiane Jablonowski, Owen K. Hughes, Ryan M. Forsyth, Alan V. Di Vittorio, Peter M. Caldwell, Gautam Bisht, Renata B. McCoy, L. Ruby Leung, and David C. Bader
Geosci. Model Dev., 16, 3953–3995,,, 2023
Short summary
Assessment of WRF (v 4.2.1) dynamically downscaled precipitation on subdaily and daily timescales over CONUS
Abhishekh Kumar Srivastava, Paul Aaron Ullrich, Deeksha Rastogi, Pouya Vahmani, Andrew Jones, and Richard Grotjahn
Geosci. Model Dev., 16, 3699–3722,,, 2023
Short summary

Related subject area

Atmospheric sciences
Assessment of climate biases in OpenIFS version 43r3 across model horizontal resolutions and time steps
Abhishek Savita, Joakim Kjellsson, Robin Pilch Kedzierski, Mojib Latif, Tabea Rahm, Sebastian Wahl, and Wonsun Park
Geosci. Model Dev., 17, 1813–1829,,, 2024
Short summary
High-resolution multi-scaling of outdoor human thermal comfort and its intra-urban variability based on machine learning
Ferdinand Briegel, Jonas Wehrle, Dirk Schindler, and Andreas Christen
Geosci. Model Dev., 17, 1667–1688,,, 2024
Short summary
Effects of vertical grid spacing on the climate simulated in the ICON-Sapphire global storm-resolving model
Hauke Schmidt, Sebastian Rast, Jiawei Bao, Amrit Cassim, Shih-Wei Fang, Diego Jimenez-de la Cuesta, Paul Keil, Lukas Kluft, Clarissa Kroll, Theresa Lang, Ulrike Niemeier, Andrea Schneidereit, Andrew I. L. Williams, and Bjorn Stevens
Geosci. Model Dev., 17, 1563–1584,,, 2024
Short summary
Development of the tangent linear and adjoint models of the global online chemical transport model MPAS-CO2 v7.3
Tao Zheng, Sha Feng, Jeffrey Steward, Xiaoxu Tian, David Baker, and Martin Baxter
Geosci. Model Dev., 17, 1543–1562,,, 2024
Short summary
Impacts of updated reaction kinetics on the global GEOS-Chem simulation of atmospheric chemistry
Kelvin H. Bates, Mathew J. Evans, Barron H. Henderson, and Daniel J. Jacob
Geosci. Model Dev., 17, 1511–1524,,, 2024
Short summary

Cited articles

Abramowitz, G.: Towards a public, standardized, diagnostic benchmarking system for land surface models, Geosci. Model Dev., 5, 819–827,, 2012. 
Ahn, M. and Kang, I.: A practical approach to scale-adaptive deep convection in a GCM by controlling the cumulus base mass flux, npj Clim. Atmos. Sci., 1, 13,, 2018. 
Ahn, M.-S., Gleckler, P. J., Lee, J., Pendergrass, A. G., and Jakob, C.: Benchmarking Simulated Precipitation Variability Amplitude across Time Scales, J. Climate, 35, 3173–3196,, 2022. 
Ahn, M.-S., Ullrich, P. A., Lee, J., Gleckler, P. J., Ma, H.-Y., Terai, C. R., Bogenschutz, P. A., and Ordonez, A. C.: Bimodality in Simulated Precipitation Frequency Distributions and Its Relationship with Convective Parameterizations, npj Clim. Atmos. Sci., submitted,, 2023. 
Ashouri, H., Hsu, K. L., Sorooshian, S., Braithwaite, D. K., Knapp, K. R., Cecil, L. D., Nelson, B. R., and Prat, O. P.: PERSIANN-CDR: Daily precipitation climate data record from multisatellite observations for hydrological and climate studies, B. Am. Meteorol. Soc., 96, 69–83,, 2015. 
Short summary
We introduce a framework for regional-scale evaluation of simulated precipitation distributions with 62 climate reference regions and 10 metrics and apply it to evaluate CMIP5 and CMIP6 models against multiple satellite-based precipitation products. The common model biases identified in this study are mainly associated with the overestimated light precipitation and underestimated heavy precipitation. These biases persist from earlier-generation models and have been slightly improved in CMIP6.