Articles | Volume 16, issue 13
https://doi.org/10.5194/gmd-16-3927-2023
https://doi.org/10.5194/gmd-16-3927-2023
Methods for assessment of models
 | 
13 Jul 2023
Methods for assessment of models |  | 13 Jul 2023

Evaluating precipitation distributions at regional scales: a benchmarking framework and application to CMIP5 and 6 models

Min-Seop Ahn, Paul A. Ullrich, Peter J. Gleckler, Jiwoo Lee, Ana C. Ordonez, and Angeline G. Pendergrass

Related authors

Evaluating downscaled products with expected hydroclimatic co-variances
Seung H. Baek, Paul A. Ullrich, Bo Dong, and Jiwoo Lee
Geosci. Model Dev., 17, 8665–8681, https://doi.org/10.5194/gmd-17-8665-2024,https://doi.org/10.5194/gmd-17-8665-2024, 2024
Short summary
Impact of ITCZ width on global climate: ITCZ-MIP
Angeline G. Pendergrass, Michael P. Byrne, Oliver Watt-Meyer, Penelope Maher, and Mark J. Webb
Geosci. Model Dev., 17, 6365–6378, https://doi.org/10.5194/gmd-17-6365-2024,https://doi.org/10.5194/gmd-17-6365-2024, 2024
Short summary
The DOE E3SM Version 2.1: Overview and Assessment of the Impacts of Parameterized Ocean Submesoscales
Katherine Smith, Alice M. Barthel, LeAnn M. Conlon, Luke P. Van Roekel, Anthony Bartoletti, Jean-Christophe Golez, Chengzhu Zhang, Carolyn Branecky Begeman, James J. Benedict, Gautum Bisht, Yan Feng, Walter Hannah, Bryce E. Harrop, Nicole Jeffery, Wuyin Lin, Po-Lun Ma, Mathew E. Maltrud, Mark R. Petersen, Balwinder Singh, Qi Tang, Teklu Tesfa, Jonathan D. Wolfe, Shaocheng Xie, Xue Zheng, Karthik Balaguru, Oluwayemi Garuba, Peter Gleckler, Aixue Hu, Jiwoo Lee, Ben Moore-Maley, and Ana C. Ordonez
Geosci. Model Dev. Discuss., https://doi.org/10.5194/gmd-2024-149,https://doi.org/10.5194/gmd-2024-149, 2024
Revised manuscript under review for GMD
Short summary
Evaluation of atmospheric rivers in reanalyses and climate models in a new metrics framework
Bo Dong, Paul Ullrich, Jiwoo Lee, Peter Gleckler, Kristin Chang, and Travis O'Brien
Geosci. Model Dev. Discuss., https://doi.org/10.5194/gmd-2024-142,https://doi.org/10.5194/gmd-2024-142, 2024
Revised manuscript under review for GMD
Short summary
Systematic and objective evaluation of Earth system models: PCMDI Metrics Package (PMP) version 3
Jiwoo Lee, Peter J. Gleckler, Min-Seop Ahn, Ana Ordonez, Paul A. Ullrich, Kenneth R. Sperber, Karl E. Taylor, Yann Y. Planton, Eric Guilyardi, Paul Durack, Celine Bonfils, Mark D. Zelinka, Li-Wei Chao, Bo Dong, Charles Doutriaux, Chengzhu Zhang, Tom Vo, Jason Boutte, Michael F. Wehner, Angeline G. Pendergrass, Daehyun Kim, Zeyu Xue, Andrew T. Wittenberg, and John Krasting
Geosci. Model Dev., 17, 3919–3948, https://doi.org/10.5194/gmd-17-3919-2024,https://doi.org/10.5194/gmd-17-3919-2024, 2024
Short summary

Related subject area

Atmospheric sciences
SLUCM+BEM (v1.0): a simple parameterisation for dynamic anthropogenic heat and electricity consumption in WRF-Urban (v4.3.2)
Yuya Takane, Yukihiro Kikegawa, Ko Nakajima, and Hiroyuki Kusaka
Geosci. Model Dev., 17, 8639–8664, https://doi.org/10.5194/gmd-17-8639-2024,https://doi.org/10.5194/gmd-17-8639-2024, 2024
Short summary
NAQPMS-PDAF v2.0: a novel hybrid nonlinear data assimilation system for improved simulation of PM2.5 chemical components
Hongyi Li, Ting Yang, Lars Nerger, Dawei Zhang, Di Zhang, Guigang Tang, Haibo Wang, Yele Sun, Pingqing Fu, Hang Su, and Zifa Wang
Geosci. Model Dev., 17, 8495–8519, https://doi.org/10.5194/gmd-17-8495-2024,https://doi.org/10.5194/gmd-17-8495-2024, 2024
Short summary
Source-specific bias correction of US background and anthropogenic ozone modeled in CMAQ
T. Nash Skipper, Christian Hogrefe, Barron H. Henderson, Rohit Mathur, Kristen M. Foley, and Armistead G. Russell
Geosci. Model Dev., 17, 8373–8397, https://doi.org/10.5194/gmd-17-8373-2024,https://doi.org/10.5194/gmd-17-8373-2024, 2024
Short summary
Observational operator for fair model evaluation with ground NO2 measurements
Li Fang, Jianbing Jin, Arjo Segers, Ke Li, Ji Xia, Wei Han, Baojie Li, Hai Xiang Lin, Lei Zhu, Song Liu, and Hong Liao
Geosci. Model Dev., 17, 8267–8282, https://doi.org/10.5194/gmd-17-8267-2024,https://doi.org/10.5194/gmd-17-8267-2024, 2024
Short summary
Valid time shifting ensemble Kalman filter (VTS-EnKF) for dust storm forecasting
Mijie Pang, Jianbing Jin, Arjo Segers, Huiya Jiang, Wei Han, Batjargal Buyantogtokh, Ji Xia, Li Fang, Jiandong Li, Hai Xiang Lin, and Hong Liao
Geosci. Model Dev., 17, 8223–8242, https://doi.org/10.5194/gmd-17-8223-2024,https://doi.org/10.5194/gmd-17-8223-2024, 2024
Short summary

Cited articles

Abramowitz, G.: Towards a public, standardized, diagnostic benchmarking system for land surface models, Geosci. Model Dev., 5, 819–827, https://doi.org/10.5194/gmd-5-819-2012, 2012. 
Ahn, M. and Kang, I.: A practical approach to scale-adaptive deep convection in a GCM by controlling the cumulus base mass flux, npj Clim. Atmos. Sci., 1, 13, https://doi.org/10.1038/s41612-018-0021-0, 2018. 
Ahn, M.-S., Gleckler, P. J., Lee, J., Pendergrass, A. G., and Jakob, C.: Benchmarking Simulated Precipitation Variability Amplitude across Time Scales, J. Climate, 35, 3173–3196, https://doi.org/10.1175/JCLI-D-21-0542.1, 2022. 
Ahn, M.-S., Ullrich, P. A., Lee, J., Gleckler, P. J., Ma, H.-Y., Terai, C. R., Bogenschutz, P. A., and Ordonez, A. C.: Bimodality in Simulated Precipitation Frequency Distributions and Its Relationship with Convective Parameterizations, npj Clim. Atmos. Sci., submitted, https://doi.org/10.21203/rs.3.rs-2874349/v1, 2023. 
Ashouri, H., Hsu, K. L., Sorooshian, S., Braithwaite, D. K., Knapp, K. R., Cecil, L. D., Nelson, B. R., and Prat, O. P.: PERSIANN-CDR: Daily precipitation climate data record from multisatellite observations for hydrological and climate studies, B. Am. Meteorol. Soc., 96, 69–83, https://doi.org/10.1175/BAMS-D-13-00068.1, 2015. 
Download
Short summary
We introduce a framework for regional-scale evaluation of simulated precipitation distributions with 62 climate reference regions and 10 metrics and apply it to evaluate CMIP5 and CMIP6 models against multiple satellite-based precipitation products. The common model biases identified in this study are mainly associated with the overestimated light precipitation and underestimated heavy precipitation. These biases persist from earlier-generation models and have been slightly improved in CMIP6.