Articles | Volume 16, issue 13
https://doi.org/10.5194/gmd-16-3927-2023
https://doi.org/10.5194/gmd-16-3927-2023
Methods for assessment of models
 | 
13 Jul 2023
Methods for assessment of models |  | 13 Jul 2023

Evaluating precipitation distributions at regional scales: a benchmarking framework and application to CMIP5 and 6 models

Min-Seop Ahn, Paul A. Ullrich, Peter J. Gleckler, Jiwoo Lee, Ana C. Ordonez, and Angeline G. Pendergrass

Related authors

Impact of ITCZ width on global climate: ITCZ-MIP
Angeline G. Pendergrass, Michael P. Byrne, Oliver Watt-Meyer, Penelope Maher, and Mark J. Webb
Geosci. Model Dev., 17, 6365–6378, https://doi.org/10.5194/gmd-17-6365-2024,https://doi.org/10.5194/gmd-17-6365-2024, 2024
Short summary
The DOE E3SM Version 2.1: Overview and Assessment of the Impacts of Parameterized Ocean Submesoscales
Katherine Smith, Alice M. Barthel, LeAnn M. Conlon, Luke P. Van Roekel, Anthony Bartoletti, Jean-Christophe Golez, Chengzhu Zhang, Carolyn Branecky Begeman, James J. Benedict, Gautum Bisht, Yan Feng, Walter Hannah, Bryce E. Harrop, Nicole Jeffery, Wuyin Lin, Po-Lun Ma, Mathew E. Maltrud, Mark R. Petersen, Balwinder Singh, Qi Tang, Teklu Tesfa, Jonathan D. Wolfe, Shaocheng Xie, Xue Zheng, Karthik Balaguru, Oluwayemi Garuba, Peter Gleckler, Aixue Hu, Jiwoo Lee, Ben Moore-Maley, and Ana C. Ordonez
Geosci. Model Dev. Discuss., https://doi.org/10.5194/gmd-2024-149,https://doi.org/10.5194/gmd-2024-149, 2024
Revised manuscript under review for GMD
Short summary
Evaluation of atmospheric rivers in reanalyses and climate models in a new metrics framework
Bo Dong, Paul Ullrich, Jiwoo Lee, Peter Gleckler, Kristin Chang, and Travis O'Brien
Geosci. Model Dev. Discuss., https://doi.org/10.5194/gmd-2024-142,https://doi.org/10.5194/gmd-2024-142, 2024
Revised manuscript under review for GMD
Short summary
Evaluating downscaled products with expected hydroclimatic co-variances
Seung H. Baek, Paul A. Ullrich, Bo Dong, and Jiwoo Lee
EGUsphere, https://doi.org/10.5194/egusphere-2024-1456,https://doi.org/10.5194/egusphere-2024-1456, 2024
Short summary
Systematic and objective evaluation of Earth system models: PCMDI Metrics Package (PMP) version 3
Jiwoo Lee, Peter J. Gleckler, Min-Seop Ahn, Ana Ordonez, Paul A. Ullrich, Kenneth R. Sperber, Karl E. Taylor, Yann Y. Planton, Eric Guilyardi, Paul Durack, Celine Bonfils, Mark D. Zelinka, Li-Wei Chao, Bo Dong, Charles Doutriaux, Chengzhu Zhang, Tom Vo, Jason Boutte, Michael F. Wehner, Angeline G. Pendergrass, Daehyun Kim, Zeyu Xue, Andrew T. Wittenberg, and John Krasting
Geosci. Model Dev., 17, 3919–3948, https://doi.org/10.5194/gmd-17-3919-2024,https://doi.org/10.5194/gmd-17-3919-2024, 2024
Short summary

Related subject area

Atmospheric sciences
Valid time shifting ensemble Kalman filter (VTS-EnKF) for dust storm forecasting
Mijie Pang, Jianbing Jin, Arjo Segers, Huiya Jiang, Wei Han, Batjargal Buyantogtokh, Ji Xia, Li Fang, Jiandong Li, Hai Xiang Lin, and Hong Liao
Geosci. Model Dev., 17, 8223–8242, https://doi.org/10.5194/gmd-17-8223-2024,https://doi.org/10.5194/gmd-17-8223-2024, 2024
Short summary
An updated parameterization of the unstable atmospheric surface layer in the Weather Research and Forecasting (WRF) modeling system
Prabhakar Namdev, Maithili Sharan, Piyush Srivastava, and Saroj Kanta Mishra
Geosci. Model Dev., 17, 8093–8114, https://doi.org/10.5194/gmd-17-8093-2024,https://doi.org/10.5194/gmd-17-8093-2024, 2024
Short summary
The impact of cloud microphysics and ice nucleation on Southern Ocean clouds assessed with single-column modeling and instrument simulators
Andrew Gettelman, Richard Forbes, Roger Marchand, Chih-Chieh Chen, and Mark Fielding
Geosci. Model Dev., 17, 8069–8092, https://doi.org/10.5194/gmd-17-8069-2024,https://doi.org/10.5194/gmd-17-8069-2024, 2024
Short summary
An updated aerosol simulation in the Community Earth System Model (v2.1.3): dust and marine aerosol emissions and secondary organic aerosol formation
Yujuan Wang, Peng Zhang, Jie Li, Yaman Liu, Yanxu Zhang, Jiawei Li, and Zhiwei Han
Geosci. Model Dev., 17, 7995–8021, https://doi.org/10.5194/gmd-17-7995-2024,https://doi.org/10.5194/gmd-17-7995-2024, 2024
Short summary
Exploring ship track spreading rates with a physics-informed Langevin particle parameterization
Lucas A. McMichael, Michael J. Schmidt, Robert Wood, Peter N. Blossey, and Lekha Patel
Geosci. Model Dev., 17, 7867–7888, https://doi.org/10.5194/gmd-17-7867-2024,https://doi.org/10.5194/gmd-17-7867-2024, 2024
Short summary

Cited articles

Abramowitz, G.: Towards a public, standardized, diagnostic benchmarking system for land surface models, Geosci. Model Dev., 5, 819–827, https://doi.org/10.5194/gmd-5-819-2012, 2012. 
Ahn, M. and Kang, I.: A practical approach to scale-adaptive deep convection in a GCM by controlling the cumulus base mass flux, npj Clim. Atmos. Sci., 1, 13, https://doi.org/10.1038/s41612-018-0021-0, 2018. 
Ahn, M.-S., Gleckler, P. J., Lee, J., Pendergrass, A. G., and Jakob, C.: Benchmarking Simulated Precipitation Variability Amplitude across Time Scales, J. Climate, 35, 3173–3196, https://doi.org/10.1175/JCLI-D-21-0542.1, 2022. 
Ahn, M.-S., Ullrich, P. A., Lee, J., Gleckler, P. J., Ma, H.-Y., Terai, C. R., Bogenschutz, P. A., and Ordonez, A. C.: Bimodality in Simulated Precipitation Frequency Distributions and Its Relationship with Convective Parameterizations, npj Clim. Atmos. Sci., submitted, https://doi.org/10.21203/rs.3.rs-2874349/v1, 2023. 
Ashouri, H., Hsu, K. L., Sorooshian, S., Braithwaite, D. K., Knapp, K. R., Cecil, L. D., Nelson, B. R., and Prat, O. P.: PERSIANN-CDR: Daily precipitation climate data record from multisatellite observations for hydrological and climate studies, B. Am. Meteorol. Soc., 96, 69–83, https://doi.org/10.1175/BAMS-D-13-00068.1, 2015. 
Download
Short summary
We introduce a framework for regional-scale evaluation of simulated precipitation distributions with 62 climate reference regions and 10 metrics and apply it to evaluate CMIP5 and CMIP6 models against multiple satellite-based precipitation products. The common model biases identified in this study are mainly associated with the overestimated light precipitation and underestimated heavy precipitation. These biases persist from earlier-generation models and have been slightly improved in CMIP6.