Articles | Volume 16, issue 13
https://doi.org/10.5194/gmd-16-3927-2023
https://doi.org/10.5194/gmd-16-3927-2023
Methods for assessment of models
 | 
13 Jul 2023
Methods for assessment of models |  | 13 Jul 2023

Evaluating precipitation distributions at regional scales: a benchmarking framework and application to CMIP5 and 6 models

Min-Seop Ahn, Paul A. Ullrich, Peter J. Gleckler, Jiwoo Lee, Ana C. Ordonez, and Angeline G. Pendergrass

Related authors

DCMIP2016: the tropical cyclone test case
Justin L. Willson, Kevin A. Reed, Christiane Jablonowski, James Kent, Peter H. Lauritzen, Ramachandran Nair, Mark A. Taylor, Paul A. Ullrich, Colin M. Zarzycki, David M. Hall, Don Dazlich, Ross Heikes, Celal Konor, David Randall, Thomas Dubos, Yann Meurdesoif, Xi Chen, Lucas Harris, Christian Kühnlein, Vivian Lee, Abdessamad Qaddouri, Claude Girard, Marco Giorgetta, Daniel Reinert, Hiroaki Miura, Tomoki Ohno, and Ryuji Yoshida
Geosci. Model Dev., 17, 2493–2507, https://doi.org/10.5194/gmd-17-2493-2024,https://doi.org/10.5194/gmd-17-2493-2024, 2024
Short summary
Impact of ITCZ width on global climate: ITCZ-MIP
Angeline G. Pendergrass, Michael P. Byrne, Oliver Watt-Meyer, Penelope Maher, and Mark J. Webb
Geosci. Model Dev. Discuss., https://doi.org/10.5194/gmd-2024-17,https://doi.org/10.5194/gmd-2024-17, 2024
Preprint under review for GMD
Short summary
rSHUD v2.0: advancing the Simulator for Hydrologic Unstructured Domains and unstructured hydrological modeling in the R environment
Lele Shu, Paul Ullrich, Xianhong Meng, Christopher Duffy, Hao Chen, and Zhaoguo Li
Geosci. Model Dev., 17, 497–527, https://doi.org/10.5194/gmd-17-497-2024,https://doi.org/10.5194/gmd-17-497-2024, 2024
Short summary
Objective Evaluation of Earth System Models: PCMDI Metrics Package (PMP) version 3
Jiwoo Lee, Peter J. Gleckler, Min-Seop Ahn, Ana Ordonez, Paul A. Ullrich, Kenneth R. Sperber, Karl E. Taylor, Yann Y. Planton, Eric Guilyardi, Paul Durack, Celine Bonfils, Mark D. Zelinka, Li-Wei Chao, Bo Dong, Charles Doutriaux, Chengzhu Zhang, Tom Vo, Jason Boutte, Michael F. Wehner, Angeline G. Pendergrass, Daehyun Kim, Zeyu Xue, Andrew T. Wittenberg, and John Krasting
EGUsphere, https://doi.org/10.5194/egusphere-2023-2720,https://doi.org/10.5194/egusphere-2023-2720, 2023
Short summary
The fully coupled regionally refined model of E3SM version 2: overview of the atmosphere, land, and river results
Qi Tang, Jean-Christophe Golaz, Luke P. Van Roekel, Mark A. Taylor, Wuyin Lin, Benjamin R. Hillman, Paul A. Ullrich, Andrew M. Bradley, Oksana Guba, Jonathan D. Wolfe, Tian Zhou, Kai Zhang, Xue Zheng, Yunyan Zhang, Meng Zhang, Mingxuan Wu, Hailong Wang, Cheng Tao, Balwinder Singh, Alan M. Rhoades, Yi Qin, Hong-Yi Li, Yan Feng, Yuying Zhang, Chengzhu Zhang, Charles S. Zender, Shaocheng Xie, Erika L. Roesler, Andrew F. Roberts, Azamat Mametjanov, Mathew E. Maltrud, Noel D. Keen, Robert L. Jacob, Christiane Jablonowski, Owen K. Hughes, Ryan M. Forsyth, Alan V. Di Vittorio, Peter M. Caldwell, Gautam Bisht, Renata B. McCoy, L. Ruby Leung, and David C. Bader
Geosci. Model Dev., 16, 3953–3995, https://doi.org/10.5194/gmd-16-3953-2023,https://doi.org/10.5194/gmd-16-3953-2023, 2023
Short summary

Related subject area

Atmospheric sciences
Emission ensemble approach to improve the development of multi-scale emission inventories
Philippe Thunis, Jeroen Kuenen, Enrico Pisoni, Bertrand Bessagnet, Manjola Banja, Lech Gawuc, Karol Szymankiewicz, Diego Guizardi, Monica Crippa, Susana Lopez-Aparicio, Marc Guevara, Alexander De Meij, Sabine Schindlbacher, and Alain Clappier
Geosci. Model Dev., 17, 3631–3643, https://doi.org/10.5194/gmd-17-3631-2024,https://doi.org/10.5194/gmd-17-3631-2024, 2024
Short summary
What is the relative impact of nudging and online coupling on meteorological variables, pollutant concentrations and aerosol optical properties?
Laurent Menut, Bertrand Bessagnet, Arineh Cholakian, Guillaume Siour, Sylvain Mailler, and Romain Pennel
Geosci. Model Dev., 17, 3645–3665, https://doi.org/10.5194/gmd-17-3645-2024,https://doi.org/10.5194/gmd-17-3645-2024, 2024
Short summary
Diagnosing drivers of PM2.5 simulation biases in China from meteorology, chemical composition, and emission sources using an efficient machine learning method
Shuai Wang, Mengyuan Zhang, Yueqi Gao, Peng Wang, Qingyan Fu, and Hongliang Zhang
Geosci. Model Dev., 17, 3617–3629, https://doi.org/10.5194/gmd-17-3617-2024,https://doi.org/10.5194/gmd-17-3617-2024, 2024
Short summary
Validation and analysis of the Polair3D v1.11 chemical transport model over Quebec
Shoma Yamanouchi, Shayamilla Mahagammulla Gamage, Sara Torbatian, Jad Zalzal, Laura Minet, Audrey Smargiassi, Ying Liu, Ling Liu, Forood Azargoshasbi, Jinwoong Kim, Youngseob Kim, Daniel Yazgi, and Marianne Hatzopoulou
Geosci. Model Dev., 17, 3579–3597, https://doi.org/10.5194/gmd-17-3579-2024,https://doi.org/10.5194/gmd-17-3579-2024, 2024
Short summary
Assimilation of GNSS tropospheric gradients into the Weather Research and Forecasting (WRF) model version 4.4.1
Rohith Thundathil, Florian Zus, Galina Dick, and Jens Wickert
Geosci. Model Dev., 17, 3599–3616, https://doi.org/10.5194/gmd-17-3599-2024,https://doi.org/10.5194/gmd-17-3599-2024, 2024
Short summary

Cited articles

Abramowitz, G.: Towards a public, standardized, diagnostic benchmarking system for land surface models, Geosci. Model Dev., 5, 819–827, https://doi.org/10.5194/gmd-5-819-2012, 2012. 
Ahn, M. and Kang, I.: A practical approach to scale-adaptive deep convection in a GCM by controlling the cumulus base mass flux, npj Clim. Atmos. Sci., 1, 13, https://doi.org/10.1038/s41612-018-0021-0, 2018. 
Ahn, M.-S., Gleckler, P. J., Lee, J., Pendergrass, A. G., and Jakob, C.: Benchmarking Simulated Precipitation Variability Amplitude across Time Scales, J. Climate, 35, 3173–3196, https://doi.org/10.1175/JCLI-D-21-0542.1, 2022. 
Ahn, M.-S., Ullrich, P. A., Lee, J., Gleckler, P. J., Ma, H.-Y., Terai, C. R., Bogenschutz, P. A., and Ordonez, A. C.: Bimodality in Simulated Precipitation Frequency Distributions and Its Relationship with Convective Parameterizations, npj Clim. Atmos. Sci., submitted, https://doi.org/10.21203/rs.3.rs-2874349/v1, 2023. 
Ashouri, H., Hsu, K. L., Sorooshian, S., Braithwaite, D. K., Knapp, K. R., Cecil, L. D., Nelson, B. R., and Prat, O. P.: PERSIANN-CDR: Daily precipitation climate data record from multisatellite observations for hydrological and climate studies, B. Am. Meteorol. Soc., 96, 69–83, https://doi.org/10.1175/BAMS-D-13-00068.1, 2015. 
Download
Short summary
We introduce a framework for regional-scale evaluation of simulated precipitation distributions with 62 climate reference regions and 10 metrics and apply it to evaluate CMIP5 and CMIP6 models against multiple satellite-based precipitation products. The common model biases identified in this study are mainly associated with the overestimated light precipitation and underestimated heavy precipitation. These biases persist from earlier-generation models and have been slightly improved in CMIP6.