Articles | Volume 15, issue 24
https://doi.org/10.5194/gmd-15-9031-2022
https://doi.org/10.5194/gmd-15-9031-2022
Methods for assessment of models
 | 
20 Dec 2022
Methods for assessment of models |  | 20 Dec 2022

The E3SM Diagnostics Package (E3SM Diags v2.7): a Python-based diagnostics package for Earth system model evaluation

Chengzhu Zhang, Jean-Christophe Golaz, Ryan Forsyth, Tom Vo, Shaocheng Xie, Zeshawn Shaheen, Gerald L. Potter, Xylar S. Asay-Davis, Charles S. Zender, Wuyin Lin, Chih-Chieh Chen, Chris R. Terai, Salil Mahajan, Tian Zhou, Karthik Balaguru, Qi Tang, Cheng Tao, Yuying Zhang, Todd Emmenegger, Susannah Burrows, and Paul A. Ullrich

Related authors

The DOE E3SM version 2.1: overview and assessment of the impacts of parameterized ocean submesoscales
Katherine M. Smith, Alice M. Barthel, LeAnn M. Conlon, Luke P. Van Roekel, Anthony Bartoletti, Jean-Christophe Golaz, Chengzhu Zhang, Carolyn Branecky Begeman, James J. Benedict, Gautam Bisht, Yan Feng, Walter Hannah, Bryce E. Harrop, Nicole Jeffery, Wuyin Lin, Po-Lun Ma, Mathew E. Maltrud, Mark R. Petersen, Balwinder Singh, Qi Tang, Teklu Tesfa, Jonathan D. Wolfe, Shaocheng Xie, Xue Zheng, Karthik Balaguru, Oluwayemi Garuba, Peter Gleckler, Aixue Hu, Jiwoo Lee, Ben Moore-Maley, and Ana C. Ordoñez
Geosci. Model Dev., 18, 1613–1633, https://doi.org/10.5194/gmd-18-1613-2025,https://doi.org/10.5194/gmd-18-1613-2025, 2025
Short summary
Systematic and objective evaluation of Earth system models: PCMDI Metrics Package (PMP) version 3
Jiwoo Lee, Peter J. Gleckler, Min-Seop Ahn, Ana Ordonez, Paul A. Ullrich, Kenneth R. Sperber, Karl E. Taylor, Yann Y. Planton, Eric Guilyardi, Paul Durack, Celine Bonfils, Mark D. Zelinka, Li-Wei Chao, Bo Dong, Charles Doutriaux, Chengzhu Zhang, Tom Vo, Jason Boutte, Michael F. Wehner, Angeline G. Pendergrass, Daehyun Kim, Zeyu Xue, Andrew T. Wittenberg, and John Krasting
Geosci. Model Dev., 17, 3919–3948, https://doi.org/10.5194/gmd-17-3919-2024,https://doi.org/10.5194/gmd-17-3919-2024, 2024
Short summary
Leveraging regional mesh refinement to simulate future climate projections for California using the Simplified Convection-Permitting E3SM Atmosphere Model Version 0
Jishi Zhang, Peter Bogenschutz, Qi Tang, Philip Cameron-smith, and Chengzhu Zhang
Geosci. Model Dev., 17, 3687–3731, https://doi.org/10.5194/gmd-17-3687-2024,https://doi.org/10.5194/gmd-17-3687-2024, 2024
Short summary
An overview of the E3SM version 2 large ensemble and comparison to other E3SM and CESM large ensembles
John T. Fasullo, Jean-Christophe Golaz, Julie M. Caron, Nan Rosenbloom, Gerald A. Meehl, Warren Strand, Sasha Glanville, Samantha Stevenson, Maria Molina, Christine A. Shields, Chengzhu Zhang, James Benedict, Hailong Wang, and Tony Bartoletti
Earth Syst. Dynam., 15, 367–386, https://doi.org/10.5194/esd-15-367-2024,https://doi.org/10.5194/esd-15-367-2024, 2024
Short summary
The fully coupled regionally refined model of E3SM version 2: overview of the atmosphere, land, and river results
Qi Tang, Jean-Christophe Golaz, Luke P. Van Roekel, Mark A. Taylor, Wuyin Lin, Benjamin R. Hillman, Paul A. Ullrich, Andrew M. Bradley, Oksana Guba, Jonathan D. Wolfe, Tian Zhou, Kai Zhang, Xue Zheng, Yunyan Zhang, Meng Zhang, Mingxuan Wu, Hailong Wang, Cheng Tao, Balwinder Singh, Alan M. Rhoades, Yi Qin, Hong-Yi Li, Yan Feng, Yuying Zhang, Chengzhu Zhang, Charles S. Zender, Shaocheng Xie, Erika L. Roesler, Andrew F. Roberts, Azamat Mametjanov, Mathew E. Maltrud, Noel D. Keen, Robert L. Jacob, Christiane Jablonowski, Owen K. Hughes, Ryan M. Forsyth, Alan V. Di Vittorio, Peter M. Caldwell, Gautam Bisht, Renata B. McCoy, L. Ruby Leung, and David C. Bader
Geosci. Model Dev., 16, 3953–3995, https://doi.org/10.5194/gmd-16-3953-2023,https://doi.org/10.5194/gmd-16-3953-2023, 2023
Short summary

Related subject area

Atmospheric sciences
Impact of multiple radar wind profiler data assimilation on convective-scale short-term rainfall forecasts: OSSE studies over the Beijing–Tianjin–Hebei region
Juan Zhao, Jianping Guo, and Xiaohui Zheng
Geosci. Model Dev., 18, 4075–4101, https://doi.org/10.5194/gmd-18-4075-2025,https://doi.org/10.5194/gmd-18-4075-2025, 2025
Short summary
New submodel for emissions from Explosive Volcanic ERuptions (EVER v1.1) within the Modular Earth Submodel System (MESSy, version 2.55.1)
Matthias Kohl, Christoph Brühl, Jennifer Schallock, Holger Tost, Patrick Jöckel, Adrian Jost, Steffen Beirle, Michael Höpfner, and Andrea Pozzer
Geosci. Model Dev., 18, 3985–4007, https://doi.org/10.5194/gmd-18-3985-2025,https://doi.org/10.5194/gmd-18-3985-2025, 2025
Short summary
Quantifying the oscillatory evolution of simulated boundary-layer cloud fields using Gaussian process regression
Gunho Loren Oh and Philip H. Austin
Geosci. Model Dev., 18, 3921–3940, https://doi.org/10.5194/gmd-18-3921-2025,https://doi.org/10.5194/gmd-18-3921-2025, 2025
Short summary
Numerical investigations on the modelling of ultrafine particles in SSH-aerosol-v1.3a: size resolution and redistribution
Oscar Jacquot and Karine Sartelet
Geosci. Model Dev., 18, 3965–3984, https://doi.org/10.5194/gmd-18-3965-2025,https://doi.org/10.5194/gmd-18-3965-2025, 2025
Short summary
The third Met Office Unified Model–JULES Regional Atmosphere and Land Configuration, RAL3
Mike Bush, David L. A. Flack, Huw W. Lewis, Sylvia I. Bohnenstengel, Chris J. Short, Charmaine Franklin, Adrian P. Lock, Martin Best, Paul Field, Anne McCabe, Kwinten Van Weverberg, Segolene Berthou, Ian Boutle, Jennifer K. Brooke, Seb Cole, Shaun Cooper, Gareth Dow, John Edwards, Anke Finnenkoetter, Kalli Furtado, Kate Halladay, Kirsty Hanley, Margaret A. Hendry, Adrian Hill, Aravindakshan Jayakumar, Richard W. Jones, Humphrey Lean, Joshua C. K. Lee, Andy Malcolm, Marion Mittermaier, Saji Mohandas, Stuart Moore, Cyril Morcrette, Rachel North, Aurore Porson, Susan Rennie, Nigel Roberts, Belinda Roux, Claudio Sanchez, Chun-Hsu Su, Simon Tucker, Simon Vosper, David Walters, James Warner, Stuart Webster, Mark Weeks, Jonathan Wilkinson, Michael Whitall, Keith D. Williams, and Hugh Zhang
Geosci. Model Dev., 18, 3819–3855, https://doi.org/10.5194/gmd-18-3819-2025,https://doi.org/10.5194/gmd-18-3819-2025, 2025
Short summary

Cited articles

Adler, R. F., Sapiano, M. R. P., Huffman, G. J., Wang, J.-J., Gu, G., Bolvin, D., Chiu, L., Schneider, U., Becker, A., Nelkin, E., Xie, P., Ferraro, R., and Shin, D.-B.: The Global Precipitation Climatology Project (GPCP) Monthly Analysis (New Version 2.3) and a Review of 2017 Global Precipitation. Atmosphere. 2018; 9(4):138. https://doi.org/10.3390/atmos9040138, 2018. a
AMWG: AMWG Diagnostics Package, NCAR CESM Atmosphere Model Working Group, https://www2.cesm.ucar.edu/working_groups/Atmosphere/amwg-diagnostics-package/, last access: 12 December 2022. a, b
Anstey, J. A., Simpson, I. R., Richter, J. H., Naoe, H., Taguchi, M., Serva, F., Gray, L. J., Butchart, N., Hamilton, K., Osprey, S., Bellprat, O., Braesicke, P., Bushell, A. C., Cagnazzo, C., Chen, C.-C., Chun, H.-Y., Garcia, R. R., Holt, L., Kawatani, Y., Kerzenmacher, T., Kim, Y.-H., Lott, F., McLandress, C., Scinocca, J., Stockdale, T. N., Versick, S., Watanabe, S., Yoshida, K., and Yukimoto, S.: Teleconnections of the Quasi-Biennial Oscillation in a multi-model ensemble of QBO-resolving models, Q. J. Roy. Meteor. Soc., 48, 1568–1592, https://doi.org/10.1002/qj.4048, 2021. a
Balaguru, K., Leung, L. R., Van Roekel, L. P., Golaz, J.-C., Ullrich, P. A., Caldwell, P. M., Hagos, S. M., Harrop, B. E., and Mametjanov, A.: Characterizing tropical cyclones in the energy exascale earth system model Version 1, J. Adv. Model. Earth Sy., 12, e2019MS002024, https://doi.org/10.1029/2019MS002024, 2020. a, b, c, d
Baldwin, M. P. and Tung, K.-K.: Extra-tropical QBO signals in angular momentum and wave forcing, Geophys. Res. Lett., 2, 2717–2720, 1994. a
Download
Short summary
Earth system model (ESM) developers run automated analysis tools on data from candidate models to inform model development. This paper introduces a new Python package, E3SM Diags, that has been developed to support ESM development and use routinely in the development of DOE's Energy Exascale Earth System Model. This tool covers a set of essential diagnostics to evaluate the mean physical climate from simulations, as well as several process-oriented and phenomenon-based evaluation diagnostics.
Share