Articles | Volume 10, issue 6
https://doi.org/10.5194/gmd-10-2379-2017
https://doi.org/10.5194/gmd-10-2379-2017
Methods for assessment of models
 | 
28 Jun 2017
Methods for assessment of models |  | 28 Jun 2017

Skill and independence weighting for multi-model assessments

Benjamin M. Sanderson, Michael Wehner, and Reto Knutti

Related authors

METEORv1.0.1: A novel framework for emulating multi-timescale regional climate responses
Marit Sandstad, Norman Julius Steinert, Susanne Baur, and Benjamin Mark Sanderson
EGUsphere, https://doi.org/10.5194/egusphere-2025-1038,https://doi.org/10.5194/egusphere-2025-1038, 2025
This preprint is open for discussion and under review for Geoscientific Model Development (GMD).
Short summary
The Scenario Model Intercomparison Project for CMIP7 (ScenarioMIP-CMIP7)
Detlef van Vuuren, Brian O'Neill, Claudia Tebaldi, Louise Chini, Pierre Friedlingstein, Tomoko Hasegawa, Keywan Riahi, Benjamin Sanderson, Bala Govindasamy, Nico Bauer, Veronika Eyring, Cheikh Fall, Katja Frieler, Matthew Gidden, Laila Gohar, Andrew Jones, Andrew King, Reto Knutti, Elmar Kriegler, Peter Lawrence, Chris Lennard, Jason Lowe, Camila Mathison, Shahbaz Mehmood, Luciana Prado, Qiang Zhang, Steven Rose, Alexander Ruane, Carl-Friederich Schleussner, Roland Seferian, Jana Sillmann, Chris Smith, Anna Sörensson, Swapna Panickal, Kaoru Tachiiri, Naomi Vaughan, Saritha Vishwanathan, Tokuta Yokohata, and Tilo Ziehn
EGUsphere, https://doi.org/10.5194/egusphere-2024-3765,https://doi.org/10.5194/egusphere-2024-3765, 2025
Short summary
An evolving Coupled Model Intercomparison Project phase 7 (CMIP7) and Fast Track in support of future climate assessment
John Patrick Dunne, Helene T. Hewitt, Julie Arblaster, Frédéric Bonou, Olivier Boucher, Tereza Cavazos, Paul J. Durack, Birgit Hassler, Martin Juckes, Tomoki Miyakawa, Matthew Mizielinski, Vaishali Naik, Zebedee Nicholls, Eleanor O’Rourke, Robert Pincus, Benjamin M. Sanderson, Isla R. Simpson, and Karl E. Taylor
EGUsphere, https://doi.org/10.5194/egusphere-2024-3874,https://doi.org/10.5194/egusphere-2024-3874, 2024
Short summary
The need for carbon-emissions-driven climate projections in CMIP7
Benjamin M. Sanderson, Ben B. B. Booth, John Dunne, Veronika Eyring, Rosie A. Fisher, Pierre Friedlingstein, Matthew J. Gidden, Tomohiro Hajima, Chris D. Jones, Colin G. Jones, Andrew King, Charles D. Koven, David M. Lawrence, Jason Lowe, Nadine Mengis, Glen P. Peters, Joeri Rogelj, Chris Smith, Abigail C. Snyder, Isla R. Simpson, Abigail L. S. Swann, Claudia Tebaldi, Tatiana Ilyina, Carl-Friedrich Schleussner, Roland Séférian, Bjørn H. Samset, Detlef van Vuuren, and Sönke Zaehle
Geosci. Model Dev., 17, 8141–8172, https://doi.org/10.5194/gmd-17-8141-2024,https://doi.org/10.5194/gmd-17-8141-2024, 2024
Short summary
flat10MIP: An emissions-driven experiment to diagnose the climate response to positive, zero, and negative CO2 emissions
Benjamin Mark Sanderson, Victor Brovkin, Rosie Fisher, David Hohn, Tatiana Ilyina, Chris Jones, Torben Koenigk, Charles Koven, Hongmei Li, David Lawrence, Peter Lawrence, Spencer Liddicoat, Andrew Macdougall, Nadine Mengis, Zebedee Nicholls, Eleanor O'Rourke, Anastasia Romanou, Marit Sandstad, Jörg Schwinger, Roland Seferian, Lori Sentman, Isla Simpson, Chris Smith, Norman Steinert, Abigail Swann, Jerry Tjiputra, and Tilo Ziehn
EGUsphere, https://doi.org/10.5194/egusphere-2024-3356,https://doi.org/10.5194/egusphere-2024-3356, 2024
Short summary

Related subject area

Climate and Earth system modeling
From weather data to river runoff: using spatiotemporal convolutional networks for discharge forecasting
Florian Börgel, Sven Karsten, Karoline Rummel, and Ulf Gräwe
Geosci. Model Dev., 18, 2005–2019, https://doi.org/10.5194/gmd-18-2005-2025,https://doi.org/10.5194/gmd-18-2005-2025, 2025
Short summary
A Fortran–Python interface for integrating machine learning parameterization into earth system models
Tao Zhang, Cyril Morcrette, Meng Zhang, Wuyin Lin, Shaocheng Xie, Ye Liu, Kwinten Van Weverberg, and Joana Rodrigues
Geosci. Model Dev., 18, 1917–1928, https://doi.org/10.5194/gmd-18-1917-2025,https://doi.org/10.5194/gmd-18-1917-2025, 2025
Short summary
A rapid-application emissions-to-impacts tool for scenario assessment: Probabilistic Regional Impacts from Model patterns and Emissions (PRIME)
Camilla Mathison, Eleanor J. Burke, Gregory Munday, Chris D. Jones, Chris J. Smith, Norman J. Steinert, Andy J. Wiltshire, Chris Huntingford, Eszter Kovacs, Laila K. Gohar, Rebecca M. Varney, and Douglas McNeall
Geosci. Model Dev., 18, 1785–1808, https://doi.org/10.5194/gmd-18-1785-2025,https://doi.org/10.5194/gmd-18-1785-2025, 2025
Short summary
The DOE E3SM version 2.1: overview and assessment of the impacts of parameterized ocean submesoscales
Katherine M. Smith, Alice M. Barthel, LeAnn M. Conlon, Luke P. Van Roekel, Anthony Bartoletti, Jean-Christophe Golaz, Chengzhu Zhang, Carolyn Branecky Begeman, James J. Benedict, Gautam Bisht, Yan Feng, Walter Hannah, Bryce E. Harrop, Nicole Jeffery, Wuyin Lin, Po-Lun Ma, Mathew E. Maltrud, Mark R. Petersen, Balwinder Singh, Qi Tang, Teklu Tesfa, Jonathan D. Wolfe, Shaocheng Xie, Xue Zheng, Karthik Balaguru, Oluwayemi Garuba, Peter Gleckler, Aixue Hu, Jiwoo Lee, Ben Moore-Maley, and Ana C. Ordoñez
Geosci. Model Dev., 18, 1613–1633, https://doi.org/10.5194/gmd-18-1613-2025,https://doi.org/10.5194/gmd-18-1613-2025, 2025
Short summary
WRF-ELM v1.0: a regional climate model to study land–atmosphere interactions over heterogeneous land use regions
Huilin Huang, Yun Qian, Gautam Bisht, Jiali Wang, Tirthankar Chakraborty, Dalei Hao, Jianfeng Li, Travis Thurber, Balwinder Singh, Zhao Yang, Ye Liu, Pengfei Xue, William J. Sacks, Ethan Coon, and Robert Hetland
Geosci. Model Dev., 18, 1427–1443, https://doi.org/10.5194/gmd-18-1427-2025,https://doi.org/10.5194/gmd-18-1427-2025, 2025
Short summary

Cited articles

Abramowitz, G. and Bishop, C. H.: Climate model dependence and the ensemble dependence transformation of cmip projections, J. Climate, 28, 2332–2348, 2015.
Alexander, L., Donat, M., Takayama, Y., and Yang, H.: The climdex project: creation of long-term global gridded products for the analysis of temperature and precipitation extremes, WCRP Open Science conference, Denver, 2011.
Annan, J. D. and Hargreaves, J. C.: Understanding the CMIP3 multimodel ensemble, J. Climate, 24, 4529–4538, 2011.
Aumann, H. H., Chahine, M. T., Gautier, C., Goldberg, M. D., Kalnay, E., McMillin, L. M., Revercomb, H., Rosenkranz, P. W., Smith, W. L., Staelin, D. H., and Strow, L. L.: AIRS/AMSU/HSB on the Aqua Mission: Design, Science Objectives, Data Products, and Processing Systems, IEEE T. Geosci. Remote, 41, 253–264, https://doi.org/10.1109/TGRS.2002.808356, 2003.
Bishop, C. H. and Abramowitz, G.: Climate model dependence and the replicate earth paradigm, Clim. Dynam., 41, 885–900, 2013.
Download
Short summary
How should climate model simulations be combined to produce an overall assessment that reflects both their performance and their interdependencies? This paper presents a strategy for weighting climate model output such that models that are replicated or models that perform poorly in a chosen set of metrics are appropriately weighted. We perform sensitivity tests to show how the method results depend on variables and parameter values.
Share