Articles | Volume 18, issue 2
https://doi.org/10.5194/gmd-18-361-2025
https://doi.org/10.5194/gmd-18-361-2025
Methods for assessment of models
 | 
22 Jan 2025
Methods for assessment of models |  | 22 Jan 2025

Decomposition of skill scores for conditional verification: impact of Atlantic Multidecadal Oscillation phases on the predictability of decadal temperature forecasts

Andy Richling, Jens Grieger, and Henning W. Rust

Related authors

Temporal dynamic vulnerability – Impact of antecedent events on residential building losses to wind storm events in Germany
Andreas Trojand, Henning Rust, and Uwe Ulbrich
EGUsphere, https://doi.org/10.5194/egusphere-2024-1506,https://doi.org/10.5194/egusphere-2024-1506, 2024
Short summary
Investigating the global and regional response of drought to idealized deforestation using multiple global climate models
Yan Li, Bo Huang, Chunping Tan, Xia Zhang, Francesco Cherubini, and Henning W. Rust
EGUsphere, https://doi.org/10.5194/egusphere-2024-1270,https://doi.org/10.5194/egusphere-2024-1270, 2024
Short summary
Earth Virtualization Engines (EVE)
Bjorn Stevens, Stefan Adami, Tariq Ali, Hartwig Anzt, Zafer Aslan, Sabine Attinger, Jaana Bäck, Johanna Baehr, Peter Bauer, Natacha Bernier, Bob Bishop, Hendryk Bockelmann, Sandrine Bony, Guy Brasseur, David N. Bresch, Sean Breyer, Gilbert Brunet, Pier Luigi Buttigieg, Junji Cao, Christelle Castet, Yafang Cheng, Ayantika Dey Choudhury, Deborah Coen, Susanne Crewell, Atish Dabholkar, Qing Dai, Francisco Doblas-Reyes, Dale Durran, Ayoub El Gaidi, Charlie Ewen, Eleftheria Exarchou, Veronika Eyring, Florencia Falkinhoff, David Farrell, Piers M. Forster, Ariane Frassoni, Claudia Frauen, Oliver Fuhrer, Shahzad Gani, Edwin Gerber, Debra Goldfarb, Jens Grieger, Nicolas Gruber, Wilco Hazeleger, Rolf Herken, Chris Hewitt, Torsten Hoefler, Huang-Hsiung Hsu, Daniela Jacob, Alexandra Jahn, Christian Jakob, Thomas Jung, Christopher Kadow, In-Sik Kang, Sarah Kang, Karthik Kashinath, Katharina Kleinen-von Königslöw, Daniel Klocke, Uta Kloenne, Milan Klöwer, Chihiro Kodama, Stefan Kollet, Tobias Kölling, Jenni Kontkanen, Steve Kopp, Michal Koran, Markku Kulmala, Hanna Lappalainen, Fakhria Latifi, Bryan Lawrence, June Yi Lee, Quentin Lejeun, Christian Lessig, Chao Li, Thomas Lippert, Jürg Luterbacher, Pekka Manninen, Jochem Marotzke, Satoshi Matsouoka, Charlotte Merchant, Peter Messmer, Gero Michel, Kristel Michielsen, Tomoki Miyakawa, Jens Müller, Ramsha Munir, Sandeep Narayanasetti, Ousmane Ndiaye, Carlos Nobre, Achim Oberg, Riko Oki, Tuba Özkan-Haller, Tim Palmer, Stan Posey, Andreas Prein, Odessa Primus, Mike Pritchard, Julie Pullen, Dian Putrasahan, Johannes Quaas, Krishnan Raghavan, Venkatachalam Ramaswamy, Markus Rapp, Florian Rauser, Markus Reichstein, Aromar Revi, Sonakshi Saluja, Masaki Satoh, Vera Schemann, Sebastian Schemm, Christina Schnadt Poberaj, Thomas Schulthess, Cath Senior, Jagadish Shukla, Manmeet Singh, Julia Slingo, Adam Sobel, Silvina Solman, Jenna Spitzer, Philip Stier, Thomas Stocker, Sarah Strock, Hang Su, Petteri Taalas, John Taylor, Susann Tegtmeier, Georg Teutsch, Adrian Tompkins, Uwe Ulbrich, Pier-Luigi Vidale, Chien-Ming Wu, Hao Xu, Najibullah Zaki, Laure Zanna, Tianjun Zhou, and Florian Ziemen
Earth Syst. Sci. Data, 16, 2113–2122, https://doi.org/10.5194/essd-16-2113-2024,https://doi.org/10.5194/essd-16-2113-2024, 2024
Short summary
Interannual variations in the seasonal cycle of extreme precipitation in Germany and the response to climate change
Madlen Peter, Henning W. Rust, and Uwe Ulbrich
Nat. Hazards Earth Syst. Sci., 24, 1261–1285, https://doi.org/10.5194/nhess-24-1261-2024,https://doi.org/10.5194/nhess-24-1261-2024, 2024
Short summary
Using statistical models to depict the response of multi-timescale drought to forest cover change across climate zones
Yan Li, Bo Huang, and Henning W. Rust
Hydrol. Earth Syst. Sci., 28, 321–339, https://doi.org/10.5194/hess-28-321-2024,https://doi.org/10.5194/hess-28-321-2024, 2024
Short summary

Related subject area

Climate and Earth system modeling
Virtual Integration of Satellite and In-situ Observation Networks (VISION) v1.0: In-Situ Observations Simulator (ISO_simulator)
Maria R. Russo, Sadie L. Bartholomew, David Hassell, Alex M. Mason, Erica Neininger, A. James Perman, David A. J. Sproson, Duncan Watson-Parris, and Nathan Luke Abraham
Geosci. Model Dev., 18, 181–191, https://doi.org/10.5194/gmd-18-181-2025,https://doi.org/10.5194/gmd-18-181-2025, 2025
Short summary
Climate model downscaling in central Asia: a dynamical and a neural network approach
Bijan Fallah, Masoud Rostami, Emmanuele Russo, Paula Harder, Christoph Menz, Peter Hoffmann, Iulii Didovets, and Fred F. Hattermann
Geosci. Model Dev., 18, 161–180, https://doi.org/10.5194/gmd-18-161-2025,https://doi.org/10.5194/gmd-18-161-2025, 2025
Short summary
Multi-year simulations at kilometre scale with the Integrated Forecasting System coupled to FESOM2.5 and NEMOv3.4
Thomas Rackow, Xabier Pedruzo-Bagazgoitia, Tobias Becker, Sebastian Milinski, Irina Sandu, Razvan Aguridan, Peter Bechtold, Sebastian Beyer, Jean Bidlot, Souhail Boussetta, Willem Deconinck, Michail Diamantakis, Peter Dueben, Emanuel Dutra, Richard Forbes, Rohit Ghosh, Helge F. Goessling, Ioan Hadade, Jan Hegewald, Thomas Jung, Sarah Keeley, Lukas Kluft, Nikolay Koldunov, Aleksei Koldunov, Tobias Kölling, Josh Kousal, Christian Kühnlein, Pedro Maciel, Kristian Mogensen, Tiago Quintino, Inna Polichtchouk, Balthasar Reuter, Domokos Sármány, Patrick Scholz, Dmitry Sidorenko, Jan Streffing, Birgit Sützl, Daisuke Takasuka, Steffen Tietsche, Mirco Valentini, Benoît Vannière, Nils Wedi, Lorenzo Zampieri, and Florian Ziemen
Geosci. Model Dev., 18, 33–69, https://doi.org/10.5194/gmd-18-33-2025,https://doi.org/10.5194/gmd-18-33-2025, 2025
Short summary
Subsurface hydrological controls on the short-term effects of hurricanes on nitrate–nitrogen runoff loading: a case study of Hurricane Ida using the Energy Exascale Earth System Model (E3SM) Land Model (v2.1)
Yilin Fang, Hoang Viet Tran, and L. Ruby Leung
Geosci. Model Dev., 18, 19–32, https://doi.org/10.5194/gmd-18-19-2025,https://doi.org/10.5194/gmd-18-19-2025, 2025
Short summary
CARIB12: a regional Community Earth System Model/Modular Ocean Model 6 configuration of the Caribbean Sea
Giovanni Seijo-Ellis, Donata Giglio, Gustavo Marques, and Frank Bryan
Geosci. Model Dev., 17, 8989–9021, https://doi.org/10.5194/gmd-17-8989-2024,https://doi.org/10.5194/gmd-17-8989-2024, 2024
Short summary

Cited articles

Balmaseda, M. A., Mogensen, K., and Weaver, A. T.: Evaluation of the ECMWF ocean reanalysis system ORAS4, Q. J. Roy. Meteor. Soc., 139, 1132–1161, https://doi.org/10.1002/qj.2063, 2013. a, b
Blyth, C. R.: On Simpson's Paradox and the Sure-Thing Principle, J. Am. Stat. Assoc., 67, 364–366, https://doi.org/10.1080/01621459.1972.10482387, 1972. a
Borchert, L. F., Müller, W. A., and Baehr, J.: Atlantic Ocean Heat Transport Influences Interannual-to-Decadal Surface Temperature Predictability in the North Atlantic Region, J. Climate, 31, 6763–6782, https://doi.org/10.1175/JCLI-D-17-0734.1, 2018. a, b, c, d, e, f
Borchert, L. F., Düsterhus, A., Brune, S., Müller, W. A., and Baehr, J.: Forecast-Oriented Assessment of Decadal Hindcast Skill for North Atlantic SST, Geophys. Res. Lett., 46, 11444–11454, https://doi.org/10.1029/2019GL084758, 2019. a, b, c, d, e
Branković, C. and Palmer, T. N.: Seasonal skill and predictability of ECMWF PROVOST ensembles, Q. J. Roy. Meteor. Soc., 126, 2035–2067, https://doi.org/10.1256/smsqj.56703, 2000. a
Download
Short summary
The performance of weather and climate prediction systems is variable in time and space. It is of interest how this performance varies in different situations. We provide a decomposition of a skill score (a measure of forecast performance) as a tool for detailed assessment of performance variability to support model development or forecast improvement. The framework is exemplified with decadal forecasts to assess the impact of different ocean states in the North Atlantic on temperature forecast.