Articles | Volume 17, issue 21
https://doi.org/10.5194/gmd-17-7915-2024
© Author(s) 2024. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
https://doi.org/10.5194/gmd-17-7915-2024
© Author(s) 2024. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
Model evaluation paper
| 
07 Nov 2024
Model evaluation paper |
| 07 Nov 2024
| 07 Nov 2024
Do data-driven models beat numerical models in forecasting weather extremes? A comparison of IFS HRES, Pangu-Weather, and GraphCast
Leonardo Olivetti
CORRESPONDING AUTHOR
Department of Earth Sciences, Uppsala University, 75236 Uppsala, Sweden
Swedish Centre for Impacts of Climate Extremes (climes), Uppsala University, 75236 Uppsala, Sweden
Centre of Natural Hazards and Disaster Science (CNDS), Uppsala University, 75236 Uppsala, Sweden
Gabriele Messori
Department of Earth Sciences, Uppsala University, 75236 Uppsala, Sweden
Swedish Centre for Impacts of Climate Extremes (climes), Uppsala University, 75236 Uppsala, Sweden
Department of Meteorology and Bolin Centre for Climate Research, Stockholm University, 10691 Stockholm, Sweden
Related authors
Leonardo Olivetti and Gabriele Messori
Geosci. Model Dev., 17, 2347–2358, https://doi.org/10.5194/gmd-17-2347-2024, https://doi.org/10.5194/gmd-17-2347-2024, 2024
Short summary
Short summary
In the last decades, weather forecasting up to 15 d into the future has been dominated by physics-based numerical models. Recently, deep learning models have challenged this paradigm. However, the latter models may struggle when forecasting weather extremes. In this article, we argue for deep learning models specifically designed to handle extreme events, and we propose a foundational framework to develop such models.
Gabriele Messori, Emily Boyd, Joakim Nivre, and Elena Raffetti
EGUsphere, https://doi.org/10.5194/egusphere-2025-3451, https://doi.org/10.5194/egusphere-2025-3451, 2025
This preprint is open for discussion and under review for Earth System Dynamics (ESD).
Short summary
Short summary
Understanding impacts of climate extremes is very important for society and the economy. We identify three challenges restricting this understanding: limited availability and quality of impact data, difficulties in understanding why given impacts occur and lack of reliable projections of future impacts. We also identify key opportunities, including newly released datasets, recent methodological and technical advances and interdisciplinary collaborations between the social and natural sciences.
Valerio Lembo, Gabriele Messori, Davide Faranda, Vera Melinda Galfi, Rune Grand Graversen, and Flavio Emanuele Pons
EGUsphere, https://doi.org/10.5194/egusphere-2025-2189, https://doi.org/10.5194/egusphere-2025-2189, 2025
Short summary
Short summary
Hemispheric heatwaves have fundamental implications for ecosystems and societies. They are studied together with the large-scale atmospheric dynamics, through the lens of the poleward heat transports by planetary-scale waves. Extremely weak transports of heat towards the Poles are found to be associated with hemispheric heatwaves in the Northern Hemisphere mid-latitudes. Therefore, we conclude that heat transports are a clear indicator, and possibly a precursor of hemispehric heatwaves.
Michael K. Schutte, Alice Portal, Simon H. Lee, and Gabriele Messori
Weather Clim. Dynam., 6, 521–548, https://doi.org/10.5194/wcd-6-521-2025, https://doi.org/10.5194/wcd-6-521-2025, 2025
Short summary
Short summary
Large-scale motions in the atmosphere, namely atmospheric waves, greatly impact the weather that we experience at the Earth's surface. Here we investigate how waves in the troposphere (the lower 10 km of the atmosphere) and the stratosphere (above the troposphere) interact to affect surface weather. We find that tropospheric waves that are reflected back down by the stratosphere change weather patterns and temperatures in North America. These changes can indirectly affect the weather in Europe.
Sara Lindersson and Gabriele Messori
Earth Syst. Sci. Data Discuss., https://doi.org/10.5194/essd-2025-128, https://doi.org/10.5194/essd-2025-128, 2025
Preprint under review for ESSD
Short summary
Short summary
The study of past temperature-related disasters requires information on socioeconomic impacts, hazard intensity and human exposure. This is often lacking in current disaster databases. SHEDIS-Temperature fills this gap by integrating impact records with information on disaster locations, high-resolution meteorological data, and population estimates. Covering 382 disasters in 71 countries (1979–2018), this dataset enables deeper analyses of heat-related risk and vulnerabilities.
Ferran Lopez-Marti, Mireia Ginesta, Davide Faranda, Anna Rutgersson, Pascal Yiou, Lichuan Wu, and Gabriele Messori
Earth Syst. Dynam., 16, 169–187, https://doi.org/10.5194/esd-16-169-2025, https://doi.org/10.5194/esd-16-169-2025, 2025
Short summary
Short summary
Explosive cyclones and atmospheric rivers are two main drivers of extreme weather in Europe. In this study, we investigate their joint changes in future climates over the North Atlantic. Our results show that both the concurrence of these events and the intensity of atmospheric rivers increase by the end of the century across different future scenarios. Furthermore, explosive cyclones associated with atmospheric rivers last longer and are deeper than those without atmospheric rivers.
Clare Marie Flynn, Julia Moemken, Joaquim G. Pinto, and Gabriele Messori
Earth Syst. Sci. Data Discuss., https://doi.org/10.5194/essd-2024-298, https://doi.org/10.5194/essd-2024-298, 2024
Revised manuscript accepted for ESSD
Short summary
Short summary
We created a new, publicly available database of the Top 50 most extreme European winter windstorms from each of four different meteorological input data sets covering the years 1995–2015. We found variability in all aspects of our database, from which storms were included in the Top 50 storms for each input to their spatial variability. We urge users of our database to consider the storms as identified from two or more input sources within our database, where possible.
Gabriele Messori, Antonio Segalini, and Alexandre M. Ramos
Earth Syst. Dynam., 15, 1207–1225, https://doi.org/10.5194/esd-15-1207-2024, https://doi.org/10.5194/esd-15-1207-2024, 2024
Short summary
Short summary
Simultaneous heatwaves or cold spells in remote geographical regions have potentially far-reaching impacts on society and the environment. Despite this, we have little knowledge of when and where these extreme events have occurred in the past decades. In this paper, we present a summary of past simultaneous heatwaves or cold spells and provide a computer program to enable other researchers to study them.
Marco Gaetani, Gabriele Messori, Francesco S. R. Pausata, Shivangi Tiwari, M. Carmen Alvarez Castro, and Qiong Zhang
Clim. Past, 20, 1735–1759, https://doi.org/10.5194/cp-20-1735-2024, https://doi.org/10.5194/cp-20-1735-2024, 2024
Short summary
Short summary
Palaeoclimate reconstructions suggest that, around 6000 years ago, a greening of the Sahara took place, accompanied by climate changes in the Northern Hemisphere at middle to high latitudes. In this study, a climate model is used to investigate how this drastic environmental change in the Sahara impacted remote regions. Specifically, climate simulations reveal significant modifications in atmospheric circulation over the North Atlantic, affecting North American and European climates.
Antonio Segalini, Jacopo Riboldi, Volkmar Wirth, and Gabriele Messori
Weather Clim. Dynam., 5, 997–1012, https://doi.org/10.5194/wcd-5-997-2024, https://doi.org/10.5194/wcd-5-997-2024, 2024
Short summary
Short summary
Planetary Rossby waves are created by topography and evolve in time. In this work, an analytical solution of this classical problem is proposed under the approximation of linear wave dynamics. The theory is able to describe reasonably well the evolution of the perturbation and compares well with full nonlinear simulations. Several relevant cases with single and double zonal jets are assessed with the theoretical framework
Davide Faranda, Gabriele Messori, Erika Coppola, Tommaso Alberti, Mathieu Vrac, Flavio Pons, Pascal Yiou, Marion Saint Lu, Andreia N. S. Hisi, Patrick Brockmann, Stavros Dafis, Gianmarco Mengaldo, and Robert Vautard
Weather Clim. Dynam., 5, 959–983, https://doi.org/10.5194/wcd-5-959-2024, https://doi.org/10.5194/wcd-5-959-2024, 2024
Short summary
Short summary
We introduce ClimaMeter, a tool offering real-time insights into extreme-weather events. Our tool unveils how climate change and natural variability affect these events, affecting communities worldwide. Our research equips policymakers and the public with essential knowledge, fostering informed decisions and enhancing climate resilience. We analysed two distinct events, showcasing ClimaMeter's global relevance.
Aleksa Stanković, Gabriele Messori, Joaquim G. Pinto, and Rodrigo Caballero
Weather Clim. Dynam., 5, 821–837, https://doi.org/10.5194/wcd-5-821-2024, https://doi.org/10.5194/wcd-5-821-2024, 2024
Short summary
Short summary
The article studies extreme winds near the surface over the North Atlantic Ocean. These winds are caused by storms that pass through this region. The strongest storms that have occurred in the winters from 1950–2020 are studied in detail and compared to weaker but still strong storms. The analysis shows that the storms associated with the strongest winds are preceded by another older storm that travelled through the same region and made the conditions suitable for development of extreme winds.
Derrick Muheki, Axel A. J. Deijns, Emanuele Bevacqua, Gabriele Messori, Jakob Zscheischler, and Wim Thiery
Earth Syst. Dynam., 15, 429–466, https://doi.org/10.5194/esd-15-429-2024, https://doi.org/10.5194/esd-15-429-2024, 2024
Short summary
Short summary
Climate change affects the interaction, dependence, and joint occurrence of climate extremes. Here we investigate the joint occurrence of pairs of river floods, droughts, heatwaves, crop failures, wildfires, and tropical cyclones in East Africa under past and future climate conditions. Our results show that, across all future warming scenarios, the frequency and spatial extent of these co-occurring extremes will increase in this region, particularly in areas close to the Nile and Congo rivers.
Leonardo Olivetti and Gabriele Messori
Geosci. Model Dev., 17, 2347–2358, https://doi.org/10.5194/gmd-17-2347-2024, https://doi.org/10.5194/gmd-17-2347-2024, 2024
Short summary
Short summary
In the last decades, weather forecasting up to 15 d into the future has been dominated by physics-based numerical models. Recently, deep learning models have challenged this paradigm. However, the latter models may struggle when forecasting weather extremes. In this article, we argue for deep learning models specifically designed to handle extreme events, and we propose a foundational framework to develop such models.
Sina Loriani, Yevgeny Aksenov, David Armstrong McKay, Govindasamy Bala, Andreas Born, Cristiano M. Chiessi, Henk Dijkstra, Jonathan F. Donges, Sybren Drijfhout, Matthew H. England, Alexey V. Fedorov, Laura Jackson, Kai Kornhuber, Gabriele Messori, Francesco Pausata, Stefanie Rynders, Jean-Baptiste Salée, Bablu Sinha, Steven Sherwood, Didier Swingedouw, and Thejna Tharammal
EGUsphere, https://doi.org/10.5194/egusphere-2023-2589, https://doi.org/10.5194/egusphere-2023-2589, 2023
Short summary
Short summary
In this work, we draw on paleoreords, observations and modelling studies to review tipping points in the ocean overturning circulations, monsoon systems and global atmospheric circulations. We find indications for tipping in the ocean overturning circulations and the West African monsoon, with potentially severe impacts on the Earth system and humans. Tipping in the other considered systems is considered conceivable but currently not sufficiently supported by evidence.
Emma Holmberg, Gabriele Messori, Rodrigo Caballero, and Davide Faranda
Earth Syst. Dynam., 14, 737–765, https://doi.org/10.5194/esd-14-737-2023, https://doi.org/10.5194/esd-14-737-2023, 2023
Short summary
Short summary
We analyse the duration of large-scale patterns of air movement in the atmosphere, referred to as persistence, and whether unusually persistent patterns favour warm-temperature extremes in Europe. We see no clear relationship between summertime heatwaves and unusually persistent patterns. This suggests that heatwaves do not necessarily require the continued flow of warm air over a region and that local effects could be important for their occurrence.
Axel Kleidon, Gabriele Messori, Somnath Baidya Roy, Ira Didenkulova, and Ning Zeng
Earth Syst. Dynam., 14, 241–242, https://doi.org/10.5194/esd-14-241-2023, https://doi.org/10.5194/esd-14-241-2023, 2023
Patrick Johannes Stoll, Rune Grand Graversen, and Gabriele Messori
Weather Clim. Dynam., 4, 1–17, https://doi.org/10.5194/wcd-4-1-2023, https://doi.org/10.5194/wcd-4-1-2023, 2023
Short summary
Short summary
The atmosphere is in motion and hereby transporting warm, cold, moist, and dry air to different climate zones. In this study, we investigate how this transport of energy organises in different manners. Outside the tropics, atmospheric waves of sizes between 2000 and 8000 km, which we perceive as cyclones from the surface, transport most of the energy and moisture poleward. In the winter, large-scale weather situations become very important for transporting energy into the polar regions.
Davide Faranda, Stella Bourdin, Mireia Ginesta, Meriem Krouma, Robin Noyelle, Flavio Pons, Pascal Yiou, and Gabriele Messori
Weather Clim. Dynam., 3, 1311–1340, https://doi.org/10.5194/wcd-3-1311-2022, https://doi.org/10.5194/wcd-3-1311-2022, 2022
Short summary
Short summary
We analyze the atmospheric circulation leading to impactful extreme events for the calendar year 2021 such as the Storm Filomena, Westphalia floods, Hurricane Ida and Medicane Apollo. For some of the events, we find that climate change has contributed to their occurrence or enhanced their intensity; for other events, we find that they are unprecedented. Our approach underscores the importance of considering changes in the atmospheric circulation when performing attribution studies.
Gabriele Messori, Marlene Kretschmer, Simon H. Lee, and Vivien Wendt
Weather Clim. Dynam., 3, 1215–1236, https://doi.org/10.5194/wcd-3-1215-2022, https://doi.org/10.5194/wcd-3-1215-2022, 2022
Short summary
Short summary
Over 10 km above the ground, there is a region of the atmosphere called the stratosphere. While there is very little air in the stratosphere itself, its interactions with the lower parts of the atmosphere – where we live – can affect the weather. Here we study a specific example of such an interaction, whereby processes occurring at the boundary of the stratosphere can lead to a continent-wide drop in temperatures in North America during winter.
Valerio Lembo, Federico Fabiano, Vera Melinda Galfi, Rune Grand Graversen, Valerio Lucarini, and Gabriele Messori
Weather Clim. Dynam., 3, 1037–1062, https://doi.org/10.5194/wcd-3-1037-2022, https://doi.org/10.5194/wcd-3-1037-2022, 2022
Short summary
Short summary
Eddies in mid-latitudes characterize the exchange of heat between the tropics and the poles. This exchange is largely uneven, with a few extreme events bearing most of the heat transported across latitudes in a season. It is thus important to understand what the dynamical mechanisms are behind these events. Here, we identify recurrent weather regime patterns associated with extreme transports, and we identify scales of mid-latitudinal eddies that are mostly responsible for the transport.
Assaf Hochman, Francesco Marra, Gabriele Messori, Joaquim G. Pinto, Shira Raveh-Rubin, Yizhak Yosef, and Georgios Zittis
Earth Syst. Dynam., 13, 749–777, https://doi.org/10.5194/esd-13-749-2022, https://doi.org/10.5194/esd-13-749-2022, 2022
Short summary
Short summary
Gaining a complete understanding of extreme weather, from its physical drivers to its impacts on society, is important in supporting future risk reduction and adaptation measures. Here, we provide a review of the available scientific literature, knowledge gaps and key open questions in the study of extreme weather events over the vulnerable eastern Mediterranean region.
Francesco S. R. Pausata, Gabriele Messori, Jayoung Yun, Chetankumar A. Jalihal, Massimo A. Bollasina, and Thomas M. Marchitto
Clim. Past, 17, 1243–1271, https://doi.org/10.5194/cp-17-1243-2021, https://doi.org/10.5194/cp-17-1243-2021, 2021
Short summary
Short summary
Far-afield changes in vegetation such as those that occurred over the Sahara during the middle Holocene and the consequent changes in dust emissions can affect the intensity of the South Asian Monsoon (SAM) rainfall and the lengthening of the monsoon season. This remote influence is mediated by anomalies in Indian Ocean sea surface temperatures and may have shaped the evolution of the SAM during the termination of the African Humid Period.
Gabriele Messori and Davide Faranda
Clim. Past, 17, 545–563, https://doi.org/10.5194/cp-17-545-2021, https://doi.org/10.5194/cp-17-545-2021, 2021
Short summary
Short summary
The palaeoclimate community must both analyse large amounts of model data and compare very different climates. Here, we present a seemingly very abstract analysis approach that may be fruitfully applied to palaeoclimate numerical simulations. This approach characterises the dynamics of a given climate through a small number of metrics and is thus suited to face the above challenges.
Gabriele Messori, Nili Harnik, Erica Madonna, Orli Lachmy, and Davide Faranda
Earth Syst. Dynam., 12, 233–251, https://doi.org/10.5194/esd-12-233-2021, https://doi.org/10.5194/esd-12-233-2021, 2021
Short summary
Short summary
Atmospheric jets are a key component of the climate system and of our everyday lives. Indeed, they affect human activities by influencing the weather in many mid-latitude regions. However, we still lack a complete understanding of their dynamical properties. In this study, we try to relate the understanding gained in idealized computer simulations of the jets to our knowledge from observations of the real atmosphere.
Assaf Hochman, Sebastian Scher, Julian Quinting, Joaquim G. Pinto, and Gabriele Messori
Earth Syst. Dynam., 12, 133–149, https://doi.org/10.5194/esd-12-133-2021, https://doi.org/10.5194/esd-12-133-2021, 2021
Short summary
Short summary
Skillful forecasts of extreme weather events have a major socioeconomic relevance. Here, we compare two approaches to diagnose the predictability of eastern Mediterranean heat waves: one based on recent developments in dynamical systems theory and one leveraging numerical ensemble weather forecasts. We conclude that the former can be a useful and cost-efficient complement to conventional numerical forecasts for understanding the dynamics of eastern Mediterranean heat waves.
Cited articles
Abrahams, A., Schlegel, R. W., and Smit, A. J.: Variation and Change of Upwelling Dynamics Detected in the World’s Eastern Boundary Upwelling Systems, Frontiers in Marine Science, 8, https://doi.org/10.3389/fmars.2021.626411, 2021. a
Arellano, M.: PRACTITIONERS’ CORNER: Computing Robust Standard Errors for Within-groups Estimators, Oxford B. Econ. Stat., 49, 431–434, https://doi.org/10.1111/j.1468-0084.1987.mp49004006.x, 1987. a
Benjamini, Y. and Hochberg, Y.: Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing, J. R. Stat. Soc. B, 57, 289–300, https://www.jstor.org/stable/2346101 (last access: 28 October 2024), 1995. a
Beucler, T., Pritchard, M., Gentine, P., and Rasp, S.: Towards Physically-Consistent, Data-Driven Models of Convection, in: IGARSS 2020–2020 IEEE International Geoscience and Remote Sensing Symposium, 26 September–2 October 2020, Waikoloa, HI, USA, online, 3987–3990, https://doi.org/10.1109/IGARSS39084.2020.9324569, 2020. a
Bi, K., Xie, L., Zhang, H., Chen, X., Gu, X., and Tian, Q.: Pangu-Weather: A 3D High-Resolution Model for Fast and Accurate Global Weather Forecast, arXiv [preprint], https://doi.org/10.48550/arXiv.2211.02556, 2022. a
Blanchonnet, H.: IFS documentation, https://www.ecmwf.int/en/publications/ifs-documentation (last access: 27 October 2024), 2022. a
Bonavita, M.: On Some Limitations of Current Machine Learning Weather Prediction Models, Geophys. Res. Lett., 51, e2023GL107377, https://doi.org/10.1029/2023GL107377, 2024. a, b, c, d
Bouallègue, Z. B., Clare, M. C. A., Magnusson, L., Gascón, E., Maier-Gerber, M., Janoušek, M., Rodwell, M., Pinault, F., Dramsch, J. S., Lang, S. T. K., Raoult, B., Rabier, F., Chevallier, M., Sandu, I., Dueben, P., Chantry, M., and Pappenberger, F.: The rise of data-driven weather forecasting: A first statistical assessment of machine learning-based weather forecasts in an operational-like context, B. Am. Meteorol. Soc., 105, E864–E883, https://doi.org/10.1175/BAMS-D-23-0162.1, 2024. a, b
Cameron, A. C. and Miller, D. L.: A Practitioner’s Guide to Cluster-Robust Inference, J. Hum. Resour., 50, 317–372, https://doi.org/10.3368/jhr.50.2.317, 2015. a
Charlton-Perez, A. J., Dacre, H. F., Driscoll, S., Gray, S. L., Harvey, B., Harvey, N. J., Hunt, K. M. R., Lee, R. W., Swaminathan, R., Vandaele, R., and Volonté, A.: Do AI models produce better weather forecasts than physics-based models? A quantitative evaluation case study of Storm Ciarán, npj Climate and Atmospheric Science, 7, 93, https://doi.org/10.1038/s41612-024-00638-w, 2024. a
Chartrand, J. and Pausata, F. S. R.: Impacts of the North Atlantic Oscillation on winter precipitations and storm track variability in southeast Canada and the northeast United States, Weather Clim. Dynam., 1, 731–744, https://doi.org/10.5194/wcd-1-731-2020, 2020. a
Chen, K., Han, T., Gong, J., Bai, L., Ling, F., Luo, J.-J., Chen, X., Ma, L., Zhang, T., Su, R., Ci, Y., Li, B., Yang, X., and Ouyang, W.: FengWu: Pushing the Skillful Global Medium-range Weather Forecast beyond 10 Days Lead, arXiv [preprint], https://doi.org/10.48550/arXiv.2304.02948, 2023a. a
Chiang, J. C. H., Kushnir, Y., and Giannini, A.: Deconstructing Atlantic Intertropical Convergence Zone variability: Influence of the local cross-equatorial sea surface temperature gradient and remote forcing from the eastern equatorial Pacific, J. Geophys. Res.-Atmos., 107, ACL 3-1–ACL 3-19, https://doi.org/10.1029/2000JD000307, 2002. a
Cisneros, D., Richards, J., Dahal, A., Lombardo, L., and Huser, R.: Deep graphical regression for jointly moderate and extreme Australian wildfires, arXiv [preprint], https://doi.org/10.48550/arXiv.2308.14547, 2023. a
Clare, M. C., Jamil, O., and Morcrette, C. J.: Combining distribution-based neural networks to predict weather forecast probabilities, Q. J. Roy. Meteor. Soc., 147, 4337–4357, https://doi.org/10.1002/qj.4180, 2021. a, b
Coronato, T., Carril, A. F., Zaninelli, P. G., Giles, J., Ruscica, R., Falco, M., Sörensson, A. A., Fita, L., Li, L. Z. X., and Menéndez, C. G.: The impact of soil moisture–atmosphere coupling on daily maximum surface temperatures in Southeastern South America, Clim. Dynam., 55, 2543–2556, https://doi.org/10.1007/s00382-020-05399-9, 2020. a
de Burgh-Day, C. O. and Leeuwenburg, T.: Machine learning for numerical weather and climate modelling: a review, Geosci. Model Dev., 16, 6433–6477, https://doi.org/10.5194/gmd-16-6433-2023, 2023. a, b
Dosovitskiy, A., Beyer, L., Kolesnikov, A., Weissenborn, D., Zhai, X., Unterthiner, T., Dehghani, M., Minderer, M., Heigold, G., Gelly, S., Uszkoreit, J., and Houlsby, N.: An Image is Worth 16×16 Words: Transformers for Image Recognition at Scale, in: International Conference on Learning Representations, Vienna, 4 May 2021, https://openreview.net/forum?id=YicbFdNTTy (last access: 28 October 2024), 2020. a, b, c
Goddard, L. and Gershunov, A.: Impact of El Niño on Weather and Climate Extremes, in: El Niño Southern Oscillation in a Changing Climate, American Geophysical Union (AGU), 361–375, ISBN 978-1-119-54816-4, https://doi.org/10.1002/9781119548164.ch16, 2020. a
Guastavino, S., Piana, M., Tizzi, M., Cassola, F., Iengo, A., Sacchetti, D., Solazzo, E., and Benvenuto, F.: Prediction of severe thunderstorm events with ensemble deep learning and radar data, Scientific Reports, 12, 20049, https://doi.org/10.1038/s41598-022-23306-6, 2022. a
Hall, T., Brooks, H. E., and Doswell, C. A.: Precipitation Forecasting Using a Neural Network, Weather Forecast., 14, 338–345, https://doi.org/10.1175/1520-0434(1999)014<0338:PFUANN>2.0.CO;2, 1999. a
Hersbach, H., Bell, B., Berrisford, P., Hirahara, S., Horányi, A., Muñoz-Sabater, J., Nicolas, J., Peubey, C., Radu, R., Schepers, D., Simmons, A., Soci, C., Abdalla, S., Abellan, X., Balsamo, G., Bechtold, P., Biavati, G., Bidlot, J., Bonavita, M., De Chiara, G., Dahlgren, P., Dee, D., Diamantakis, M., Dragani, R., Flemming, J., Forbes, R., Fuentes, M., Geer, A., Haimberger, L., Healy, S., Hogan, R. J., Hólm, E., Janisková, M., Keeley, S., Laloyaux, P., Lopez, P., Lupu, C., Radnoti, G., de Rosnay, P., Rozum, I., Vamborg, F., Villaume, S., and Thépaut, J.-N.: The ERA5 global reanalysis, Q. J. Roy. Meteor. Soc., 146, 1999–2049, https://doi.org/10.1002/qj.3803, 2020. a, b, c
Hersbach, H., Bell, B., Berrisford, P., Biavati, G., Horányi, A., Muñoz Sabater, J., Nicolas, J., Peubey, C., Radu, R., Rozum, I., Schepers, D., Simmons, A., Soci, C., Dee, D., and Thépaut, J.-N.: ERA5 hourly data on single levels from 1940 to present, Copernicus Climate Change Service (C3S) Climate Data Store (CDS) [data set], https://doi.org/10.24381/cds.adbb2d47, 2023a. a
Hersbach, H., Bell, B., Berrisford, P., Biavati, G., Horányi, A., Muñoz Sabater, J., Nicolas, J., Peubey, C., Radu, R., Rozum, I., Schepers, D., Simmons, A., Soci, C., Dee, D., and Thépaut, J.-N.: ERA5 hourly data on pressure levels from 1940 to present, Copernicus Climate Change Service (C3S) Climate Data Store (CDS) [data set], https://doi.org/10.24381/cds.bd0915c6, 2023b. a
Hu, Y., Chen, L., Wang, Z., and Li, H.: SwinVRNN: A Data-Driven Ensemble Forecasting Model via Learned Distribution Perturbation, J. Adv. Model. Earth Sy., 15, e2022MS003211, https://doi.org/10.1029/2022MS003211, 2023. a
Jacox, M. G., Bograd, S. J., Hazen, E. L., and Fiechter, J.: Sensitivity of the California Current nutrient supply to wind, heat, and remote ocean forcing, Geophys. Res. Lett., 42, 5950–5957, https://doi.org/10.1002/2015GL065147, 2015. a
Kashinath, K., Mustafa, M., Albert, A., Wu, J.-L., Jiang, C., Esmaeilzadeh, S., Azizzadenesheli, K., Wang, R., Chattopadhyay, A., Singh, A., Manepalli, A., Chirila, D., Yu, R., Walters, R., White, B., Xiao, H., Tchelepi, H. A., Marcus, P., Anandkumar, A., Hassanzadeh, P., and Prabhat, N.: Physics-informed machine learning: case studies for weather and climate modelling, Philos. T. R. Soc. A, 379, 20200093, https://doi.org/10.1098/rsta.2020.0093, 2021. a, b
Keisler, R.: Forecasting Global Weather with Graph Neural Networks, arXiv [preprint], https://doi.org/10.48550/arXiv.2202.07575, 2022. a, b
Kochkov, D., Yuval, J., Langmore, I., Norgaard, P., Smith, J., Mooers, G., Klöwer, M., Lottes, J., Rasp, S., Düben, P., Hatfield, S., Battaglia, P., Sanchez-Gonzalez, A., Willson, M., Brenner, M. P., and Hoyer, S.: Neural general circulation models for weather and climate, Nature, 632, 1060–1066, https://doi.org/10.1038/s41586-024-07744-y, 2024. a
Kron, W., Löw, P., and Kundzewicz, Z. W.: Changes in risk of extreme weather events in Europe, Environ. Sci. Policy, 100, 74–83, https://doi.org/10.1016/j.envsci.2019.06.007, 2019. a
Lam, R., Sanchez-Gonzalez, A., Willson, M., Wirnsberger, P., Fortunato, M., Pritzel, A., Ravuri, S., Ewalds, T., Alet, F., Eaton-Rosen, Z., Hu, W., Merose, A., Hoyer, S., Holland, G., Stott, J., Vinyals, O., Mohamed, S., and Battaglia, P.: GraphCast: Learning skillful medium-range global weather forecasting, arXiv [preprint], https://doi.org/10.48550/arXiv.2212.12794, 2022. a
Lam, R., Sanchez-Gonzalez, A., Willson, M., Wirnsberger, P., Fortunato, M., Alet, F., Ravuri, S., Ewalds, T., Eaton-Rosen, Z., Hu, W., Merose, A., Hoyer, S., Holland, G., Vinyals, O., Stott, J., Pritzel, A., Mohamed, S., and Battaglia, P.: Learning skillful medium-range global weather forecasting, Science, 382, 1416–1421, https://doi.org/10.1126/science.adi2336, 2023. a, b, c, d, e, f, g, h, i
Lang, S., Alexe, M., Chantry, M., Dramsch, J., Pinault, F., Raoult, B., Clare, M. C. A., Lessig, C., Maier-Gerber, M., Magnusson, L., Bouallègue, Z. B., Nemesio, A. P., Dueben, P. D., Brown, A., Pappenberger, F., and Rabier, F.: AIFS – ECMWF's data-driven forecasting system, arXiv [preprint], https://doi.org/10.48550/arXiv.2406.01465, 2024. a, b
Lemos, R. T. and Pires, H. O.: The upwelling regime off the West Portuguese Coast, 1941–2000, Int. J. Climatol., 24, 511–524, https://doi.org/10.1002/joc.1009, 2004. a
Lerch, S., Thorarinsdottir, T. L., Ravazzolo, F., and Gneiting, T.: Forecaster’s Dilemma: Extreme Events and Forecast Evaluation, Stat. Sci., 32, 106–127, https://doi.org/10.1214/16-STS588, 2017. a
Liang, K.-Y. and Zeger, S. L.: Longitudinal data analysis using generalized linear models, Biometrika, 73, 13–22, https://doi.org/10.1093/biomet/73.1.13, 1986. a
Liu, D., Wang, G., Mei, R., Yu, Z., and Yu, M.: Impact of initial soil moisture anomalies on climate mean and extremes over Asia, J. Geophys. Res.-Atmos., 119, 529–545, https://doi.org/10.1002/2013JD020890, 2014. a
Luo, M. and Lau, N.-C.: Summer heat extremes in northern continents linked to developing ENSO events, Environ. Res. Lett., 15, 074042, https://doi.org/10.1088/1748-9326/ab7d07, 2020. a
Merz, B., Kuhlicke, C., Kunz, M., Pittore, M., Babeyko, A., Bresch, D. N., Domeisen, D. I. V., Feser, F., Koszalka, I., Kreibich, H., Pantillon, F., Parolai, S., Pinto, J. G., Punge, H. J., Rivalta, E., Schröter, K., Strehlow, K., Weisse, R., and Wurpts, A.: Impact Forecasting to Support Emergency Management of Natural Hazards, Rev. Geophys., 58, e2020RG000704, https://doi.org/10.1029/2020RG000704, 2020. a
Molina, M. J., O’Brien, T. A., Anderson, G., Ashfaq, M., Bennett, K. E., Collins, W. D., Dagon, K., Restrepo, J. M., and Ullrich, P. A.: A Review of Recent and Emerging Machine Learning Applications for Climate Variability and Weather Phenomena, Artif. Intell. Earth Syst., 2, 220086, https://doi.org/10.1175/AIES-D-22-0086.1, 2023. a
Nguyen, T., Brandstetter, J., Kapoor, A., Gupta, J. K., and Grover, A.: ClimaX: A foundation model for weather and climate, arXiv [preprint], https://doi.org/10.48550/arXiv.2301.10343, 2023. a
Olivetti, L.: LeonardoOlivetti/Do-data-driven-models-beat-numerical-models-in-forecasting-weather-extremes-: Updated code after first round of revisions, Zenodo [software], https://doi.org/10.5281/zenodo.13329880, 2024. a
Olivetti, L. and Messori, G.: Advances and prospects of deep learning for medium-range extreme weather forecasting, Geosci. Model Dev., 17, 2347–2358, https://doi.org/10.5194/gmd-17-2347-2024, 2024. a, b, c
Oskarsson, J., Landelius, T., Deisenroth, M. P., and Lindsten, F.: Probabilistic Weather Forecasting with Hierarchical Graph Neural Networks, arXiv [preprint], https://doi.org/10.48550/arXiv.2406.04759, 2024. a
Pathak, J., Subramanian, S., Harrington, P., Raja, S., Chattopadhyay, A., Mardani, M., Kurth, T., Hall, D., Li, Z., Azizzadenesheli, K., Hassanzadeh, P., Kashinath, K., and Anandkumar, A.: FourCastNet: A Global Data-driven High-resolution Weather Model using Adaptive Fourier Neural Operators, arXiv [preprint], https://doi.org/10.48550/arXiv.2202.11214, 2022. a
Price, I., Sanchez-Gonzalez, A., Alet, F., Andersson, T. R., El-Kadi, A., Masters, D., Ewalds, T., Stott, J., Mohamed, S., Battaglia, P., Lam, R., and Willson, M.: GenCast: Diffusion-based ensemble forecasting for medium-range weather, arXiv [preprint], https://doi.org/10.48550/arXiv.2312.15796, 2024. a, b, c, d, e
Rasp, S., Dueben, P. D., Scher, S., Weyn, J. A., Mouatadid, S., and Thuerey, N.: WeatherBench: A Benchmark Data Set for Data-Driven Weather Forecasting, J. Adv. Model. Earth Sy., 12, e2020MS002203, https://doi.org/10.1029/2020MS002203, 2020. a
Rasp, S., Hoyer, S., Merose, A., Langmore, I., Battaglia, P., Russell, T., Sanchez-Gonzalez, A., Yang, V., Carver, R., Agrawal, S., Chantry, M., Ben Bouallegue, Z., Dueben, P., Bromberg, C., Sisk, J., Barrington, L., Bell, A., and Sha, F.: WeatherBench 2: A Benchmark for the Next Generation of Data-Driven Global Weather Models, J. Adv. Model. Earth Sy., 16, e2023MS004019, https://doi.org/10.1029/2023MS004019, 2024. a, b, c, d, e, f, g, h, i, j, k, l, m, n, o
Scarselli, F., Gori, M., Tsoi, A. C., Hagenbuchner, M., and Monfardini, G.: The Graph Neural Network Model, IEEE T. Neural Networ., 20, 61–80, https://doi.org/10.1109/TNN.2008.2005605, 2009. a, b
Scher, S. and Messori, G.: Ensemble Methods for Neural Network-Based Weather Forecasts, J. Adv. Model. Earth Sy., 13, e2020MS002331, https://doi.org/10.1029/2020MS002331, 2021. a, b
Schizas, C., Michaelides, S., Pattichis, C., and Livesay, R.: Artificial neural networks in forecasting minimum temperature (weather), in: 1991 Second International Conference on Artificial Neural Networks, Bournemouth, UK, 18–20 November 1991, 112–114, https://ieeexplore.ieee.org/abstract/document/140297 (last access: 28 October 2024) 1991. a
Taggart, R.: Evaluation of point forecasts for extreme events using consistent scoring functions, Q. J. Roy. Meteor. Soc., 148, 306–320, https://doi.org/10.1002/qj.4206, 2022. a, b, c
Wilks, D. S.: “The Stippling Shows Statistically Significant Grid Points”: How Research Results are Routinely Overstated and Overinterpreted, and What to Do about It, B. Am. Meteorol. Soc., 97, 2263–2273, https://doi.org/10.1175/BAMS-D-15-00267.1, 2016. a, b
World Meteorological Organization: Early warnings for all: Executive action plan 2023–2027, https://www.preventionweb.net/publication/early-warnings-all-executive-action-plan-2023-2027 (last access: 28 October 2024), 2022. a
Xu, W., Chen, K., Han, T., Chen, H., Ouyang, W., and Bai, L.: ExtremeCast: Boosting Extreme Value Prediction for Global Weather Forecast, arXiv [preprint], https://doi.org/10.48550/arXiv.2402.01295, 2024. a
Zhang, Y., Long, M., Chen, K., Xing, L., Jin, R., Jordan, M. I., and Wang, J.: Skilful nowcasting of extreme precipitation with NowcastNet, Nature, 619, 526–532, https://doi.org/10.1038/s41586-023-06184-4, 2023. a
Short summary
Data-driven models are becoming a viable alternative to physics-based models for weather forecasting up to 15 d into the future. However, it is unclear whether they are as reliable as physics-based models when forecasting weather extremes. We evaluate their performance in forecasting near-surface cold, hot, and windy extremes globally. We find that data-driven models can compete with physics-based models and that the choice of the best model mainly depends on the region and type of extreme.
Data-driven models are becoming a viable alternative to physics-based models for weather...
