Articles | Volume 18, issue 17
https://doi.org/10.5194/gmd-18-5873-2025
https://doi.org/10.5194/gmd-18-5873-2025
Development and technical paper
 | 
10 Sep 2025
Development and technical paper |  | 10 Sep 2025

Statistical summaries for streamed data from climate simulations: one-pass algorithms

Katherine Grayson, Stephan Thober, Aleksander Lacima-Nadolnik, Ivan Alsina-Ferrer, Llorenç Lledó, Ehsan Sharifi, and Francisco Doblas-Reyes

Related authors

The Destination Earth digital twin for climate change adaptation
Francisco J. Doblas-Reyes, Jenni Kontkanen, Irina Sandu, Mario Acosta, Mohammed Hussam Al Turjmam, Ivan Alsina-Ferrer, Miguel Andrés-Martínez, Leo Arriola, Marvin Axness, Marc Batlle Martín, Peter Bauer, Tobias Becker, Daniel Beltrán, Sebastian Beyer, Hendryk Bockelmann, Pierre-Antoine Bretonnière, Sebastien Cabaniols, Silvia Caprioli, Miguel Castrillo, Aparna Chandrasekar, Suvarchal Cheedela, Victor Correal, Emanuele Danovaro, Paolo Davini, Jussi Enkovaara, Claudia Frauen, Barbara Früh, Aina Gaya Àvila, Paolo Ghinassi, Rohit Ghosh, Supriyo Ghosh, Iker González, Katherine Grayson, Matthew Griffith, Ioan Hadade, Christopher Haine, Carl Hartick, Utz-Uwe Haus, Shane Hearne, Heikki Järvinen, Bernat Jiménez, Amal John, Marlin Juchem, Thomas Jung, Jessica Kegel, Matthias Kelbling, Kai Keller, Bruno Kinoshita, Theresa Kiszler, Daniel Klocke, Lukas Kluft, Nikolay Koldunov, Tobias Kölling, Joonas Kolstela, Luis Kornblueh, Sergey Kosukhin, Aleksander Lacima-Nadolnik, Jeisson Javier Leal Rojas, Jonni Lehtiranta, Tuomas Lunttila, Anna Luoma, Pekka Manninen, Alexey Medvedev, Sebastian Milinski, Ali Omar Abdelazim Mohammed, Sebastian Müller, Devaraju Naryanappa, Natalia Nazarova, Sami Niemelä, Bimochan Niraula, Henrik Nortamo, Aleksi Nummelin, Matteo Nurisso, Pablo Ortega, Stella Paronuzzi, Xabier Pedruzo Bagazgoitia, Charles Pelletier, Carlos Peña, Suraj Polade, Himansu Pradhan, Rommel Quintanilla, Tiago Quintino, Thomas Rackow, Jouni Räisänen, Maqsood Mubarak Rajput, René Redler, Balthasar Reuter, Nuno Rocha Monteiro, Francesc Roura-Adserias, Silva Ruppert, Susan Sayed, Reiner Schnur, Tanvi Sharma, Dmitry Sidorenko, Outi Sievi-Korte, Albert Soret, Christian Steger, Bjorn Stevens, Jan Streffing, Jaleena Sunny, Luiggi Tenorio, Stephan Thober, Ulf Tigerstedt, Oriol Tinto, Juha Tonttila, Heikki Tuomenvirta, Lauri Tuppi, Ginka Van Thielen, Emanuele Vitali, Jost von Hardenberg, Ingo Wagner, Nils Wedi, Jan Wehner, Sven Willner, Xavier Yepes-Arbós, Florian Ziemen, and Janos Zimmermann
EGUsphere, https://doi.org/10.5194/egusphere-2025-2198,https://doi.org/10.5194/egusphere-2025-2198, 2025
This preprint is open for discussion and under review for Geoscientific Model Development (GMD).
Short summary
nextGEMS: entering the era of kilometer-scale Earth system modeling
Hans Segura, Xabier Pedruzo-Bagazgoitia, Philipp Weiss, Sebastian K. Müller, Thomas Rackow, Junhong Lee, Edgar Dolores-Tesillos, Imme Benedict, Matthias Aengenheyster, Razvan Aguridan, Gabriele Arduini, Alexander J. Baker, Jiawei Bao, Swantje Bastin, Eulàlia Baulenas, Tobias Becker, Sebastian Beyer, Hendryk Bockelmann, Nils Brüggemann, Lukas Brunner, Suvarchal K. Cheedela, Sushant Das, Jasper Denissen, Ian Dragaud, Piotr Dziekan, Madeleine Ekblom, Jan Frederik Engels, Monika Esch, Richard Forbes, Claudia Frauen, Lilli Freischem, Diego García-Maroto, Philipp Geier, Paul Gierz, Álvaro González-Cervera, Katherine Grayson, Matthew Griffith, Oliver Gutjahr, Helmuth Haak, Ioan Hadade, Kerstin Haslehner, Shabeh ul Hasson, Jan Hegewald, Lukas Kluft, Aleksei Koldunov, Nikolay Koldunov, Tobias Kölling, Shunya Koseki, Sergey Kosukhin, Josh Kousal, Peter Kuma, Arjun U. Kumar, Rumeng Li, Nicolas Maury, Maximilian Meindl, Sebastian Milinski, Kristian Mogensen, Bimochan Niraula, Jakub Nowak, Divya Sri Praturi, Ulrike Proske, Dian Putrasahan, René Redler, David Santuy, Domokos Sármány, Reiner Schnur, Patrick Scholz, Dmitry Sidorenko, Dorian Spät, Birgit Sützl, Daisuke Takasuka, Adrian Tompkins, Alejandro Uribe, Mirco Valentini, Menno Veerman, Aiko Voigt, Sarah Warnau, Fabian Wachsmann, Marta Wacławczyk, Nils Wedi, Karl-Hermann Wieners, Jonathan Wille, Marius Winkler, Yuting Wu, Florian Ziemen, Janos Zimmermann, Frida A.-M. Bender, Dragana Bojovic, Sandrine Bony, Simona Bordoni, Patrice Brehmer, Marcus Dengler, Emanuel Dutra, Saliou Faye, Erich Fischer, Chiel van Heerwaarden, Cathy Hohenegger, Heikki Järvinen, Markus Jochum, Thomas Jung, Johann H. Jungclaus, Noel S. Keenlyside, Daniel Klocke, Heike Konow, Martina Klose, Szymon Malinowski, Olivia Martius, Thorsten Mauritsen, Juan Pedro Mellado, Theresa Mieslinger, Elsa Mohino, Hanna Pawłowska, Karsten Peters-von Gehlen, Abdoulaye Sarré, Pajam Sobhani, Philip Stier, Lauri Tuppi, Pier Luigi Vidale, Irina Sandu, and Bjorn Stevens
EGUsphere, https://doi.org/10.5194/egusphere-2025-509,https://doi.org/10.5194/egusphere-2025-509, 2025
Short summary

Cited articles

Alsina-Ferrer, I. and Grayson, K: DestinE-Climate-DT/one_pass: v0.8.0, Zenodo [code], https://doi.org/10.5281/zenodo.15438184, 2025a. a, b
Alsina-Ferrer, I. and Grayson, K: kat-grayson/one_pass_algorithms_paper: v0.5.0, Zenodo [code], https://doi.org/10.5281/zenodo.15439803, 2025b. a
Asadieh, B. and Krakauer, N. Y.: Global trends in extreme precipitation: climate models versus observations, Hydrol. Earth Syst. Sci., 19, 877–891, https://doi.org/10.5194/hess-19-877-2015, 2015. a
Bador, M., Boé, J., Terray, L., Alexander, L. V., Baker, A., Bellucci, A., Haarsma, R., Koenigk, T., Moine, M. P., Lohmann, K., Putrasahan, D. A., Roberts, C., Roberts, M., Scoccimarro, E., Schiemann, R., Seddon, J., Senan, R., Valcke, S., and Vanniere, B.: Impact of Higher Spatial Atmospheric Resolution on Precipitation Extremes Over Land in Global Climate Models, J. Geophys. Res.-Atmos., 125, https://doi.org/10.1029/2019JD032184, 2020. a
Bauer, P., Stevens, B., and Hazeleger, W.: A digital twin of Earth for the green transition, Nat. Clim. Change, 11, 80–83, https://doi.org/10.1038/s41558-021-00986-y, 2021. a, b, c, d
Download
Short summary
We present One_Pass (v0.8.0), a Python package enabling computation of statistics from streamed global climate model output using one-pass algorithms. Users often need statistics covering periods longer than the stream duration, requiring algorithms that do not store full time series. One-pass methods address this need while avoiding full data archiving, offering memory-efficient, accurate results for high-performance computing (HPC) workflows and downstream applications like bias adjustment.
Share