Articles | Volume 18, issue 23
https://doi.org/10.5194/gmd-18-9709-2025
© Author(s) 2025. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
https://doi.org/10.5194/gmd-18-9709-2025
© Author(s) 2025. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
Development and technical paper
| 
05 Dec 2025
Development and technical paper |
| 05 Dec 2025
| 05 Dec 2025
Evaluating the impact of task aggregation in workflows with shared resource environments: use case for the MONARCH application
Barcelona Supercomputing Center (BSC), Plaça Eusebi Güell, 1–3, Barcelona, Spain
Universitat Politècnica de Catalunya (UPC), Carrer Jordi Girona, 1–3, Barcelona, Spain
Miguel Castrillo
Barcelona Supercomputing Center (BSC), Plaça Eusebi Güell, 1–3, Barcelona, Spain
Gladys Utrera
Universitat Politècnica de Catalunya (UPC), Carrer Jordi Girona, 1–3, Barcelona, Spain
Barcelona Supercomputing Center (BSC), Plaça Eusebi Güell, 1–3, Barcelona, Spain
Barcelona Supercomputing Center (BSC), Plaça Eusebi Güell, 1–3, Barcelona, Spain
Bruno P. Kinoshita
Barcelona Supercomputing Center (BSC), Plaça Eusebi Güell, 1–3, Barcelona, Spain
Francisco Doblas-Reyes
Barcelona Supercomputing Center (BSC), Plaça Eusebi Güell, 1–3, Barcelona, Spain
Institució Catalana de Recerca i Estudis Avançats (ICREA), Barcelona, Spain
Related authors
Pablo Goitia, Manuel G. Marciani, Miguel Castrillo, and Mario C. Acosta
EGUsphere, https://doi.org/10.5194/egusphere-2026-539, https://doi.org/10.5194/egusphere-2026-539, 2026
This preprint is open for discussion and under review for Geoscientific Model Development (GMD).
Short summary
Short summary
Earth System Model workflows commonly run on highly congested high-performance computing platforms, meaning that each individual workflow task potentially faces lengthy waiting times in the queues of the schedulers. In this work, we evaluate the task aggregation approach in EC-Earth3 workflows to reduce the queue times and, consequently, the total execution time. The results show an increase of up to 23.04 % in the actual simulated years per day, with queuing times reduced by up to 12.33 times.
Pablo Goitia, Manuel G. Marciani, Miguel Castrillo, and Mario C. Acosta
EGUsphere, https://doi.org/10.5194/egusphere-2026-539, https://doi.org/10.5194/egusphere-2026-539, 2026
This preprint is open for discussion and under review for Geoscientific Model Development (GMD).
Short summary
Short summary
Earth System Model workflows commonly run on highly congested high-performance computing platforms, meaning that each individual workflow task potentially faces lengthy waiting times in the queues of the schedulers. In this work, we evaluate the task aggregation approach in EC-Earth3 workflows to reduce the queue times and, consequently, the total execution time. The results show an increase of up to 23.04 % in the actual simulated years per day, with queuing times reduced by up to 12.33 times.
Francisco J. Doblas-Reyes, Jenni Kontkanen, Irina Sandu, Mario Acosta, Mohammed Hussam Al Turjmam, Ivan Alsina-Ferrer, Miguel Andrés-Martínez, Costanza Anerdi, Leo Arriola, Marvin Axness, Marc Batlle Martín, Peter Bauer, Tobias Becker, Daniel Beltrán, Sebastian Beyer, Hendryk Bockelmann, Pierre-Antoine Bretonnière, Sebastien Cabaniols, Silvia Caprioli, Miguel Castrillo, Aparna Chandrasekar, Suvarchal Cheedela, Victor Correal, Emanuele Danovaro, Paolo Davini, Jussi Enkovaara, Claudia Frauen, Barbara Früh, Aina Gaya Àvila, Paolo Ghinassi, Rohit Ghosh, Supriyo Ghosh, Iker González, Katherine Grayson, Matthew Griffith, Ioan Hadade, Christopher Haine, Carl Hartick, Utz-Uwe Haus, Shane Hearne, Heikki Järvinen, Bernat Jiménez, Amal John, Marlin Juchem, Thomas Jung, Jessica Kegel, Matthias Kelbling, Kai Keller, Bruno Kinoshita, Theresa Kiszler, Daniel Klocke, Lukas Kluft, Nikolay Koldunov, Tobias Kölling, Joonas Kolstela, Luis Kornblueh, Sergey Kosukhin, Aleksander Lacima-Nadolnik, Jeisson Javier Leal Rojas, Jonni Lehtiranta, Tuomas Lunttila, Anna Luoma, Pekka Manninen, Alexey Medvedev, Sebastian Milinski, Ali Mohammed, Sebastian Müller, Devaraju Naryanappa, Natalia Nazarova, Sami Niemelä, Bimochan Niraula, Henrik Nortamo, Aleksi Nummelin, Matteo Nurisso, Pablo Ortega, Stella Paronuzzi, Xabier Pedruzo-Bagazgoitia, Charles Pelletier, Carlos Peña, Suraj Polade, Himansu Kesari Pradhan, Rommel Quintanilla, Tiago Quintino, Thomas Rackow, Jouni Räisänen, Maqsood Mubarak Rajput, René Redler, Balthasar Reuter, Nuno Rocha Monteiro, Francesc Roura-Adserias, Silva Ruppert, Susan Sayed, Reiner Schnur, Tanvi Sharma, Dmitry Sidorenko, Outi Sievi-Korte, Albert Soret, Christian Steger, Bjorn Stevens, Jan Streffing, Jaleena Sunny, Luiggi Tenorio, Stephan Thober, Ulf Tigerstedt, Oriol Tinto, Juha Tonttila, Heikki Tuomenvirta, Lauri Tuppi, Ginka Van Thielen, Emanuele Vitali, Jost von Hardenberg, Ingo Wagner, Nils Wedi, Jan Wehner, Sven Willner, Xavier Yepes-Arbós, Florian Ziemen, and Janos Zimmermann
Geosci. Model Dev., 19, 2821–2848, https://doi.org/10.5194/gmd-19-2821-2026, https://doi.org/10.5194/gmd-19-2821-2026, 2026
Short summary
Short summary
The Climate Change Adaptation Digital Twin (Climate DT) pioneers the operationalisation of global climate projections. It produces global simulations with local granularity for adaptation decision-making. Applications are embedded to generate tailored indicators. A unified workflow orchestrates all components in several supercomputers. Data management ensures consistency and streaming enables real-time use. It is a complementary innovation to initiatives like CMIP, CORDEX, and climate services.
Carlos Delgado-Torres, Markus G. Donat, Núria Pérez-Zanón, Verónica Torralba, Roberto Bilbao, Pierre-Antoine Bretonnière, Margarida Samsó-Cabré, Albert Soret, and Francisco J. Doblas-Reyes
Earth Syst. Dynam., 17, 41–56, https://doi.org/10.5194/esd-17-41-2026, https://doi.org/10.5194/esd-17-41-2026, 2026
Short summary
Short summary
Many decisions require consistent climate information from seasonal to multi-year timescales. We assess seamless forecasts created by constraining seasonal and decadal predictions and compare them with initialised multi-annual forecasts. Multi-annual predictions provide the highest skill, but constrained forecasts still perform well and offer a low-cost, regularly updatable solution for delivering coherent climate information.
Kai R. Keller, Marta Alerany Solé, and Mario Acosta
Geosci. Model Dev., 18, 10221–10243, https://doi.org/10.5194/gmd-18-10221-2025, https://doi.org/10.5194/gmd-18-10221-2025, 2025
Short summary
Short summary
Can we be sure that different computing environments, that should not change the model climate, indeed leave the climate unaltered? In this article, we present a novel methodology that answers whether two model climates are statistically the same. Besides a new methodology, able to detect significant differences between two model climates 60 % more accurately than a similar recent state-of-the-art method, we also provide an analysis on what actually constitutes a different climate.
Diego A. Campos, Katherine Grayson, Ramiro I. Saurral, Sebastian Beyer, Amal John, Matías Olmo, and Francisco Doblas-Reyes
EGUsphere, https://doi.org/10.5194/egusphere-2025-5929, https://doi.org/10.5194/egusphere-2025-5929, 2025
Short summary
Short summary
Human-caused warming intensified the late October 2024 Valencia extreme precipitation event. Using storyline simulations, we compared today’s climate with a cooler past climate while keeping the synoptic weather pattern the same. Warmer air and sea temperatures increased moisture, instability, and rainfall, showing that climate change amplified an already extreme storm.
Rashed Mahmood, Markus G. Donat, Roberto Bilbao, Pablo Ortega, Vladimir Lapin, Etienne Tourigny, and Francisco Doblas-Reyes
Earth Syst. Dynam., 16, 1923–1934, https://doi.org/10.5194/esd-16-1923-2025, https://doi.org/10.5194/esd-16-1923-2025, 2025
Short summary
Short summary
We present 30 year long initialized climate predictions run with the EC-Earth3 model. The predictions show high skill in most regions for near-surface temperatures, with some added skill from initialization for the first decade, but only very limited added skill beyond. The predictions exhibit drift associated with a persistent slowdown in Atlantic Meridonial Overturning Circulation , leaving the initialised predictions in a different climate state than the historical climate simulations.
Aude Carréric, Pablo Ortega, Roberto Bilbao, Carlos Delgado-Torres, Vladimir Lapin, Ferran López-Martí, Markus Donat, and Francisco Doblas-Reyes
EGUsphere, https://doi.org/10.5194/egusphere-2025-4658, https://doi.org/10.5194/egusphere-2025-4658, 2025
Short summary
Short summary
The paper assessed the impact of horizontal resolution of the EC-Earth climate model on its ability to predict El Nino Southern Oscillation (ENSO). The high-resolution simulations show better forecast skill linked to improved simulation of the tropical Pacific mean state and teleconnections with the equatorial Atlantic. However, the remaining poor skill in the western Pacific highlights the importance of better understanding ENSO simulation errors and mean state biases to improve forecasts.
Katherine Grayson, Stephan Thober, Aleksander Lacima-Nadolnik, Ivan Alsina-Ferrer, Llorenç Lledó, Ehsan Sharifi, and Francisco Doblas-Reyes
Geosci. Model Dev., 18, 5873–5890, https://doi.org/10.5194/gmd-18-5873-2025, https://doi.org/10.5194/gmd-18-5873-2025, 2025
Short summary
Short summary
We present One_Pass (v0.8.0), a Python package enabling computation of statistics from streamed global climate model output using one-pass algorithms. Users often need statistics covering periods longer than the stream duration, requiring algorithms that do not store full time series. One-pass methods address this need while avoiding full data archiving, offering memory-efficient, accurate results for high-performance computing (HPC) workflows and downstream applications like bias adjustment.
M. Andrea Orihuela-García, Yohan Ruprich-Robert, Vladimir Lapin, Saskia Loosveldt Tomas, Raffaele Bernardello, Margarida Samsó-Cabré, Pierre-Antoine Bretonnière, Miguel Castrillo, and Marti Gali
EGUsphere, https://doi.org/10.22541/essoar.174481514.42345660/v1, https://doi.org/10.22541/essoar.174481514.42345660/v1, 2025
Short summary
Short summary
Tiny oceanic algae absorb carbon using sunlight. When they die, some sink as "detritus" that oceanic creatures eat or bacteria decompose. This "biological carbon pump" stores carbon in the deep ocean. Our study found that in warm southern waters, particles decompose quickly but more survive deeper trips. In cold northern waters, creatures eat more particles. Winter water mixing moves carbon down before spring algae bloom. Understanding these processes helps predict future ocean carbon storage.
Sergi Palomas, Mario C. Acosta, Gladys Utrera, and Etienne Tourigny
Geosci. Model Dev., 18, 3661–3679, https://doi.org/10.5194/gmd-18-3661-2025, https://doi.org/10.5194/gmd-18-3661-2025, 2025
Short summary
Short summary
We present an automatic tool that optimizes resource distribution in coupled climate models, enhancing speed and reducing computational costs without requiring expert knowledge. Users can set energy/time criteria or limit resource usage. Tested on various European Community Earth System Model (EC-Earth) configurations and high-performance computing (HPC) platforms, it achieved up to 34 % faster simulations with fewer resources.
Pep Cos, Matias Olmo, Diego Campos, Raül Marcos-Matamoros, Lluís Palma, Ángel G. Muñoz, and Francisco J. Doblas-Reyes
Weather Clim. Dynam., 6, 609–626, https://doi.org/10.5194/wcd-6-609-2025, https://doi.org/10.5194/wcd-6-609-2025, 2025
Short summary
Short summary
This work presents the identification of Saharan warm-air intrusions in the western Mediterranean, which are the displacement of air masses formed over the Sahara toward the west of the Mediterranean region. We focus on the recent past and obtain a catalogue of intrusion days. The results show the existence of different types of intrusions, important impacts on extremely high temperatures in the Mediterranean and Europe, and the dynamic mechanisms that can cause the onset of these events.
Eduardo Moreno-Chamarro, Thomas Arsouze, Mario Acosta, Pierre-Antoine Bretonnière, Miguel Castrillo, Eric Ferrer, Amanda Frigola, Daria Kuznetsova, Eneko Martin-Martinez, Pablo Ortega, and Sergi Palomas
Geosci. Model Dev., 18, 461–482, https://doi.org/10.5194/gmd-18-461-2025, https://doi.org/10.5194/gmd-18-461-2025, 2025
Short summary
Short summary
We present the high-resolution model version of the EC-Earth global climate model to contribute to HighResMIP. The combined model resolution is about 10–15 km in both the ocean and atmosphere, which makes it one of the finest ever used to complete historical and scenario simulations. This model is compared with two lower-resolution versions, with a 100 km and a 25 km grid. The three models are compared with observations to study the improvements thanks to the increased resolution.
Colin G. Jones, Fanny Adloff, Ben B. B. Booth, Peter M. Cox, Veronika Eyring, Pierre Friedlingstein, Katja Frieler, Helene T. Hewitt, Hazel A. Jeffery, Sylvie Joussaume, Torben Koenigk, Bryan N. Lawrence, Eleanor O'Rourke, Malcolm J. Roberts, Benjamin M. Sanderson, Roland Séférian, Samuel Somot, Pier Luigi Vidale, Detlef van Vuuren, Mario Acosta, Mats Bentsen, Raffaele Bernardello, Richard Betts, Ed Blockley, Julien Boé, Tom Bracegirdle, Pascale Braconnot, Victor Brovkin, Carlo Buontempo, Francisco Doblas-Reyes, Markus Donat, Italo Epicoco, Pete Falloon, Sandro Fiore, Thomas Frölicher, Neven S. Fučkar, Matthew J. Gidden, Helge F. Goessling, Rune Grand Graversen, Silvio Gualdi, José M. Gutiérrez, Tatiana Ilyina, Daniela Jacob, Chris D. Jones, Martin Juckes, Elizabeth Kendon, Erik Kjellström, Reto Knutti, Jason Lowe, Matthew Mizielinski, Paola Nassisi, Michael Obersteiner, Pierre Regnier, Romain Roehrig, David Salas y Mélia, Carl-Friedrich Schleussner, Michael Schulz, Enrico Scoccimarro, Laurent Terray, Hannes Thiemann, Richard A. Wood, Shuting Yang, and Sönke Zaehle
Earth Syst. Dynam., 15, 1319–1351, https://doi.org/10.5194/esd-15-1319-2024, https://doi.org/10.5194/esd-15-1319-2024, 2024
Short summary
Short summary
We propose a number of priority areas for the international climate research community to address over the coming decade. Advances in these areas will both increase our understanding of past and future Earth system change, including the societal and environmental impacts of this change, and deliver significantly improved scientific support to international climate policy, such as future IPCC assessments and the UNFCCC Global Stocktake.
Bjorn Stevens, Stefan Adami, Tariq Ali, Hartwig Anzt, Zafer Aslan, Sabine Attinger, Jaana Bäck, Johanna Baehr, Peter Bauer, Natacha Bernier, Bob Bishop, Hendryk Bockelmann, Sandrine Bony, Guy Brasseur, David N. Bresch, Sean Breyer, Gilbert Brunet, Pier Luigi Buttigieg, Junji Cao, Christelle Castet, Yafang Cheng, Ayantika Dey Choudhury, Deborah Coen, Susanne Crewell, Atish Dabholkar, Qing Dai, Francisco Doblas-Reyes, Dale Durran, Ayoub El Gaidi, Charlie Ewen, Eleftheria Exarchou, Veronika Eyring, Florencia Falkinhoff, David Farrell, Piers M. Forster, Ariane Frassoni, Claudia Frauen, Oliver Fuhrer, Shahzad Gani, Edwin Gerber, Debra Goldfarb, Jens Grieger, Nicolas Gruber, Wilco Hazeleger, Rolf Herken, Chris Hewitt, Torsten Hoefler, Huang-Hsiung Hsu, Daniela Jacob, Alexandra Jahn, Christian Jakob, Thomas Jung, Christopher Kadow, In-Sik Kang, Sarah Kang, Karthik Kashinath, Katharina Kleinen-von Königslöw, Daniel Klocke, Uta Kloenne, Milan Klöwer, Chihiro Kodama, Stefan Kollet, Tobias Kölling, Jenni Kontkanen, Steve Kopp, Michal Koran, Markku Kulmala, Hanna Lappalainen, Fakhria Latifi, Bryan Lawrence, June Yi Lee, Quentin Lejeun, Christian Lessig, Chao Li, Thomas Lippert, Jürg Luterbacher, Pekka Manninen, Jochem Marotzke, Satoshi Matsouoka, Charlotte Merchant, Peter Messmer, Gero Michel, Kristel Michielsen, Tomoki Miyakawa, Jens Müller, Ramsha Munir, Sandeep Narayanasetti, Ousmane Ndiaye, Carlos Nobre, Achim Oberg, Riko Oki, Tuba Özkan-Haller, Tim Palmer, Stan Posey, Andreas Prein, Odessa Primus, Mike Pritchard, Julie Pullen, Dian Putrasahan, Johannes Quaas, Krishnan Raghavan, Venkatachalam Ramaswamy, Markus Rapp, Florian Rauser, Markus Reichstein, Aromar Revi, Sonakshi Saluja, Masaki Satoh, Vera Schemann, Sebastian Schemm, Christina Schnadt Poberaj, Thomas Schulthess, Cath Senior, Jagadish Shukla, Manmeet Singh, Julia Slingo, Adam Sobel, Silvina Solman, Jenna Spitzer, Philip Stier, Thomas Stocker, Sarah Strock, Hang Su, Petteri Taalas, John Taylor, Susann Tegtmeier, Georg Teutsch, Adrian Tompkins, Uwe Ulbrich, Pier-Luigi Vidale, Chien-Ming Wu, Hao Xu, Najibullah Zaki, Laure Zanna, Tianjun Zhou, and Florian Ziemen
Earth Syst. Sci. Data, 16, 2113–2122, https://doi.org/10.5194/essd-16-2113-2024, https://doi.org/10.5194/essd-16-2113-2024, 2024
Short summary
Short summary
To manage Earth in the Anthropocene, new tools, new institutions, and new forms of international cooperation will be required. Earth Virtualization Engines is proposed as an international federation of centers of excellence to empower all people to respond to the immense and urgent challenges posed by climate change.
Roberto Bilbao, Pablo Ortega, Didier Swingedouw, Leon Hermanson, Panos Athanasiadis, Rosie Eade, Marion Devilliers, Francisco Doblas-Reyes, Nick Dunstone, An-Chi Ho, William Merryfield, Juliette Mignot, Dario Nicolì, Margarida Samsó, Reinel Sospedra-Alfonso, Xian Wu, and Stephen Yeager
Earth Syst. Dynam., 15, 501–525, https://doi.org/10.5194/esd-15-501-2024, https://doi.org/10.5194/esd-15-501-2024, 2024
Short summary
Short summary
In recent decades three major volcanic eruptions have occurred: Mount Agung in 1963, El Chichón in 1982 and Mount Pinatubo in 1991. In this article we explore the climatic impacts of these volcanic eruptions with a purposefully designed set of simulations from six CMIP6 decadal prediction systems. We analyse the radiative and dynamical responses and show that including the volcanic forcing in these predictions is important to reproduce the observed surface temperature variations.
Mario C. Acosta, Sergi Palomas, Stella V. Paronuzzi Ticco, Gladys Utrera, Joachim Biercamp, Pierre-Antoine Bretonniere, Reinhard Budich, Miguel Castrillo, Arnaud Caubel, Francisco Doblas-Reyes, Italo Epicoco, Uwe Fladrich, Sylvie Joussaume, Alok Kumar Gupta, Bryan Lawrence, Philippe Le Sager, Grenville Lister, Marie-Pierre Moine, Jean-Christophe Rioual, Sophie Valcke, Niki Zadeh, and Venkatramani Balaji
Geosci. Model Dev., 17, 3081–3098, https://doi.org/10.5194/gmd-17-3081-2024, https://doi.org/10.5194/gmd-17-3081-2024, 2024
Short summary
Short summary
We present a collection of performance metrics gathered during the Coupled Model Intercomparison Project Phase 6 (CMIP6), a worldwide initiative to study climate change. We analyse the metrics that resulted from collaboration efforts among many partners and models and describe our findings to demonstrate the utility of our study for the scientific community. The research contributes to understanding climate modelling performance on the current high-performance computing (HPC) architectures.
Elsa Mohino, Paul-Arthur Monerie, Juliette Mignot, Moussa Diakhaté, Markus Donat, Christopher David Roberts, and Francisco Doblas-Reyes
Earth Syst. Dynam., 15, 15–40, https://doi.org/10.5194/esd-15-15-2024, https://doi.org/10.5194/esd-15-15-2024, 2024
Short summary
Short summary
The impact of the Atlantic multidecadal variability (AMV) on the rainfall distribution and timing of the West African monsoon is not well known. Analysing model output, we find that a positive AMV enhances the number of wet days, daily rainfall intensity, and extremes over the Sahel and tends to prolong the monsoon length through later demise. Heavy rainfall events increase all over the Sahel, while moderate ones only occur in the north. Model biases affect the skill in simulating AMV impact.
Rashed Mahmood, Markus G. Donat, Pablo Ortega, Francisco J. Doblas-Reyes, Carlos Delgado-Torres, Margarida Samsó, and Pierre-Antoine Bretonnière
Earth Syst. Dynam., 13, 1437–1450, https://doi.org/10.5194/esd-13-1437-2022, https://doi.org/10.5194/esd-13-1437-2022, 2022
Short summary
Short summary
Near-term climate change projections are strongly affected by the uncertainty from internal climate variability. Here we present a novel approach to reduce such uncertainty by constraining decadal-scale variability in the projections using observations. The constrained ensembles show significant added value over the unconstrained ensemble in predicting global climate 2 decades ahead. We also show the applicability of regional constraints for attributing predictability to certain ocean regions.
Marcus Falls, Raffaele Bernardello, Miguel Castrillo, Mario Acosta, Joan Llort, and Martí Galí
Geosci. Model Dev., 15, 5713–5737, https://doi.org/10.5194/gmd-15-5713-2022, https://doi.org/10.5194/gmd-15-5713-2022, 2022
Short summary
Short summary
This paper describes and tests a method which uses a genetic algorithm (GA), a type of optimisation algorithm, on an ocean biogeochemical model. The aim is to produce a set of numerical parameters that best reflect the observed data of particulate organic carbon in a specific region of the ocean. We show that the GA can provide optimised model parameters in a robust and efficient manner and can also help detect model limitations, ultimately leading to a reduction in the model uncertainties.
Enza Di Tomaso, Jerónimo Escribano, Sara Basart, Paul Ginoux, Francesca Macchia, Francesca Barnaba, Francesco Benincasa, Pierre-Antoine Bretonnière, Arnau Buñuel, Miguel Castrillo, Emilio Cuevas, Paola Formenti, María Gonçalves, Oriol Jorba, Martina Klose, Lucia Mona, Gilbert Montané Pinto, Michail Mytilinaios, Vincenzo Obiso, Miriam Olid, Nick Schutgens, Athanasios Votsis, Ernest Werner, and Carlos Pérez García-Pando
Earth Syst. Sci. Data, 14, 2785–2816, https://doi.org/10.5194/essd-14-2785-2022, https://doi.org/10.5194/essd-14-2785-2022, 2022
Short summary
Short summary
MONARCH reanalysis of desert dust aerosols extends the existing observation-based information for mineral dust monitoring by providing 3-hourly upper-air, surface and total column key geophysical variables of the dust cycle over Northern Africa, the Middle East and Europe, at a 0.1° horizontal resolution in a rotated grid, from 2007 to 2016. This work provides evidence of the high accuracy of this data set and its suitability for air quality and health and climate service applications.
Matthew L. Dawson, Christian Guzman, Jeffrey H. Curtis, Mario Acosta, Shupeng Zhu, Donald Dabdub, Andrew Conley, Matthew West, Nicole Riemer, and Oriol Jorba
Geosci. Model Dev., 15, 3663–3689, https://doi.org/10.5194/gmd-15-3663-2022, https://doi.org/10.5194/gmd-15-3663-2022, 2022
Short summary
Short summary
Progress in identifying complex, mixed-phase physicochemical processes has resulted in an advanced understanding of the evolution of atmospheric systems but has also introduced a level of complexity that few atmospheric models were designed to handle. We present a flexible treatment for multiphase chemical processes for models of diverse scale, from box up to global models. This enables users to build a customized multiphase mechanism that is accessible to a much wider community.
Ralf Döscher, Mario Acosta, Andrea Alessandri, Peter Anthoni, Thomas Arsouze, Tommi Bergman, Raffaele Bernardello, Souhail Boussetta, Louis-Philippe Caron, Glenn Carver, Miguel Castrillo, Franco Catalano, Ivana Cvijanovic, Paolo Davini, Evelien Dekker, Francisco J. Doblas-Reyes, David Docquier, Pablo Echevarria, Uwe Fladrich, Ramon Fuentes-Franco, Matthias Gröger, Jost v. Hardenberg, Jenny Hieronymus, M. Pasha Karami, Jukka-Pekka Keskinen, Torben Koenigk, Risto Makkonen, François Massonnet, Martin Ménégoz, Paul A. Miller, Eduardo Moreno-Chamarro, Lars Nieradzik, Twan van Noije, Paul Nolan, Declan O'Donnell, Pirkka Ollinaho, Gijs van den Oord, Pablo Ortega, Oriol Tintó Prims, Arthur Ramos, Thomas Reerink, Clement Rousset, Yohan Ruprich-Robert, Philippe Le Sager, Torben Schmith, Roland Schrödner, Federico Serva, Valentina Sicardi, Marianne Sloth Madsen, Benjamin Smith, Tian Tian, Etienne Tourigny, Petteri Uotila, Martin Vancoppenolle, Shiyu Wang, David Wårlind, Ulrika Willén, Klaus Wyser, Shuting Yang, Xavier Yepes-Arbós, and Qiong Zhang
Geosci. Model Dev., 15, 2973–3020, https://doi.org/10.5194/gmd-15-2973-2022, https://doi.org/10.5194/gmd-15-2973-2022, 2022
Short summary
Short summary
The Earth system model EC-Earth3 is documented here. Key performance metrics show physical behavior and biases well within the frame known from recent models. With improved physical and dynamic features, new ESM components, community tools, and largely improved physical performance compared to the CMIP5 version, EC-Earth3 represents a clear step forward for the only European community ESM. We demonstrate here that EC-Earth3 is suited for a range of tasks in CMIP6 and beyond.
Josep Cos, Francisco Doblas-Reyes, Martin Jury, Raül Marcos, Pierre-Antoine Bretonnière, and Margarida Samsó
Earth Syst. Dynam., 13, 321–340, https://doi.org/10.5194/esd-13-321-2022, https://doi.org/10.5194/esd-13-321-2022, 2022
Short summary
Short summary
The Mediterranean has been identified as being more affected by climate change than other regions. We find that amplified warming during summer and annual precipitation declines are expected for the 21st century and that the magnitude of the changes will mainly depend on greenhouse gas emissions. By applying a method giving more importance to models with greater performance and independence, we find that the differences between the last two community modelling efforts are reduced in the region.
Xavier Yepes-Arbós, Gijs van den Oord, Mario C. Acosta, and Glenn D. Carver
Geosci. Model Dev., 15, 379–394, https://doi.org/10.5194/gmd-15-379-2022, https://doi.org/10.5194/gmd-15-379-2022, 2022
Short summary
Short summary
Climate prediction models produce a large volume of simulated data that sometimes might not be efficiently managed. In this paper we present an approach to address this issue by reducing the computing time and storage space. As a case study, we analyse the output writing process of the ECMWF atmospheric model called IFS, and we integrate into it a data writing tool called XIOS. The results suggest that the integration between the two components achieves an adequate computational performance.
Cited articles
Acosta, M. C., Palomas, S., Paronuzzi Ticco, S. V., Utrera, G., Biercamp, J., Bretonniere, P.-A., Budich, R., Castrillo, M., Caubel, A., Doblas-Reyes, F., Epicoco, I., Fladrich, U., Joussaume, S., Kumar Gupta, A., Lawrence, B., Le Sager, P., Lister, G., Moine, M.-P., Rioual, J.-C., Valcke, S., Zadeh, N., and Balaji, V.: The computational and energy cost of simulation and storage for climate science: lessons from CMIP6, Geosci. Model Dev., 17, 3081–3098, https://doi.org/10.5194/gmd-17-3081-2024, 2024. a
Balaji, V., Maisonnave, E., Zadeh, N., Lawrence, B. N., Biercamp, J., Fladrich, U., Aloisio, G., Benson, R., Caubel, A., Durachta, J., Foujols, M.-A., Lister, G., Mocavero, S., Underwood, S., and Wright, G.: CPMIP: measurements of real computational performance of Earth system models in CMIP6, Geosci. Model Dev., 10, 19–34, https://doi.org/10.5194/gmd-10-19-2017, 2017. a
Brucker, P.: Scheduling Algorithms, in: 5th Edn., Springer, Berlin, Germany, https://doi.org/10.1007/978-3-540-69516-5, 2007. a
BSC-CNS: Blog post, https://www.bsc.es/marenostrum/marenostrum (last access: 29 September 2023), 2023. a
Cirne, W. and Berman, F.: Adaptive selection of partition size for supercomputer requests, in: Job Scheduling Strategies for Parallel Processing: IPDPS 2000 Workshop, Proceedings 6, 1 May 2000, Cancun, Mexico, Springer, 187–207, ISBN 3540411208, 2000. a
Döscher, R., Acosta, M., Alessandri, A., Anthoni, P., Arsouze, T., Bergman, T., Bernardello, R., Boussetta, S., Caron, L. P., Carver, G., Castrillo, M., Catalano, F., Cvijanovic, I., Davini, P., Dekker, E., Doblas-Reyes, F. J., Docquier, D., Echevarria, P., Fladrich, U., Fuentes-Franco, R., Gröger, M., Hardenberg, J. V., Hieronymus, J., Karami, M. P., Keskinen, J. P., Koenigk, T., Makkonen, R., Massonnet, F., Ménégoz, M., Miller, P. A., Moreno-Chamarro, E., Nieradzik, L., Van Noije, T., Nolan, P., O'donnell, D., Ollinaho, P., Van Den Oord, G., Ortega, P., Prims, O. T., Ramos, A., Reerink, T., Rousset, C., Ruprich-Robert, Y., Le Sager, P., Schmith, T., Schrödner, R., Serva, F., Sicardi, V., Sloth Madsen, M., Smith, B., Tian, T., Tourigny, E., Uotila, P., Vancoppenolle, M., Wang, S., Wårlind, D., Willén, U., Wyser, K., Yang, S., Yepes-Arbós, X., and Zhang, Q.: The EC-Earth3 Earth system model for the Coupled Model Intercomparison Project 6, Geosci. Model Dev., 15, 2973–3020, https://doi.org/10.5194/gmd-15-2973-2022, 2022. a
Hoffmann, J., Bauer, P., Sandu, I., Wedi, N., Geenen, T., and Thiemert, D.: Destination Earth – A digital twin in support of climate services, Clim. Serv., 30, 100394, https://doi.org/10.1016/j.cliser.2023.100394, 2023. a, b
Huber, S. P., Zoupanos, S., Uhrin, M., Talirz, L., Kahle, L., Häuselmann, R., Gresch, D., Müller, T., Yakutovich, A. V., Andersen, C. W., Ramirez, F. F., Adorf, C. S., Gargiulo, F., Kumbhar, S., Passaro, E., Johnston, C., Merkys, A., Cepellotti, A., Mounet, N., Marzari, N., Kozinsky, B., and Pizzi, G.: AiiDA 1.0, a scalable computational infrastructure for automated reproducible workflows and data provenance, Sci. Data, 7, 300, https://doi.org/10.1038/s41597-020-00638-4, 2020. a
Irrmann, G., Masson, S., Maisonnave, E., Guibert, D., and Raffin, E.: Improving ocean modeling software NEMO 4.0 benchmarking and communication efficiency, Geosci. Model Dev., 15, 1567–1582, https://doi.org/10.5194/gmd-15-1567-2022, 2022. a
Jeannot, E., Pallez, G., and Vidal, N.: IO-aware Job-Scheduling: Exploiting the Impacts of Workload Characterizations to select the Mapping Strategy, Int. J. High Perform. Comput. Appl., 37, https://doi.org/10.1177/10943420231175854, 2023. a
Jette, M. A. and Wickberg, T.: Architecture of the Slurm Workload Manager, in: Job Scheduling Strategies for Parallel Processing, JSSPP 2023, Lecture Notes in Computer Science, vol. 14283, edited by: Dalibor, K., Corbalán, J., and Rodrigo Gonzalo, P., Springer Nature Switzerland, Cham, 3–23, https://doi.org/10.1007/978-3-031-43943-8, 2023. a
Jokanovic, A., D'Amico, M., and Corbalan, J.: Evaluating SLURM Simulator with Real-Machine SLURM and Vice Versa, Performance Modeling, Benchmarking and Simulation of High Performance Computer Systems (PMBS18) At: ACM/IEEE Supercomputing 2018, 72–82, https://doi.org/10.1109/PMBS.2018.8641556, 2018. a, b, c
Klose, M., Jorba, O., Gonçalves Ageitos, M., Escribano, J., Dawson, M. L., Obiso, V., Di Tomaso, E., Basart, S., Montané Pinto, G., Macchia, F., Ginoux, P., Guerschman, J., Prigent, C., Huang, Y., Kok, J. F., Miller, R. L., and Pérez García-Pando, C.: Mineral dust cycle in the Multiscale Online Nonhydrostatic AtmospheRe CHemistry model (MONARCH) Version 2.0, Geosci. Model Dev., 14, 6403–6444, https://doi.org/10.5194/gmd-14-6403-2021, 2021. a, b, c
Manubens-Gil, D., Vegas-Regidor, J., Prodhomme, C., Mula-Valls, O., and Doblas-Reyes, F. J.: Seamless management of ensemble climate prediction experiments on HPC platforms, in: 2016 International Conference on High Performance Computing and Simulation (HPCS), 895–900, https://doi.org/10.1109/HPCSim.2016.7568429, 2016. a
Marciani, G. M.: Scripts and Files to Add Workflow to Curie, Zenodo [code], https://doi.org/10.5281/zenodo.12801281, 2024a. a, b
Marciani, G. M.: BSC Computational Earth Sciences Slurm Simulator Tools, Zenodo [code], https://doi.org/10.5281/zenodo.12800999, 2024b. a, b, c
Marciani, G. M.: Docker Image of the Computational Earth Sciences Slurm Simulator, Zenodo [code], https://doi.org/10.5281/zenodo.12801138, 2024c. a, b
Marciani, G. M.: Wrapper Impact Workloads and BSC Slurm Simulator Output of Dynamic Traces from CEA Curie, Zenodo [data set], https://doi.org/10.5281/zenodo.10623439, 2024d. a
Marciani, G. M.: Lumi Workload Analysis Script, Zenodo [code], https://doi.org/10.5281/zenodo.12801326, 2024e. a, b
Marciani, G. M.: Full Results from Simulations for Static and Dynamic Workloads Using BSC Slurm Simulator, Zenodo [data set], https://doi.org/10.5281/zenodo.10818813, 2024f. a, b
Marciani, G. M.: Wrapper Impact Workloads and BSC Slurm Simulator Output of Static Traces based on Data from LUMI Supercomputer, Zenodo [data set], https://doi.org/10.5281/zenodo.10624403, 2024g. a
Marciani, G. M.: Static Workload Results Analysis Scripts, Zenodo [code], https://doi.org/10.5281/zenodo.12801377, 2024h. a, b
Merkel, D.: Docker: lightweight linux containers for consistent development and deployment, Linux J., 2014, 2, 2014. a
Merzky, A., Turilli, M., Titov, M., Al-Saadi, A., and Jha, S.: Design and performance characterization of radical-pilot on leadership-class platforms, IEEE T. Parallel Distrib. Syst., 33, 818–829, 2021. a
Mickelson, S., Bertini, A., Strand, G., Paul, K., Nienhouse, E., Dennis, J., and Vertenstein, M.: A new end-to-end workflow for the Community Earth System Model (version 2.0) for the Coupled Model Intercomparison Project Phase 6 (CMIP6), Geosci. Model Dev., 13, 5567–5581, https://doi.org/10.5194/gmd-13-5567-2020, 2020. a
Mölder, F., Jablonski, K., Letcher, B., Hall, M., van Dyken, P., Tomkins-Tinch, C., Sochat, V., Forster, J., Vieira, F., Meesters, C., Lee, S., Twardziok, S., Kanitz, A., VanCampen, J., Malladi, V., Wilm, A., Holtgrewe, M., Rahmann, S., Nahnsen, S., and Köster, J.: Sustainable data analysis with Snakemake, F1000Research, 10 pp. https://doi.org/10.12688/f1000research.29032.3, 2021. a
Patel, T., Liu, Z., Kettimuthu, R., Rich, P., Allcock, W., and Tiwari, D.: Job characteristics on large-scale systems: long-term analysis, quantification, and implications, in: IEEE SC20: International conference for high performance computing, networking, storage and analysis, 1–17, https://doi.org/10.1109/SC41405.2020.00088, 2020. a, b
SchedMD: Scheduling Configuration Guide, https://slurm.schedmd.com/sched_config.html (last access: 29 September 2023), 2022. a
SchedMD: Multifactor Priority Plugin, Blog post, https://slurm.schedmd.com/priority_multifactor.html (last access: 6 February 2024), 2023. a
Srinivasan, S., Kettimuthu, R., Subramani, V., and Sadayappan, P.: Selective reservation strategies for backfill job scheduling, in: Job Scheduling Strategies for Parallel Processing: 8th International Workshop, JSSPP 2002, Revised Papers 8, 24 July 2002, Edinburgh, Scotland, UK, Springer, 55–71, https://doi.org/10.1007/3-540-36180-4_4, 2002. a, b
Strohmaier, E., Dongarra, J., Simon, H., and Meuer, M.: TOP500. The List, https://top500.org/ (last access: 1 November 2023), 2023. a
Turilli, M., Santcroos, M., and Jha, S.: A comprehensive perspective on pilot-job systems, ACM Comput. Surv., 51, 1–32, 2018. a
Short summary
Earth System Model simulations are typically run on large, highly congested flagship computers using workflows. These workflows can consist of thousands of tasks. If these tasks are queued individually, the wait time can add up, resulting in a long response time. In this paper, we explore a technique for aggregating tasks into a single submission. We found that this simple technique reduced the time spent in the queue by up to 7 %.
Earth System Model simulations are typically run on large, highly congested flagship computers...
