Articles | Volume 18, issue 12
https://doi.org/10.5194/gmd-18-3661-2025
© Author(s) 2025. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
https://doi.org/10.5194/gmd-18-3661-2025
© Author(s) 2025. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
Development and technical paper
| 
20 Jun 2025
Development and technical paper |
| 20 Jun 2025
| 20 Jun 2025
Reducing time and computing costs in EC-Earth: an automatic load-balancing approach for coupled Earth system models
Barcelona Supercomputing Center, Plaça d'Eusebi Güell, 1–3, 08034 Barcelona, Spain
Universitat Politècnica de Catalunya (UPC), Carrer de Jordi Girona, 1–3, 08034 Barcelona, Spain
Mario C. Acosta
Barcelona Supercomputing Center, Plaça d'Eusebi Güell, 1–3, 08034 Barcelona, Spain
Gladys Utrera
Barcelona Supercomputing Center, Plaça d'Eusebi Güell, 1–3, 08034 Barcelona, Spain
Universitat Politècnica de Catalunya (UPC), Carrer de Jordi Girona, 1–3, 08034 Barcelona, Spain
Etienne Tourigny
Barcelona Supercomputing Center, Plaça d'Eusebi Güell, 1–3, 08034 Barcelona, Spain
Related authors
Eduardo Moreno-Chamarro, Thomas Arsouze, Mario Acosta, Pierre-Antoine Bretonnière, Miguel Castrillo, Eric Ferrer, Amanda Frigola, Daria Kuznetsova, Eneko Martin-Martinez, Pablo Ortega, and Sergi Palomas
Geosci. Model Dev., 18, 461–482, https://doi.org/10.5194/gmd-18-461-2025, https://doi.org/10.5194/gmd-18-461-2025, 2025
Short summary
Short summary
We present the high-resolution model version of the EC-Earth global climate model to contribute to HighResMIP. The combined model resolution is about 10–15 km in both the ocean and atmosphere, which makes it one of the finest ever used to complete historical and scenario simulations. This model is compared with two lower-resolution versions, with a 100 km and a 25 km grid. The three models are compared with observations to study the improvements thanks to the increased resolution.
Mario C. Acosta, Sergi Palomas, Stella V. Paronuzzi Ticco, Gladys Utrera, Joachim Biercamp, Pierre-Antoine Bretonniere, Reinhard Budich, Miguel Castrillo, Arnaud Caubel, Francisco Doblas-Reyes, Italo Epicoco, Uwe Fladrich, Sylvie Joussaume, Alok Kumar Gupta, Bryan Lawrence, Philippe Le Sager, Grenville Lister, Marie-Pierre Moine, Jean-Christophe Rioual, Sophie Valcke, Niki Zadeh, and Venkatramani Balaji
Geosci. Model Dev., 17, 3081–3098, https://doi.org/10.5194/gmd-17-3081-2024, https://doi.org/10.5194/gmd-17-3081-2024, 2024
Short summary
Short summary
We present a collection of performance metrics gathered during the Coupled Model Intercomparison Project Phase 6 (CMIP6), a worldwide initiative to study climate change. We analyse the metrics that resulted from collaboration efforts among many partners and models and describe our findings to demonstrate the utility of our study for the scientific community. The research contributes to understanding climate modelling performance on the current high-performance computing (HPC) architectures.
Francisco J. Doblas-Reyes, Jenni Kontkanen, Irina Sandu, Mario Acosta, Mohammed Hussam Al Turjmam, Ivan Alsina-Ferrer, Miguel Andrés-Martínez, Leo Arriola, Marvin Axness, Marc Batlle Martín, Peter Bauer, Tobias Becker, Daniel Beltrán, Sebastian Beyer, Hendryk Bockelmann, Pierre-Antoine Bretonnière, Sebastien Cabaniols, Silvia Caprioli, Miguel Castrillo, Aparna Chandrasekar, Suvarchal Cheedela, Victor Correal, Emanuele Danovaro, Paolo Davini, Jussi Enkovaara, Claudia Frauen, Barbara Früh, Aina Gaya Àvila, Paolo Ghinassi, Rohit Ghosh, Supriyo Ghosh, Iker González, Katherine Grayson, Matthew Griffith, Ioan Hadade, Christopher Haine, Carl Hartick, Utz-Uwe Haus, Shane Hearne, Heikki Järvinen, Bernat Jiménez, Amal John, Marlin Juchem, Thomas Jung, Jessica Kegel, Matthias Kelbling, Kai Keller, Bruno Kinoshita, Theresa Kiszler, Daniel Klocke, Lukas Kluft, Nikolay Koldunov, Tobias Kölling, Joonas Kolstela, Luis Kornblueh, Sergey Kosukhin, Aleksander Lacima-Nadolnik, Jeisson Javier Leal Rojas, Jonni Lehtiranta, Tuomas Lunttila, Anna Luoma, Pekka Manninen, Alexey Medvedev, Sebastian Milinski, Ali Omar Abdelazim Mohammed, Sebastian Müller, Devaraju Naryanappa, Natalia Nazarova, Sami Niemelä, Bimochan Niraula, Henrik Nortamo, Aleksi Nummelin, Matteo Nurisso, Pablo Ortega, Stella Paronuzzi, Xabier Pedruzo Bagazgoitia, Charles Pelletier, Carlos Peña, Suraj Polade, Himansu Pradhan, Rommel Quintanilla, Tiago Quintino, Thomas Rackow, Jouni Räisänen, Maqsood Mubarak Rajput, René Redler, Balthasar Reuter, Nuno Rocha Monteiro, Francesc Roura-Adserias, Silva Ruppert, Susan Sayed, Reiner Schnur, Tanvi Sharma, Dmitry Sidorenko, Outi Sievi-Korte, Albert Soret, Christian Steger, Bjorn Stevens, Jan Streffing, Jaleena Sunny, Luiggi Tenorio, Stephan Thober, Ulf Tigerstedt, Oriol Tinto, Juha Tonttila, Heikki Tuomenvirta, Lauri Tuppi, Ginka Van Thielen, Emanuele Vitali, Jost von Hardenberg, Ingo Wagner, Nils Wedi, Jan Wehner, Sven Willner, Xavier Yepes-Arbós, Florian Ziemen, and Janos Zimmermann
EGUsphere, https://doi.org/10.5194/egusphere-2025-2198, https://doi.org/10.5194/egusphere-2025-2198, 2025
This preprint is open for discussion and under review for Geoscientific Model Development (GMD).
Short summary
Short summary
The Climate Change Adaptation Digital Twin (Climate DT) pioneers the operationalisation of climate projections. The system produces global simulations with local granularity for adaptation decision-making. Applications are embedded to generate tailored indicators. A unified workflow orchestrates all components in several supercomputers. Data management ensures consistency and streaming enables real-time use. It is a complementary innovation to initiatives like CMIP, CORDEX, and climate services.
Manuel G. Marciani, Miguel Castrillo, Gladys Utrera, Mario C. Acosta, Bruno P. Kinoshita, and Francisco Doblas-Reyes
EGUsphere, https://doi.org/10.5194/egusphere-2025-1104, https://doi.org/10.5194/egusphere-2025-1104, 2025
Short summary
Short summary
Earth System Model simulations are executed with workflows in congested HPC resources. These workflows could be made of thousands of tasks, which, if naively submitted to be executed, might add overheads due to queueing for resources. In this paper we explored a technique of aggregating tasks into a single submission. We related it to a key factor used by the software in charge of the scheduling. We find that this simple technique can reduce up to 7 % of the time spent in queue.
Kai Rasmus Keller, Marta Alerany Solé, and Mario Acosta
EGUsphere, https://doi.org/10.5194/egusphere-2025-1367, https://doi.org/10.5194/egusphere-2025-1367, 2025
Short summary
Short summary
Can we be sure that different computing environments, that should not change the model climate, indeed leave the climate unaltered? In this article, we present a novel methodology that answers whether two model climates are statistically the same. Besides a new methodology, able to detect significant differences between two model climates 60 % more accurately than a similar recent state-of-the-art method, we also provide an analysis on what actually constitutes a different climate.
Rashed Mahmood, Markus G. Donat, Roberto Bilbao, Pablo Ortega, Vladimir Lapin, Etienne Tourigny, and Francisco Doblas-Reyes
EGUsphere, https://doi.org/10.5194/egusphere-2025-1208, https://doi.org/10.5194/egusphere-2025-1208, 2025
Short summary
Short summary
We present 30 year long initialized climate predictions run with the EC-Earth3 model. The predictions show high skill in most regions for near-surface temperatures, with some added skill from initialization for the first decade, but only very limited added skill beyond. The predictions exhibit drift associated with a persistent slowdown in Atlantic Meridonial Overturning Circulation , leaving the initialised predictions in a different climate state than the historical climate simulations.
Pierre Friedlingstein, Michael O'Sullivan, Matthew W. Jones, Robbie M. Andrew, Judith Hauck, Peter Landschützer, Corinne Le Quéré, Hongmei Li, Ingrid T. Luijkx, Are Olsen, Glen P. Peters, Wouter Peters, Julia Pongratz, Clemens Schwingshackl, Stephen Sitch, Josep G. Canadell, Philippe Ciais, Robert B. Jackson, Simone R. Alin, Almut Arneth, Vivek Arora, Nicholas R. Bates, Meike Becker, Nicolas Bellouin, Carla F. Berghoff, Henry C. Bittig, Laurent Bopp, Patricia Cadule, Katie Campbell, Matthew A. Chamberlain, Naveen Chandra, Frédéric Chevallier, Louise P. Chini, Thomas Colligan, Jeanne Decayeux, Laique M. Djeutchouang, Xinyu Dou, Carolina Duran Rojas, Kazutaka Enyo, Wiley Evans, Amanda R. Fay, Richard A. Feely, Daniel J. Ford, Adrianna Foster, Thomas Gasser, Marion Gehlen, Thanos Gkritzalis, Giacomo Grassi, Luke Gregor, Nicolas Gruber, Özgür Gürses, Ian Harris, Matthew Hefner, Jens Heinke, George C. Hurtt, Yosuke Iida, Tatiana Ilyina, Andrew R. Jacobson, Atul K. Jain, Tereza Jarníková, Annika Jersild, Fei Jiang, Zhe Jin, Etsushi Kato, Ralph F. Keeling, Kees Klein Goldewijk, Jürgen Knauer, Jan Ivar Korsbakken, Xin Lan, Siv K. Lauvset, Nathalie Lefèvre, Zhu Liu, Junjie Liu, Lei Ma, Shamil Maksyutov, Gregg Marland, Nicolas Mayot, Patrick C. McGuire, Nicolas Metzl, Natalie M. Monacci, Eric J. Morgan, Shin-Ichiro Nakaoka, Craig Neill, Yosuke Niwa, Tobias Nützel, Lea Olivier, Tsuneo Ono, Paul I. Palmer, Denis Pierrot, Zhangcai Qin, Laure Resplandy, Alizée Roobaert, Thais M. Rosan, Christian Rödenbeck, Jörg Schwinger, T. Luke Smallman, Stephen M. Smith, Reinel Sospedra-Alfonso, Tobias Steinhoff, Qing Sun, Adrienne J. Sutton, Roland Séférian, Shintaro Takao, Hiroaki Tatebe, Hanqin Tian, Bronte Tilbrook, Olivier Torres, Etienne Tourigny, Hiroyuki Tsujino, Francesco Tubiello, Guido van der Werf, Rik Wanninkhof, Xuhui Wang, Dongxu Yang, Xiaojuan Yang, Zhen Yu, Wenping Yuan, Xu Yue, Sönke Zaehle, Ning Zeng, and Jiye Zeng
Earth Syst. Sci. Data, 17, 965–1039, https://doi.org/10.5194/essd-17-965-2025, https://doi.org/10.5194/essd-17-965-2025, 2025
Short summary
Short summary
The Global Carbon Budget 2024 describes the methodology, main results, and datasets used to quantify the anthropogenic emissions of carbon dioxide (CO2) and their partitioning among the atmosphere, land ecosystems, and the ocean over the historical period (1750–2024). These living datasets are updated every year to provide the highest transparency and traceability in the reporting of CO2, the key driver of climate change.
Eduardo Moreno-Chamarro, Thomas Arsouze, Mario Acosta, Pierre-Antoine Bretonnière, Miguel Castrillo, Eric Ferrer, Amanda Frigola, Daria Kuznetsova, Eneko Martin-Martinez, Pablo Ortega, and Sergi Palomas
Geosci. Model Dev., 18, 461–482, https://doi.org/10.5194/gmd-18-461-2025, https://doi.org/10.5194/gmd-18-461-2025, 2025
Short summary
Short summary
We present the high-resolution model version of the EC-Earth global climate model to contribute to HighResMIP. The combined model resolution is about 10–15 km in both the ocean and atmosphere, which makes it one of the finest ever used to complete historical and scenario simulations. This model is compared with two lower-resolution versions, with a 100 km and a 25 km grid. The three models are compared with observations to study the improvements thanks to the increased resolution.
Yona Silvy, Thomas L. Frölicher, Jens Terhaar, Fortunat Joos, Friedrich A. Burger, Fabrice Lacroix, Myles Allen, Raffaele Bernardello, Laurent Bopp, Victor Brovkin, Jonathan R. Buzan, Patricia Cadule, Martin Dix, John Dunne, Pierre Friedlingstein, Goran Georgievski, Tomohiro Hajima, Stuart Jenkins, Michio Kawamiya, Nancy Y. Kiang, Vladimir Lapin, Donghyun Lee, Paul Lerner, Nadine Mengis, Estela A. Monteiro, David Paynter, Glen P. Peters, Anastasia Romanou, Jörg Schwinger, Sarah Sparrow, Eric Stofferahn, Jerry Tjiputra, Etienne Tourigny, and Tilo Ziehn
Earth Syst. Dynam., 15, 1591–1628, https://doi.org/10.5194/esd-15-1591-2024, https://doi.org/10.5194/esd-15-1591-2024, 2024
Short summary
Short summary
The adaptive emission reduction approach is applied with Earth system models to generate temperature stabilization simulations. These simulations provide compatible emission pathways and budgets for a given warming level, uncovering uncertainty ranges previously missing in the Coupled Model Intercomparison Project scenarios. These target-based emission-driven simulations offer a more coherent assessment across models for studying both the carbon cycle and its impacts under climate stabilization.
Colin G. Jones, Fanny Adloff, Ben B. B. Booth, Peter M. Cox, Veronika Eyring, Pierre Friedlingstein, Katja Frieler, Helene T. Hewitt, Hazel A. Jeffery, Sylvie Joussaume, Torben Koenigk, Bryan N. Lawrence, Eleanor O'Rourke, Malcolm J. Roberts, Benjamin M. Sanderson, Roland Séférian, Samuel Somot, Pier Luigi Vidale, Detlef van Vuuren, Mario Acosta, Mats Bentsen, Raffaele Bernardello, Richard Betts, Ed Blockley, Julien Boé, Tom Bracegirdle, Pascale Braconnot, Victor Brovkin, Carlo Buontempo, Francisco Doblas-Reyes, Markus Donat, Italo Epicoco, Pete Falloon, Sandro Fiore, Thomas Frölicher, Neven S. Fučkar, Matthew J. Gidden, Helge F. Goessling, Rune Grand Graversen, Silvio Gualdi, José M. Gutiérrez, Tatiana Ilyina, Daniela Jacob, Chris D. Jones, Martin Juckes, Elizabeth Kendon, Erik Kjellström, Reto Knutti, Jason Lowe, Matthew Mizielinski, Paola Nassisi, Michael Obersteiner, Pierre Regnier, Romain Roehrig, David Salas y Mélia, Carl-Friedrich Schleussner, Michael Schulz, Enrico Scoccimarro, Laurent Terray, Hannes Thiemann, Richard A. Wood, Shuting Yang, and Sönke Zaehle
Earth Syst. Dynam., 15, 1319–1351, https://doi.org/10.5194/esd-15-1319-2024, https://doi.org/10.5194/esd-15-1319-2024, 2024
Short summary
Short summary
We propose a number of priority areas for the international climate research community to address over the coming decade. Advances in these areas will both increase our understanding of past and future Earth system change, including the societal and environmental impacts of this change, and deliver significantly improved scientific support to international climate policy, such as future IPCC assessments and the UNFCCC Global Stocktake.
Raffaele Bernardello, Valentina Sicardi, Vladimir Lapin, Pablo Ortega, Yohan Ruprich-Robert, Etienne Tourigny, and Eric Ferrer
Earth Syst. Dynam., 15, 1255–1275, https://doi.org/10.5194/esd-15-1255-2024, https://doi.org/10.5194/esd-15-1255-2024, 2024
Short summary
Short summary
The ocean mitigates climate change by absorbing about 25 % of the carbon that is emitted to the atmosphere. However, ocean CO2 uptake is not constant in time, and improving our understanding of the mechanisms regulating this variability can potentially lead to a better predictive capability of its future behavior. In this study, we compare two ocean modeling practices that are used to reconstruct the historical ocean carbon uptake, demonstrating the abilities of one over the other.
Jenny Hieronymus, Magnus Hieronymus, Matthias Gröger, Jörg Schwinger, Raffaele Bernadello, Etienne Tourigny, Valentina Sicardi, Itzel Ruvalcaba Baroni, and Klaus Wyser
Biogeosciences, 21, 2189–2206, https://doi.org/10.5194/bg-21-2189-2024, https://doi.org/10.5194/bg-21-2189-2024, 2024
Short summary
Short summary
The timing of the net primary production annual maxima in the North Atlantic in the period 1750–2100 is investigated using two Earth system models and the high-emissions scenario SSP5-8.5. It is found that, for most of the region, the annual maxima occur progressively earlier, with the most change occurring after the year 2000. Shifts in the seasonality of the primary production may impact the entire ecosystem, which highlights the need for long-term monitoring campaigns in this area.
Mario C. Acosta, Sergi Palomas, Stella V. Paronuzzi Ticco, Gladys Utrera, Joachim Biercamp, Pierre-Antoine Bretonniere, Reinhard Budich, Miguel Castrillo, Arnaud Caubel, Francisco Doblas-Reyes, Italo Epicoco, Uwe Fladrich, Sylvie Joussaume, Alok Kumar Gupta, Bryan Lawrence, Philippe Le Sager, Grenville Lister, Marie-Pierre Moine, Jean-Christophe Rioual, Sophie Valcke, Niki Zadeh, and Venkatramani Balaji
Geosci. Model Dev., 17, 3081–3098, https://doi.org/10.5194/gmd-17-3081-2024, https://doi.org/10.5194/gmd-17-3081-2024, 2024
Short summary
Short summary
We present a collection of performance metrics gathered during the Coupled Model Intercomparison Project Phase 6 (CMIP6), a worldwide initiative to study climate change. We analyse the metrics that resulted from collaboration efforts among many partners and models and describe our findings to demonstrate the utility of our study for the scientific community. The research contributes to understanding climate modelling performance on the current high-performance computing (HPC) architectures.
Marcus Falls, Raffaele Bernardello, Miguel Castrillo, Mario Acosta, Joan Llort, and Martí Galí
Geosci. Model Dev., 15, 5713–5737, https://doi.org/10.5194/gmd-15-5713-2022, https://doi.org/10.5194/gmd-15-5713-2022, 2022
Short summary
Short summary
This paper describes and tests a method which uses a genetic algorithm (GA), a type of optimisation algorithm, on an ocean biogeochemical model. The aim is to produce a set of numerical parameters that best reflect the observed data of particulate organic carbon in a specific region of the ocean. We show that the GA can provide optimised model parameters in a robust and efficient manner and can also help detect model limitations, ultimately leading to a reduction in the model uncertainties.
Matthew L. Dawson, Christian Guzman, Jeffrey H. Curtis, Mario Acosta, Shupeng Zhu, Donald Dabdub, Andrew Conley, Matthew West, Nicole Riemer, and Oriol Jorba
Geosci. Model Dev., 15, 3663–3689, https://doi.org/10.5194/gmd-15-3663-2022, https://doi.org/10.5194/gmd-15-3663-2022, 2022
Short summary
Short summary
Progress in identifying complex, mixed-phase physicochemical processes has resulted in an advanced understanding of the evolution of atmospheric systems but has also introduced a level of complexity that few atmospheric models were designed to handle. We present a flexible treatment for multiphase chemical processes for models of diverse scale, from box up to global models. This enables users to build a customized multiphase mechanism that is accessible to a much wider community.
Ralf Döscher, Mario Acosta, Andrea Alessandri, Peter Anthoni, Thomas Arsouze, Tommi Bergman, Raffaele Bernardello, Souhail Boussetta, Louis-Philippe Caron, Glenn Carver, Miguel Castrillo, Franco Catalano, Ivana Cvijanovic, Paolo Davini, Evelien Dekker, Francisco J. Doblas-Reyes, David Docquier, Pablo Echevarria, Uwe Fladrich, Ramon Fuentes-Franco, Matthias Gröger, Jost v. Hardenberg, Jenny Hieronymus, M. Pasha Karami, Jukka-Pekka Keskinen, Torben Koenigk, Risto Makkonen, François Massonnet, Martin Ménégoz, Paul A. Miller, Eduardo Moreno-Chamarro, Lars Nieradzik, Twan van Noije, Paul Nolan, Declan O'Donnell, Pirkka Ollinaho, Gijs van den Oord, Pablo Ortega, Oriol Tintó Prims, Arthur Ramos, Thomas Reerink, Clement Rousset, Yohan Ruprich-Robert, Philippe Le Sager, Torben Schmith, Roland Schrödner, Federico Serva, Valentina Sicardi, Marianne Sloth Madsen, Benjamin Smith, Tian Tian, Etienne Tourigny, Petteri Uotila, Martin Vancoppenolle, Shiyu Wang, David Wårlind, Ulrika Willén, Klaus Wyser, Shuting Yang, Xavier Yepes-Arbós, and Qiong Zhang
Geosci. Model Dev., 15, 2973–3020, https://doi.org/10.5194/gmd-15-2973-2022, https://doi.org/10.5194/gmd-15-2973-2022, 2022
Short summary
Short summary
The Earth system model EC-Earth3 is documented here. Key performance metrics show physical behavior and biases well within the frame known from recent models. With improved physical and dynamic features, new ESM components, community tools, and largely improved physical performance compared to the CMIP5 version, EC-Earth3 represents a clear step forward for the only European community ESM. We demonstrate here that EC-Earth3 is suited for a range of tasks in CMIP6 and beyond.
Xavier Yepes-Arbós, Gijs van den Oord, Mario C. Acosta, and Glenn D. Carver
Geosci. Model Dev., 15, 379–394, https://doi.org/10.5194/gmd-15-379-2022, https://doi.org/10.5194/gmd-15-379-2022, 2022
Short summary
Short summary
Climate prediction models produce a large volume of simulated data that sometimes might not be efficiently managed. In this paper we present an approach to address this issue by reducing the computing time and storage space. As a case study, we analyse the output writing process of the ECMWF atmospheric model called IFS, and we integrate into it a data writing tool called XIOS. The results suggest that the integration between the two components achieves an adequate computational performance.
Eduardo Moreno-Chamarro, Louis-Philippe Caron, Saskia Loosveldt Tomas, Javier Vegas-Regidor, Oliver Gutjahr, Marie-Pierre Moine, Dian Putrasahan, Christopher D. Roberts, Malcolm J. Roberts, Retish Senan, Laurent Terray, Etienne Tourigny, and Pier Luigi Vidale
Geosci. Model Dev., 15, 269–289, https://doi.org/10.5194/gmd-15-269-2022, https://doi.org/10.5194/gmd-15-269-2022, 2022
Short summary
Short summary
Climate models do not fully reproduce observations: they show differences (biases) in regional temperature, precipitation, or cloud cover. Reducing model biases is important to increase our confidence in their ability to reproduce present and future climate changes. Model realism is set by its resolution: the finer it is, the more physical processes and interactions it can resolve. We here show that increasing resolution of up to ~ 25 km can help reduce model biases but not remove them entirely.
Roberto Bilbao, Simon Wild, Pablo Ortega, Juan Acosta-Navarro, Thomas Arsouze, Pierre-Antoine Bretonnière, Louis-Philippe Caron, Miguel Castrillo, Rubén Cruz-García, Ivana Cvijanovic, Francisco Javier Doblas-Reyes, Markus Donat, Emanuel Dutra, Pablo Echevarría, An-Chi Ho, Saskia Loosveldt-Tomas, Eduardo Moreno-Chamarro, Núria Pérez-Zanon, Arthur Ramos, Yohan Ruprich-Robert, Valentina Sicardi, Etienne Tourigny, and Javier Vegas-Regidor
Earth Syst. Dynam., 12, 173–196, https://doi.org/10.5194/esd-12-173-2021, https://doi.org/10.5194/esd-12-173-2021, 2021
Short summary
Short summary
This paper presents and evaluates a set of retrospective decadal predictions with the EC-Earth3 climate model. These experiments successfully predict past changes in surface air temperature but show poor predictive capacity in the subpolar North Atlantic, a well-known source region of decadal climate variability. The poor predictive capacity is linked to an initial shock affecting the Atlantic Ocean circulation, ultimately due to a suboptimal representation of the Labrador Sea density.
Cited articles
Abdulsalam, S., Zong, Z., Gu, Q., and Qiu, M.: Using the Greenup, Powerup, and Speedup metrics to evaluate software energy efficiency, in: 2015 Sixth International Green and Sustainable Computing Conference (IGSC), 1–8, https://doi.org/10.1109/IGCC.2015.7393699, 2015. a, b
Acosta, M. C., Palomas, S., Paronuzzi Ticco, S. V., Utrera, G., Biercamp, J., Bretonniere, P.-A., Budich, R., Castrillo, M., Caubel, A., Doblas-Reyes, F., Epicoco, I., Fladrich, U., Joussaume, S., Kumar Gupta, A., Lawrence, B., Le Sager, P., Lister, G., Moine, M.-P., Rioual, J.-C., Valcke, S., Zadeh, N., and Balaji, V.: The computational and energy cost of simulation and storage for climate science: lessons from CMIP6, Geosci. Model Dev., 17, 3081–3098, https://doi.org/10.5194/gmd-17-3081-2024, 2024a. a, b, c, d
Acosta, M. C., Palomas, S., and Tourigny, E.: Balancing EC-Earth3 Improving the Performance of EC-Earth CMIP6 Configurations by Minimizing the Coupling Cost, Earth Space Sci., 10, e2023EA002912, https://doi.org/10.1029/2023EA002912, 2023b. a
Alexeev, Y., Mickelson, S., Leyffer, S., Jacob, R., and Craig, A.: The Heuristic Static Load-Balancing Algorithm Applied to the Community Earth System Model, in: 2014 IEEE International Parallel & Distributed Processing Symposium Workshops, 1581–1590, https://doi.org/10.1109/IPDPSW.2014.177, 2014. a
Autosubmit documentation and user guide: Autosubmit, Autosubmit [code], https://autosubmit.readthedocs.io/en/master/, last access: 18 November 2024. a
Autosubmit workflow manager: Python package, Pypi [code], https://pypi.org/project/autosubmit/, last access: 18 November 2024. a
Balaji, V.: Climate Computing: The State of Play, Comput. Sci. Eng., 17, 9–13, https://doi.org/10.1109/MCSE.2015.109, 2015. a
Balaji, V., Maisonnave, E., Zadeh, N., Lawrence, B. N., Biercamp, J., Fladrich, U., Aloisio, G., Benson, R., Caubel, A., Durachta, J., Foujols, M.-A., Lister, G., Mocavero, S., Underwood, S., and Wright, G.: CPMIP: measurements of real computational performance of Earth system models in CMIP6, Geosci. Model Dev., 10, 19–34, https://doi.org/10.5194/gmd-10-19-2017, 2017. a, b
Balaprakash, P., Alexeev, Y., Mickelson, S. A., Leyffer, S., Jacob, R., and Craig, A.: Machine-Learning-Based Load Balancing for Community Ice Code Component in CESM, in: High Performance Computing for Computational Science – VECPAR 2014, edited by Daydé, M., Marques, O., and Nakajima, K., Springer International Publishing, Cham, 79–91, ISBN 978-3-319-17353-5, 2015. a
Craig, A., Valcke, S., and Coquart, L.: Development and performance of a new version of the OASIS coupler, OASIS3-MCT_3.0, Geosci. Model Dev., 10, 3297–3308, https://doi.org/10.5194/gmd-10-3297-2017, 2017. a
Dennis, J. M., Vertenstein, M., Worley, P. H., Mirin, A. A., Craig, A. P., Jacob, R., and Mickelson, S.: Computational performance of ultra-high-resolution capability in the Community Earth System Model, The Int. J. High Perform. C., 26, 5–16, https://doi.org/10.1177/1094342012436965, 2012. a
Ding, N., Wei, X., Xu, J., Haoyu, X., and Zhenya, S.: CESMTuner: An Auto-tuning Framework for the Community Earth System Model, in: 2014 IEEE Intl Conf on High Performance Computing and Communications, 2014 IEEE 6th Intl Symp on Cyberspace Safety and Security, 2014 IEEE 11th Intl Conf on Embedded Software and Syst (HPCC,CSS,ICESS), 282–289, https://doi.org/10.1109/HPCC.2014.51, 2014. a
Ding, N., Xue, W., Song, Z., Fu, H., Xu, S., and Zheng, W.: An automatic performance model-based scheduling tool for coupled climate system models, J. Parallel Distr. Com., 132, 204–216, https://doi.org/10.1016/j.jpdc.2018.01.002, 2019. a
Donners, J., Basu, C., Mckinstry, A., Asif, M., Porter, A., Maisonnave, E., Valcke, S., and Fladrich, U.: Performance Analysis of EC-EARTH 3.1, PRACE Whitepaper, Partnership for Advanced Computing in Europe White Paper, 26 pp., vol. 560, 2012. a
Döscher, R., Acosta, M., Alessandri, A., Anthoni, P., Arsouze, T., Bergman, T., Bernardello, R., Boussetta, S., Caron, L.-P., Carver, G., Castrillo, M., Catalano, F., Cvijanovic, I., Davini, P., Dekker, E., Doblas-Reyes, F. J., Docquier, D., Echevarria, P., Fladrich, U., Fuentes-Franco, R., Gröger, M., v. Hardenberg, J., Hieronymus, J., Karami, M. P., Keskinen, J.-P., Koenigk, T., Makkonen, R., Massonnet, F., Ménégoz, M., Miller, P. A., Moreno-Chamarro, E., Nieradzik, L., van Noije, T., Nolan, P., O'Donnell, D., Ollinaho, P., van den Oord, G., Ortega, P., Prims, O. T., Ramos, A., Reerink, T., Rousset, C., Ruprich-Robert, Y., Le Sager, P., Schmith, T., Schrödner, R., Serva, F., Sicardi, V., Sloth Madsen, M., Smith, B., Tian, T., Tourigny, E., Uotila, P., Vancoppenolle, M., Wang, S., Wårlind, D., Willén, U., Wyser, K., Yang, S., Yepes-Arbós, X., and Zhang, Q.: The EC-Earth3 Earth system model for the Coupled Model Intercomparison Project 6, Geosci. Model Dev., 15, 2973–3020, https://doi.org/10.5194/gmd-15-2973-2022, 2022. a, b, c
EC-Earth development portal: http://www.ec-earth.org, last access: 18 November 2024. a
Eyring, V., Bony, S., Meehl, G. A., Senior, C. A., Stevens, B., Stouffer, R. J., and Taylor, K. E.: Overview of the Coupled Model Intercomparison Project Phase 6 (CMIP6) experimental design and organization, Geosci. Model Dev., 9, 1937–1958, https://doi.org/10.5194/gmd-9-1937-2016, 2016. a
Feitelson, D. G. and Rudolph, L.: Parallel job scheduling: Issues and approaches, in: Workshop on Job Scheduling Strategies for Parallel Processing, 1–18, https://doi.org/10.1007/3-540-60153-8_20, 1995. a
Freeh, V. W., Pan, F., Kappiah, N., Lowenthal, D. K., and Springer, R.: Exploring the energy-time tradeoff in MPI programs on a power-scalable cluster, in: 19th IEEE International Parallel and Distributed Processing Symposium, 10 pp., https://doi.org/10.1109/IPDPS.2005.214, 2005. a
Garcia, M., Corbalan, J., and Labarta, J.: LeWI: A Runtime Balancing Algorithm for Nested Parallelism, in: 2009 International Conference on Parallel Processing, 526–533, https://doi.org/10.1109/ICPP.2009.56, 2009. a
Haarsma, R., Acosta, M., Bakhshi, R., Bretonnière, P.-A., Caron, L.-P., Castrillo, M., Corti, S., Davini, P., Exarchou, E., Fabiano, F., Fladrich, U., Fuentes Franco, R., García-Serrano, J., von Hardenberg, J., Koenigk, T., Levine, X., Meccia, V. L., van Noije, T., van den Oord, G., Palmeiro, F. M., Rodrigo, M., Ruprich-Robert, Y., Le Sager, P., Tourigny, E., Wang, S., van Weele, M., and Wyser, K.: HighResMIP versions of EC-Earth: EC-Earth3P and EC-Earth3P-HR – description, model computational performance and basic validation, Geosci. Model Dev., 13, 3507–3527, https://doi.org/10.5194/gmd-13-3507-2020, 2020. a
Kim, D., Larson, J. W., and Chiu, K.: Toward Malleable Model Coupling, Procedia Comput. Sci., 4, 312–321, https://doi.org/10.1016/j.procs.2011.04.033, 2011. a
Kim, D., Larson, J. W., and Chiu, K.: Dynamic Load Balancing for Malleable Model Coupling, in: 2012 IEEE 10th International Symposium on Parallel and Distributed Processing with Applications, 150–157, https://doi.org/10.1109/ISPA.2012.28, 2012a. a
Kim, D., Larson, J. W., and Chiu, K.: Malleable Model Coupling with Prediction, in: 2012 12th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (ccgrid 2012), 360–367, https://doi.org/10.1109/CCGrid.2012.20, 2012b. a
Kim, D., Larson, J. W., and Chiu, K.: Automatic Performance Prediction for Load-Balancing Coupled Models, in: 2013 13th IEEE/ACM International Symposium on Cluster, Cloud, and Grid Computing, 410–417, https://doi.org/10.1109/CCGrid.2013.72, 2013. a
Lieber, M. and Wolke, R.: Optimizing the coupling in parallel air quality model systems, Environ. Modell. Softw., 23, 235–243, https://doi.org/10.1016/j.envsoft.2007.06.007, 2008. a
Maghraoui, K., Szymanski, B., and Varela, C.: An Architecture for Reconfigurable Iterative MPI Applications in Dynamic Environments, in: Parallel Processing and Applied Mathematics, 3911, 258–271, ISBN 978-3-540-34141-3, https://doi.org/10.1007/11752578_32, 2005. a
Maghraoui, K. E., Desell, T. J., Szymanski, B. K., and Varela, C. A.: Dynamic Malleability in Iterative MPI Applications, in: Seventh IEEE International Symposium on Cluster Computing and the Grid (CCGrid '07), 591–598, https://doi.org/10.1109/CCGRID.2007.45, 2007. a
Manabe, S., Bryan, K., and Spelman, M. J.: A global ocean-atmosphere climate model. Part I. The atmospheric circulation, J. Phys. Oceanogr., 5, 3–29, 1975. a
Manubens-Gil, D., Vegas-Regidor, J., Prodhomme, C., Mula-Valls, O., and Doblas-Reyes, F. J.: Seamless management of ensemble climate prediction experiments on HPC platforms, in: 2016 International Conference on High Performance Computing & Simulation (HPCS), 895–900, https://doi.org/10.1109/HPCSim.2016.7568429, 2016. a
Marta, G., Corbalan, J., Maria, B. R., and Jesus, L.: A Dynamic Load Balancing Approach with SMPSuperscalar and MPI, chap. Facing the Multicore – Challenge II: Aspects of New Paradigms and Technologies in Parallel Computing, Springer Berlin Heidelberg, ISBN 978-3-642-30397-5, https://doi.org/10.1007/978-3-642-30397-5_2, 2012. a
Mechoso, C. R., An, S.-I., and Valcke, S.: Atmosphere-ocean Modeling: Coupling and Couplers, World Scientific, ISBN 9811232954, 2021. a
Palomas, S.: sergipalomas/auto-lb_prediction-script: version for publication (v1.0), Zenodo [code], https://doi.org/10.5281/zenodo.14163512, 2024. a
Tintó Prims, O., Castrillo, M., Acosta, M. C., Mula-Valls, O., Sanchez Lorente, A., Serradell, K., Cortés, A., and Doblas-Reyes, F. J.: Finding, analysing and solving MPI communication bottlenecks in Earth System models, J. Comput. Sci., 36, 100864, https://doi.org/10.1016/j.jocs.2018.04.015, 2019. a
Vadhiyar, S. and Dongarra, J.: SRS – A Framework for Developing Malleable and Migratable Parallel Applications for Distributed Systems, Parallel Processing Letters, 13, 291–312, https://doi.org/10.1142/S0129626403001288, 2003. a
Valcke, S., Balaji, V., Craig, A., DeLuca, C., Dunlap, R., Ford, R. W., Jacob, R., Larson, J., O'Kuinghttons, R., Riley, G. D., and Vertenstein, M.: Coupling technologies for Earth System Modelling, Geosci. Model Dev., 5, 1589–1596, https://doi.org/10.5194/gmd-5-1589-2012, 2012. a
Will, A., Akhtar, N., Brauch, J., Breil, M., Davin, E., Ho-Hagemann, H. T. M., Maisonnave, E., Thürkow, M., and Weiher, S.: The COSMO-CLM 4.8 regional climate model coupled to regional ocean, land surface and global earth system models using OASIS3-MCT: description and performance, Geosci. Model Dev., 10, 1549–1586, https://doi.org/10.5194/gmd-10-1549-2017, 2017. a
Yepes-Arbós, X., Acosta, M. C., Serradell, K., Mula-Valls, O., and Doblas-Reyes, F. J.: Scalability and performance analysis of EC-EARTH 3.2.0 using a new metrics approach (part I), Tech. rep., Barcelona Supercomputing Center (BSC-CNS), https://earth.bsc.es/wiki/lib/exe/fetch.php?media=library:external:technical_memoranda:bsc-ces-2016-001-scalability_ec-earth.pdf (last access: 18 November 2024), 2016. a
Short summary
We present an automatic tool that optimizes resource distribution in coupled climate models, enhancing speed and reducing computational costs without requiring expert knowledge. Users can set energy/time criteria or limit resource usage. Tested on various European Community Earth System Model (EC-Earth) configurations and high-performance computing (HPC) platforms, it achieved up to 34 % faster simulations with fewer resources.
We present an automatic tool that optimizes resource distribution in coupled climate models,...
