Articles | Volume 15, issue 2
https://doi.org/10.5194/gmd-15-379-2022
https://doi.org/10.5194/gmd-15-379-2022
Development and technical paper
 | 
18 Jan 2022
Development and technical paper |  | 18 Jan 2022

Evaluation and optimisation of the I/O scalability for the next generation of Earth system models: IFS CY43R3 and XIOS 2.0 integration as a case study

Xavier Yepes-Arbós, Gijs van den Oord, Mario C. Acosta, and Glenn D. Carver

Related authors

The EC-Earth3 Earth system model for the Coupled Model Intercomparison Project 6
Ralf Döscher, Mario Acosta, Andrea Alessandri, Peter Anthoni, Thomas Arsouze, Tommi Bergman, Raffaele Bernardello, Souhail Boussetta, Louis-Philippe Caron, Glenn Carver, Miguel Castrillo, Franco Catalano, Ivana Cvijanovic, Paolo Davini, Evelien Dekker, Francisco J. Doblas-Reyes, David Docquier, Pablo Echevarria, Uwe Fladrich, Ramon Fuentes-Franco, Matthias Gröger, Jost v. Hardenberg, Jenny Hieronymus, M. Pasha Karami, Jukka-Pekka Keskinen, Torben Koenigk, Risto Makkonen, François Massonnet, Martin Ménégoz, Paul A. Miller, Eduardo Moreno-Chamarro, Lars Nieradzik, Twan van Noije, Paul Nolan, Declan O'Donnell, Pirkka Ollinaho, Gijs van den Oord, Pablo Ortega, Oriol Tintó Prims, Arthur Ramos, Thomas Reerink, Clement Rousset, Yohan Ruprich-Robert, Philippe Le Sager, Torben Schmith, Roland Schrödner, Federico Serva, Valentina Sicardi, Marianne Sloth Madsen, Benjamin Smith, Tian Tian, Etienne Tourigny, Petteri Uotila, Martin Vancoppenolle, Shiyu Wang, David Wårlind, Ulrika Willén, Klaus Wyser, Shuting Yang, Xavier Yepes-Arbós, and Qiong Zhang
Geosci. Model Dev., 15, 2973–3020, https://doi.org/10.5194/gmd-15-2973-2022,https://doi.org/10.5194/gmd-15-2973-2022, 2022
Short summary
Replicability of the EC-Earth3 Earth system model under a change in computing environment
François Massonnet, Martin Ménégoz, Mario Acosta, Xavier Yepes-Arbós, Eleftheria Exarchou, and Francisco J. Doblas-Reyes
Geosci. Model Dev., 13, 1165–1178, https://doi.org/10.5194/gmd-13-1165-2020,https://doi.org/10.5194/gmd-13-1165-2020, 2020
Short summary

Related subject area

Climate and Earth system modeling
Multivariate adjustment of drizzle bias using machine learning in European climate projections
Georgia Lazoglou, Theo Economou, Christina Anagnostopoulou, George Zittis, Anna Tzyrkalli, Pantelis Georgiades, and Jos Lelieveld
Geosci. Model Dev., 17, 4689–4703, https://doi.org/10.5194/gmd-17-4689-2024,https://doi.org/10.5194/gmd-17-4689-2024, 2024
Short summary
Development and evaluation of the interactive Model for Air Pollution and Land Ecosystems (iMAPLE) version 1.0
Xu Yue, Hao Zhou, Chenguang Tian, Yimian Ma, Yihan Hu, Cheng Gong, Hui Zheng, and Hong Liao
Geosci. Model Dev., 17, 4621–4642, https://doi.org/10.5194/gmd-17-4621-2024,https://doi.org/10.5194/gmd-17-4621-2024, 2024
Short summary
A perspective on the next generation of Earth system model scenarios: towards representative emission pathways (REPs)
Malte Meinshausen, Carl-Friedrich Schleussner, Kathleen Beyer, Greg Bodeker, Olivier Boucher, Josep G. Canadell, John S. Daniel, Aïda Diongue-Niang, Fatima Driouech, Erich Fischer, Piers Forster, Michael Grose, Gerrit Hansen, Zeke Hausfather, Tatiana Ilyina, Jarmo S. Kikstra, Joyce Kimutai, Andrew D. King, June-Yi Lee, Chris Lennard, Tabea Lissner, Alexander Nauels, Glen P. Peters, Anna Pirani, Gian-Kasper Plattner, Hans Pörtner, Joeri Rogelj, Maisa Rojas, Joyashree Roy, Bjørn H. Samset, Benjamin M. Sanderson, Roland Séférian, Sonia Seneviratne, Christopher J. Smith, Sophie Szopa, Adelle Thomas, Diana Urge-Vorsatz, Guus J. M. Velders, Tokuta Yokohata, Tilo Ziehn, and Zebedee Nicholls
Geosci. Model Dev., 17, 4533–4559, https://doi.org/10.5194/gmd-17-4533-2024,https://doi.org/10.5194/gmd-17-4533-2024, 2024
Short summary
Parallel SnowModel (v1.0): a parallel implementation of a distributed snow-evolution modeling system (SnowModel)
Ross Mower, Ethan D. Gutmann, Glen E. Liston, Jessica Lundquist, and Soren Rasmussen
Geosci. Model Dev., 17, 4135–4154, https://doi.org/10.5194/gmd-17-4135-2024,https://doi.org/10.5194/gmd-17-4135-2024, 2024
Short summary
LB-SCAM: a learning-based method for efficient large-scale sensitivity analysis and tuning of the Single Column Atmosphere Model (SCAM)
Jiaxu Guo, Juepeng Zheng, Yidan Xu, Haohuan Fu, Wei Xue, Lanning Wang, Lin Gan, Ping Gao, Wubing Wan, Xianwei Wu, Zhitao Zhang, Liang Hu, Gaochao Xu, and Xilong Che
Geosci. Model Dev., 17, 3975–3992, https://doi.org/10.5194/gmd-17-3975-2024,https://doi.org/10.5194/gmd-17-3975-2024, 2024
Short summary

Cited articles

Barros, S., Dent, D., Isaksen, L., Robinson, G., Mozdzynski, G., and Wollenweber, F.: The IFS model: A parallel production weather code, Parallel Comput., 21, 1621–1638, https://doi.org/10.1016/0167-8191(96)80002-0, 1995. a, b
Chassignet, E. P. and Marshall, D. P.: Gulf Stream Separation in Numerical Ocean Models, Geophys. Monogr. Ser., 177, 39–61, https://doi.org/10.1029/177GM05, 2008. a
Demory, M.-E., Vidale, P. L., Roberts, M. J., Berrisford, P., Strachan, J., Schiemann, R., and Mizielinski, M. S.: The role of horizontal resolution in simulating drivers of the global hydrological cycle, Clim. Dynam., 42, 2201–2225, https://doi.org/10.1007/s00382-013-1924-4, 2013. a
Dorier, M., Antoniu, G., Cappello, F., Snir, M., and Orf, L.: Damaris: How to Efficiently Leverage Multicore Parallelism to Achieve Scalable, Jitter-free I/O, in: 2012 IEEE International Conference on Cluster Computing, 24–28 September 2012, Beijing, China, IEEE, 155–163, https://doi.org/10.1109/CLUSTER.2012.26, 2012. a
ECMWF: IFS Documentation CY43R3 – Part VI: Technical and computational procedures, in: IFS Documentation CY43R3, chap. 6, ECMWF, 1–227, https://doi.org/10.21957/nrwhwmukh, 2017a. a, b
Download
Short summary
Climate prediction models produce a large volume of simulated data that sometimes might not be efficiently managed. In this paper we present an approach to address this issue by reducing the computing time and storage space. As a case study, we analyse the output writing process of the ECMWF atmospheric model called IFS, and we integrate into it a data writing tool called XIOS. The results suggest that the integration between the two components achieves an adequate computational performance.