Articles | Volume 15, issue 2
https://doi.org/10.5194/gmd-15-379-2022
https://doi.org/10.5194/gmd-15-379-2022
Development and technical paper
 | 
18 Jan 2022
Development and technical paper |  | 18 Jan 2022

Evaluation and optimisation of the I/O scalability for the next generation of Earth system models: IFS CY43R3 and XIOS 2.0 integration as a case study

Xavier Yepes-Arbós, Gijs van den Oord, Mario C. Acosta, and Glenn D. Carver

Related authors

The EC-Earth3 Earth system model for the Coupled Model Intercomparison Project 6
Ralf Döscher, Mario Acosta, Andrea Alessandri, Peter Anthoni, Thomas Arsouze, Tommi Bergman, Raffaele Bernardello, Souhail Boussetta, Louis-Philippe Caron, Glenn Carver, Miguel Castrillo, Franco Catalano, Ivana Cvijanovic, Paolo Davini, Evelien Dekker, Francisco J. Doblas-Reyes, David Docquier, Pablo Echevarria, Uwe Fladrich, Ramon Fuentes-Franco, Matthias Gröger, Jost v. Hardenberg, Jenny Hieronymus, M. Pasha Karami, Jukka-Pekka Keskinen, Torben Koenigk, Risto Makkonen, François Massonnet, Martin Ménégoz, Paul A. Miller, Eduardo Moreno-Chamarro, Lars Nieradzik, Twan van Noije, Paul Nolan, Declan O'Donnell, Pirkka Ollinaho, Gijs van den Oord, Pablo Ortega, Oriol Tintó Prims, Arthur Ramos, Thomas Reerink, Clement Rousset, Yohan Ruprich-Robert, Philippe Le Sager, Torben Schmith, Roland Schrödner, Federico Serva, Valentina Sicardi, Marianne Sloth Madsen, Benjamin Smith, Tian Tian, Etienne Tourigny, Petteri Uotila, Martin Vancoppenolle, Shiyu Wang, David Wårlind, Ulrika Willén, Klaus Wyser, Shuting Yang, Xavier Yepes-Arbós, and Qiong Zhang
Geosci. Model Dev., 15, 2973–3020, https://doi.org/10.5194/gmd-15-2973-2022,https://doi.org/10.5194/gmd-15-2973-2022, 2022
Short summary
Replicability of the EC-Earth3 Earth system model under a change in computing environment
François Massonnet, Martin Ménégoz, Mario Acosta, Xavier Yepes-Arbós, Eleftheria Exarchou, and Francisco J. Doblas-Reyes
Geosci. Model Dev., 13, 1165–1178, https://doi.org/10.5194/gmd-13-1165-2020,https://doi.org/10.5194/gmd-13-1165-2020, 2020
Short summary

Related subject area

Climate and Earth system modeling
A diffusion-based kernel density estimator (diffKDE, version 1) with optimal bandwidth approximation for the analysis of data in geoscience and ecological research
Maria-Theresia Pelz, Markus Schartau, Christopher J. Somes, Vanessa Lampe, and Thomas Slawig
Geosci. Model Dev., 16, 6609–6634, https://doi.org/10.5194/gmd-16-6609-2023,https://doi.org/10.5194/gmd-16-6609-2023, 2023
Short summary
Monte Carlo drift correction – quantifying the drift uncertainty of global climate models
Benjamin S. Grandey, Zhi Yang Koh, Dhrubajyoti Samanta, Benjamin P. Horton, Justin Dauwels, and Lock Yue Chew
Geosci. Model Dev., 16, 6593–6608, https://doi.org/10.5194/gmd-16-6593-2023,https://doi.org/10.5194/gmd-16-6593-2023, 2023
Short summary
Improvements in the Canadian Earth System Model (CanESM) through systematic model analysis: CanESM5.0 and CanESM5.1
Michael Sigmond, James Anstey, Vivek Arora, Ruth Digby, Nathan Gillett, Viatcheslav Kharin, William Merryfield, Catherine Reader, John Scinocca, Neil Swart, John Virgin, Carsten Abraham, Jason Cole, Nicolas Lambert, Woo-Sung Lee, Yongxiao Liang, Elizaveta Malinina, Landon Rieger, Knut von Salzen, Christian Seiler, Clint Seinen, Andrew Shao, Reinel Sospedra-Alfonso, Libo Wang, and Duo Yang
Geosci. Model Dev., 16, 6553–6591, https://doi.org/10.5194/gmd-16-6553-2023,https://doi.org/10.5194/gmd-16-6553-2023, 2023
Short summary
Earth System Model Aerosol–Cloud Diagnostics (ESMAC Diags) package, version 2: assessing aerosols, clouds, and aerosol–cloud interactions via field campaign and long-term observations
Shuaiqi Tang, Adam C. Varble, Jerome D. Fast, Kai Zhang, Peng Wu, Xiquan Dong, Fan Mei, Mikhail Pekour, Joseph C. Hardin, and Po-Lun Ma
Geosci. Model Dev., 16, 6355–6376, https://doi.org/10.5194/gmd-16-6355-2023,https://doi.org/10.5194/gmd-16-6355-2023, 2023
Short summary
CIOFC1.0: a common parallel input/output framework based on C-Coupler2.0
Xinzhu Yu, Li Liu, Chao Sun, Qingu Jiang, Biao Zhao, Zhiyuan Zhang, Hao Yu, and Bin Wang
Geosci. Model Dev., 16, 6285–6308, https://doi.org/10.5194/gmd-16-6285-2023,https://doi.org/10.5194/gmd-16-6285-2023, 2023
Short summary

Cited articles

Barros, S., Dent, D., Isaksen, L., Robinson, G., Mozdzynski, G., and Wollenweber, F.: The IFS model: A parallel production weather code, Parallel Comput., 21, 1621–1638, https://doi.org/10.1016/0167-8191(96)80002-0, 1995. a, b
Chassignet, E. P. and Marshall, D. P.: Gulf Stream Separation in Numerical Ocean Models, Geophys. Monogr. Ser., 177, 39–61, https://doi.org/10.1029/177GM05, 2008. a
Demory, M.-E., Vidale, P. L., Roberts, M. J., Berrisford, P., Strachan, J., Schiemann, R., and Mizielinski, M. S.: The role of horizontal resolution in simulating drivers of the global hydrological cycle, Clim. Dynam., 42, 2201–2225, https://doi.org/10.1007/s00382-013-1924-4, 2013. a
Dorier, M., Antoniu, G., Cappello, F., Snir, M., and Orf, L.: Damaris: How to Efficiently Leverage Multicore Parallelism to Achieve Scalable, Jitter-free I/O, in: 2012 IEEE International Conference on Cluster Computing, 24–28 September 2012, Beijing, China, IEEE, 155–163, https://doi.org/10.1109/CLUSTER.2012.26, 2012. a
ECMWF: IFS Documentation CY43R3 – Part VI: Technical and computational procedures, in: IFS Documentation CY43R3, chap. 6, ECMWF, 1–227, https://doi.org/10.21957/nrwhwmukh, 2017a. a, b
Download
Short summary
Climate prediction models produce a large volume of simulated data that sometimes might not be efficiently managed. In this paper we present an approach to address this issue by reducing the computing time and storage space. As a case study, we analyse the output writing process of the ECMWF atmospheric model called IFS, and we integrate into it a data writing tool called XIOS. The results suggest that the integration between the two components achieves an adequate computational performance.