Articles | Volume 11, issue 7
https://doi.org/10.5194/gmd-11-2875-2018
https://doi.org/10.5194/gmd-11-2875-2018
Development and technical paper
 | 
13 Jul 2018
Development and technical paper |  | 13 Jul 2018

A run control framework to streamline profiling, porting, and tuning simulation runs and provenance tracking of geoscientific applications

Wendy Sharples, Ilya Zhukov, Markus Geimer, Klaus Goergen, Sebastian Luehrs, Thomas Breuer, Bibi Naz, Ketan Kulkarni, Slavko Brdar, and Stefan Kollet

Related authors

Improving soil moisture and runoff simulations at 3 km over Europe using land surface data assimilation
Bibi S. Naz, Wolfgang Kurtz, Carsten Montzka, Wendy Sharples, Klaus Goergen, Jessica Keune, Huilin Gao, Anne Springer, Harrie-Jan Hendricks Franssen, and Stefan Kollet
Hydrol. Earth Syst. Sci., 23, 277–301, https://doi.org/10.5194/hess-23-277-2019,https://doi.org/10.5194/hess-23-277-2019, 2019
Short summary

Related subject area

Earth and space science informatics
Machine learning for numerical weather and climate modelling: a review
Catherine O. de Burgh-Day and Tennessee Leeuwenburg
Geosci. Model Dev., 16, 6433–6477, https://doi.org/10.5194/gmd-16-6433-2023,https://doi.org/10.5194/gmd-16-6433-2023, 2023
Short summary
Overcoming barriers to enable convergence research by integrating ecological and climate sciences: the NCAR–NEON system Version 1
Danica L. Lombardozzi, William R. Wieder, Negin Sobhani, Gordon B. Bonan, David Durden, Dawn Lenz, Michael SanClements, Samantha Weintraub-Leff, Edward Ayres, Christopher R. Florian, Kyla Dahlin, Sanjiv Kumar, Abigail L. S. Swann, Claire M. Zarakas, Charles Vardeman, and Valerio Pascucci
Geosci. Model Dev., 16, 5979–6000, https://doi.org/10.5194/gmd-16-5979-2023,https://doi.org/10.5194/gmd-16-5979-2023, 2023
Short summary
Ensemble of optimised machine learning algorithms for predicting surface soil moisture content at a global scale
Qianqian Han, Yijian Zeng, Lijie Zhang, Calimanut-Ionut Cira, Egor Prikaziuk, Ting Duan, Chao Wang, Brigitta Szabó, Salvatore Manfreda, Ruodan Zhuang, and Bob Su
Geosci. Model Dev., 16, 5825–5845, https://doi.org/10.5194/gmd-16-5825-2023,https://doi.org/10.5194/gmd-16-5825-2023, 2023
Short summary
Hazard assessment modeling and software development of earthquake-triggered landslides in the Sichuan–Yunnan area, China
Xiaoyi Shao, Siyuan Ma, and Chong Xu
Geosci. Model Dev., 16, 5113–5129, https://doi.org/10.5194/gmd-16-5113-2023,https://doi.org/10.5194/gmd-16-5113-2023, 2023
Short summary
A generalized spatial autoregressive neural network method for three-dimensional spatial interpolation
Junda Zhan, Sensen Wu, Jin Qi, Jindi Zeng, Mengjiao Qin, Yuanyuan Wang, and Zhenhong Du
Geosci. Model Dev., 16, 2777–2794, https://doi.org/10.5194/gmd-16-2777-2023,https://doi.org/10.5194/gmd-16-2777-2023, 2023
Short summary

Cited articles

Alonso, P., Badia, R. M., Labarta, J., Barreda, M., Dolz, M. F., Mayo, R., Quintana-Orti, E. S., and Reyes, R.: Tools for Power-Energy Modelling and Analysis of Parallel Scientific Applications, in: 2012 41st International Conference on Parallel Processing, 420–429, https://doi.org/10.1109/ICPP.2012.57, 2012.
Ashby, S. F. and Falgout, R. D.: A parallel multigrid preconditioned conjugate gradient algorithm for groundwater flow simulations, Nucl. Sci. Eng., 124, 145–159, 1996.
Attig, N., Gibbon, P., and Lippert, T.: Trends in supercomputing: The European path to exascale, Comput. Phys. Commun., 182, 2041–2046, https://doi.org/10.1016/j.cpc.2010.11.011, 2011.
Bahra, A.: Managing work flows with ecFlow, ECMWF Newsletter,. Tech. Rep., 129, 30–32, 2011.
Download
Short summary
Next-generation geoscientific models are based on complex model implementations and workflows. Next-generation HPC systems require new programming paradigms and code optimization. In order to meet the challenge of running complex simulations on new massively parallel HPC systems, we developed a run control framework that facilitates code portability, code profiling, and provenance tracking to reduce both the duration and the cost of code migration and development, while ensuring reproducibility.