Articles | Volume 11, issue 7
https://doi.org/10.5194/gmd-11-2875-2018
https://doi.org/10.5194/gmd-11-2875-2018
Development and technical paper
 | 
13 Jul 2018
Development and technical paper |  | 13 Jul 2018

A run control framework to streamline profiling, porting, and tuning simulation runs and provenance tracking of geoscientific applications

Wendy Sharples, Ilya Zhukov, Markus Geimer, Klaus Goergen, Sebastian Luehrs, Thomas Breuer, Bibi Naz, Ketan Kulkarni, Slavko Brdar, and Stefan Kollet

Related authors

Improving soil moisture and runoff simulations at 3 km over Europe using land surface data assimilation
Bibi S. Naz, Wolfgang Kurtz, Carsten Montzka, Wendy Sharples, Klaus Goergen, Jessica Keune, Huilin Gao, Anne Springer, Harrie-Jan Hendricks Franssen, and Stefan Kollet
Hydrol. Earth Syst. Sci., 23, 277–301, https://doi.org/10.5194/hess-23-277-2019,https://doi.org/10.5194/hess-23-277-2019, 2019
Short summary

Related subject area

Earth and space science informatics
Random forests with spatial proxies for environmental modelling: opportunities and pitfalls
Carles Milà, Marvin Ludwig, Edzer Pebesma, Cathryn Tonne, and Hanna Meyer
Geosci. Model Dev., 17, 6007–6033, https://doi.org/10.5194/gmd-17-6007-2024,https://doi.org/10.5194/gmd-17-6007-2024, 2024
Short summary
An improved global pressure and zenith wet delay model with optimized vertical correction considering the spatiotemporal variability in multiple height-scale factors
Chunhua Jiang, Xiang Gao, Huizhong Zhu, Shuaimin Wang, Sixuan Liu, Shaoni Chen, and Guangsheng Liu
Geosci. Model Dev., 17, 5939–5959, https://doi.org/10.5194/gmd-17-5939-2024,https://doi.org/10.5194/gmd-17-5939-2024, 2024
Short summary
kNNDM CV: k-fold nearest-neighbour distance matching cross-validation for map accuracy estimation
Jan Linnenbrink, Carles Milà, Marvin Ludwig, and Hanna Meyer
Geosci. Model Dev., 17, 5897–5912, https://doi.org/10.5194/gmd-17-5897-2024,https://doi.org/10.5194/gmd-17-5897-2024, 2024
Short summary
Accelerating Lagrangian transport simulations on graphics processing units: performance optimizations of Massive-Parallel Trajectory Calculations (MPTRAC) v2.6
Lars Hoffmann, Kaveh Haghighi Mood, Andreas Herten, Markus Hrywniak, Jiri Kraus, Jan Clemens, and Mingzhao Liu
Geosci. Model Dev., 17, 4077–4094, https://doi.org/10.5194/gmd-17-4077-2024,https://doi.org/10.5194/gmd-17-4077-2024, 2024
Short summary
Focal-TSMP: deep learning for vegetation health prediction and agricultural drought assessment from a regional climate simulation
Mohamad Hakam Shams Eddin and Juergen Gall
Geosci. Model Dev., 17, 2987–3023, https://doi.org/10.5194/gmd-17-2987-2024,https://doi.org/10.5194/gmd-17-2987-2024, 2024
Short summary

Cited articles

Alonso, P., Badia, R. M., Labarta, J., Barreda, M., Dolz, M. F., Mayo, R., Quintana-Orti, E. S., and Reyes, R.: Tools for Power-Energy Modelling and Analysis of Parallel Scientific Applications, in: 2012 41st International Conference on Parallel Processing, 420–429, https://doi.org/10.1109/ICPP.2012.57, 2012.
Ashby, S. F. and Falgout, R. D.: A parallel multigrid preconditioned conjugate gradient algorithm for groundwater flow simulations, Nucl. Sci. Eng., 124, 145–159, 1996.
Attig, N., Gibbon, P., and Lippert, T.: Trends in supercomputing: The European path to exascale, Comput. Phys. Commun., 182, 2041–2046, https://doi.org/10.1016/j.cpc.2010.11.011, 2011.
Bahra, A.: Managing work flows with ecFlow, ECMWF Newsletter,. Tech. Rep., 129, 30–32, 2011.
Download
Short summary
Next-generation geoscientific models are based on complex model implementations and workflows. Next-generation HPC systems require new programming paradigms and code optimization. In order to meet the challenge of running complex simulations on new massively parallel HPC systems, we developed a run control framework that facilitates code portability, code profiling, and provenance tracking to reduce both the duration and the cost of code migration and development, while ensuring reproducibility.