Articles | Volume 11, issue 7
https://doi.org/10.5194/gmd-11-2875-2018
© Author(s) 2018. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
https://doi.org/10.5194/gmd-11-2875-2018
© Author(s) 2018. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
Development and technical paper
| 
13 Jul 2018
Development and technical paper |
| 13 Jul 2018
| 13 Jul 2018
A run control framework to streamline profiling, porting, and tuning simulation runs and provenance tracking of geoscientific applications
Wendy Sharples
CORRESPONDING AUTHOR
Jülich Supercomputing Centre, Forschungszentrum Jülich, Jülich, Germany
Institute of Bio- and Geosciences, Agrosphere (IBG-3), Forschungszentrum Jülich, Jülich, Germany
Meteorological Institute, University of Bonn, Bonn, Germany
Ilya Zhukov
Jülich Supercomputing Centre, Forschungszentrum Jülich, Jülich, Germany
Markus Geimer
Jülich Supercomputing Centre, Forschungszentrum Jülich, Jülich, Germany
Klaus Goergen
Institute of Bio- and Geosciences, Agrosphere (IBG-3), Forschungszentrum Jülich, Jülich, Germany
Centre for High-Performance Scientific Computing in Terrestrial Systems, Geoverbund ABC/J, Jülich, Germany
Sebastian Luehrs
Jülich Supercomputing Centre, Forschungszentrum Jülich, Jülich, Germany
Thomas Breuer
Jülich Supercomputing Centre, Forschungszentrum Jülich, Jülich, Germany
Institute of Bio- and Geosciences, Agrosphere (IBG-3), Forschungszentrum Jülich, Jülich, Germany
Centre for High-Performance Scientific Computing in Terrestrial Systems, Geoverbund ABC/J, Jülich, Germany
Ketan Kulkarni
Jülich Supercomputing Centre, Forschungszentrum Jülich, Jülich, Germany
Centre for High-Performance Scientific Computing in Terrestrial Systems, Geoverbund ABC/J, Jülich, Germany
Slavko Brdar
Jülich Supercomputing Centre, Forschungszentrum Jülich, Jülich, Germany
Centre for High-Performance Scientific Computing in Terrestrial Systems, Geoverbund ABC/J, Jülich, Germany
Stefan Kollet
Institute of Bio- and Geosciences, Agrosphere (IBG-3), Forschungszentrum Jülich, Jülich, Germany
Centre for High-Performance Scientific Computing in Terrestrial Systems, Geoverbund ABC/J, Jülich, Germany
Related authors
Bibi S. Naz, Wolfgang Kurtz, Carsten Montzka, Wendy Sharples, Klaus Goergen, Jessica Keune, Huilin Gao, Anne Springer, Harrie-Jan Hendricks Franssen, and Stefan Kollet
Hydrol. Earth Syst. Sci., 23, 277–301, https://doi.org/10.5194/hess-23-277-2019, https://doi.org/10.5194/hess-23-277-2019, 2019
Short summary
Short summary
This study investigates the value of assimilating coarse-resolution remotely sensed soil moisture data into high-resolution land surface models for improving soil moisture and runoff modeling. The soil moisture estimates in this study, with complete spatio-temporal coverage and improved spatial resolution from the assimilation, offer a new reanalysis product for the monitoring of surface soil water content and other hydrological fluxes at 3 km resolution over Europe.
Christian Poppe Terán, Bibi S. Naz, Harry Vereecken, Roland Baatz, Rosie Fisher, and Harrie-Jan Hendricks Franssen
EGUsphere, https://doi.org/10.5194/egusphere-2024-978, https://doi.org/10.5194/egusphere-2024-978, 2024
Short summary
Short summary
Carbon and water exchanges between the atmosphere and the land surface contribute to water resource availability and climate change mitigation. Land Surface Models, like the Community Land Model version 5 (CLM5), simulate these. This study finds that CLM5 and other data sets underestimate the magnitudes and variability of carbon and water exchanges for the most abundant plant functional types compared to observations. It provides essential insights for further research on these processes.
Bjorn Stevens, Stefan Adami, Tariq Ali, Hartwig Anzt, Zafer Aslan, Sabine Attinger, Jaana Bäck, Johanna Baehr, Peter Bauer, Natacha Bernier, Bob Bishop, Hendryk Bockelmann, Sandrine Bony, Guy Brasseur, David N. Bresch, Sean Breyer, Gilbert Brunet, Pier Luigi Buttigieg, Junji Cao, Christelle Castet, Yafang Cheng, Ayantika Dey Choudhury, Deborah Coen, Susanne Crewell, Atish Dabholkar, Qing Dai, Francisco Doblas-Reyes, Dale Durran, Ayoub El Gaidi, Charlie Ewen, Eleftheria Exarchou, Veronika Eyring, Florencia Falkinhoff, David Farrell, Piers M. Forster, Ariane Frassoni, Claudia Frauen, Oliver Fuhrer, Shahzad Gani, Edwin Gerber, Debra Goldfarb, Jens Grieger, Nicolas Gruber, Wilco Hazeleger, Rolf Herken, Chris Hewitt, Torsten Hoefler, Huang-Hsiung Hsu, Daniela Jacob, Alexandra Jahn, Christian Jakob, Thomas Jung, Christopher Kadow, In-Sik Kang, Sarah Kang, Karthik Kashinath, Katharina Kleinen-von Königslöw, Daniel Klocke, Uta Kloenne, Milan Klöwer, Chihiro Kodama, Stefan Kollet, Tobias Kölling, Jenni Kontkanen, Steve Kopp, Michal Koran, Markku Kulmala, Hanna Lappalainen, Fakhria Latifi, Bryan Lawrence, June Yi Lee, Quentin Lejeun, Christian Lessig, Chao Li, Thomas Lippert, Jürg Luterbacher, Pekka Manninen, Jochem Marotzke, Satoshi Matsouoka, Charlotte Merchant, Peter Messmer, Gero Michel, Kristel Michielsen, Tomoki Miyakawa, Jens Müller, Ramsha Munir, Sandeep Narayanasetti, Ousmane Ndiaye, Carlos Nobre, Achim Oberg, Riko Oki, Tuba Özkan-Haller, Tim Palmer, Stan Posey, Andreas Prein, Odessa Primus, Mike Pritchard, Julie Pullen, Dian Putrasahan, Johannes Quaas, Krishnan Raghavan, Venkatachalam Ramaswamy, Markus Rapp, Florian Rauser, Markus Reichstein, Aromar Revi, Sonakshi Saluja, Masaki Satoh, Vera Schemann, Sebastian Schemm, Christina Schnadt Poberaj, Thomas Schulthess, Cath Senior, Jagadish Shukla, Manmeet Singh, Julia Slingo, Adam Sobel, Silvina Solman, Jenna Spitzer, Philip Stier, Thomas Stocker, Sarah Strock, Hang Su, Petteri Taalas, John Taylor, Susann Tegtmeier, Georg Teutsch, Adrian Tompkins, Uwe Ulbrich, Pier-Luigi Vidale, Chien-Ming Wu, Hao Xu, Najibullah Zaki, Laure Zanna, Tianjun Zhou, and Florian Ziemen
Earth Syst. Sci. Data, 16, 2113–2122, https://doi.org/10.5194/essd-16-2113-2024, https://doi.org/10.5194/essd-16-2113-2024, 2024
Short summary
Short summary
To manage Earth in the Anthropocene, new tools, new institutions, and new forms of international cooperation will be required. Earth Virtualization Engines is proposed as an international federation of centers of excellence to empower all people to respond to the immense and urgent challenges posed by climate change.
Liubov Poshyvailo-Strube, Niklas Wagner, Klaus Goergen, Carina Furusho-Percot, Carl Hartick, and Stefan Kollet
Earth Syst. Dynam., 15, 167–189, https://doi.org/10.5194/esd-15-167-2024, https://doi.org/10.5194/esd-15-167-2024, 2024
Short summary
Short summary
Groundwater (GW) representation is simplified in most regional climate models. Here, we introduce a unique Terrestrial Systems Modeling Platform (TSMP) dataset with an explicit representation of GW, in the context of dynamical downscaling of GCMs for climate change studies. We compare the heat events statistics of TSMP and the CORDEX ensemble. Our results show that TSMP systematically simulates fewer heat waves, and they are shorter and less intense.
Bamidele Joseph Oloruntoba, Stefan Kollet, Carsten Montzka, Harry Vereecken, and Harrie-Jan Hendricks Franssen
EGUsphere, https://doi.org/10.5194/egusphere-2023-3132, https://doi.org/10.5194/egusphere-2023-3132, 2024
Short summary
Short summary
This study uses simulations to understand how the soil information across Africa affects the water balance, using 4 soil databases and 3 different rainfall datasets. Results show that the soil information impacts water balance estimates, especially with a higher rate of rainfall.
Elena Xoplaki, Florian Ellsäßer, Jens Grieger, Katrin M. Nissen, Joaquim Pinto, Markus Augenstein, Ting-Chen Chen, Hendrik Feldmann, Petra Friederichs, Daniel Gliksman, Laura Goulier, Karsten Haustein, Jens Heinke, Lisa Jach, Florian Knutzen, Stefan Kollet, Jürg Luterbacher, Niklas Luther, Susanna Mohr, Christoph Mudersbach, Christoph Müller, Efi Rousi, Felix Simon, Laura Suarez-Gutierrez, Svenja Szemkus, Sara M. Vallejo-Bernal, Odysseas Vlachopoulos, and Frederik Wolf
EGUsphere, https://doi.org/10.5194/egusphere-2023-1460, https://doi.org/10.5194/egusphere-2023-1460, 2023
Short summary
Short summary
Europe is regularly affected by compound events and natural hazards that occur simultaneously or with a temporal lag and are connected with disproportional impacts. Within the interdisciplinary project climXtreme (https://climxtreme.net/) we investigate the interplay of these events, their characteristics and changes, intensity, frequency and uncertainties in the past, present and future, as well as the associated impacts on different socio-economic sectors in Germany and Central Europe.
Zbigniew P. Piotrowski, Jaro Hokkanen, Daniel Caviedes-Voullieme, Olaf Stein, and Stefan Kollet
EGUsphere, https://doi.org/10.5194/egusphere-2023-1079, https://doi.org/10.5194/egusphere-2023-1079, 2023
Preprint withdrawn
Short summary
Short summary
The computer programs capable of simulation of Earth system components evolve, adapting new fundamental science concepts and more observational data on more and more powerful computer hardware. Adaptation of a large scientific program to a new type of hardware is costly. In this work we propose cheap and simple but effective strategy that enable computation using graphic processing units, based on automated program code modification. This results in better resolution and/or longer predictions.
Florian Knutzen, Paul Averbeck, Caterina Barrasso, Laurens M. Bouwer, Barry Gardiner, José M. Grünzweig, Sabine Hänel, Karsten Haustein, Marius Rohde Johannessen, Stefan Kollet, Joni-Pekka Pietikaeinen, Karolina Pietras-Couffignal, Joaquim G. Pinto, Diana Rechid, Efi Rousi, Ana Russo, Laura Suarez-Gutierrez, Julian Wendler, Elena Xoplaki, and Daniel Gliksman
EGUsphere, https://doi.org/10.5194/egusphere-2023-1463, https://doi.org/10.5194/egusphere-2023-1463, 2023
Short summary
Short summary
With a team of 20 authors from different countries, we tried to compile the impacts of drought and heat on European forests in the period 2018–2022. This is a research approach that transcends subject and country borders.
Tobias Tesch, Stefan Kollet, and Jochen Garcke
Geosci. Model Dev., 16, 2149–2166, https://doi.org/10.5194/gmd-16-2149-2023, https://doi.org/10.5194/gmd-16-2149-2023, 2023
Short summary
Short summary
A recent statistical approach for studying relations in the Earth system is to train deep learning (DL) models to predict Earth system variables given one or several others and use interpretable DL to analyze the relations learned by the models. Here, we propose to combine the approach with a theorem from causality research to ensure that the deep learning model learns causal rather than spurious relations. As an example, we apply the method to study soil-moisture–precipitation coupling.
Bibi S. Naz, Wendy Sharples, Yueling Ma, Klaus Goergen, and Stefan Kollet
Geosci. Model Dev., 16, 1617–1639, https://doi.org/10.5194/gmd-16-1617-2023, https://doi.org/10.5194/gmd-16-1617-2023, 2023
Short summary
Short summary
It is challenging to apply a high-resolution integrated land surface and groundwater model over large spatial scales. In this paper, we demonstrate the application of such a model over a pan-European domain at 3 km resolution and perform an extensive evaluation of simulated water states and fluxes by comparing with in situ and satellite data. This study can serve as a benchmark and baseline for future studies of climate change impact projections and for hydrological forecasting.
Mohamed Saadi, Carina Furusho-Percot, Alexandre Belleflamme, Ju-Yu Chen, Silke Trömel, and Stefan Kollet
Nat. Hazards Earth Syst. Sci., 23, 159–177, https://doi.org/10.5194/nhess-23-159-2023, https://doi.org/10.5194/nhess-23-159-2023, 2023
Short summary
Short summary
On 14 July 2021, heavy rainfall fell over central Europe, causing considerable damage and human fatalities. We analyzed how accurate our estimates of rainfall and peak flow were for these flooding events in western Germany. We found that the rainfall estimates from radar measurements were improved by including polarimetric variables and their vertical gradients. Peak flow estimates were highly uncertain due to uncertainties in hydrological model parameters and rainfall measurements.
Bernd Schalge, Gabriele Baroni, Barbara Haese, Daniel Erdal, Gernot Geppert, Pablo Saavedra, Vincent Haefliger, Harry Vereecken, Sabine Attinger, Harald Kunstmann, Olaf A. Cirpka, Felix Ament, Stefan Kollet, Insa Neuweiler, Harrie-Jan Hendricks Franssen, and Clemens Simmer
Earth Syst. Sci. Data, 13, 4437–4464, https://doi.org/10.5194/essd-13-4437-2021, https://doi.org/10.5194/essd-13-4437-2021, 2021
Short summary
Short summary
In this study, a 9-year simulation of complete model output of a coupled atmosphere–land-surface–subsurface model on the catchment scale is discussed. We used the Neckar catchment in SW Germany as the basis of this simulation. Since the dataset includes the full model output, it is not only possible to investigate model behavior and interactions between the component models but also use it as a virtual truth for comparison of, for example, data assimilation experiments.
Yueling Ma, Carsten Montzka, Bagher Bayat, and Stefan Kollet
Hydrol. Earth Syst. Sci., 25, 3555–3575, https://doi.org/10.5194/hess-25-3555-2021, https://doi.org/10.5194/hess-25-3555-2021, 2021
Short summary
Short summary
This study utilized spatiotemporally continuous precipitation anomaly (pra) and water table depth anomaly (wtda) data from integrated hydrologic simulation results over Europe in combination with Long Short-Term Memory (LSTM) networks to capture the time-varying and time-lagged relationship between pra and wtda in order to obtain reliable models to estimate wtda at the individual pixel level.
Susannah Rennie, Klaus Goergen, Christoph Wohner, Sander Apweiler, Johannes Peterseil, and John Watkins
Earth Syst. Sci. Data, 13, 631–644, https://doi.org/10.5194/essd-13-631-2021, https://doi.org/10.5194/essd-13-631-2021, 2021
Short summary
Short summary
This paper describes a pan-European climate service data product intended for ecological researchers. Access to regional climate scenario data will save ecologists time, and, for many, it will allow them to work with data resources that they will not previously have used due to a lack of knowledge and skills to access them. Providing easy access to climate scenario data in this way enhances long-term ecological research, for example in general regional climate change or impact assessments.
Benjamin N. O. Kuffour, Nicholas B. Engdahl, Carol S. Woodward, Laura E. Condon, Stefan Kollet, and Reed M. Maxwell
Geosci. Model Dev., 13, 1373–1397, https://doi.org/10.5194/gmd-13-1373-2020, https://doi.org/10.5194/gmd-13-1373-2020, 2020
Short summary
Short summary
Integrated hydrologic models (IHMs) were developed in order to allow for more accurate simulations of real-world ecohydrologic conditions. Many IHMs exist, and the literature can be dense, so it is often difficult to understand what a specific model can and cannot do. We provide a review of the current core capabilities, solution techniques, communication structure with other models, some limitations, and potential future improvements of one such open-source integrated model called ParFlow.
Bibi S. Naz, Wolfgang Kurtz, Carsten Montzka, Wendy Sharples, Klaus Goergen, Jessica Keune, Huilin Gao, Anne Springer, Harrie-Jan Hendricks Franssen, and Stefan Kollet
Hydrol. Earth Syst. Sci., 23, 277–301, https://doi.org/10.5194/hess-23-277-2019, https://doi.org/10.5194/hess-23-277-2019, 2019
Short summary
Short summary
This study investigates the value of assimilating coarse-resolution remotely sensed soil moisture data into high-resolution land surface models for improving soil moisture and runoff modeling. The soil moisture estimates in this study, with complete spatio-temporal coverage and improved spatial resolution from the assimilation, offer a new reanalysis product for the monitoring of surface soil water content and other hydrological fluxes at 3 km resolution over Europe.
Sylvia C. Sullivan, Christian Barthlott, Jonathan Crosier, Ilya Zhukov, Athanasios Nenes, and Corinna Hoose
Atmos. Chem. Phys., 18, 16461–16480, https://doi.org/10.5194/acp-18-16461-2018, https://doi.org/10.5194/acp-18-16461-2018, 2018
Short summary
Short summary
Ice crystal formation in clouds can occur via thermodynamic nucleation, but also via mechanical collisions between pre-existing crystals or co-existing droplets. When descriptions of this mechanical ice generation are implemented into the COSMO weather model, we find that the contributions to crystal number from thermodynamic and mechanical processes are of the same order. Mechanical ice generation also intensifies differences in precipitation intensity between dynamic and quiescent regions.
Bernd Schalge, Jehan Rihani, Gabriele Baroni, Daniel Erdal, Gernot Geppert, Vincent Haefliger, Barbara Haese, Pablo Saavedra, Insa Neuweiler, Harrie-Jan Hendricks Franssen, Felix Ament, Sabine Attinger, Olaf A. Cirpka, Stefan Kollet, Harald Kunstmann, Harry Vereecken, and Clemens Simmer
Hydrol. Earth Syst. Sci. Discuss., https://doi.org/10.5194/hess-2016-557, https://doi.org/10.5194/hess-2016-557, 2016
Manuscript not accepted for further review
Short summary
Short summary
In this work we show how we used a coupled atmosphere-land surface-subsurface model at highest possible resolution to create a testbed for data assimilation. The model was able to capture all important processes and interactions between the compartments as well as showing realistic statistical behavior. This proves that using a model as a virtual truth is possible and it will enable us to develop data assimilation methods where states and parameters are updated across compartment.
Stefan J. Kollet
Hydrol. Earth Syst. Sci., 20, 2801–2809, https://doi.org/10.5194/hess-20-2801-2016, https://doi.org/10.5194/hess-20-2801-2016, 2016
Wolfgang Kurtz, Guowei He, Stefan J. Kollet, Reed M. Maxwell, Harry Vereecken, and Harrie-Jan Hendricks Franssen
Geosci. Model Dev., 9, 1341–1360, https://doi.org/10.5194/gmd-9-1341-2016, https://doi.org/10.5194/gmd-9-1341-2016, 2016
Short summary
Short summary
This paper describes the development of a modular data assimilation (DA) system for the integrated Earth system model TerrSysMP with the help of the PDAF data assimilation library.
Currently, pressure and soil moisture data can be used to update model states and parameters in the subsurface compartment of TerrSysMP.
Results from an idealized twin experiment show that the developed DA system provides a good parallel performance and is also applicable for high-resolution modelling problems.
P. Shrestha, M. Sulis, C. Simmer, and S. Kollet
Hydrol. Earth Syst. Sci., 19, 4317–4326, https://doi.org/10.5194/hess-19-4317-2015, https://doi.org/10.5194/hess-19-4317-2015, 2015
Short summary
Short summary
This study highlights the grid resolution dependence of energy and water balance of the 3-D physically based integrated surface-groundwater model. The non-local controls of soil moisture were found to be highly grid resolution dependent, but the local vegetation control strongly modulates the scaling behavior of surface energy fluxes. For coupled runs, variability in patterns of surface fluxes due to this scale dependence can affect the simulated atmospheric boundary layer and local circulation.
X. Han, X. Li, G. He, P. Kumbhar, C. Montzka, S. Kollet, T. Miyoshi, R. Rosolem, Y. Zhang, H. Vereecken, and H.-J. H. Franssen
Geosci. Model Dev. Discuss., https://doi.org/10.5194/gmdd-8-7395-2015, https://doi.org/10.5194/gmdd-8-7395-2015, 2015
Revised manuscript not accepted
Short summary
Short summary
DasPy is a ready to use open source parallel multivariate land data assimilation framework with joint state and parameter estimation using Local Ensemble Transform Kalman Filter. The Community Land Model (4.5) was integrated as model operator. The Community Microwave Emission Modelling platform, COsmic-ray Soil Moisture Interaction Code and the Two-Source Formulation were integrated as observation operators for the multivariate assimilation of soil moisture and soil temperature, respectively.
R. M. Maxwell, L. E. Condon, and S. J. Kollet
Geosci. Model Dev., 8, 923–937, https://doi.org/10.5194/gmd-8-923-2015, https://doi.org/10.5194/gmd-8-923-2015, 2015
Short summary
Short summary
A model that simulates groundwater and surface water flow has been developed for the major river basins of the continental United States. Fundamental data sets provide input to the model resulting in a natural organization of stream networks and groundwater flow that is compared to observations of surface water and groundwater. Model results show relationships between flow and area that are moderated by aridity and represent an important step toward integrated hydrological prediction.
E. Katragkou, M. García-Díez, R. Vautard, S. Sobolowski, P. Zanis, G. Alexandri, R. M. Cardoso, A. Colette, J. Fernandez, A. Gobiet, K. Goergen, T. Karacostas, S. Knist, S. Mayer, P. M. M. Soares, I. Pytharoulis, I. Tegoulias, A. Tsikerdekis, and D. Jacob
Geosci. Model Dev., 8, 603–618, https://doi.org/10.5194/gmd-8-603-2015, https://doi.org/10.5194/gmd-8-603-2015, 2015
F. Gasper, K. Goergen, P. Shrestha, M. Sulis, J. Rihani, M. Geimer, and S. Kollet
Geosci. Model Dev., 7, 2531–2543, https://doi.org/10.5194/gmd-7-2531-2014, https://doi.org/10.5194/gmd-7-2531-2014, 2014
S. Kotlarski, K. Keuler, O. B. Christensen, A. Colette, M. Déqué, A. Gobiet, K. Goergen, D. Jacob, D. Lüthi, E. van Meijgaard, G. Nikulin, C. Schär, C. Teichmann, R. Vautard, K. Warrach-Sagi, and V. Wulfmeyer
Geosci. Model Dev., 7, 1297–1333, https://doi.org/10.5194/gmd-7-1297-2014, https://doi.org/10.5194/gmd-7-1297-2014, 2014
Related subject area
Earth and space science informatics
Random forests with spatial proxies for environmental modelling: opportunities and pitfalls
An improved global pressure and zenith wet delay model with optimized vertical correction considering the spatiotemporal variability in multiple height-scale factors
kNNDM CV: k-fold nearest-neighbour distance matching cross-validation for map accuracy estimation
Remote sensing-based high-resolution mapping of the forest canopy height: some models are useful, but might they be even more if combined?
GNNWR: An Open-Source Package of Spatiotemporal Intelligent Regression Methods for Modeling Spatial and Temporal Non-Stationarity
Consistency-Checking 3D Geological Models
Accelerating Lagrangian transport simulations on graphics processing units: performance optimizations of Massive-Parallel Trajectory Calculations (MPTRAC) v2.6
The effect of lossy compression of numerical weather prediction data on data analysis: a case study using enstools-compression 2023.11
Focal-TSMP: deep learning for vegetation health prediction and agricultural drought assessment from a regional climate simulation
Tomofast-x 2.0: an open-source parallel code for inversion of potential field data with topography using wavelet compression
Functional analysis of variance (ANOVA) for carbon flux estimates from remote sensing data
The 4D reconstruction of dynamic geological evolution processes for renowned geological features
Moving beyond post-hoc XAI: Lessons learned from dynamical climate modeling
Machine learning for numerical weather and climate modelling: a review
Overcoming barriers to enable convergence research by integrating ecological and climate sciences: the NCAR–NEON system Version 1
Ensemble of optimised machine learning algorithms for predicting surface soil moisture content at a global scale
Hazard assessment modeling and software development of earthquake-triggered landslides in the Sichuan–Yunnan area, China
A generalized spatial autoregressive neural network method for three-dimensional spatial interpolation
The Common Community Physics Package (CCPP) Framework v6
Causal deep learning models for studying the Earth system
A methodological framework for improving the performance of data-driven models: a case study for daily runoff prediction in the Maumee domain, USA
SHAFTS (v2022.3): a deep-learning-based Python package for simultaneous extraction of building height and footprint from sentinel imagery
Bayesian atmospheric correction over land: Sentinel-2/MSI and Landsat 8/OLI
Twenty-five years of the IPCC Data Distribution Centre at the DKRZ and the Reference Data Archive for CMIP data
Effectiveness and computational efficiency of absorbing boundary conditions for full-waveform inversion
LAND-SUITE V1.0: a suite of tools for statistically based landslide susceptibility zonation
Towards physics-inspired data-driven weather forecasting: integrating data assimilation with a deep spatial-transformer-based U-NET in a case study with ERA5
Fast infrared radiative transfer calculations using graphics processing units: JURASSIC-GPU v2.0
CSDMS: a community platform for numerical modeling of Earth surface processes
A new methodological framework for geophysical sensor combinations associated with machine learning algorithms to understand soil attributes
Model calibration using ESEm v1.1.0 – an open, scalable Earth system emulator
Turbidity maximum zone index: a novel model for remote extraction of the turbidity maximum zone in different estuaries
dh2loop 1.0: an open-source Python library for automated processing and classification of geological logs
Copula-based synthetic data augmentation for machine-learning emulators
Automated geological map deconstruction for 3D model construction using map2loop 1.0 and map2model 1.0
A spatially explicit approach to simulate urban heat mitigation with InVEST (v3.8.0)
S-SOM v1.0: a structural self-organizing map algorithm for weather typing
Using Shapley additive explanations to interpret extreme gradient boosting predictions of grassland degradation in Xilingol, China
Current status on the need for improved accessibility to climate models code
ClimateNet: an expert-labeled open dataset and deep learning architecture for enabling high-precision analyses of extreme weather
A spatiotemporal weighted regression model (STWR v1.0) for analyzing local nonstationarity in space and time
A new end-to-end workflow for the Community Earth System Model (version 2.0) for the Coupled Model Intercomparison Project Phase 6 (CMIP6)
HyLands 1.0: a hybrid landscape evolution model to simulate the impact of landslides and landslide-derived sediment on landscape evolution
Comparative analysis of atmospheric radiative transfer models using the Atmospheric Look-up table Generator (ALG) toolbox (version 2.0)
Fast domain-aware neural network emulation of a planetary boundary layer parameterization in a numerical weather forecast model
VISIR-1.b: ocean surface gravity waves and currents for energy-efficient navigation
Topological data analysis and machine learning for recognizing atmospheric river patterns in large climate datasets
Global hydro-climatic biomes identified via multitask learning
An improved logistic regression model based on a spatially weighted technique (ILRBSWT v1.0) and its application to mineral prospectivity mapping
High-performance software framework for the calculation of satellite-to-satellite data matchups (MMS version 1.2)
Carles Milà, Marvin Ludwig, Edzer Pebesma, Cathryn Tonne, and Hanna Meyer
Geosci. Model Dev., 17, 6007–6033, https://doi.org/10.5194/gmd-17-6007-2024, https://doi.org/10.5194/gmd-17-6007-2024, 2024
Short summary
Short summary
Spatial proxies, such as coordinates and distances, are often used as predictors in random forest models for predictive mapping. In a simulation and two case studies, we investigated the conditions under which their use is appropriate. We found that spatial proxies are not always beneficial and should not be used as a default approach without careful consideration. We also provide insights into the reasons behind their suitability, how to detect them, and potential alternatives.
Chunhua Jiang, Xiang Gao, Huizhong Zhu, Shuaimin Wang, Sixuan Liu, Shaoni Chen, and Guangsheng Liu
Geosci. Model Dev., 17, 5939–5959, https://doi.org/10.5194/gmd-17-5939-2024, https://doi.org/10.5194/gmd-17-5939-2024, 2024
Short summary
Short summary
With ERA5 hourly data, we show spatiotemporal characteristics of pressure and zenith wet delay (ZWD) and propose an empirical global pressure and ZWD grid model with a broader operating space which can provide accurate pressure, ZWD, zenith hydrostatic delay, and zenith tropospheric delay estimates for any selected time and location over globe. IGPZWD will be of great significance for the tropospheric augmentation in real-time GNSS positioning and atmospheric water vapor remote sensing.
Jan Linnenbrink, Carles Milà, Marvin Ludwig, and Hanna Meyer
Geosci. Model Dev., 17, 5897–5912, https://doi.org/10.5194/gmd-17-5897-2024, https://doi.org/10.5194/gmd-17-5897-2024, 2024
Short summary
Short summary
Estimation of map accuracy based on cross-validation (CV) in spatial modelling is pervasive but controversial. Here, we build upon our previous work and propose a novel, prediction-oriented k-fold CV strategy for map accuracy estimation in which the distribution of geographical distances between prediction and training points is taken into account when constructing the CV folds. Our method produces more reliable estimates than other CV methods and can be used for large datasets.
Nikola Besic, Nicolas Picard, Cédric Vega, Lionel Hertzog, Jean-Pierre Renaud, Fajwel Fogel, Agnès Pellissier-Tanon, Gabriel Destouet, Milena Planells-Rodriguez, and Philippe Ciais
Geosci. Model Dev. Discuss., https://doi.org/10.5194/gmd-2024-95, https://doi.org/10.5194/gmd-2024-95, 2024
Revised manuscript accepted for GMD
Short summary
Short summary
The creation of advanced mapping models for forest attributes, utilizing remote sensing data and incorporating machine or deep learning methods, has become a key area of interest in the domain of forest observation and monitoring. This paper introduces a method where we blend and collectively interpret five models dedicated to estimating forest canopy height. We achieve this through Bayesian model averaging, offering a comprehensive approach to height estimation in forest ecosystems.
Ziyu Yin, Jiale Ding, Yi Liu, Ruoxu Wang, Yige Wang, Yijun Chen, Jin Qi, Sensen Wu, and Zhenhong Du
Geosci. Model Dev. Discuss., https://doi.org/10.5194/gmd-2024-62, https://doi.org/10.5194/gmd-2024-62, 2024
Revised manuscript accepted for GMD
Short summary
Short summary
In geography, understanding how relationships between different factors change over time and space is crucial. This study implements two neural network-based spatiotemporal regression models as well as an open-sourced Python package named GNNWR, to accurately capture the varying relationships between factors. This makes it a valuable tool for researchers in various fields, such as environmental science, urban planning, and public health.
Marion N. Parquer, Eric A. de Kemp, Boyan Brodaric, and Michael J. Hillier
EGUsphere, https://doi.org/10.5194/egusphere-2024-1326, https://doi.org/10.5194/egusphere-2024-1326, 2024
Short summary
Short summary
This is a proof-of-concept paper outlining a general approach to how 3D geological models would be checked to be geologically 'reasonable'. We do this with a consistency checking tool that looks at geological feature pairs and their spatial, temporal and internal polarity characteristics. The idea is to assess if geological relationships from a specific 3D geological model matches what is allowed in the real world, from the perspective of geological principals.
Lars Hoffmann, Kaveh Haghighi Mood, Andreas Herten, Markus Hrywniak, Jiri Kraus, Jan Clemens, and Mingzhao Liu
Geosci. Model Dev., 17, 4077–4094, https://doi.org/10.5194/gmd-17-4077-2024, https://doi.org/10.5194/gmd-17-4077-2024, 2024
Short summary
Short summary
Lagrangian particle dispersion models are key for studying atmospheric transport but can be computationally intensive. To speed up simulations, the MPTRAC model was ported to graphics processing units (GPUs). Performance optimization of data structures and memory alignment resulted in runtime improvements of up to 75 % on NVIDIA A100 GPUs for ERA5-based simulations with 100 million particles. These optimizations make the MPTRAC model well suited for future high-performance computing systems.
Oriol Tintó Prims, Robert Redl, Marc Rautenhaus, Tobias Selz, Takumi Matsunobu, Kameswar Rao Modali, and George Craig
EGUsphere, https://doi.org/10.5194/egusphere-2024-753, https://doi.org/10.5194/egusphere-2024-753, 2024
Short summary
Short summary
Advanced compression techniques can drastically reduce the size of meteorological datasets (by 5x to 150x) without compromising the data's scientific value. We developed a user-friendly tool called 'enstools-compression' that makes this compression simple for Earth scientists. This tool works seamlessly with common weather and climate data formats. Our work shows that lossy compression can significantly improve how researchers store and analyze large meteorological datasets.
Mohamad Hakam Shams Eddin and Juergen Gall
Geosci. Model Dev., 17, 2987–3023, https://doi.org/10.5194/gmd-17-2987-2024, https://doi.org/10.5194/gmd-17-2987-2024, 2024
Short summary
Short summary
In this study, we use deep learning and a climate simulation to predict the vegetation health as it would be observed from satellites. We found that the developed model can help to identify regions with a high risk of agricultural drought. The main applications of this study are to estimate vegetation products for periods where no satellite data are available and to forecast the future vegetation response to climate change based on climate scenarios.
Vitaliy Ogarko, Kim Frankcombe, Taige Liu, Jeremie Giraud, Roland Martin, and Mark Jessell
Geosci. Model Dev., 17, 2325–2345, https://doi.org/10.5194/gmd-17-2325-2024, https://doi.org/10.5194/gmd-17-2325-2024, 2024
Short summary
Short summary
We present a major release of the Tomofast-x open-source gravity and magnetic inversion code that is enhancing its performance and applicability for both industrial and academic studies. We focus on real-world mineral exploration scenarios, while offering flexibility for applications at regional scale or for crustal studies. The optimisation work described in this paper is fundamental to allowing more complete descriptions of the controls on magnetisation, including remanence.
Jonathan Hobbs, Matthias Katzfuss, Hai Nguyen, Vineet Yadav, and Junjie Liu
Geosci. Model Dev., 17, 1133–1151, https://doi.org/10.5194/gmd-17-1133-2024, https://doi.org/10.5194/gmd-17-1133-2024, 2024
Short summary
Short summary
The cycling of carbon among the land, oceans, and atmosphere is a closely monitored process in the global climate system. These exchanges between the atmosphere and the surface can be quantified using a combination of atmospheric carbon dioxide observations and computer models. This study presents a statistical method for investigating the similarities and differences in the estimated surface–atmosphere carbon exchange when different computer model assumptions are invoked.
Jiateng Guo, Zhibin Liu, Xulei Wang, Lixin Wu, Shanjun Liu, and Yunqiang Li
Geosci. Model Dev., 17, 847–864, https://doi.org/10.5194/gmd-17-847-2024, https://doi.org/10.5194/gmd-17-847-2024, 2024
Short summary
Short summary
This study proposes a 3D and temporally dynamic (4D) geological modeling method. Several simulation and actual cases show that the 4D spatial and temporal evolution of regional geological formations can be modeled easily using this method with smooth boundaries. The 4D modeling system can dynamically present the regional geological evolution process under the timeline, which will be helpful to the research and teaching on the formation of typical and complex geological features.
Ryan O'Loughlin, Dan Li, and Travis O'Brien
EGUsphere, https://doi.org/10.5194/egusphere-2023-2969, https://doi.org/10.5194/egusphere-2023-2969, 2024
Short summary
Short summary
We draw from traditional climate modeling practices to make recommendations for AI-driven climate science. In particular, we show how component-level understanding–which is obtained when scientists can link model behavior to parts within the overall model–should guide the development and evaluation of AI models. Better understanding can lead to a stronger basis for trust in these models. We highlight several examples to demonstrate.
Catherine O. de Burgh-Day and Tennessee Leeuwenburg
Geosci. Model Dev., 16, 6433–6477, https://doi.org/10.5194/gmd-16-6433-2023, https://doi.org/10.5194/gmd-16-6433-2023, 2023
Short summary
Short summary
Machine learning (ML) is an increasingly popular tool in the field of weather and climate modelling. While ML has been used in this space for a long time, it is only recently that ML approaches have become competitive with more traditional methods. In this review, we have summarized the use of ML in weather and climate modelling over time; provided an overview of key ML concepts, methodologies, and terms; and suggested promising avenues for further research.
Danica L. Lombardozzi, William R. Wieder, Negin Sobhani, Gordon B. Bonan, David Durden, Dawn Lenz, Michael SanClements, Samantha Weintraub-Leff, Edward Ayres, Christopher R. Florian, Kyla Dahlin, Sanjiv Kumar, Abigail L. S. Swann, Claire M. Zarakas, Charles Vardeman, and Valerio Pascucci
Geosci. Model Dev., 16, 5979–6000, https://doi.org/10.5194/gmd-16-5979-2023, https://doi.org/10.5194/gmd-16-5979-2023, 2023
Short summary
Short summary
We present a novel cyberinfrastructure system that uses National Ecological Observatory Network measurements to run Community Terrestrial System Model point simulations in a containerized system. The simple interface and tutorials expand access to data and models used in Earth system research by removing technical barriers and facilitating research, educational opportunities, and community engagement. The NCAR–NEON system enables convergence of climate and ecological sciences.
Qianqian Han, Yijian Zeng, Lijie Zhang, Calimanut-Ionut Cira, Egor Prikaziuk, Ting Duan, Chao Wang, Brigitta Szabó, Salvatore Manfreda, Ruodan Zhuang, and Bob Su
Geosci. Model Dev., 16, 5825–5845, https://doi.org/10.5194/gmd-16-5825-2023, https://doi.org/10.5194/gmd-16-5825-2023, 2023
Short summary
Short summary
Using machine learning, we estimated global surface soil moisture (SSM) to aid in understanding water, energy, and carbon exchange. Ensemble models outperformed individual algorithms in predicting SSM under different climates. The best-performing ensemble included K-neighbours Regressor, Random Forest Regressor, and Extreme Gradient Boosting. This is important for hydrological and climatological applications such as water cycle monitoring, irrigation management, and crop yield prediction.
Xiaoyi Shao, Siyuan Ma, and Chong Xu
Geosci. Model Dev., 16, 5113–5129, https://doi.org/10.5194/gmd-16-5113-2023, https://doi.org/10.5194/gmd-16-5113-2023, 2023
Short summary
Short summary
Scientific understandings of the distribution of coseismic landslides, followed by emergency and medium- and long-term risk assessment, can reduce landslide risk. The aim of this study is to propose an improved three-stage spatial prediction strategy and develop corresponding hazard assessment software called Mat.LShazard V1.0, which provides a new application tool for coseismic landslide disaster prevention and mitigation in different stages.
Junda Zhan, Sensen Wu, Jin Qi, Jindi Zeng, Mengjiao Qin, Yuanyuan Wang, and Zhenhong Du
Geosci. Model Dev., 16, 2777–2794, https://doi.org/10.5194/gmd-16-2777-2023, https://doi.org/10.5194/gmd-16-2777-2023, 2023
Short summary
Short summary
We develop a generalized spatial autoregressive neural network model used for three-dimensional spatial interpolation. Taking the different changing trend of geographic elements along various directions into consideration, the model defines spatial distance in a generalized way and integrates it into the process of spatial interpolation with the theories of spatial autoregression and neural network. Compared with traditional methods, the model achieves better performance and is more adaptable.
Dominikus Heinzeller, Ligia Bernardet, Grant Firl, Man Zhang, Xia Sun, and Michael Ek
Geosci. Model Dev., 16, 2235–2259, https://doi.org/10.5194/gmd-16-2235-2023, https://doi.org/10.5194/gmd-16-2235-2023, 2023
Short summary
Short summary
The Common Community Physics Package is a collection of physical atmospheric parameterizations for use in Earth system models and a framework that couples the physics to a host model’s dynamical core. A primary goal for this effort is to facilitate research and development of physical parameterizations and physics–dynamics coupling methods while offering capabilities for numerical weather prediction operations, for example in the upcoming implementation of the Global Forecast System (GFS) v17.
Tobias Tesch, Stefan Kollet, and Jochen Garcke
Geosci. Model Dev., 16, 2149–2166, https://doi.org/10.5194/gmd-16-2149-2023, https://doi.org/10.5194/gmd-16-2149-2023, 2023
Short summary
Short summary
A recent statistical approach for studying relations in the Earth system is to train deep learning (DL) models to predict Earth system variables given one or several others and use interpretable DL to analyze the relations learned by the models. Here, we propose to combine the approach with a theorem from causality research to ensure that the deep learning model learns causal rather than spurious relations. As an example, we apply the method to study soil-moisture–precipitation coupling.
Yao Hu, Chirantan Ghosh, and Siamak Malakpour-Estalaki
Geosci. Model Dev., 16, 1925–1936, https://doi.org/10.5194/gmd-16-1925-2023, https://doi.org/10.5194/gmd-16-1925-2023, 2023
Short summary
Short summary
Data-driven models (DDMs) gain popularity in earth and environmental systems, thanks in large part to advancements in data collection techniques and artificial intelligence (AI). The performance of these models is determined by the underlying machine learning (ML) algorithms. In this study, we develop a framework to improve the model performance by optimizing ML algorithms and demonstrate the effectiveness of the framework using a DDM to predict edge-of-field runoff in the Maumee domain, USA.
Ruidong Li, Ting Sun, Fuqiang Tian, and Guang-Heng Ni
Geosci. Model Dev., 16, 751–778, https://doi.org/10.5194/gmd-16-751-2023, https://doi.org/10.5194/gmd-16-751-2023, 2023
Short summary
Short summary
We developed SHAFTS (Simultaneous building Height And FootprinT extraction from Sentinel imagery), a multi-task deep-learning-based Python package, to estimate average building height and footprint from Sentinel imagery. Evaluation in 46 cities worldwide shows that SHAFTS achieves significant improvement over existing machine-learning-based methods.
Feng Yin, Philip E. Lewis, and Jose L. Gómez-Dans
Geosci. Model Dev., 15, 7933–7976, https://doi.org/10.5194/gmd-15-7933-2022, https://doi.org/10.5194/gmd-15-7933-2022, 2022
Short summary
Short summary
The proposed SIAC atmospheric correction method provides consistent surface reflectance estimations from medium spatial-resolution satellites (Sentinel 2 and Landsat 8) with per-pixel uncertainty information. The outputs from SIAC have been validated against a wide range of ground measurements, and it shows that SIAC can provide accurate estimations of both surface reflectance and atmospheric parameters, with meaningful uncertainty information.
Martina Stockhause and Michael Lautenschlager
Geosci. Model Dev., 15, 6047–6058, https://doi.org/10.5194/gmd-15-6047-2022, https://doi.org/10.5194/gmd-15-6047-2022, 2022
Short summary
Short summary
The Data Distribution Centre (DDC) of the Intergovernmental Panel on Climate Change (IPCC) celebrates its 25th anniversary in 2022. DDC Partner DKRZ has supported the IPCC Assessments and preserved the quality-assured, citable climate model data underpinning the Assessment Reports over these years over the long term. With the introduction of the IPCC FAIR Guidelines into the current AR6, the value of DDC services has been recognized. However, DDC sustainability remains unresolved.
Daiane Iglesia Dolci, Felipe A. G. Silva, Pedro S. Peixoto, and Ernani V. Volpe
Geosci. Model Dev., 15, 5857–5881, https://doi.org/10.5194/gmd-15-5857-2022, https://doi.org/10.5194/gmd-15-5857-2022, 2022
Short summary
Short summary
We investigate and compare the theoretical and computational characteristics of several absorbing boundary conditions (ABCs) for the full-waveform inversion (FWI) problem. The different ABCs are implemented in an optimized computational framework called Devito. The computational efficiency and memory requirements of the ABC methods are evaluated in the forward and adjoint wave propagators, from simple to realistic velocity models.
Mauro Rossi, Txomin Bornaetxea, and Paola Reichenbach
Geosci. Model Dev., 15, 5651–5666, https://doi.org/10.5194/gmd-15-5651-2022, https://doi.org/10.5194/gmd-15-5651-2022, 2022
Short summary
Short summary
LAND-SUITE is a software package designed to support landslide susceptibility zonation. The software integrates, extends, and completes LAND-SE (Rossi et al., 2010; Rossi and Reichenbach, 2016). The software is implemented in R, a free software environment for statistical computing and graphics, and gives expert users the possibility to perform easier, more flexible, and more informed statistically based landslide susceptibility applications and zonations.
Ashesh Chattopadhyay, Mustafa Mustafa, Pedram Hassanzadeh, Eviatar Bach, and Karthik Kashinath
Geosci. Model Dev., 15, 2221–2237, https://doi.org/10.5194/gmd-15-2221-2022, https://doi.org/10.5194/gmd-15-2221-2022, 2022
Short summary
Short summary
There is growing interest in data-driven weather forecasting, i.e., to predict the weather by using a deep neural network that learns from the evolution of past atmospheric patterns. Here, we propose three components to add to the current data-driven weather forecast models to improve their performance. These components involve a feature that incorporates physics into the neural network, a method to add data assimilation, and an algorithm to use several different time intervals in the forecast.
Paul F. Baumeister and Lars Hoffmann
Geosci. Model Dev., 15, 1855–1874, https://doi.org/10.5194/gmd-15-1855-2022, https://doi.org/10.5194/gmd-15-1855-2022, 2022
Short summary
Short summary
The efficiency of the numerical simulation of radiative transport is shown on modern server-class graphics cards (GPUs). The low-cost prefactor on GPUs compared to general-purpose processors (CPUs) enables future large retrieval campaigns for multi-channel data from infrared sounders aboard low-orbit satellites. The validated research software JURASSIC is available in the public domain.
Gregory E. Tucker, Eric W. H. Hutton, Mark D. Piper, Benjamin Campforts, Tian Gan, Katherine R. Barnhart, Albert J. Kettner, Irina Overeem, Scott D. Peckham, Lynn McCready, and Jaia Syvitski
Geosci. Model Dev., 15, 1413–1439, https://doi.org/10.5194/gmd-15-1413-2022, https://doi.org/10.5194/gmd-15-1413-2022, 2022
Short summary
Short summary
Scientists use computer simulation models to understand how Earth surface processes work, including floods, landslides, soil erosion, river channel migration, ocean sedimentation, and coastal change. Research benefits when the software for simulation modeling is open, shared, and coordinated. The Community Surface Dynamics Modeling System (CSDMS) is a US-based facility that supports research by providing community support, computing tools and guidelines, and educational resources.
Danilo César de Mello, Gustavo Vieira Veloso, Marcos Guedes de Lana, Fellipe Alcantara de Oliveira Mello, Raul Roberto Poppiel, Diego Ribeiro Oquendo Cabrero, Luis Augusto Di Loreto Di Raimo, Carlos Ernesto Gonçalves Reynaud Schaefer, Elpídio Inácio Fernandes Filho, Emilson Pereira Leite, and José Alexandre Melo Demattê
Geosci. Model Dev., 15, 1219–1246, https://doi.org/10.5194/gmd-15-1219-2022, https://doi.org/10.5194/gmd-15-1219-2022, 2022
Short summary
Short summary
We used soil parent material, terrain attributes, and geophysical data from the soil surface to test and compare different and unprecedented geophysical sensor combination, as well as different machine learning algorithms to model and predict several soil attributes. Also, we analyzed the importance of pedoenvironmental variables. The soil attributes were modeled throughout different machine learning algorithms and related to different geophysical sensor combinations.
Duncan Watson-Parris, Andrew Williams, Lucia Deaconu, and Philip Stier
Geosci. Model Dev., 14, 7659–7672, https://doi.org/10.5194/gmd-14-7659-2021, https://doi.org/10.5194/gmd-14-7659-2021, 2021
Short summary
Short summary
The Earth System Emulator (ESEm) provides a fast and flexible framework for emulating a wide variety of Earth science datasets and tools for constraining (or tuning) models of any complexity. Three distinct use cases are presented that demonstrate the utility of ESEm and provide some insight into the use of machine learning for emulation in these different settings. The open-source Python package is freely available so that it might become a valuable tool for the community.
Chongyang Wang, Li Wang, Danni Wang, Dan Li, Chenghu Zhou, Hao Jiang, Qiong Zheng, Shuisen Chen, Kai Jia, Yangxiaoyue Liu, Ji Yang, Xia Zhou, and Yong Li
Geosci. Model Dev., 14, 6833–6846, https://doi.org/10.5194/gmd-14-6833-2021, https://doi.org/10.5194/gmd-14-6833-2021, 2021
Short summary
Short summary
The turbidity maximum zone (TMZ) is a special phenomenon in estuaries worldwide. However, the extraction methods and criteria used to describe the TMZ vary significantly both spatially and temporally. This study proposes an new index, the turbidity maximum zone index, based on the corresponding relationship of total suspended solid concentration and Chl a concentration, which could better extract TMZs in different estuaries and on different dates.
Ranee Joshi, Kavitha Madaiah, Mark Jessell, Mark Lindsay, and Guillaume Pirot
Geosci. Model Dev., 14, 6711–6740, https://doi.org/10.5194/gmd-14-6711-2021, https://doi.org/10.5194/gmd-14-6711-2021, 2021
Short summary
Short summary
We have developed a software that allows the user to extract and standardize drill hole information from legacy datasets and/or different drilling campaigns. It also provides functionality to upscale the lithological information. These functionalities were possible by developing thesauri to identify and group geological terminologies together.
David Meyer, Thomas Nagler, and Robin J. Hogan
Geosci. Model Dev., 14, 5205–5215, https://doi.org/10.5194/gmd-14-5205-2021, https://doi.org/10.5194/gmd-14-5205-2021, 2021
Short summary
Short summary
A major limitation in training machine-learning emulators is often caused by the lack of data. This paper presents a cheap way to increase the size of training datasets using statistical techniques and thereby improve the performance of machine-learning emulators.
Mark Jessell, Vitaliy Ogarko, Yohan de Rose, Mark Lindsay, Ranee Joshi, Agnieszka Piechocka, Lachlan Grose, Miguel de la Varga, Laurent Ailleres, and Guillaume Pirot
Geosci. Model Dev., 14, 5063–5092, https://doi.org/10.5194/gmd-14-5063-2021, https://doi.org/10.5194/gmd-14-5063-2021, 2021
Short summary
Short summary
We have developed software that allows the user to extract sufficient information from unmodified digital maps and associated datasets that we are able to use to automatically build 3D geological models. By automating the process we are able to remove human bias from the procedure, which makes the workflow reproducible.
Martí Bosch, Maxence Locatelli, Perrine Hamel, Roy P. Remme, Jérôme Chenal, and Stéphane Joost
Geosci. Model Dev., 14, 3521–3537, https://doi.org/10.5194/gmd-14-3521-2021, https://doi.org/10.5194/gmd-14-3521-2021, 2021
Short summary
Short summary
The article presents a novel approach to simulate urban heat mitigation from land use/land cover data based on three biophysical mechanisms: tree shade, evapotranspiration and albedo. An automated procedure is proposed to calibrate the model parameters to best fit temperature observations from monitoring stations. A case study in Lausanne, Switzerland, shows that the approach outperforms regressions based on satellite data and provides valuable insights into design heat mitigation policies.
Quang-Van Doan, Hiroyuki Kusaka, Takuto Sato, and Fei Chen
Geosci. Model Dev., 14, 2097–2111, https://doi.org/10.5194/gmd-14-2097-2021, https://doi.org/10.5194/gmd-14-2097-2021, 2021
Short summary
Short summary
This study proposes a novel structural self-organizing map (S-SOM) algorithm. The superiority of S-SOM is that it can better recognize the difference (or similarity) among spatial (or temporal) data used for training and thus improve the clustering quality compared to traditional SOM algorithms.
Batunacun, Ralf Wieland, Tobia Lakes, and Claas Nendel
Geosci. Model Dev., 14, 1493–1510, https://doi.org/10.5194/gmd-14-1493-2021, https://doi.org/10.5194/gmd-14-1493-2021, 2021
Short summary
Short summary
Extreme gradient boosting (XGBoost) can provide alternative insights that conventional land-use models are unable to generate. Shapley additive explanations (SHAP) can interpret the results of the purely data-driven approach. XGBoost achieved similar and robust simulation results. SHAP values were useful for analysing the complex relationship between the different drivers of grassland degradation.
Juan A. Añel, Michael García-Rodríguez, and Javier Rodeiro
Geosci. Model Dev., 14, 923–934, https://doi.org/10.5194/gmd-14-923-2021, https://doi.org/10.5194/gmd-14-923-2021, 2021
Short summary
Short summary
This work shows that it continues to be hard, if not impossible, to obtain some of the most used climate models worldwide. We reach this conclusion through a systematic study and encourage all development teams and research centres to make public the models they use to produce scientific results.
Prabhat, Karthik Kashinath, Mayur Mudigonda, Sol Kim, Lukas Kapp-Schwoerer, Andre Graubner, Ege Karaismailoglu, Leo von Kleist, Thorsten Kurth, Annette Greiner, Ankur Mahesh, Kevin Yang, Colby Lewis, Jiayi Chen, Andrew Lou, Sathyavat Chandran, Ben Toms, Will Chapman, Katherine Dagon, Christine A. Shields, Travis O'Brien, Michael Wehner, and William Collins
Geosci. Model Dev., 14, 107–124, https://doi.org/10.5194/gmd-14-107-2021, https://doi.org/10.5194/gmd-14-107-2021, 2021
Short summary
Short summary
Detecting extreme weather events is a crucial step in understanding how they change due to climate change. Deep learning (DL) is remarkable at pattern recognition; however, it works best only when labeled datasets are available. We create
ClimateNet– an expert-labeled curated dataset – to train a DL model for detecting weather events and predicting changes in extreme precipitation. This work paves the way for DL-based automated, high-fidelity, and highly precise analytics of climate data.
Xiang Que, Xiaogang Ma, Chao Ma, and Qiyu Chen
Geosci. Model Dev., 13, 6149–6164, https://doi.org/10.5194/gmd-13-6149-2020, https://doi.org/10.5194/gmd-13-6149-2020, 2020
Short summary
Short summary
This paper presents a spatiotemporal weighted regression (STWR) model for exploring nonstationary spatiotemporal processes in nature and socioeconomics. A value change rate is introduced in the temporal kernel, which presents significant model fitting and accuracy in both simulated and real-world data. STWR fully incorporates observed data in the past and outperforms geographic temporal weighted regression (GTWR) and geographic weighted regression (GWR) models in several experiments.
Sheri Mickelson, Alice Bertini, Gary Strand, Kevin Paul, Eric Nienhouse, John Dennis, and Mariana Vertenstein
Geosci. Model Dev., 13, 5567–5581, https://doi.org/10.5194/gmd-13-5567-2020, https://doi.org/10.5194/gmd-13-5567-2020, 2020
Short summary
Short summary
Every generation of MIP exercises introduces new layers of complexity and an exponential growth in the amount of data requested. CMIP6 required us to develop a new tool chain and forced us to change our methodologies. The new methods discussed in this paper provided us with an 18 times faster speedup over our existing methods. This allowed us to meet our deadlines and we were able to publish more than half a million data sets on the Earth System Grid Federation (ESGF) for the CMIP6 project.
Benjamin Campforts, Charles M. Shobe, Philippe Steer, Matthias Vanmaercke, Dimitri Lague, and Jean Braun
Geosci. Model Dev., 13, 3863–3886, https://doi.org/10.5194/gmd-13-3863-2020, https://doi.org/10.5194/gmd-13-3863-2020, 2020
Short summary
Short summary
Landslides shape the Earth’s surface and are a dominant source of terrestrial sediment. Rivers, then, act as conveyor belts evacuating landslide-produced sediment. Understanding the interaction among rivers and landslides is important to predict the Earth’s surface response to past and future environmental changes and for mitigating natural hazards. We develop HyLands, a new numerical model that provides a toolbox to explore how landslides and rivers interact over several timescales.
Jorge Vicent, Jochem Verrelst, Neus Sabater, Luis Alonso, Juan Pablo Rivera-Caicedo, Luca Martino, Jordi Muñoz-Marí, and José Moreno
Geosci. Model Dev., 13, 1945–1957, https://doi.org/10.5194/gmd-13-1945-2020, https://doi.org/10.5194/gmd-13-1945-2020, 2020
Short summary
Short summary
The modeling of light propagation through the atmosphere is key to process satellite images and to understand atmospheric processes. However, existing atmospheric models can be complex to use in practical applications. Here we aim at providing a new software tool to facilitate using advanced models and to generate large databases of simulated data. As a test case, we use this tool to analyze differences between several atmospheric models, showing the capabilities of this open-source tool.
Jiali Wang, Prasanna Balaprakash, and Rao Kotamarthi
Geosci. Model Dev., 12, 4261–4274, https://doi.org/10.5194/gmd-12-4261-2019, https://doi.org/10.5194/gmd-12-4261-2019, 2019
Short summary
Short summary
Parameterizations are frequently used in models representing physical phenomena and are often the computationally expensive portions of the code. Using model output from simulations performed using a weather model, we train deep neural networks to provide an accurate alternative to a physics-based parameterization. We demonstrate that a domain-aware deep neural network can successfully simulate the entire diurnal cycle of the boundary layer physics and the results are transferable.
Gianandrea Mannarini and Lorenzo Carelli
Geosci. Model Dev., 12, 3449–3480, https://doi.org/10.5194/gmd-12-3449-2019, https://doi.org/10.5194/gmd-12-3449-2019, 2019
Short summary
Short summary
The VISIR ship-routing model is updated in order to deal with ocean currents.
The optimal tracks we computed through VISIR in the Atlantic ocean show great seasonal and regional variability, following a variable influence of surface gravity waves and currents. We assess how these tracks contribute to voyage energy-efficiency gains through a standard indicator (EEOI) of the International Maritime Organization. Also, the new model features are validated against an exact analytical benchmark.
Grzegorz Muszynski, Karthik Kashinath, Vitaliy Kurlin, Michael Wehner, and Prabhat
Geosci. Model Dev., 12, 613–628, https://doi.org/10.5194/gmd-12-613-2019, https://doi.org/10.5194/gmd-12-613-2019, 2019
Short summary
Short summary
We present the automated method for recognizing atmospheric rivers in climate data, i.e., climate model output and reanalysis product. The method is based on topological data analysis and machine learning, both of which are powerful tools that the climate science community often does not use. An advantage of the proposed method is that it is free of selection of subjective threshold conditions on a physical variable. This method is also suitable for rapidly analyzing large amounts of data.
Christina Papagiannopoulou, Diego G. Miralles, Matthias Demuzere, Niko E. C. Verhoest, and Willem Waegeman
Geosci. Model Dev., 11, 4139–4153, https://doi.org/10.5194/gmd-11-4139-2018, https://doi.org/10.5194/gmd-11-4139-2018, 2018
Short summary
Short summary
Common global land cover and climate classifications are based on vegetation–climatic characteristics derived from observational data, ignoring the interaction between the local climate and biome. Here, we model the interplay between vegetation and local climate by discovering spatial relationships among different locations. The resulting global
hydro-climatic biomescorrespond to regions of coherent climate–vegetation interactions that agree well with traditional global land cover maps.
Daojun Zhang, Na Ren, and Xianhui Hou
Geosci. Model Dev., 11, 2525–2539, https://doi.org/10.5194/gmd-11-2525-2018, https://doi.org/10.5194/gmd-11-2525-2018, 2018
Short summary
Short summary
Geographically weighted regression is a widely used method to deal with spatial heterogeneity, which is common in geostatistics. However, most existing software does not support logistic regression and cannot deal with missing data, which exist extensively in mineral prospectivity mapping. This work generalized logistic regression to spatial statistics based on a spatially weighted technique. The new model also supports an anisotropic local window, which is another innovative point.
Thomas Block, Sabine Embacher, Christopher J. Merchant, and Craig Donlon
Geosci. Model Dev., 11, 2419–2427, https://doi.org/10.5194/gmd-11-2419-2018, https://doi.org/10.5194/gmd-11-2419-2018, 2018
Short summary
Short summary
For calibration and validation purposes it is necessary to detect simultaneous data acquisitions from different spaceborne platforms. We present an algorithm and a software system which implements a general approach to resolve this problem. The multisensor matchup system (MMS) can detect simultaneous acquisitions in a large dataset (> 100 TB) and extract data for matching locations for further analysis. The MMS implements a flexible software infrastructure and allows for high parallelization.
Cited articles
Alonso, P., Badia, R. M., Labarta, J., Barreda, M., Dolz, M. F., Mayo, R., Quintana-Orti, E. S., and Reyes, R.: Tools for Power-Energy Modelling and Analysis of Parallel Scientific Applications, in: 2012 41st International Conference on Parallel Processing, 420–429, https://doi.org/10.1109/ICPP.2012.57, 2012.
Ashby, S. F. and Falgout, R. D.: A parallel multigrid preconditioned conjugate gradient algorithm for groundwater flow simulations, Nucl. Sci. Eng., 124, 145–159, 1996.
Attig, N., Gibbon, P., and Lippert, T.: Trends in supercomputing: The European path to exascale, Comput. Phys. Commun., 182, 2041–2046, https://doi.org/10.1016/j.cpc.2010.11.011, 2011.
Bahra, A.: Managing work flows with ecFlow, ECMWF Newsletter,. Tech. Rep., 129, 30–32, 2011.
Bierkens, M. F. P., Bell, V. A., Burek, P., Chaney, N., Condon, L. E., David, C. H., de Roo, A., Döll, P., Drost, N., Famiglietti, J. S., Flörke, M., Gochis, D. J., Houser, P., Hut, R., Keune, J., Kollet, S., Maxwell, R. M., Reager, J. T., Samaniego, L., Sudicky, E., Sutanudjaja, E. H., van de Giesen, N., Winsemius, H., and Wood, E. F.: Hyper-resolution global hydrological modelling: what is next?, Hydrol. Proc., 29, 310–320, https://doi.org/10.1002/hyp.10391, 2015.
Brodtkorb, A. R., Dyken, C., Hagen, T. R., Hjelmervik, J. M., and Storaasli, O. O.: State-of-the-art in heterogeneous computing, Sci. Programming, 18, 1–33, https://doi.org/10.3233/SPR-2009-0296, 2010.
Burstedde, C., Fonseca, J. A., and Kollet, S.: Enhancing speed and scalability of the ParFlow simulation code, Comput. Geosci., 22, 347–361, https://doi.org/10.1007/s10596-017-9696-2, 2018.
Carns, P., Harms, K., Allcock, W., Bacon, C., Lang, S., Latham, R., and Ross, R.: Understanding and Improving Computational Science Storage Access through Continuous Characterization, ACM T. Storage, 7, 1–26, https://doi.org/10.1145/2027066.2027068, 2011.
Davis, N. E., Robey, R. W., Ferenbaugh, C. R., Nicholaeff, D., and Trujillo, D. P.: Paradigmatic shifts for exascale supercomputing, J. Supercomput., 62, 1023–1044, https://doi.org/10.1007/s11227-012-0789-3, 2012.
Eaton, B., Gregory, J., Drach, R., Taylor, K., and Hankin, S.: NetCDF Climate and Forecast (CF) Metadata Conventions, available at: http://cfconventions.org/cf-conventions/v1.6.0/cf-conventions.html (last access: 2 July 2018), 2009.
Eyring, V., Bony, S., Meehl, G. A., Senior, C. A., Stevens, B., Stouffer, R. J., and Taylor, K. E.: Overview of the Coupled Model Intercomparison Project Phase 6 (CMIP6) experimental design and organization, Geosci. Model Dev., 9, 1937–1958, https://doi.org/10.5194/gmd-9-1937-2016, 2016.
Gasper, F., Goergen, K., Shrestha, P., Sulis, M., Rihani, J., Geimer, M., and Kollet, S.: Implementation and scaling of the fully coupled Terrestrial Systems Modeling Platform (TerrSysMP v1.0) in a massively parallel supercomputing environment – a case study on JUQUEEN (IBM Blue Gene/Q), Geosci. Model Dev., 7, 2531–2543, https://doi.org/10.5194/gmd-7-2531-2014, 2014.
Geimer, M., Wolf, F., Wylie, B. J. N., Ábrahám, E., Becker, D., and Mohr, B.: The Scalasca performance toolset architecture, Concurr. Comp.-Pract. E., 22, 702–719, https://doi.org/10.1002/cpe.1556, 2010.
Hammond, G. E., Lichtner, P. C., and Mills, R. T.: Evaluating the performance of parallel subsurface simulators: An illustrative example with PFLOTRAN, Water Resour. Res., 50, 208–228, https://doi.org/10.1002/2012WR013483, 2014.
Han, X., Hendricks Franssen, H.-J., Jiménez Bello, M. Á., Rosolem, R., Bogena, H., Alzamora, F. M., Chanzy, A., and Vereecken, H.: Simultaneous soil moisture and properties estimation for a drip irrigated field by assimilating cosmic-ray neutron intensity, J. Hydrol., 539, 611–624, https://doi.org/10.1016/j.jhydrol.2016.05.050, 2016.
Heinzeller, D., Duda, M. G., and Kunstmann, H.: Towards convection-resolving, global atmospheric simulations with the Model for Prediction Across Scales (MPAS) v3.1: an extreme scaling experiment, Geosci. Model Dev., 9, 77–110, https://doi.org/10.5194/gmd-9-77-2016, 2016.
Hethey, J. M.: GitLab repository management: delve into managing your projects with GitLab, while tailoring it to fit your environment, Packt Pub,Birmingham, 88 pp., ISBN: 9781783281794, 2013.
Hindmarsh, A. C., Brown, P. N., Grant, K. E., Lee, S. L., Serban, R., Shumaker, D. E., and Woodward, C. S.: SUNDIALS, ACM T. Math. Software, 31, 363–396, https://doi.org/10.1145/1089014.1089020, 2005.
Hutton, C., Wagener, T., Freer, J., Han, D., Duffy, C., and Arheimer, B.: Most computational hydrology is not reproducible, so is it really science?, Water Resour. Res., 52, 7548–7555, https://doi.org/10.1002/2016WR019285, 2016.
Hwu, W.-M.: What is ahead for parallel computing, J Parallel Distr. Com., 74, 2574–2581, https://doi.org/10.1016/j.jpdc.2014.02.005, 2014.
IBM: IBM XL C/C++ for Blue Gene/Q: Compiler Reference, version 12.1, IBM Corporation ,available at: http://www-01.ibm.com/support/docview.wss?uid=swg27027065&aid=1 (last access: 1 July 2018), 2012.
Irving, D.: A Minimum Standard for Publishing Computational Results in the Weather and Climate Sciences, B. Am. Meteorol. Soc., 97, 1149–1158, https://doi.org/10.1175/BAMS-D-15-00010.1, 2016.
January, C., Byrd, J., Oró, X., and O'Connor, M.: Allinea MAP: Adding Energy and OpenMP Profiling Without Increasing Overhead, in: Tools for High Performance Computing 2014, Springer International Publishing, Cham, 25–35, https://doi.org/10.1007/978-3-319-16012-2_2, 2015.
John, E. and Rubio, J.: Unique chips and systems, CRC Press, 34–35, 2008.
Jones, J. E. and Woodward, C. S.: Newton–Krylov-multigrid solvers for large-scale, highly heterogeneous, variably saturated flow problems, Adv. Water Resour., 24, 763–774, https://doi.org/10.1016/S0309-1708(00)00075-0, 2001.
Kandalla, K., Mendygral, P., Radcliffe, N., Cernohous, B., Knaak, D., McMahon, K., and Pagel, M.: Optimizing Cray MPI and SHMEM Software Stacks for Cray-XC Supercomputers based on Intel KNL Processors, Proceedings of 2016 Cray User Group (CUG), 2016.
Keune, J., Kollet, S., Sulis, M., Shresta, P., Görgen, K., and Ohlwein, C.: Implementation of a coupled soil-vegetation-atmosphere system over the European CORDEX domain, Hans-Ertel Centre for Weather Research workshop 2013, Bonn, Germany, Climate Monitoring Branch, Centre for High-Performance Scientific Computing in Terrestrial Systems, 2013.
Keyes, D. E.: Exaflop/s: The why and the how, CR Mecanique, 339, 70–77, https://doi.org/10.1016/j.crme.2010.11.002, 2011.
Knüpfer, A., Rössel, C., an Mey, D., Biersdorff, S., Diethelm, K., Eschweiler, D., Geimer, M., Gerndt, M., Lorenz, D., Malony, A. D., Nagel, W. E., Oleynik, Y., Philippen, P., Saviankou, P., Schmidl, D., Shende, S. S., Tschüter, R., Wagner, M., Wesarg, B., and Wolf, F.: Score-P – A Joint Performance Measurement Run-Time Infrastructure for Periscope, Scalasca, TAU, and Vampir, in: Tools for High Performance Computing 2011: Proceedings of the 5th International Workshop on Parallel Tools for High Performance Computing, edited by: Brunst, H., Müller, M. S., Nagel, W. E., and Resch, M. M., September 2011, ZIH, Dresden, Germany, Springer, 79–91, https://doi.org/10.1007/978-3-642-31476-6_7, 2012.
Kollet, S. J. and Maxwell, R. M.: Integrated surface–groundwater flow modeling: A free-surface overland flow boundary condition in a parallel groundwater flow model, Adv. Water Resour., 29, 945–958, https://doi.org/10.1016/j.advwatres.2005.08.006, 2006.
Kollet, S. J. and Maxwell, R. M.: Capturing the influence of groundwater dynamics on land surface processes using an integrated, distributed watershed model, Water Resour. Res., 44, W02402, https://doi.org/10.1029/2007WR006004, 2008.
Kurtz, W., He, G., Kollet, S. J., Maxwell, R. M., Vereecken, H., and Hendricks Franssen, H.-J.: TerrSysMP–PDAF (version 1.0): a modular high-performance data assimilation framework for an integrated land surface–subsurface model, Geosci. Model Dev., 9, 1341–1360, https://doi.org/10.5194/gmd-9-1341-2016, 2016.
Labarta, J., Gi Enez, J., Martínez, E., Gon, P., Servat, H., Llort, G., and Aguilar, X.: Scalability of Visualization and Tracing Tools, in: Parallel Computing: Current & Future Issues of High-End Computing, edited by: Joubert, G. R., Nagel, W. E., Peters, F. J., Plata, O., Tirado, P., and Zapata, E., NIC Series Vol. 33, 869–876, ISBN 3-00-017352-8, 2006.
Langdon, W. B., Vilella, A., Lam, B. Y. H., Petke, J., and Harman, M.: Benchmarking genetically improved BarraCUDA on epigenetic methylation NGS datasets and nVidia GPUs, in: Proceedings of the 2016 on Genetic and Evolutionary Computation Conference Companion, ACM, Denver, CO, USA, 20–24 July 2016, 1131–1132, https://doi.org/10.1145/2908961.2931687, 2016.
Leutwyler, D., Fuhrer, O., Lapillonne, X., Lüthi, D., and Schär, C.: Towards European-scale convection-resolving climate simulations with GPUs: a study with COSMO 4.19, Geosci. Model Dev., 9, 3393–3412, https://doi.org/10.5194/gmd-9-3393-2016, 2016.
Liu, B., Zydek, D., Selvaraj, H., and Gewali, L.: Accelerating High Performance Computing Applications: Using CPUs, GPUs, Hybrid CPU/GPU, and FPGAs, in: 2012 13th International Conference on Parallel and Distributed Computing, Applications and Technologies, IEEE, 337–342, https://doi.org/10.1109/PDCAT.2012.34, 2012.
Lührs, S., Rohe, D., Frings, W., Thust, K., and Schnurpfeil, A.: Flexible and Generic Workflow Management, Adv. Par. Com., 27, 431–438, https://doi.org/10.3233/978-1-61499-621-7-431, 2016.
Manubens-Gil, D., Vegas-Regidor, J., Prodhomme, C., Mula-Valls, O., and Doblas-Reyes, F. J.: Seamless management of ensemble climate prediction experiments on hpc platforms, in: 2016 International Conference on High Performance Computing & Simulation (HPCS), IEEE, 895–900, 2016.
Mavroidis, I., Papaefstathiou, I., Lavagno, L., Nikolopoulos, D. S., Koch, D., Goodacre, J., Sourdis, I., Papaefstathiou, V., Coppola, M., and Palomino, M.: ECOSCALE: Reconfigurable computing and runtime system for future exascale systems, in: Proceedings of the 2016 Conference on Design, Automation & Test in Europe, EDA Consortium, 696–701, 2016.
Maxwell, R. M.: A terrain-following grid transform and preconditioner for parallel, large-scale, integrated hydrologic modeling, Adv. Water Resour., 53, 109–117, https://doi.org/10.1016/j.advwatres.2012.10.001, 2013.
Maxwell, R. M. and Miller, N. L.: Development of a Coupled Land Surface and Groundwater Model, J. Hydrometeorol., 6, 233–247, https://doi.org/10.1175/JHM422.1, 2005.
Maxwell, R. M., Lundquist, J. K., Mirocha, J. D., Smith, S. G., Woodward, C. S., and Tompson, A. F. B.: Development of a Coupled Groundwater–Atmosphere Model, Mon. Weather Rev., 139, 96–116, https://doi.org/10.1175/2010MWR3392.1, 2011.
Maxwell, R. M., Condon, L. E., and Kollet, S. J.: A high-resolution simulation of groundwater and surface water over most of the continental US with the integrated hydrologic model ParFlow v3, Geosci. Model Dev., 8, 923–937, https://doi.org/10.5194/gmd-8-923-2015, 2015.
Meadows, L.: Experiments with WRF on Intel many integrated core (Intel MIC) architecture, in: OpenMP in a Heterogeneous World, Springer, 130–139, 2012.
Mills, R. T., Lu, C., Lichtner, P. C., and Hammond, G. E.: Simulating subsurface flow and transport on ultrascale computers using PFLOTRAN, J. Phys. Conf. Ser., 78, 012051, https://doi.org/10.1088/1742-6596/78/1/012051, 2007.
Moore, S., Terpstra, D., London, K., Mucci, P., Teller, P., Salayandia, L., Bayona, A., and Nieto, M.: PAPI deployment, evaluation, and extensions, 2003 User Group Conference Proceedings, Bellevue, WA, USA, USA, 9–13 June 2003, IEEE, 349–353, https://doi.org/10.1109/DODUGC.2003.1253415, 2003.
Nadeau, D., Doutriaux, C., Bradshaw, T., Kettleborough, J., Weigel, T., Hogan, E., and Durack, P. J.: Pcmdi/Cmor: Cmor Version 3.2.2, https://doi.org/10.5281/zenodo.345171, 2017.
Nerger, L. and Hiller, W.: Software for ensemble-based data assimilation systems–Implementation strategies and scalability, Comput. Geosci., 55, 110–118, https://doi.org/10.1016/j.cageo.2012.03.026, 2013.
Oliver, H. J., Shin, M., Fitzpatrick, B., Clark, A., Sanders, O., M214089, Smout-Day, K., Matthews, D., Wales, S., Osprey, A., Reinecke, A., Williams, J., Kinoshita, B. P., Pulo, K., and Valters, D.: Cylc/Cylc: Cylc-7.3.0, https://doi.org/10.5281/ZENODO.545663, 2017.
Prein, A. F., Langhans, W., Fosser, G., Ferrone, A., Ban, N., Goergen, K., Keller, M., Tölle, M., Gutjahr, O., Feser, F., Brisson, E., Kollet, S., Schmidli, J., van Lipzig, N. P. M., and Leung, R.: A review on regional convection-permitting climate modeling: Demonstrations, prospects, and challenges, Rev. Geophys., 53, 323–361, https://doi.org/10.1002/2014RG000475, 2015.
Rane, A., Krishnaiyer, R., Newburn, C. J., Browne, J., Fialho, L., and Matveev, Z.: Unification of Static and Dynamic Analyses to Enable Vectorization, Springer, Cham, 367–381, https://doi.org/10.1007/978-3-319-17473-0_24, 2015.
Rigo, A., Pinto, C., Pouget, K., Raho, D., Dutoit, D., Martinez, P.-Y., Doran, C., Benini, L., Mavroidis, I., Marazakis, M., Bartsch, V., Lonsdale, G., Pop, A., Goodacre, J., Colliot, A., Carpenter, P., Radojkovic, P., Pleiter, D., Drouin, D., and de Dinechin, B.: Paving the way towards a highly energy-efficient and highly integrated compute node for the Exascale revolution: the ExaNoDe approach, in: 2017 Euromicro Conference on Digital System Design (DSD), IEEE, 486–493, 2017.
Rosas, C., Giménez, J., and Labarta, J.: Scalability prediction for fundamental performance factors, Supercomputing Frontiers and Innovations, 1, 4–19, https://doi.org/10.14529/jsfi140201, 2014.
Ruti, P. M., Somot, S., Giorgi, F., Dubois, C., Flaounas, E., Obermann, A., Dell'Aquila, A., Pisacane, G., Harzallah, A., Lombardi, E., Ahrens, B., Akhtar, N., Alias, A., Arsouze, T., Aznar, R., Bastin, S., Bartholy, J., Béranger, K., Beuvier, J., Bouffies-Cloché, S., Brauch, J., Cabos, W., Calmanti, S., Calvet, J.-C., Carillo, A., Conte, D., Coppola, E., Djurdjevic, V., Drobinski, P., Elizalde-Arellano, A., Gaertner, M., Galàn, P., Gallardo, C., Gualdi, S., Goncalves, M., Jorba, O., Jordà, G., L'Heveder, B., Lebeaupin-Brossier, C., Li, L., Liguori, G., Lionello, P., Maciàs, D., Nabat, P., Önol, B., Raikovic, B., Ramage, K., Sevault, F., Sannino, G., Struglia, M. V., Sanna, A., Torma, C., and Vervatis, V.: Med-CORDEX Initiative for Mediterranean Climate Studies, B. Am. Meteorol. Soc., 97, 1187–1208, https://doi.org/10.1175/BAMS-D-14-00176.1, 2016.
Saviankou, P., Knobloch, M., Visser, A., and Mohr, B.: Cube v4: From Performance Report Explorer to Performance Analysis Tool, Procedia Comput. Sci., 51, 1343–1352, https://doi.org/10.1016/j.procs.2015.05.320, 2015.
Schwitalla, T., Bauer, H.-S., Wulfmeyer, V., and Warrach-Sagi, K.: Continuous high-resolution midlatitude-belt simulations for July–August 2013 with WRF, Geosci. Model Dev., 10, 2031–2055, https://doi.org/10.5194/gmd-10-2031-2017, 2017.
Shrestha, P., Sulis, M., Masbou, M., Kollet, S., and Simmer, C.: A scale-consistent Terrestrial Systems Modeling Platform based on COSMO, CLM and ParFlow, Mon. Weather Rev., 142, 3466–3483, https://doi.org/10.1175/MWR-D-14-00029.1, 2014.
Stodden, V., McNutt, M., Bailey, D. H., Deelman, E., Gil, Y., Hanson, B., Heroux, M. A., Ioannidis, J. P. A., and Taufer, M.: Enhancing reproducibility for computational methods, Science, 354, 1240–1241, https://doi.org/10.1126/science.aah6168, 2016.
Zhukov, I., Feld, C., Geimer, M., Knobloch, M., Mohr, B., and Saviankou, P.: Scalasca v2: Back to the Future, in: Tools for High Performance Computing 2014, Springer International Publishing, Cham, 1–24, https://doi.org/10.1007/978-3-319-16012-2_1, 2015.
Short summary
Next-generation geoscientific models are based on complex model implementations and workflows. Next-generation HPC systems require new programming paradigms and code optimization. In order to meet the challenge of running complex simulations on new massively parallel HPC systems, we developed a run control framework that facilitates code portability, code profiling, and provenance tracking to reduce both the duration and the cost of code migration and development, while ensuring reproducibility.
Next-generation geoscientific models are based on complex model implementations and workflows....
