Articles | Volume 9, issue 8
Development and technical paper 26 Aug 2016
Development and technical paper | 26 Aug 2016
Asynchronous communication in spectral-element and discontinuous Galerkin methods for atmospheric dynamics – a case study using the High-Order Methods Modeling Environment (HOMME-homme_dg_branch)
Benjamin F. Jamroz and Robert Klöfkorn
Related subject area
Earth and Space Science InformaticsClimateNet: an expert-labeled open dataset and deep learning architecture for enabling high-precision analyses of extreme weatherA spatiotemporal weighted regression model (STWR v1.0) for analyzing local nonstationarity in space and timeA new end-to-end workflow for the Community Earth System Model (version 2.0) for the Coupled Model Intercomparison Project Phase 6 (CMIP6)HyLands 1.0: a hybrid landscape evolution model to simulate the impact of landslides and landslide-derived sediment on landscape evolutionUsing SHAP to interpret XGBoost predictions of grassland degradation in Xilingol, ChinaComparative analysis of atmospheric radiative transfer models using the Atmospheric Look-up table Generator (ALG) toolbox (version 2.0)Fast domain-aware neural network emulation of a planetary boundary layer parameterization in a numerical weather forecast modelCurrent status on the need for improved accessibility to climate change modelsVISIR-1.b: ocean surface gravity waves and currents for energy-efficient navigationTopological data analysis and machine learning for recognizing atmospheric river patterns in large climate datasetsGlobal hydro-climatic biomes identified via multitask learningA run control framework to streamline profiling, porting, and tuning simulation runs and provenance tracking of geoscientific applicationsAn improved logistic regression model based on a spatially weighted technique (ILRBSWT v1.0) and its application to mineral prospectivity mappingHigh-performance software framework for the calculation of satellite-to-satellite data matchups (MMS version 1.2)A data model of the Climate and Forecast metadata conventions (CF-1.6) with a software implementation (cf-python v2.1)Reverse engineering model structures for soil and ecosystem respiration: the potential of gene expression programmingA high-fidelity multiresolution digital elevation model for Earth systemsCPMIP: measurements of real computational performance of Earth system models in CMIP6Automatic delineation of geomorphological slope units with r.slopeunits v1.0 and their optimization for landslide susceptibility modelingCommunity Intercomparison Suite (CIS) v1.4.0: a tool for intercomparing models and observationsGO2OGS 1.0: a versatile workflow to integrate complex geological information with fault data into numerical simulation modelsAn open and extensible framework for spatially explicit land use change modelling: the lulcc R packagePlant functional type classification for earth system models: results from the European Space Agency's Land Cover Climate Change InitiativeNon-singular spherical harmonic expressions of geomagnetic vector and gradient tensor fields in the local north-oriented reference frameAn approach to enhance pnetCDF performance in environmental modeling applicationsA strategy for GIS-based 3-D slope stability modelling over large areasAn approach to computing direction relations between separated object groupsImproving computational efficiency in large linear inverse problems: an example from carbon dioxide flux estimationCoupling technologies for Earth System ModellingQuality assessment concept of the World Data Center for Climate and its application to CMIP5 dataA web service based tool to plan atmospheric research flightsAutomated continuous verification for numerical simulation
Prabhat, Karthik Kashinath, Mayur Mudigonda, Sol Kim, Lukas Kapp-Schwoerer, Andre Graubner, Ege Karaismailoglu, Leo von Kleist, Thorsten Kurth, Annette Greiner, Ankur Mahesh, Kevin Yang, Colby Lewis, Jiayi Chen, Andrew Lou, Sathyavat Chandran, Ben Toms, Will Chapman, Katherine Dagon, Christine A. Shields, Travis O'Brien, Michael Wehner, and William Collins
Geosci. Model Dev., 14, 107–124,Short summary
Detecting extreme weather events is a crucial step in understanding how they change due to climate change. Deep learning (DL) is remarkable at pattern recognition; however, it works best only when labeled datasets are available. We create
ClimateNet– an expert-labeled curated dataset – to train a DL model for detecting weather events and predicting changes in extreme precipitation. This work paves the way for DL-based automated, high-fidelity, and highly precise analytics of climate data.
Xiang Que, Xiaogang Ma, Chao Ma, and Qiyu Chen
Geosci. Model Dev., 13, 6149–6164,Short summary
This paper presents a spatiotemporal weighted regression (STWR) model for exploring nonstationary spatiotemporal processes in nature and socioeconomics. A value change rate is introduced in the temporal kernel, which presents significant model fitting and accuracy in both simulated and real-world data. STWR fully incorporates observed data in the past and outperforms geographic temporal weighted regression (GTWR) and geographic weighted regression (GWR) models in several experiments.
Sheri Mickelson, Alice Bertini, Gary Strand, Kevin Paul, Eric Nienhouse, John Dennis, and Mariana Vertenstein
Geosci. Model Dev., 13, 5567–5581,Short summary
Every generation of MIP exercises introduces new layers of complexity and an exponential growth in the amount of data requested. CMIP6 required us to develop a new tool chain and forced us to change our methodologies. The new methods discussed in this paper provided us with an 18 times faster speedup over our existing methods. This allowed us to meet our deadlines and we were able to publish more than half a million data sets on the Earth System Grid Federation (ESGF) for the CMIP6 project.
Benjamin Campforts, Charles M. Shobe, Philippe Steer, Matthias Vanmaercke, Dimitri Lague, and Jean Braun
Geosci. Model Dev., 13, 3863–3886,Short summary
Landslides shape the Earth’s surface and are a dominant source of terrestrial sediment. Rivers, then, act as conveyor belts evacuating landslide-produced sediment. Understanding the interaction among rivers and landslides is important to predict the Earth’s surface response to past and future environmental changes and for mitigating natural hazards. We develop HyLands, a new numerical model that provides a toolbox to explore how landslides and rivers interact over several timescales.
Batunacun, Ralf Wieland, Tobia Lakes, and Claas Nendel
Geosci. Model Dev. Discuss.,
Revised manuscript accepted for GMDShort summary
XGBoost can provide alternative insights that conventional land-use models are unable to generate. SHAP can interpret the results of the purely data-driven approach. XGBoost achieved similar and robust simulation results. SHAP values were useful for analysing the complex relationship between the different drivers of grassland degradation.
Jorge Vicent, Jochem Verrelst, Neus Sabater, Luis Alonso, Juan Pablo Rivera-Caicedo, Luca Martino, Jordi Muñoz-Marí, and José Moreno
Geosci. Model Dev., 13, 1945–1957,Short summary
The modeling of light propagation through the atmosphere is key to process satellite images and to understand atmospheric processes. However, existing atmospheric models can be complex to use in practical applications. Here we aim at providing a new software tool to facilitate using advanced models and to generate large databases of simulated data. As a test case, we use this tool to analyze differences between several atmospheric models, showing the capabilities of this open-source tool.
Jiali Wang, Prasanna Balaprakash, and Rao Kotamarthi
Geosci. Model Dev., 12, 4261–4274,Short summary
Parameterizations are frequently used in models representing physical phenomena and are often the computationally expensive portions of the code. Using model output from simulations performed using a weather model, we train deep neural networks to provide an accurate alternative to a physics-based parameterization. We demonstrate that a domain-aware deep neural network can successfully simulate the entire diurnal cycle of the boundary layer physics and the results are transferable.
Juan Antonio Añel, Michael García-Rodríguez, and Javier Rodeiro
Geosci. Model Dev. Discuss.,
Revised manuscript accepted for GMDShort summary
This work shows that it continues to be hard, if not impossible, to obtain some of the most used climate models worldwide. We reach this conclusion through a systematic study and encourage all the development teams and research centres to make public the models that they use to produce scientific results.
Gianandrea Mannarini and Lorenzo Carelli
Geosci. Model Dev., 12, 3449–3480,Short summary
The VISIR ship-routing model is updated in order to deal with ocean currents. The optimal tracks we computed through VISIR in the Atlantic ocean show great seasonal and regional variability, following a variable influence of surface gravity waves and currents. We assess how these tracks contribute to voyage energy-efficiency gains through a standard indicator (EEOI) of the International Maritime Organization. Also, the new model features are validated against an exact analytical benchmark.
Grzegorz Muszynski, Karthik Kashinath, Vitaliy Kurlin, Michael Wehner, and Prabhat
Geosci. Model Dev., 12, 613–628,Short summary
We present the automated method for recognizing atmospheric rivers in climate data, i.e., climate model output and reanalysis product. The method is based on topological data analysis and machine learning, both of which are powerful tools that the climate science community often does not use. An advantage of the proposed method is that it is free of selection of subjective threshold conditions on a physical variable. This method is also suitable for rapidly analyzing large amounts of data.
Christina Papagiannopoulou, Diego G. Miralles, Matthias Demuzere, Niko E. C. Verhoest, and Willem Waegeman
Geosci. Model Dev., 11, 4139–4153,Short summary
Common global land cover and climate classifications are based on vegetation–climatic characteristics derived from observational data, ignoring the interaction between the local climate and biome. Here, we model the interplay between vegetation and local climate by discovering spatial relationships among different locations. The resulting global
hydro-climatic biomescorrespond to regions of coherent climate–vegetation interactions that agree well with traditional global land cover maps.
Wendy Sharples, Ilya Zhukov, Markus Geimer, Klaus Goergen, Sebastian Luehrs, Thomas Breuer, Bibi Naz, Ketan Kulkarni, Slavko Brdar, and Stefan Kollet
Geosci. Model Dev., 11, 2875–2895,Short summary
Next-generation geoscientific models are based on complex model implementations and workflows. Next-generation HPC systems require new programming paradigms and code optimization. In order to meet the challenge of running complex simulations on new massively parallel HPC systems, we developed a run control framework that facilitates code portability, code profiling, and provenance tracking to reduce both the duration and the cost of code migration and development, while ensuring reproducibility.
Daojun Zhang, Na Ren, and Xianhui Hou
Geosci. Model Dev., 11, 2525–2539,Short summary
Geographically weighted regression is a widely used method to deal with spatial heterogeneity, which is common in geostatistics. However, most existing software does not support logistic regression and cannot deal with missing data, which exist extensively in mineral prospectivity mapping. This work generalized logistic regression to spatial statistics based on a spatially weighted technique. The new model also supports an anisotropic local window, which is another innovative point.
Thomas Block, Sabine Embacher, Christopher J. Merchant, and Craig Donlon
Geosci. Model Dev., 11, 2419–2427,Short summary
For calibration and validation purposes it is necessary to detect simultaneous data acquisitions from different spaceborne platforms. We present an algorithm and a software system which implements a general approach to resolve this problem. The multisensor matchup system (MMS) can detect simultaneous acquisitions in a large dataset (> 100 TB) and extract data for matching locations for further analysis. The MMS implements a flexible software infrastructure and allows for high parallelization.
David Hassell, Jonathan Gregory, Jon Blower, Bryan N. Lawrence, and Karl E. Taylor
Geosci. Model Dev., 10, 4619–4646,Short summary
We present a formal data model for version 1.6 of the CF (Climate and Forecast) metadata conventions that provide a description of the physical meaning of geoscientific data and their spatial and temporal properties. We describe the CF conventions and how they lead to our CF data model, and compare it other data models for storing data and metadata. We present cf-python version 2.1: a software implementation of the CF data model capable of manipulating any CF-compliant dataset.
Iulia Ilie, Peter Dittrich, Nuno Carvalhais, Martin Jung, Andreas Heinemeyer, Mirco Migliavacca, James I. L. Morison, Sebastian Sippel, Jens-Arne Subke, Matthew Wilkinson, and Miguel D. Mahecha
Geosci. Model Dev., 10, 3519–3545,Short summary
Accurate representation of land-atmosphere carbon fluxes is essential for future climate projections, although some of the responses of CO2 fluxes to climate often remain uncertain. The increase in available data allows for new approaches in their modelling. We automatically developed models for ecosystem and soil carbon respiration using a machine learning approach. When compared with established respiration models, we found that they are better in prediction as well as offering new insights.
Xinqiao Duan, Lin Li, Haihong Zhu, and Shen Ying
Geosci. Model Dev., 10, 239–253,Short summary
This article proposes an optimized transformation for topographic datasets. The resulting topographic grid exhibits good surface approximation and quasi-uniform high-quality. Both features of the processed topography build a concrete base from which improved endogenous or exogenous parameters can be derived, and makes it suitable for Earth and environmental simulations.
Venkatramani Balaji, Eric Maisonnave, Niki Zadeh, Bryan N. Lawrence, Joachim Biercamp, Uwe Fladrich, Giovanni Aloisio, Rusty Benson, Arnaud Caubel, Jeffrey Durachta, Marie-Alice Foujols, Grenville Lister, Silvia Mocavero, Seth Underwood, and Garrett Wright
Geosci. Model Dev., 10, 19–34,Short summary
Climate models are among the most computationally expensive scientific applications in the world. We present a set of measures of computational performance that can be used to compare models that are independent of underlying hardware and the model formulation. They are easy to collect and reflect performance actually achieved in practice. We are preparing a systematic effort to collect these metrics for the world's climate models during CMIP6, the next Climate Model Intercomparison Project.
Massimiliano Alvioli, Ivan Marchesini, Paola Reichenbach, Mauro Rossi, Francesca Ardizzone, Federica Fiorucci, and Fausto Guzzetti
Geosci. Model Dev., 9, 3975–3991,Short summary
Slope units are morphological mapping units bounded by drainage and divide lines that maximize within-unit homogeneity and between-unit heterogeneity. We use r.slopeunits, a software for the automatic delination of slope units. We outline an objective procedure to optimize the software input parameters for landslide susceptibility (LS) zonation. Optimization is achieved by maximizing an objective function that simultaneously evaluates terrain aspect segmentation quality and LS model performance.
Duncan Watson-Parris, Nick Schutgens, Nicholas Cook, Zak Kipling, Philip Kershaw, Edward Gryspeerdt, Bryan Lawrence, and Philip Stier
Geosci. Model Dev., 9, 3093–3110,Short summary
In this paper we describe CIS, a new command line tool for the easy visualization, analysis and comparison of a wide variety of gridded and ungridded data sets used in Earth sciences. Users can now use a single tool to not only view plots of satellite, aircraft, station or model data, but also bring them onto the same spatio-temporal sampling. This allows robust, quantitative comparisons to be made easily. CIS is an open-source project and welcomes input from the community.
T. Fischer, D. Naumov, S. Sattler, O. Kolditz, and M. Walther
Geosci. Model Dev., 8, 3681–3694,Short summary
We present a workflow to convert geological models into the open-source VTU format for usage in numerical simulation models. Tackling relevant scientific questions or engineering tasks often involves multidisciplinary approaches. Conversion workflows are needed between the diverse tools of the various disciplines. Our approach offers an open-source, platform-independent, robust, and comprehensible method that is potentially useful for a multitude of similar environmental studies.
S. Moulds, W. Buytaert, and A. Mijic
Geosci. Model Dev., 8, 3215–3229,Short summary
The contribution of lulcc is to provide a free and open-source framework for land use change modelling. The software, which is provided as an R package, addresses problems associated with the current paradigm of closed-source, specialised land use change modelling software which disrupt the scientific process. It is an attempt to move the discipline towards open and transparent science and to ensure land use change models are accessible to scientists working across the geosciences.
B. Poulter, N. MacBean, A. Hartley, I. Khlystova, O. Arino, R. Betts, S. Bontemps, M. Boettcher, C. Brockmann, P. Defourny, S. Hagemann, M. Herold, G. Kirches, C. Lamarche, D. Lederer, C. Ottlé, M. Peters, and P. Peylin
Geosci. Model Dev., 8, 2315–2328,Short summary
Land cover is an essential variable in earth system models and determines conditions driving biogeochemical, energy and water exchange between ecosystems and the atmosphere. A methodology is presented for mapping plant functional types used in global vegetation models from a updated land cover classification system and open-source conversion tool, resulting from a consultative process among map producers and modelers engaged in the European Space Agency’s Land Cover Climate Change Initiative.
J. Du, C. Chen, V. Lesur, and L. Wang
Geosci. Model Dev., 8, 1979–1990,
D. C. Wong, C. E. Yang, J. S. Fu, K. Wong, and Y. Gao
Geosci. Model Dev., 8, 1033–1046,
M. Mergili, I. Marchesini, M. Alvioli, M. Metz, B. Schneider-Muntau, M. Rossi, and F. Guzzetti
Geosci. Model Dev., 7, 2969–2982,Short summary
The article deals with strategies to (i) reduce computation time and to (ii) appropriately account for uncertain input parameters when applying an open source GIS sliding surface model to estimate landslide susceptibility for a 90km² study area in central Italy. For (i), the area is split into a large number of tiles, enabling the exploitation of multi-processor computing environments. For (ii), the model is run with various parameter combinations to compute the slope failure probability.
H. Yan, Z. Wang, and J. Li
Geosci. Model Dev., 6, 1591–1599,
V. Yadav and A. M. Michalak
Geosci. Model Dev., 6, 583–590,
S. Valcke, V. Balaji, A. Craig, C. DeLuca, R. Dunlap, R. W. Ford, R. Jacob, J. Larson, R. O'Kuinghttons, G. D. Riley, and M. Vertenstein
Geosci. Model Dev., 5, 1589–1596,
M. Stockhause, H. Höck, F. Toussaint, and M. Lautenschlager
Geosci. Model Dev., 5, 1023–1032,
M. Rautenhaus, G. Bauer, and A. Dörnbrack
Geosci. Model Dev., 5, 55–71,
P. E. Farrell, M. D. Piggott, G. J. Gorman, D. A. Ham, C. R. Wilson, and T. M. Bond
Geosci. Model Dev., 4, 435–449,
The 2012 Dynamical Core Model Intercomparison Project: available at: https://earthsystemcog.org/projects/dcmip-2012 (last access: 22 August 2016), 2012.
Baggag, A., Atkins, H., and Keyes, D.: Parallel Implementation of the Discontinuous Galerkin Method, in: Proceedings of Parallel CFD'99, 115–122, 1999.
Baker, A. H., Hammerling, D. M., Levy, M. N., Xu, H., Dennis, J. M., Eaton, B. E., Edwards, J., Hannay, C., Mickelson, S. A., Neale, R. B., Nychka, D., Shollenberger, J., Tribbia, J., Vertenstein, M., and Williamson, D.: A new ensemble-based consistency test for the Community Earth System Model (pyCECT v1.0), Geosci. Model Dev., 8, 2829–2840, https://doi.org/10.5194/gmd-8-2829-2015, 2015.
Bermejo-Moreno, I., Bodart, J., Larsson, J., Barney, B., Nichols, J., and Jones, S.: Solving the compressible Navier-Stokes equations on up to 1.97 million cores and 4.1 trillion grid points, in: Proceedings of SC13: International Conference for High Performance Computing, Networking, Storage and Analysis, Denver, 62:1–62:10, 2013.
Brömmel, D., Frings, W., and Wylie, B. J. N.: JUQUEEN Extreme Scaling Workshop 2015, Tech. Rep. FZJ-JSC-IB-2015-01, available at: http://juser.fz-juelich.de/record/188191 (last access: 22 August 2016), 2015.
Brömmel, D., Frings, W., and Wylie, B. J. N.: JUQUEEN Extreme Scaling Workshop 2016, Tech. Rep. FZJ-JSC-IB-2016-01, available at: https://juser.fz-juelich.de/record/283461, last access: 22 August 2016.
Chhugani, J., Kim, C., Shukla, H., Park, J., Dubey, P., Shalf, J., and Simon, H. D.: Billion-particle SIMD-friendly Two-point Correlation on Large-scale HPC Cluster Systems, in: Proceedings of the International Conference on High Performance Computing, Networking, Storage and Analysis, SC '12, IEEE Computer Society Press, Los Alamitos, CA, USA, 1:1–1:11, http://dl.acm.org/citation.cfm?id=2388996.2388998, 2012.
Computational and Information Systems Laboratory. Yellowstone: IBM iDataPlex System (Climate Simulation Laboratory), Boulder, CO: National Center for Atmospheric Research, available at: http://n2t.net/ark:/85065/d7wd3xhc (last access: 22 August 2016), 2012.
Dennis, J. M., Edwards, J., Evans, K. J., Guba, O., Lauritzen, P. H., Mirin, A. A., St.-Cyr, A., Taylor, M. A., and Worley, P. H.: CAM-SE: A scalable spectral element dynamical core for the Community Atmosphere Model, IJHPCA, 26, 74–89, https://doi.org/10.1177/1094342011428142, 2012.
Erath, C. and Nair, R.: A conservative multi-tracer transport scheme for spectral-element spherical grids, J. Comput. Phys., 256, 118–134, https://doi.org/10.1016/j.jcp.2013.08.050, 2014.
Erath, C., Lauritzen, P. H., Garcia, J. H., and Tufo, H. M.: Proceedings of the International Conference on Computational Science, ICCS 2012 Integrating a scalable and effcient semi-Lagrangian multi-tracer transport scheme in HOMME, Procedia Computer Science, 9, 994–1003, https://doi.org/10.1016/j.procs.2012.04.106, 2012.
Forum, M. P.: MPI: A Message-Passing Interface Standard, Tech. rep., Knoxville, TN, USA, 1994.
Gent, P. R., Danabasoglu, G., Donner, L. J., Holland, M. M., Hunke, E. C., Jayne, S. R., Lawrence, D. M., Neale, R. B., Rasch, P. J., Vertenstein, M., Worley, P. H., Yang, Z.-L., and Zhang, M.: The Community Climate System Model Version 4, J. Climate, 24, 4973–4991, https://doi.org/10.1175/2011JCLI4083.1, 2011.
Heinecke, A., Breuer, A., Rettenberger, S., Bader, M., Gabriel, A. A., Pelties, C., Bode, A., Barth, W., Liao, X. K., Vaidyanathan, K., Smelyanskiy, M., and Dubey, P.: Petascale High Order Dynamic Rupture Earthquake Simulations on Heterogeneous Supercomputers, in: SC14: International Conference for High Performance Computing, Networking, Storage and Analysis, 3–14, https://doi.org/10.1109/SC.2014.6, 2014.
Jablonowski, C. and Williamson, D. L.: A baroclinic instability test case for atmospheric model dynamical cores, Q. J. Roy. Meteor. Soc., 132, 2943–2975, https://doi.org/10.1256/qj.06.12, 2006.
Kahan, W.: Pracniques: Further Remarks on Reducing Truncation Errors, Commun. ACM, 8, 40, https://doi.org/10.1145/363707.363723, 1965.
Keyes, D.: Exaflop/s: The why and the how, Comptes Rendus Mécanique, 339, 70–77, https://doi.org/10.1016/j.crme.2010.11.002, 2011.
Kodama, C., Terai, M., Noda, A. T., Yamada, Y., Satoh, M., Seiki, T., ichi Iga, S., Yashiro, H., Tomita, H., and Minami, K.: Scalable rank-mapping algorithm for an icosahedral grid sy stem on the massive parallel computer with a 3-D torus network , Parallel Comput., 40, 362–373, https://doi.org/10.1016/j.parco.2014.06.002, 2014.
Liu, H.-L., Foster, B. T., Hagan, M. E., McInerney, J. M., Maute, A., Qian, L., Richmond, A. D., Roble, R. G., Solomon, S. C., Garcia, R. R., Kinnison, D., Marsh, D. R., Smith, A. K., Richter, J., Sassi, F., and Oberheide, J.: Thermosphere extension of the Whole Atmosphere Community Climate Model, J. Geophys. Res.-Space, 115, A12302, https://doi.org/10.1029/2010JA015586, 2010.
Müller, A., Kopera, M. A., Marras, S., Wilcox, L. C., Isaac, T., and Giraldo, F. X.: Strong Scaling for Numerical Weather Prediction at Petascale with the Atmospheric Model NUMA, CoRR, abs/1511.01561, http://arxiv.org/abs/1511.01561 (last access: 22 August 2016), 2015.
Nair, R., Choi, H.-W., and Tufo, H.: Computational aspects of a scalable high-order discontinuous Galerkin atmospheric dynamical core, Comput. Fluids, 38, 309–319, https://doi.org/10.1016/j.compfluid.2008.04.006, 2009.
Nair, R. D.: Diffusion Experiments with a Global Discontinuous Galerkin Shallow Water Model, Mon. Weather Rev., 137, 3339–3350, 2009.
Nair, R. D., Bao, L., Toy, M. D., and Klöfkorn, R.: A High-Order Multiscale Global Atmospheric Model, in: 8th AIAA Atmospheric and Space Environments Conference, AIAA Aviation, (AIAA 2016-3888), https://doi.org/10.2514/6.2016-3888, 2016.
Neale, R. B., Gettelman, A., Park, S., Conley, A. J., Kinnison, D., Marsh, D., Smith, A. K., Vitt, F., Morrison, H., Cameron-Smith, P., Collins, W. D., Iacono, M. J., Easter, R. C., Liu, X., Taylor, M. A., Chen, C.-C., Lauritzen, P. H., Williamson, D. L., Garcia, R., Lamarque, J.-F., Mills, M., Tilmes, S., Ghan, S. J., and Rasch, P. J.: Description of the NCAR Community Atmosphere Model (CAM 5.0), NCAR Tech. Note, p. 268, available at: http://www.cesm.ucar.edu/models/cesm1.0/cam/ (last access: 22 August 2016), 2010.
Rudi, J., Malossi, A. C. I., Isaac, T., Stadler, G., Gurnis, M., Staar, P. W. J., Ineichen, Y., Bekas, C., Curioni, A., and Ghattas, O.: An Extreme-scale Implicit Solver for Complex PDEs: Highly Heterogeneous Flow in Earth's Mantle, in: Proceedings of the International Conference for High Performance Computing, Networking, Storage and Analysis, SC '15, ACM, New York, NY, USA, 5:1–5:12, https://doi.org/10.1145/2807591.2807675, 2015.
Sandia MPI Micro-Benchmark Suite (SMB): available at: http://www.cs.sandia.gov/smb/, last access: 22 August 2016.
Simmons, A. J. and Burridge, D. M.: An Energy and Angular-Momentum Conserving Vertical Finite-Difference Scheme and Hybrid Vertical Coordinates, Mon. Weather Rev., 109, 758–766, https://doi.org/10.1175/1520-0493(1981)109<0758:AEAAMC>2.0.CO;2, 1981.
Small, R. J., Bacmeister, J., Bailey, D., Baker, A., Bishop, S., Bryan, F., Caron, J., Dennis, J., Gent, P., ming Hsu, H., Jochum, M., Lawrence, D., Munoz, E., diNezio, P., Sheitlin, T., Tomas, R., Tribbia, J., Heng Tseng, Y., and Vertenstein, M.: A new synoptic scale resolving global climate simulation using the Community Earth System Model, J. Adv. Model. Earth Syst., 6, 1065–1094, https://doi.org/10.1002/2014MS000363, 2014.
Taylor, M. A. and Fournier, A.: A Compatible and Conservative Spectral Element Method on Unstructured Grids, J. Comput. Phys., 229, 5879–5895, https://doi.org/10.1016/j.jcp.2010.04.008, 2010.
Wittmann, M., Hager, G., Zeiser, T., and Wellein, G.: Asynchronous MPI for the Masses, CoRR, abs/1302.4280, available at: http://arxiv.org/abs/1302.4280 (last access: 22 August 2016), 2013.
The scalability of computational applications on current and next-generation supercomputers is increasingly limited by the cost of inter-process communication. We implement communication hiding data exchange in the High-Order Methods Modeling Environment (HOMME) for the time integration of the hydrostatic fluid equations using both the spectral-element and discontinuous Galerkin methods. The presented approach produces significant performance and scalability gains in large-scale simulations.
The scalability of computational applications on current and next-generation supercomputers is...