Articles | Volume 12, issue 9
https://doi.org/10.5194/gmd-12-4099-2019
© Author(s) 2019. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
https://doi.org/10.5194/gmd-12-4099-2019
© Author(s) 2019. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
Development and technical paper
| 
23 Sep 2019
Development and technical paper |
| 23 Sep 2019
| 23 Sep 2019
Evaluation of lossless and lossy algorithms for the compression of scientific datasets in netCDF-4 or HDF5 files
Xavier Delaunay
CORRESPONDING AUTHOR
Thales, 290 allée du Lac, 31670 Labège, France
Aurélie Courtois
Thales, 290 allée du Lac, 31670 Labège, France
Flavien Gouillon
CNES, Centre Spatial de Toulouse, 18 avenue Edouard Belin, 31401 Toulouse, France
Related authors
No articles found.
Mathieu Thevenin, Stephane Pigoury, Olivier Thomine, and Flavien Gouillon
EGUsphere, https://doi.org/10.5194/egusphere-2022-1094, https://doi.org/10.5194/egusphere-2022-1094, 2022
Preprint archived
Short summary
Short summary
As an extension of the work presented in "Evaluation of lossless and lossy algorithms for the compression of scientific datasets in netCDF-4 or HDF5 files" (Delaunay) https://gmd.copernicus.org/articles/12/4099/2019/, this paper present a detailed bench of lossless, mostly LZ-based, compression algorithms that could be used for space-to-earth communication or data storage. The work is conducted on the SWOT altimetry data.
Jean-Michel Zigna, Reda Semlal, Flavien Gouillon, Ethan Davis, Elisabeth Lambert, Frédéric Briol, Romain Prod-Homme, Sean Arms, and Lionel Zawadzki
Geosci. Model Dev. Discuss., https://doi.org/10.5194/gmd-2021-138, https://doi.org/10.5194/gmd-2021-138, 2021
Preprint withdrawn
Short summary
Short summary
The Parquet Cube storage alternative presented here is compared with Pangeo and THREDDS platforms to access to gridded data for large scale processing and modeling. Stressing the 3 implementations through 3 data scientists' scenarii, this Parquet Cube Alternative appears to be a good candidate to share gridded data in a cloud environment and share them through different communities of users. This open source alternative can be enriched by additional services to subset, enrich or explore data.
Related subject area
Numerical methods
Numerical stabilization methods for level-set-based ice front migration
Modelling chemical advection during magma ascent
Consistent point data assimilation in Firedrake and Icepack
A computationally efficient parameterization of aerosol, cloud and precipitation pH for application at global and regional scale (EQSAM4Clim-v12)
Assessing the benefits of approximately exact step sizes for Picard and Newton solver in simulating ice flow (FEniCS-full-Stokes v.1.3.2)
Assessing effects of climate and technology uncertainties in large natural resource allocation problems
VISIR-2: ship weather routing in Python
Incremental analysis update (IAU) in the Model for Prediction Across Scales coupled with the Joint Effort for Data assimilation Integration (MPAS–JEDI 2.0.0)
Decision-making strategies implemented in SolFinder 1.0 to identify eco-efficient aircraft trajectories: application study in AirTraf 3.0
Developing meshing workflows in Gmsh v4.11 for the geologic uncertainty assessment of high-temperature aquifer thermal energy storage
Development and preliminary validation of a land surface image assimilation system based on the Common Land Model
NorSand4AI: a comprehensive triaxial test simulation database for NorSand constitutive model materials
ParticleDA.jl v.1.0: a distributed particle-filtering data assimilation package
HETerogeneous vectorized or Parallel (HETPv1.0): an updated inorganic heterogeneous chemistry solver for the metastable-state NH4+–Na+–Ca2+–K+–Mg2+–SO42−–NO3−–Cl−–H2O system based on ISORROPIA II
Three-dimensional geological modelling of igneous intrusions in LoopStructural v1.5.10
Estimating volcanic ash emissions using retrieved satellite ash columns and inverse ash transport modeling using VolcanicAshInversion v1.2.1, within the operational eEMEP (emergency European Monitoring and Evaluation Programme) volcanic plume forecasting system (version rv4_17)
Accounting for uncertainties in forecasting tropical-cyclone-induced compound flooding
An automatic mesh generator for coupled 1D–2D hydrodynamic models
Numerical coupling of aerosol emissions, dry removal, and turbulent mixing in the E3SM Atmosphere Model version 1 (EAMv1) – Part 1: Dust budget analyses and the impacts of a revised coupling scheme
Numerical coupling of aerosol emissions, dry removal, and turbulent mixing in the E3SM Atmosphere Model version 1 (EAMv1) – Part 2: A semi-discrete error analysis framework for assessing coupling schemes
jsmetrics v0.2.0: a Python package for metrics and algorithms used to identify or characterise atmospheric jet streams
P3D-BRNS v1.0.0: a three-dimensional, multiphase, multicomponent, pore-scale reactive transport modelling package for simulating biogeochemical processes in subsurface environments
MinVoellmy v1: a lightweight model for simulating rapid mass movements based on a modified Voellmy rheology
Scalable Feature Extraction and Tracking (SCAFET): a general framework for feature extraction from large climate data sets
Sweep interpolation: a cost-effective semi-Lagrangian scheme in the Global Environmental Multiscale model
CHONK 1.0: landscape evolution framework: cellular automata meets graph theory
Perspectives of physics-based machine learning strategies for geoscientific applications governed by partial differential equations
Calibration of absorbing boundary layers for geoacoustic wave modeling in pseudo-spectral time-domain methods
GeoINR 1.0: an implicit neural network approach to three-dimensional geological modelling
A comparison of Eulerian and Lagrangian methods for vertical particle transport in the water column
AutoQS v1: automatic parametrization of QuickSampling based on training images analysis
Implementation and application of ensemble optimal interpolation on an operational chemistry weather model for improving PM2.5 and visibility predictions
A dynamical core based on a discontinuous Galerkin method for higher-order finite-element sea ice modeling
GStatSim V1.0: a Python package for geostatistical interpolation and conditional simulation
Leveraging Google's Tensor Processing Units for tsunami-risk mitigation planning in the Pacific Northwest and beyond
An improved subgrid channel model with upwind-form artificial diffusion for river hydrodynamics and floodplain inundation simulation
A model instability issue in the National Centers for Environmental Prediction Global Forecast System version 16 and potential solutions
A comparison of 3-D spherical shell thermal convection results at low to moderate Rayleigh number using ASPECT (version 2.2.0) and CitcomS (version 3.3.1)
LISFLOOD-FP 8.1: new GPU-accelerated solvers for faster fluvial/pluvial flood simulations
Measurement Error Proxy System Models: MEPSM v0.2
Fast approximate Barnes interpolation: illustrated by Python-Numba implementation fast-barnes-py v1.0
Strategies for conservative and non-conservative monotone remapping on the sphere
Modeling large‐scale landform evolution with a stream power law for glacial erosion (OpenLEM v37): benchmarking experiments against a more process-based description of ice flow (iSOSIA v3.4.3)
A mixed finite-element discretisation of the shallow-water equations
Multifidelity Monte Carlo estimation for efficient uncertainty quantification in climate-related modeling
Massively parallel modeling and inversion of electrical resistivity tomography data using PFLOTRAN
Parallelized domain decomposition for multi-dimensional Lagrangian random walk mass-transfer particle tracking schemes
The Intelligent Prospector v1.0: geoscientific model development and prediction by sequential data acquisition planning with application to mineral exploration
Predicting peak daily maximum 8 h ozone and linkages to emissions and meteorology in Southern California using machine learning methods (SoCAB-8HR V1.0)
Transfer learning for landslide susceptibility modeling using domain adaptation and case-based reasoning
Gong Cheng, Mathieu Morlighem, and G. Hilmar Gudmundsson
Geosci. Model Dev., 17, 6227–6247, https://doi.org/10.5194/gmd-17-6227-2024, https://doi.org/10.5194/gmd-17-6227-2024, 2024
Short summary
Short summary
We conducted a comprehensive analysis of the stabilization and reinitialization techniques currently employed in ISSM and Úa for solving level-set equations, specifically those related to the dynamic representation of moving ice fronts within numerical ice sheet models. Our results demonstrate that the streamline upwind Petrov–Galerkin (SUPG) method outperforms the other approaches. We found that excessively frequent reinitialization can lead to exceptionally high errors in simulations.
Hugo Dominguez, Nicolas Riel, and Pierre Lanari
Geosci. Model Dev., 17, 6105–6122, https://doi.org/10.5194/gmd-17-6105-2024, https://doi.org/10.5194/gmd-17-6105-2024, 2024
Short summary
Short summary
Predicting the behaviour of magmatic systems is important for understanding Earth's matter and heat transport. Numerical modelling is a technique that can predict complex systems at different scales of space and time by solving equations using various techniques. This study tests four algorithms to find the best way to transport the melt composition. The "weighted essentially non-oscillatory" algorithm emerges as the best choice, minimising errors and preserving system mass well.
Reuben W. Nixon-Hill, Daniel Shapero, Colin J. Cotter, and David A. Ham
Geosci. Model Dev., 17, 5369–5386, https://doi.org/10.5194/gmd-17-5369-2024, https://doi.org/10.5194/gmd-17-5369-2024, 2024
Short summary
Short summary
Scientists often use models to study complex processes, like the movement of ice sheets, and compare them to measurements for estimating quantities that are hard to measure. We highlight an approach that ensures accurate results from point data sources (e.g. height measurements) by evaluating the numerical solution at true point locations. This method improves accuracy, aids communication between scientists, and is well-suited for integration with specialised software that automates processes.
Swen Metzger, Samuel Rémy, Jason E. Williams, Vincent Huijnen, and Johannes Flemming
Geosci. Model Dev., 17, 5009–5021, https://doi.org/10.5194/gmd-17-5009-2024, https://doi.org/10.5194/gmd-17-5009-2024, 2024
Short summary
Short summary
EQSAM4Clim has recently been revised to provide an accurate and efficient method for calculating the acidity of atmospheric particles. It is based on an analytical concept that is sufficiently fast and free of numerical noise, which makes it attractive for air quality forecasting. Version 12 allows the calculation of aerosol composition based on the gas–liquid–solid and the reduced gas–liquid partitioning with the associated water uptake for both cases, including the acidity of the aerosols.
Niko Schmidt, Angelika Humbert, and Thomas Slawig
Geosci. Model Dev., 17, 4943–4959, https://doi.org/10.5194/gmd-17-4943-2024, https://doi.org/10.5194/gmd-17-4943-2024, 2024
Short summary
Short summary
Future sea-level rise is of big significance for coastal regions. The melting and acceleration of glaciers plays a major role in sea-level change. Computer simulation of glaciers costs a lot of computational resources. In this publication, we test a new way of simulating glaciers. This approach produces the same results but has the advantage that it needs much less computation time. As simulations can be obtained with fewer computation resources, higher resolution and physics become affordable.
Jevgenijs Steinbuks, Yongyang Cai, Jonas Jaegermeyr, and Thomas W. Hertel
Geosci. Model Dev., 17, 4791–4819, https://doi.org/10.5194/gmd-17-4791-2024, https://doi.org/10.5194/gmd-17-4791-2024, 2024
Short summary
Short summary
This paper applies a cutting-edge numerical method, SCEQ, to show how uncertain climate change and technological progress affect the future utilization of the world's scarce land resources. The paper's key insight is to illustrate how much global cropland will expand when future crop yields are unknown. The study finds the range of outcomes for land use change to be smaller when using this novel method compared to existing deterministic models.
Gianandrea Mannarini, Mario Leonardo Salinas, Lorenzo Carelli, Nicola Petacco, and Josip Orović
Geosci. Model Dev., 17, 4355–4382, https://doi.org/10.5194/gmd-17-4355-2024, https://doi.org/10.5194/gmd-17-4355-2024, 2024
Short summary
Short summary
Ship weather routing has the potential to reduce CO2 emissions, but it currently lacks open and verifiable research. The Python-refactored VISIR-2 model considers currents, waves, and wind to optimise routes. The model was validated, and its computational performance is quasi-linear. For a ferry sailing in the Mediterranean Sea, VISIR-2 yields the largest percentage emission savings for upwind navigation. Given the vessel performance curve, the model is generalisable across various vessel types.
Soyoung Ha, Jonathan J. Guerrette, Ivette Hernández Baños, William C. Skamarock, and Michael G. Duda
Geosci. Model Dev., 17, 4199–4211, https://doi.org/10.5194/gmd-17-4199-2024, https://doi.org/10.5194/gmd-17-4199-2024, 2024
Short summary
Short summary
To mitigate the imbalances in the initial conditions, this study introduces our recent implementation of the incremental analysis update (IAU) in the Model for Prediction Across Scales – Atmospheric (MPAS-A) component coupled with the Joint Effort for Data assimilation Integration (JEDI) through the cycling system. A month-long cycling run demonstrates the successful implementation of the IAU capability in the MPAS–JEDI cycling system.
Federica Castino, Feijia Yin, Volker Grewe, Hiroshi Yamashita, Sigrun Matthes, Simone Dietmüller, Sabine Baumann, Manuel Soler, Abolfazl Simorgh, Maximilian Mendiguchia Meuser, Florian Linke, and Benjamin Lührs
Geosci. Model Dev., 17, 4031–4052, https://doi.org/10.5194/gmd-17-4031-2024, https://doi.org/10.5194/gmd-17-4031-2024, 2024
Short summary
Short summary
We introduce SolFinder 1.0, a decision-making tool to select trade-offs between different objective functions for optimal aircraft trajectories, including fuel use, flight time, NOx emissions, contrail distance, and climate impact. The module is included in the AirTraf 3.0 submodel and uses weather conditions simulated by the EMAC atmospheric model. This paper focuses on the ability of SolFinder to identify eco-efficient trajectories, reducing a flight's climate impact at limited cost penalties.
Ali Dashti, Jens C. Grimmer, Christophe Geuzaine, Florian Bauer, and Thomas Kohl
Geosci. Model Dev., 17, 3467–3485, https://doi.org/10.5194/gmd-17-3467-2024, https://doi.org/10.5194/gmd-17-3467-2024, 2024
Short summary
Short summary
This study developed new meshing workflows to enable the automatic generation of meshes that follow geological models. The workflow allows for importing several geological models as input for Gmsh and later exporting the same number of high-quality meshes. This way, geological uncertainty is directly included in the numerical simulations. This study evaluates the impact of the geological uncertainty on thermohydraulic performance of two reservoirs for high-temperature heat storage applications.
Wangbin Shen, Zhaohui Lin, Zhengkun Qin, and Juan Li
Geosci. Model Dev., 17, 3447–3465, https://doi.org/10.5194/gmd-17-3447-2024, https://doi.org/10.5194/gmd-17-3447-2024, 2024
Short summary
Short summary
In this study, a land surface image assimilation system capable of optimizing the spatial structure of the background field is constructed by introducing the curvelet analysis method and taking the similarity of image structure as a weak constraint. The findings demonstrate that the assimilation of surface soil moisture observation images effectively and reasonably enhances the spatial structure of soil moisture analysis field.
Luan Carlos de Sena Monteiro Ozelim, Michéle Dal Toé Casagrande, and André Luís Brasil Cavalcante
Geosci. Model Dev., 17, 3175–3197, https://doi.org/10.5194/gmd-17-3175-2024, https://doi.org/10.5194/gmd-17-3175-2024, 2024
Short summary
Short summary
The paper addresses synthetic dataset challenges in nonlinear constitutive modeling of soils, providing two datasets: one with 2000 soil types, 40 test conditions each (160 000 triaxial tests), and a second with 2048 soil types, 42 test conditions each (172 032 triaxial tests). Each dataset is a 4000×10 matrix applicable for multivariate forecasting and geotechnical simulations. In addition, a new Python code is introduced, empowering researchers to leverage Python packages for NorSand analyses.
Daniel Giles, Matthew M. Graham, Mosè Giordano, Tuomas Koskela, Alexandros Beskos, and Serge Guillas
Geosci. Model Dev., 17, 2427–2445, https://doi.org/10.5194/gmd-17-2427-2024, https://doi.org/10.5194/gmd-17-2427-2024, 2024
Short summary
Short summary
Digital twins of physical and human systems informed by real-time data are becoming ubiquitous across a wide range of settings. Progress for researchers is currently limited by a lack of tools to run these models effectively and efficiently. A key challenge is the optimal use of high-performance computing environments. The work presented here focuses on a developed open-source software platform which aims to improve this usage, with an emphasis placed on flexibility, efficiency, and scalability.
Stefan J. Miller, Paul A. Makar, and Colin J. Lee
Geosci. Model Dev., 17, 2197–2219, https://doi.org/10.5194/gmd-17-2197-2024, https://doi.org/10.5194/gmd-17-2197-2024, 2024
Short summary
Short summary
This work outlines a new solver written in Fortran to calculate the partitioning of metastable aerosols at thermodynamic equilibrium based on the forward algorithms of ISORROPIA II. The new code includes numerical improvements that decrease the computational speed (compared to ISORROPIA II) while improving the accuracy of the partitioning solution.
Fernanda Alvarado-Neves, Laurent Ailleres, Lachlan Grose, Alexander R. Cruden, and Robin Armit
Geosci. Model Dev., 17, 1975–1993, https://doi.org/10.5194/gmd-17-1975-2024, https://doi.org/10.5194/gmd-17-1975-2024, 2024
Short summary
Short summary
Previous work has demonstrated that adding geological knowledge to modelling methods creates more accurate and reliable models. Following this reasoning, we added constraints from magma emplacement mechanisms into existing modelling frameworks to improve the 3D characterisation of igneous intrusions. We tested the method on synthetic and real-world case studies, and the results show that our method can reproduce intrusion morphologies with no manual processing and using realistic datasets.
André R. Brodtkorb, Anna Benedictow, Heiko Klein, Arve Kylling, Agnes Nyiri, Alvaro Valdebenito, Espen Sollum, and Nina Kristiansen
Geosci. Model Dev., 17, 1957–1974, https://doi.org/10.5194/gmd-17-1957-2024, https://doi.org/10.5194/gmd-17-1957-2024, 2024
Short summary
Short summary
It is vital to know the extent and concentration of volcanic ash in the atmosphere during a volcanic eruption. Whilst satellite imagery may give an estimate of the ash right now (assuming no cloud coverage), we also need to know where it will be in the coming hours. This paper presents a method for estimating parameters for a volcanic eruption based on satellite observations of ash in the atmosphere. The software package is open source and applicable to similar inversion scenarios.
Kees Nederhoff, Maarten van Ormondt, Jay Veeramony, Ap van Dongeren, José Antonio Álvarez Antolínez, Tim Leijnse, and Dano Roelvink
Geosci. Model Dev., 17, 1789–1811, https://doi.org/10.5194/gmd-17-1789-2024, https://doi.org/10.5194/gmd-17-1789-2024, 2024
Short summary
Short summary
Forecasting tropical cyclones and their flooding impact is challenging. Our research introduces the Tropical Cyclone Forecasting Framework (TC-FF), enhancing cyclone predictions despite uncertainties. TC-FF generates global wind and flood scenarios, valuable even in data-limited regions. Applied to cases like Cyclone Idai, it showcases potential in bettering disaster preparation, marking progress in handling cyclone threats.
Younghun Kang and Ethan J. Kubatko
Geosci. Model Dev., 17, 1603–1625, https://doi.org/10.5194/gmd-17-1603-2024, https://doi.org/10.5194/gmd-17-1603-2024, 2024
Short summary
Short summary
Models used to simulate the flow of coastal and riverine waters, including flooding, require a geometric representation (or mesh) of geographic features that exhibit a range of disparate spatial scales from large, open waters to small, narrow channels. Representing these features in an accurate way without excessive computational overhead presents a challenge. Here, we develop an automatic mesh generation tool to help address this challenge. Our results demonstrate the efficacy of our approach.
Hui Wan, Kai Zhang, Christopher J. Vogl, Carol S. Woodward, Richard C. Easter, Philip J. Rasch, Yan Feng, and Hailong Wang
Geosci. Model Dev., 17, 1387–1407, https://doi.org/10.5194/gmd-17-1387-2024, https://doi.org/10.5194/gmd-17-1387-2024, 2024
Short summary
Short summary
Sophisticated numerical models of the Earth's atmosphere include representations of many physical and chemical processes. In numerical simulations, these processes need to be calculated in a certain sequence. This study reveals the weaknesses of the sequence of calculations used for aerosol processes in a global atmosphere model. A revision of the sequence is proposed and its impacts on the simulated global aerosol climatology are evaluated.
Christopher J. Vogl, Hui Wan, Carol S. Woodward, and Quan M. Bui
Geosci. Model Dev., 17, 1409–1428, https://doi.org/10.5194/gmd-17-1409-2024, https://doi.org/10.5194/gmd-17-1409-2024, 2024
Short summary
Short summary
Generally speaking, accurate climate simulation requires an accurate evolution of the underlying mathematical equations on large computers. The equations are typically formulated and evolved in process groups. Process coupling refers to how the evolution of each group is combined with that of other groups to evolve the full set of equations for the whole atmosphere. This work presents a mathematical framework to evaluate methods without the need to first implement the methods.
Tom Keel, Chris Brierley, and Tamsin Edwards
Geosci. Model Dev., 17, 1229–1247, https://doi.org/10.5194/gmd-17-1229-2024, https://doi.org/10.5194/gmd-17-1229-2024, 2024
Short summary
Short summary
Jet streams are an important control on surface weather as their speed and shape can modify the properties of weather systems. Establishing trends in the operation of jet streams may provide some indication of the future of weather in a warming world. Despite this, it has not been easy to establish trends, as many methods have been used to characterise them in data. We introduce a tool containing various implementations of jet stream statistics and algorithms that works in a standardised manner.
Amir Golparvar, Matthias Kästner, and Martin Thullner
Geosci. Model Dev., 17, 881–898, https://doi.org/10.5194/gmd-17-881-2024, https://doi.org/10.5194/gmd-17-881-2024, 2024
Short summary
Short summary
Coupled reaction transport modelling is an established and beneficial method for studying natural and synthetic porous material, with applications ranging from industrial processes to natural decompositions in terrestrial environments. Up to now, a framework that explicitly considers the porous structure (e.g. from µ-CT images) for modelling the transport of reactive species is missing. We presented a model that overcomes this limitation and represents a novel numerical simulation toolbox.
Stefan Hergarten
Geosci. Model Dev., 17, 781–794, https://doi.org/10.5194/gmd-17-781-2024, https://doi.org/10.5194/gmd-17-781-2024, 2024
Short summary
Short summary
The Voellmy rheology has been widely used for simulating snow and rock avalanches. Recently, a modified version of this rheology was proposed, which turned out to be able to predict the observed long runout of large rock avalanches theoretically. The software MinVoellmy presented here is the first numerical implementation of the modified rheology. It consists of MATLAB and Python classes, where simplicity and parsimony were the design goals.
Arjun Babu Nellikkattil, Danielle Lemmon, Travis Allen O'Brien, June-Yi Lee, and Jung-Eun Chu
Geosci. Model Dev., 17, 301–320, https://doi.org/10.5194/gmd-17-301-2024, https://doi.org/10.5194/gmd-17-301-2024, 2024
Short summary
Short summary
This study introduces a new computational framework called Scalable Feature Extraction and Tracking (SCAFET), designed to extract and track features in climate data. SCAFET stands out by using innovative shape-based metrics to identify features without relying on preconceived assumptions about the climate model or mean state. This approach allows more accurate comparisons between different models and scenarios.
Mohammad Mortezazadeh, Jean-François Cossette, Ashu Dastoor, Jean de Grandpré, Irena Ivanova, and Abdessamad Qaddouri
Geosci. Model Dev., 17, 335–346, https://doi.org/10.5194/gmd-17-335-2024, https://doi.org/10.5194/gmd-17-335-2024, 2024
Short summary
Short summary
The interpolation process is the most computationally expensive step of the semi-Lagrangian (SL) approach. In this paper we implement a new interpolation scheme into the semi-Lagrangian approach which has the same computational cost as a third-order polynomial scheme but with the accuracy of a fourth-order interpolation scheme. This improvement is achieved by using two third-order backward and forward polynomial interpolation schemes in two consecutive time steps.
Boris Gailleton, Luca C. Malatesta, Guillaume Cordonnier, and Jean Braun
Geosci. Model Dev., 17, 71–90, https://doi.org/10.5194/gmd-17-71-2024, https://doi.org/10.5194/gmd-17-71-2024, 2024
Short summary
Short summary
This contribution presents a new method to numerically explore the evolution of mountain ranges and surrounding areas. The method helps in monitoring with details on the timing and travel path of material eroded from the mountain ranges. It is particularly well suited to studies juxtaposing different domains – lakes or multiple rock types, for example – and enables the combination of different processes.
Denise Degen, Daniel Caviedes Voullième, Susanne Buiter, Harrie-Jan Hendricks Franssen, Harry Vereecken, Ana González-Nicolás, and Florian Wellmann
Geosci. Model Dev., 16, 7375–7409, https://doi.org/10.5194/gmd-16-7375-2023, https://doi.org/10.5194/gmd-16-7375-2023, 2023
Short summary
Short summary
In geosciences, we often use simulations based on physical laws. These simulations can be computationally expensive, which is a problem if simulations must be performed many times (e.g., to add error bounds). We show how a novel machine learning method helps to reduce simulation time. In comparison to other approaches, which typically only look at the output of a simulation, the method considers physical laws in the simulation itself. The method provides reliable results faster than standard.
Carlos Spa, Otilio Rojas, and Josep de la Puente
Geosci. Model Dev., 16, 7237–7252, https://doi.org/10.5194/gmd-16-7237-2023, https://doi.org/10.5194/gmd-16-7237-2023, 2023
Short summary
Short summary
This paper develops a calibration methodology of all absorbing techniques typically used by Fourier pseudo-spectral time-domain (PSTD) methods for geoacoustic wave simulations. The main contributions of the paper are (a) an implementation and quantitative comparison of all absorbing techniques available for PSTD methods through a simple and robust numerical experiment, and (b) a validation of these absorbing techniques in several 3-D seismic scenarios with gradual heterogeneity complexities.
Michael Hillier, Florian Wellmann, Eric A. de Kemp, Boyan Brodaric, Ernst Schetselaar, and Karine Bédard
Geosci. Model Dev., 16, 6987–7012, https://doi.org/10.5194/gmd-16-6987-2023, https://doi.org/10.5194/gmd-16-6987-2023, 2023
Short summary
Short summary
Neural networks can be used effectively to model three-dimensional geological structures from point data, sampling geological interfaces, units, and structural orientations. Existing neural network approaches for this type of modelling are advanced by the efficient incorporation of unconformities, new knowledge inputs, and improved data fitting techniques. These advances permit the modelling of more complex geology in diverse geological settings, different-sized areas, and various data regimes.
Tor Nordam, Ruben Kristiansen, Raymond Nepstad, Erik van Sebille, and Andy M. Booth
Geosci. Model Dev., 16, 5339–5363, https://doi.org/10.5194/gmd-16-5339-2023, https://doi.org/10.5194/gmd-16-5339-2023, 2023
Short summary
Short summary
We describe and compare two common methods, Eulerian and Lagrangian models, used to simulate the vertical transport of material in the ocean. They both solve the same transport problems but use different approaches for representing the underlying equations on the computer. The main focus of our study is on the numerical accuracy of the two approaches. Our results should be useful for other researchers creating or using these types of transport models.
Mathieu Gravey and Grégoire Mariethoz
Geosci. Model Dev., 16, 5265–5279, https://doi.org/10.5194/gmd-16-5265-2023, https://doi.org/10.5194/gmd-16-5265-2023, 2023
Short summary
Short summary
Multiple‐point geostatistics are widely used to simulate complex spatial structures based on a training image. The use of these methods relies on the possibility of finding optimal training images and parametrization of the simulation algorithms. Here, we propose finding an optimal set of parameters using only the training image as input. The main advantage of our approach is to remove the risk of overfitting an objective function.
Siting Li, Ping Wang, Hong Wang, Yue Peng, Zhaodong Liu, Wenjie Zhang, Hongli Liu, Yaqiang Wang, Huizheng Che, and Xiaoye Zhang
Geosci. Model Dev., 16, 4171–4191, https://doi.org/10.5194/gmd-16-4171-2023, https://doi.org/10.5194/gmd-16-4171-2023, 2023
Short summary
Short summary
Optimizing the initial state of atmospheric chemistry model input is one of the most essential methods to improve forecast accuracy. Considering the large computational load of the model, we introduce an ensemble optimal interpolation scheme (EnOI) for operational use and efficient updating of the initial fields of chemical components. The results suggest that EnOI provides a practical and cost-effective technique for improving the accuracy of chemical weather numerical forecasts.
Thomas Richter, Véronique Dansereau, Christian Lessig, and Piotr Minakowski
Geosci. Model Dev., 16, 3907–3926, https://doi.org/10.5194/gmd-16-3907-2023, https://doi.org/10.5194/gmd-16-3907-2023, 2023
Short summary
Short summary
Sea ice covers not only the pole regions but affects the weather and climate globally. For example, its white surface reflects more sunlight than land. The oceans around the poles are therefore kept cool, which affects the circulation in the oceans worldwide. Simulating the behavior and changes in sea ice on a computer is, however, very difficult. We propose a new computer simulation that better models how cracks in the ice change over time and show this by comparing to other simulations.
Emma J. MacKie, Michael Field, Lijing Wang, Zhen Yin, Nathan Schoedl, Matthew Hibbs, and Allan Zhang
Geosci. Model Dev., 16, 3765–3783, https://doi.org/10.5194/gmd-16-3765-2023, https://doi.org/10.5194/gmd-16-3765-2023, 2023
Short summary
Short summary
Earth scientists often have to fill in spatial gaps in measurements. This gap-filling or interpolation can be accomplished with geostatistical methods, where the statistical relationships between measurements are used to inform how these gaps should be filled. Despite the broad utility of these methods, there are few freely available geostatistical software applications. We present GStatSim, a Python package for performing different geostatistical interpolation methods.
Ian Madden, Simone Marras, and Jenny Suckale
Geosci. Model Dev., 16, 3479–3500, https://doi.org/10.5194/gmd-16-3479-2023, https://doi.org/10.5194/gmd-16-3479-2023, 2023
Short summary
Short summary
To aid risk managers who may wish to rapidly assess tsunami risk but may lack high-performance computing infrastructure, we provide an accessible software package able to rapidly model tsunami inundation over real topography by leveraging Google's Tensor Processing Unit, a high-performance hardware. Minimally trained users can take advantage of the rapid modeling abilities provided by this package via a web browser thanks to the ease of use of Google Cloud Platform.
Youtong Rong, Paul Bates, and Jeffrey Neal
Geosci. Model Dev., 16, 3291–3311, https://doi.org/10.5194/gmd-16-3291-2023, https://doi.org/10.5194/gmd-16-3291-2023, 2023
Short summary
Short summary
A novel subgrid channel (SGC) model is developed for river–floodplain modelling, allowing utilization of subgrid-scale bathymetric information while performing computations on relatively coarse grids. By including adaptive artificial diffusion, potential numerical instability, which the original SGC solver had, in low-friction regions such as urban areas is addressed. Evaluation of the new SGC model through structured tests confirmed that the accuracy and stability have improved.
Xiaqiong Zhou and Hann-Ming Henry Juang
Geosci. Model Dev., 16, 3263–3274, https://doi.org/10.5194/gmd-16-3263-2023, https://doi.org/10.5194/gmd-16-3263-2023, 2023
Short summary
Short summary
The National Centers for Environmental Prediction Global Forecast System version 16 experienced model instability failures in real-time runs resolved by increasing the minimum thickness depth parameter. Further investigation revealed that the issue was caused by the advection of geopotential heights at the model's layer interfaces. By replacing high-order boundary conditions with zero-gradient boundary conditions for interface-wind reconstruction, the instability was effectively addressed.
Grant T. Euen, Shangxin Liu, Rene Gassmöller, Timo Heister, and Scott D. King
Geosci. Model Dev., 16, 3221–3239, https://doi.org/10.5194/gmd-16-3221-2023, https://doi.org/10.5194/gmd-16-3221-2023, 2023
Short summary
Short summary
Due to the increasing availability of high-performance computing over the past few decades, numerical models have become an important tool for research. Here we test two geodynamic codes that produce such models: ASPECT, a newer code, and CitcomS, an older one. We show that they produce solutions that are extremely close. As methods and codes become more complex over time, showing reproducibility allows us to seamlessly link previously known information to modern methodologies.
Mohammad Kazem Sharifian, Georges Kesserwani, Alovya Ahmed Chowdhury, Jeffrey Neal, and Paul Bates
Geosci. Model Dev., 16, 2391–2413, https://doi.org/10.5194/gmd-16-2391-2023, https://doi.org/10.5194/gmd-16-2391-2023, 2023
Short summary
Short summary
This paper describes a new release of the LISFLOOD-FP model for fast and efficient flood simulations. It features a new non-uniform grid generator that uses multiwavelet analyses to sensibly coarsens the resolutions where the local topographic variations are smooth. Moreover, the model is parallelised on the graphical processing units (GPUs) to further boost computational efficiency. The performance of the model is assessed for five real-world case studies, noting its potential applications.
Matt J. Fischer
EGUsphere, https://doi.org/10.5194/egusphere-2023-643, https://doi.org/10.5194/egusphere-2023-643, 2023
Short summary
Short summary
In paleoclimate research, proxy system models or PSMs model chemical or biological systems which receive environmental inputs, and output e.g. geochemical signals. The environmental inputs are rarely noiseless, which causes problems when calibrating multi-input PSMs. Here a PSM is developed which includes generalized noise in both model inputs and outputs, and prior information. A quasi-Bayesian method enhances the stability of the solution of the Measurement Error Proxy System Model.
Bruno K. Zürcher
Geosci. Model Dev., 16, 1697–1711, https://doi.org/10.5194/gmd-16-1697-2023, https://doi.org/10.5194/gmd-16-1697-2023, 2023
Short summary
Short summary
We present a novel algorithm to efficiently compute Barnes interpolation, which is a method for transforming data values recorded at irregularly spaced points into a corresponding regular grid. In contrast to naive implementations with an algorithmic complexity that depends on the product of the number of sample points and the number of grid points, our approach reduces this dependency to their sum.
David H. Marsico and Paul A. Ullrich
Geosci. Model Dev., 16, 1537–1551, https://doi.org/10.5194/gmd-16-1537-2023, https://doi.org/10.5194/gmd-16-1537-2023, 2023
Short summary
Short summary
Climate models involve several different components, such as the atmosphere, ocean, and land models. Information needs to be exchanged, or remapped, between these models, and devising algorithms for performing this exchange is important for ensuring the accuracy of climate simulations. In this paper, we examine the efficacy of several traditional and novel approaches to remapping on the sphere and demonstrate where our approaches offer improvement.
Moritz Liebl, Jörg Robl, Stefan Hergarten, David Lundbek Egholm, and Kurt Stüwe
Geosci. Model Dev., 16, 1315–1343, https://doi.org/10.5194/gmd-16-1315-2023, https://doi.org/10.5194/gmd-16-1315-2023, 2023
Short summary
Short summary
In this study, we benchmark a topography-based model for glacier erosion (OpenLEM) with a well-established process-based model (iSOSIA). Our experiments show that large-scale erosion patterns and particularly the transformation of valley length geometry from fluvial to glacial conditions are very similar in both models. This finding enables the application of OpenLEM to study the influence of climate and tectonics on glaciated mountains with reasonable computational effort on standard PCs.
James Kent, Thomas Melvin, and Golo Albert Wimmer
Geosci. Model Dev., 16, 1265–1276, https://doi.org/10.5194/gmd-16-1265-2023, https://doi.org/10.5194/gmd-16-1265-2023, 2023
Short summary
Short summary
This paper introduces the Met Office's new shallow water model. The shallow water model is a building block towards the Met Office's new atmospheric dynamical core. The shallow water model is tested on a number of standard spherical shallow water test cases, including flow over mountains and unstable jets. Results show that the model produces similar results to other shallow water models in the literature.
Anthony Gruber, Max Gunzburger, Lili Ju, Rihui Lan, and Zhu Wang
Geosci. Model Dev., 16, 1213–1229, https://doi.org/10.5194/gmd-16-1213-2023, https://doi.org/10.5194/gmd-16-1213-2023, 2023
Short summary
Short summary
This work applies a novel technical tool, multifidelity Monte Carlo (MFMC) estimation, to three climate-related benchmark experiments involving oceanic, atmospheric, and glacial modeling. By considering useful quantities such as maximum sea height and total (kinetic) energy, we show that MFMC leads to predictions which are more accurate and less costly than those obtained by standard methods. This suggests MFMC as a potential drop-in replacement for estimation in realistic climate models.
Piyoosh Jaysaval, Glenn E. Hammond, and Timothy C. Johnson
Geosci. Model Dev., 16, 961–976, https://doi.org/10.5194/gmd-16-961-2023, https://doi.org/10.5194/gmd-16-961-2023, 2023
Short summary
Short summary
We present a robust and highly scalable implementation of numerical forward modeling and inversion algorithms for geophysical electrical resistivity tomography data. The implementation is publicly available and developed within the framework of PFLOTRAN (http://www.pflotran.org), an open-source, state-of-the-art massively parallel subsurface flow and transport simulation code. The paper details all the theoretical and implementation aspects of the new capabilities along with test examples.
Lucas Schauer, Michael J. Schmidt, Nicholas B. Engdahl, Stephen D. Pankavich, David A. Benson, and Diogo Bolster
Geosci. Model Dev., 16, 833–849, https://doi.org/10.5194/gmd-16-833-2023, https://doi.org/10.5194/gmd-16-833-2023, 2023
Short summary
Short summary
We develop a multi-dimensional, parallelized domain decomposition strategy for mass-transfer particle tracking methods in two and three dimensions, investigate different procedures for decomposing the domain, and prescribe an optimal tiling based on physical problem parameters and the number of available CPU cores. For an optimally subdivided diffusion problem, the parallelized algorithm achieves nearly perfect linear speedup in comparison with the serial run-up to thousands of cores.
John Mern and Jef Caers
Geosci. Model Dev., 16, 289–313, https://doi.org/10.5194/gmd-16-289-2023, https://doi.org/10.5194/gmd-16-289-2023, 2023
Short summary
Short summary
In this work, we formulate the sequential geoscientific data acquisition problem as a problem that is similar to playing chess against nature, except the pieces are not fully observed. Solutions to these problems are given in AI and rarely used in geoscientific data planning. We illustrate our approach to a simple 2D problem of mineral exploration.
Ziqi Gao, Yifeng Wang, Petros Vasilakos, Cesunica E. Ivey, Khanh Do, and Armistead G. Russell
Geosci. Model Dev., 15, 9015–9029, https://doi.org/10.5194/gmd-15-9015-2022, https://doi.org/10.5194/gmd-15-9015-2022, 2022
Short summary
Short summary
While the national ambient air quality standard of ozone is based on the 3-year average of the fourth highest 8 h maximum (MDA8) ozone concentrations, these predicted extreme values using numerical methods are always biased low. We built four computational models (GAM, MARS, random forest and SVR) to predict the fourth highest MDA8 ozone in Southern California using precursor emissions, meteorology and climatological patterns. All models presented acceptable performance, with GAM being the best.
Zhihao Wang, Jason Goetz, and Alexander Brenning
Geosci. Model Dev., 15, 8765–8784, https://doi.org/10.5194/gmd-15-8765-2022, https://doi.org/10.5194/gmd-15-8765-2022, 2022
Short summary
Short summary
A lack of inventory data can be a limiting factor in developing landslide predictive models, which are crucial for supporting hazard policy and decision-making. We show how case-based reasoning and domain adaptation (transfer-learning techniques) can effectively retrieve similar landslide modeling situations for prediction in new data-scarce areas. Using cases in Italy, Austria, and Ecuador, our findings support the application of transfer learning for areas that require rapid model development.
Cited articles
Baker, A. H., Hammerling, D. M., Mickelson, S. A., Xu, H., Stolpe, M. B., Naveau, P., Sanderson, B., Ebert-Uphoff, I., Samarasinghe, S., De Simone, F., Carbone, F., Gencarelli, C. N., Dennis, J. M., Kay, J. E., and Lindstrom, P.: Evaluating lossy data compression on climate simulation data within a large ensemble, Geosci. Model Dev., 9, 4381–4403, https://doi.org/10.5194/gmd-9-4381-2016, 2016.
Caron, J.: Compression by Scaling and Offset, available at:
http://www.unidata.ucar.edu/blogs/developer/en/entry/compression_by_scaling_and_offfset (last access: 27 September 2018), 2014a.
Caron, J.: Compression by bit shaving, available at:
http://www.unidata.ucar.edu/blogs/developer/entry/compression_by_bit_shaving (last access: 27 September 2018), 2014b.
Collet, Y.: LZ4 lossless compression algorithm, available at: http://lz4.org (last access: 27 September 2018), 2013.
Collet, Y. and Turner, C.: Smaller and faster data compression with
Zstandard, available at:
https://code.fb.com/core-data/smaller-and-faster-data-compression-with-zstandard/
(last access: 27 September 2018), 2016.
Deutsch, L. P.: DEFLATE compressed data format specification version 1.3,
Tech. Rep. IETF RFC1951, Internet Engineering Task Force, Menlo Park, CA,
USA, https://doi.org/10.17487/RFC1951, 1996.
Duda, J.: Asymmetric numeral systems: entropy coding combining speed of
Huffman coding with compression rate of arithmetic coding, arXiv:1311.2540v2
[cs.IT], 2013.
Huffman, D. A.: A method for the construction of minimum redundancy codes,
Proceedings of the IRE, 40, 1098–1101, https://doi.org/10.1109/JRPROC.1952.273898,
1952.
Lindstrom, P.: Fixed-Rate Compressed Floating-Point Arrays,
IEEE T. Vis. Comput. Gr., 20, 2674–2683, https://doi.org/10.1109/TVCG.2014.2346458, 2014.
Lindstrom, P. and Isenburg, M.: Fast and Efficient Compression of
Floating-Point Data, IEEE T. Vis. Comput. Gr., 12, 1245–1250, https://doi.org/10.1109/TVCG.2006.143, 2006.
Masui, K., Amiri, M., Connor, L., Deng, M., Fandino, M., Höfer, C.,
Halpern, M., Hanna, D., Hincks, A. D., Hinshaw, G., Parra, J. M., Newburgh,
L. B., Shaw, J. R., and Vanderlinde, K.: A compression scheme for radio data
in high performance computing, Astron. Comput., 12,
181–190, https://doi.org/10.1016/j.ascom.2015.07.002, 2015.
Silver, J. D. and Zender, C. S.: The compression-error trade-off for large gridded data sets, Geosci. Model Dev., 10, 413–423, https://doi.org/10.5194/gmd-10-413-2017, 2017.
Tao, D., Di, S., Chen, Z., and Cappello, F.: Significantly Improving Lossy
Compression for Scientific Data Sets Based on Multidimensional Prediction
and Error-Controlled Quantization, 2017 IEEE International Parallel and Distributed Processing Symposium (IPDPS), Orlando, FL, USA, 29 May–2 June 2017, 1129–1139,
https://doi.org/10.1109/IPDPS.2017.115, 2017.
Tao, D., Di, S., Guo, H., Chen, Z., and Cappello F.: Z-checker: A Framework
for Assessing Lossy Compression of Scientific Data, Int. J. High Perform. C.,
33, 285–303, https://doi.org/10.1177/1094342017737147, 2019.
Zender, C. S.: Bit Grooming: statistically accurate precision-preserving quantization with compression, evaluated in the netCDF Operators (NCO, v4.4.8+), Geosci. Model Dev., 9, 3199–3211, https://doi.org/10.5194/gmd-9-3199-2016,
2016a.
Zender, C. S.: netCDF Operators (NCO), version 4.6.1, Zenodo,
https://doi.org/10.5281/zenodo.61341, 2016b.
Ziv, J. and Lempel, A.: A universal algorithm for sequential data
compression, IEEE T. Inform. Theory, 23, 337–343, https://doi.org/10.1109/TIT.1977.1055714, 1977.
Short summary
This research aimed at finding a compression method suitable for the ground processing of CFOSAT and SWOT satellite datasets. Lossless algorithms did not allow enough compression. That is why we began studying lossy alternatives. This work introduces the digit rounding algorithm which reduces the volume of scientific datasets keeping only the significant digits in each sample value. The number of digits kept is relative to each sample so that both small and high values are similarly preserved.
This research aimed at finding a compression method suitable for the ground processing of CFOSAT...
