Articles | Volume 14, issue 1
https://doi.org/10.5194/gmd-14-377-2021
https://doi.org/10.5194/gmd-14-377-2021
Development and technical paper
 | 
22 Jan 2021
Development and technical paper |  | 22 Jan 2021

A note on precision-preserving compression of scientific data

Rostislav Kouznetsov

Related authors

Copernicus Atmosphere Monitoring Service – Regional Air Quality Production System v1.0
Augustin Colette, Gaëlle Collin, François Besson, Etienne Blot, Vincent Guidard, Frederik Meleux, Adrien Royer, Valentin Petiot, Claire Miller, Oihana Fermond, Alizé Jeant, Mario Adani, Joaquim Arteta, Anna Benedictow, Robert Bergström, Dene Bowdalo, Jorgen Brandt, Gino Briganti, Ana C. Carvalho, Jesper Heile Christensen, Florian Couvidat, Ilia D’Elia, Massimo D’Isidoro, Hugo Denier van der Gon, Gaël Descombes, Enza Di Tomaso, John Douros, Jeronimo Escribano, Henk Eskes, Hilde Fagerli, Yalda Fatahi, Johannes Flemming, Elmar Friese, Lise Frohn, Michael Gauss, Camilla Geels, Guido Guarnieri, Marc Guevara, Antoine Guion, Jonathan Guth, Risto Hänninen, Kaj Hansen, Ulas Im, Ruud Janssen, Marine Jeoffrion, Mathieu Joly, Luke Jones, Oriol Jorba, Evgeni Kadantsev, Michael Kahnert, Jacek W. Kaminski, Rostislav Kouznetsov, Richard Kranenburg, Jeroen Kuenen, Anne Caroline Lange, Joachim Langner, Victor Lannuque, Francesca Macchia, Astrid Manders, Mihaela Mircea, Agnes Nyiri, Miriam Olid, Carlos Pérez García-Pando, Yuliia Palamarchuk, Antonio Piersanti, Blandine Raux, Miha Razinger, Lennard Robertson, Arjo Segers, Martijn Schaap, Pilvi Siljamo, David Simpson, Mikhail Sofiev, Anders Stangel, Joanna Struzewska, Carles Tena, Renske Timmermans, Thanos Tsikerdekis, Svetlana Tsyro, Svyatoslav Tyuryakov, Anthony Ung, Andreas Uppstu, Alvaro Valdebenito, Peter van Velthoven, Lina Vitali, Zhuyun Ye, Vincent-Henri Peuch, and Laurence Rouïl
EGUsphere, https://doi.org/10.5194/egusphere-2024-3744,https://doi.org/10.5194/egusphere-2024-3744, 2024
Short summary
Air quality modeling intercomparison and multiscale ensemble chain for Latin America
Jorge E. Pachón, Mariel A. Opazo, Pablo Lichtig, Nicolas Huneeus, Idir Bouarar, Guy Brasseur, Cathy W. Y. Li, Johannes Flemming, Laurent Menut, Camilo Menares, Laura Gallardo, Michael Gauss, Mikhail Sofiev, Rostislav Kouznetsov, Julia Palamarchuk, Andreas Uppstu, Laura Dawidowski, Nestor Y. Rojas, María de Fátima Andrade, Mario E. Gavidia-Calderón, Alejandro H. Delgado Peralta, and Daniel Schuch
Geosci. Model Dev., 17, 7467–7512, https://doi.org/10.5194/gmd-17-7467-2024,https://doi.org/10.5194/gmd-17-7467-2024, 2024
Short summary
A bottom-up emission estimate for the 2022 Nord Stream gas leak: derivation, simulations, and evaluation
Rostislav Kouznetsov, Risto Hänninen, Andreas Uppstu, Evgeny Kadantsev, Yalda Fatahi, Marje Prank, Dmitrii Kouznetsov, Steffen Manfred Noe, Heikki Junninen, and Mikhail Sofiev
Atmos. Chem. Phys., 24, 4675–4691, https://doi.org/10.5194/acp-24-4675-2024,https://doi.org/10.5194/acp-24-4675-2024, 2024
Short summary
Shipping and algae emissions have a major impact on ambient air mixing ratios of non-methane hydrocarbons (NMHCs) and methanethiol on Utö Island in the Baltic Sea
Heidi Hellén, Rostislav Kouznetsov, Kaisa Kraft, Jukka Seppälä, Mika Vestenius, Jukka-Pekka Jalkanen, Lauri Laakso, and Hannele Hakola
Atmos. Chem. Phys., 24, 4717–4731, https://doi.org/10.5194/acp-24-4717-2024,https://doi.org/10.5194/acp-24-4717-2024, 2024
Short summary
Positive semi-definite variants of CBM4 and CBM05 chemistry schemes for atmospheric composition models
Risto Matias Hänninen, Rostislav Kouznetsov, and Mikhail Sofiev
Geosci. Model Dev. Discuss., https://doi.org/10.5194/gmd-2023-3,https://doi.org/10.5194/gmd-2023-3, 2023
Preprint withdrawn
Short summary

Related subject area

Numerical methods
Hydro-geomorphological modelling of leaky wooden dam efficacy from reach to catchment scale with CAESAR-Lisflood 1.9j
Joshua M. Wolstenholme, Christopher J. Skinner, David Milan, Robert E. Thomas, and Daniel R. Parsons
Geosci. Model Dev., 18, 1395–1411, https://doi.org/10.5194/gmd-18-1395-2025,https://doi.org/10.5194/gmd-18-1395-2025, 2025
Short summary
Enhancing single precision with quasi-double precision: achieving double-precision accuracy in the Model for Prediction Across Scales – Atmosphere (MPAS-A) version 8.2.1
Jiayi Lai, Lanning Wang, Qizhong Wu, Yizhou Yang, and Fang Wang
Geosci. Model Dev., 18, 1089–1102, https://doi.org/10.5194/gmd-18-1089-2025,https://doi.org/10.5194/gmd-18-1089-2025, 2025
Short summary
Advances in land surface forecasting: a comparison of LSTM, gradient boosting, and feed-forward neural networks as prognostic state emulators in a case study with ecLand
Marieke Wesselkamp, Matthew Chantry, Ewan Pinnington, Margarita Choulga, Souhail Boussetta, Maria Kalweit, Joschka Bödecker, Carsten F. Dormann, Florian Pappenberger, and Gianpaolo Balsamo
Geosci. Model Dev., 18, 921–937, https://doi.org/10.5194/gmd-18-921-2025,https://doi.org/10.5194/gmd-18-921-2025, 2025
Short summary
Subgrid corrections for the linear inertial equations of a compound flood model – a case study using SFINCS 2.1.1 Dollerup release
Maarten van Ormondt, Tim Leijnse, Roel de Goede, Kees Nederhoff, and Ap van Dongeren
Geosci. Model Dev., 18, 843–861, https://doi.org/10.5194/gmd-18-843-2025,https://doi.org/10.5194/gmd-18-843-2025, 2025
Short summary
Introducing Iterative Model Calibration (IMC) v1.0: a generalizable framework for numerical model calibration with a CAESAR-Lisflood case study
Chayan Banerjee, Kien Nguyen, Clinton Fookes, Gregory Hancock, and Thomas Coulthard
Geosci. Model Dev., 18, 803–818, https://doi.org/10.5194/gmd-18-803-2025,https://doi.org/10.5194/gmd-18-803-2025, 2025
Short summary

Cited articles

ANSI/IEEE: IEEE Standard for Binary Floating-Point Arithmetic, ANSI/IEEE Std 754-1985, pp. 1–20, https://doi.org/10.1109/IEEESTD.1985.82928, 1985. a, b
Holton, J. and Hakim, G.: An Introduction to Dynamic Meteorology, Academic Press, Elsevier Science, Amsterdam, Boston, Heidelberg, London, New York, Oxford, Paris, San Diego, San Francisco, Singapore, Sydney, Tokyo, 2013. a
Stackpole, J. D.: GRIB (Edition 1) The WMO Format for the Storage of Weather Product Information and the Exchange of Weather Product Messages in Gridded Binary Form, Office note 388, U.S. Department of Commerce, National Oceanic and Atmospheric Administration, National Weather Service, National Meteorological Center, MD, USA, 1994. a
Zender, C. S.: Bit Grooming: statistically accurate precision-preserving quantization with compression, evaluated in the netCDF Operators (NCO, v4.4.8+), Geosci. Model Dev., 9, 3199–3211, https://doi.org/10.5194/gmd-9-3199-2016, 2016. a, b, c, d, e, f, g
Download
Short summary
Resetting of non-significant figures (precision trimming) enables efficient data compression and helps to avoid excessive use of storage space and network bandwidth while having well-constrained distortion to the data. The paper analyses accuracy losses and artifacts caused by trimming methods and by the widely used linear packing method. The paper presents several methods with implementation, evaluation, and illustrations and includes subroutines directly usable in geoscientific models.
Share