Articles | Volume 14, issue 1
https://doi.org/10.5194/gmd-14-377-2021
https://doi.org/10.5194/gmd-14-377-2021
Development and technical paper
 | 
22 Jan 2021
Development and technical paper |  | 22 Jan 2021

A note on precision-preserving compression of scientific data

Rostislav Kouznetsov

Related authors

Air quality modeling intercomparison and multi-scale ensemble chain for Latin America
Jorge E. Pachon, Mariel Opazo, Pablo Lichtig, Nicolas Hunneus, Idir Bouarar, Guy Brasseur, Cathy W. Y. Li, Johannes Flemming, Laurent Menut, Camilo Menares, Laura Gallardo, Michael Gauss, Mikhail Sofiev, Rostislav Kouznetsov, Julia Palamarchuk, Laura Dawidowski, Nestor Y. Rojas, Maria de Fatima Andrade, Mario E. Gavidia-Calderón, Alejandro H. Delgado Peralta, and Daniel Schuch
EGUsphere, https://doi.org/10.5194/egusphere-2024-815,https://doi.org/10.5194/egusphere-2024-815, 2024
Short summary
A bottom-up emission estimate for the 2022 Nord Stream gas leak: derivation, simulations, and evaluation
Rostislav Kouznetsov, Risto Hänninen, Andreas Uppstu, Evgeny Kadantsev, Yalda Fatahi, Marje Prank, Dmitrii Kouznetsov, Steffen Manfred Noe, Heikki Junninen, and Mikhail Sofiev
Atmos. Chem. Phys., 24, 4675–4691, https://doi.org/10.5194/acp-24-4675-2024,https://doi.org/10.5194/acp-24-4675-2024, 2024
Short summary
Shipping and algae emissions have a major impact on ambient air mixing ratios of non-methane hydrocarbons (NMHCs) and methanethiol on Utö Island in the Baltic Sea
Heidi Hellén, Rostislav Kouznetsov, Kaisa Kraft, Jukka Seppälä, Mika Vestenius, Jukka-Pekka Jalkanen, Lauri Laakso, and Hannele Hakola
Atmos. Chem. Phys., 24, 4717–4731, https://doi.org/10.5194/acp-24-4717-2024,https://doi.org/10.5194/acp-24-4717-2024, 2024
Short summary
Positive semi-definite variants of CBM4 and CBM05 chemistry schemes for atmospheric composition models
Risto Matias Hänninen, Rostislav Kouznetsov, and Mikhail Sofiev
Geosci. Model Dev. Discuss., https://doi.org/10.5194/gmd-2023-3,https://doi.org/10.5194/gmd-2023-3, 2023
Preprint withdrawn
Short summary
Characterization of volatile organic compounds and submicron organic aerosol in a traffic environment
Sanna Saarikoski, Heidi Hellén, Arnaud P. Praplan, Simon Schallhart, Petri Clusius, Jarkko V. Niemi, Anu Kousa, Toni Tykkä, Rostislav Kouznetsov, Minna Aurela, Laura Salo, Topi Rönkkö, Luis M. F. Barreira, Liisa Pirjola, and Hilkka Timonen
Atmos. Chem. Phys., 23, 2963–2982, https://doi.org/10.5194/acp-23-2963-2023,https://doi.org/10.5194/acp-23-2963-2023, 2023
Short summary

Related subject area

Numerical methods
Numerical stabilization methods for level-set-based ice front migration
Gong Cheng, Mathieu Morlighem, and G. Hilmar Gudmundsson
Geosci. Model Dev., 17, 6227–6247, https://doi.org/10.5194/gmd-17-6227-2024,https://doi.org/10.5194/gmd-17-6227-2024, 2024
Short summary
Modelling chemical advection during magma ascent
Hugo Dominguez, Nicolas Riel, and Pierre Lanari
Geosci. Model Dev., 17, 6105–6122, https://doi.org/10.5194/gmd-17-6105-2024,https://doi.org/10.5194/gmd-17-6105-2024, 2024
Short summary
Consistent point data assimilation in Firedrake and Icepack
Reuben W. Nixon-Hill, Daniel Shapero, Colin J. Cotter, and David A. Ham
Geosci. Model Dev., 17, 5369–5386, https://doi.org/10.5194/gmd-17-5369-2024,https://doi.org/10.5194/gmd-17-5369-2024, 2024
Short summary
A computationally efficient parameterization of aerosol, cloud and precipitation pH for application at global and regional scale (EQSAM4Clim-v12)
Swen Metzger, Samuel Rémy, Jason E. Williams, Vincent Huijnen, and Johannes Flemming
Geosci. Model Dev., 17, 5009–5021, https://doi.org/10.5194/gmd-17-5009-2024,https://doi.org/10.5194/gmd-17-5009-2024, 2024
Short summary
Assessing the benefits of approximately exact step sizes for Picard and Newton solver in simulating ice flow (FEniCS-full-Stokes v.1.3.2)
Niko Schmidt, Angelika Humbert, and Thomas Slawig
Geosci. Model Dev., 17, 4943–4959, https://doi.org/10.5194/gmd-17-4943-2024,https://doi.org/10.5194/gmd-17-4943-2024, 2024
Short summary

Cited articles

ANSI/IEEE: IEEE Standard for Binary Floating-Point Arithmetic, ANSI/IEEE Std 754-1985, pp. 1–20, https://doi.org/10.1109/IEEESTD.1985.82928, 1985. a, b
Holton, J. and Hakim, G.: An Introduction to Dynamic Meteorology, Academic Press, Elsevier Science, Amsterdam, Boston, Heidelberg, London, New York, Oxford, Paris, San Diego, San Francisco, Singapore, Sydney, Tokyo, 2013. a
Stackpole, J. D.: GRIB (Edition 1) The WMO Format for the Storage of Weather Product Information and the Exchange of Weather Product Messages in Gridded Binary Form, Office note 388, U.S. Department of Commerce, National Oceanic and Atmospheric Administration, National Weather Service, National Meteorological Center, MD, USA, 1994. a
Zender, C. S.: Bit Grooming: statistically accurate precision-preserving quantization with compression, evaluated in the netCDF Operators (NCO, v4.4.8+), Geosci. Model Dev., 9, 3199–3211, https://doi.org/10.5194/gmd-9-3199-2016, 2016. a, b, c, d, e, f, g
Download
Short summary
Resetting of non-significant figures (precision trimming) enables efficient data compression and helps to avoid excessive use of storage space and network bandwidth while having well-constrained distortion to the data. The paper analyses accuracy losses and artifacts caused by trimming methods and by the widely used linear packing method. The paper presents several methods with implementation, evaluation, and illustrations and includes subroutines directly usable in geoscientific models.