Articles | Volume 14, issue 1
https://doi.org/10.5194/gmd-14-377-2021
https://doi.org/10.5194/gmd-14-377-2021
Development and technical paper
 | 
22 Jan 2021
Development and technical paper |  | 22 Jan 2021

A note on precision-preserving compression of scientific data

Rostislav Kouznetsov

Related authors

Air quality modeling intercomparison and multi-scale ensemble chain for Latin America
Jorge E. Pachon, Mariel Opazo, Pablo Lichtig, Nicolas Hunneus, Idir Bouarar, Guy Brasseur, Cathy W. Y. Li, Johannes Flemming, Laurent Menut, Camilo Menares, Laura Gallardo, Michael Gauss, Mikhail Sofiev, Rostislav Kouznetsov, Julia Palamarchuk, Laura Dawidowski, Nestor Y. Rojas, Maria de Fatima Andrade, Mario E. Gavidia-Calderón, Alejandro H. Delgado Peralta, and Daniel Schuch
EGUsphere, https://doi.org/10.5194/egusphere-2024-815,https://doi.org/10.5194/egusphere-2024-815, 2024
Short summary
A bottom-up emission estimate for the 2022 Nord Stream gas leak: derivation, simulations, and evaluation
Rostislav Kouznetsov, Risto Hänninen, Andreas Uppstu, Evgeny Kadantsev, Yalda Fatahi, Marje Prank, Dmitrii Kouznetsov, Steffen Manfred Noe, Heikki Junninen, and Mikhail Sofiev
Atmos. Chem. Phys., 24, 4675–4691, https://doi.org/10.5194/acp-24-4675-2024,https://doi.org/10.5194/acp-24-4675-2024, 2024
Short summary
Shipping and algae emissions have a major impact on ambient air mixing ratios of non-methane hydrocarbons (NMHCs) and methanethiol on Utö Island in the Baltic Sea
Heidi Hellén, Rostislav Kouznetsov, Kaisa Kraft, Jukka Seppälä, Mika Vestenius, Jukka-Pekka Jalkanen, Lauri Laakso, and Hannele Hakola
Atmos. Chem. Phys., 24, 4717–4731, https://doi.org/10.5194/acp-24-4717-2024,https://doi.org/10.5194/acp-24-4717-2024, 2024
Short summary
Positive semi-definite variants of CBM4 and CBM05 chemistry schemes for atmospheric composition models
Risto Matias Hänninen, Rostislav Kouznetsov, and Mikhail Sofiev
Geosci. Model Dev. Discuss., https://doi.org/10.5194/gmd-2023-3,https://doi.org/10.5194/gmd-2023-3, 2023
Preprint withdrawn
Short summary
Characterization of volatile organic compounds and submicron organic aerosol in a traffic environment
Sanna Saarikoski, Heidi Hellén, Arnaud P. Praplan, Simon Schallhart, Petri Clusius, Jarkko V. Niemi, Anu Kousa, Toni Tykkä, Rostislav Kouznetsov, Minna Aurela, Laura Salo, Topi Rönkkö, Luis M. F. Barreira, Liisa Pirjola, and Hilkka Timonen
Atmos. Chem. Phys., 23, 2963–2982, https://doi.org/10.5194/acp-23-2963-2023,https://doi.org/10.5194/acp-23-2963-2023, 2023
Short summary

Related subject area

Numerical methods
A computationally efficient parameterization of aerosol, cloud and precipitation pH for application at global and regional scale (EQSAM4Clim-v12)
Swen Metzger, Samuel Rémy, Jason E. Williams, Vincent Huijnen, and Johannes Flemming
Geosci. Model Dev., 17, 5009–5021, https://doi.org/10.5194/gmd-17-5009-2024,https://doi.org/10.5194/gmd-17-5009-2024, 2024
Short summary
Assessing the benefits of approximately exact step sizes for Picard and Newton solver in simulating ice flow (FEniCS-full-Stokes v.1.3.2)
Niko Schmidt, Angelika Humbert, and Thomas Slawig
Geosci. Model Dev., 17, 4943–4959, https://doi.org/10.5194/gmd-17-4943-2024,https://doi.org/10.5194/gmd-17-4943-2024, 2024
Short summary
Assessing effects of climate and technology uncertainties in large natural resource allocation problems
Jevgenijs Steinbuks, Yongyang Cai, Jonas Jaegermeyr, and Thomas W. Hertel
Geosci. Model Dev., 17, 4791–4819, https://doi.org/10.5194/gmd-17-4791-2024,https://doi.org/10.5194/gmd-17-4791-2024, 2024
Short summary
VISIR-2: ship weather routing in Python
Gianandrea Mannarini, Mario Leonardo Salinas, Lorenzo Carelli, Nicola Petacco, and Josip Orović
Geosci. Model Dev., 17, 4355–4382, https://doi.org/10.5194/gmd-17-4355-2024,https://doi.org/10.5194/gmd-17-4355-2024, 2024
Short summary
Incremental analysis update (IAU) in the Model for Prediction Across Scales coupled with the Joint Effort for Data assimilation Integration (MPAS–JEDI 2.0.0)
Soyoung Ha, Jonathan J. Guerrette, Ivette Hernández Baños, William C. Skamarock, and Michael G. Duda
Geosci. Model Dev., 17, 4199–4211, https://doi.org/10.5194/gmd-17-4199-2024,https://doi.org/10.5194/gmd-17-4199-2024, 2024
Short summary

Cited articles

ANSI/IEEE: IEEE Standard for Binary Floating-Point Arithmetic, ANSI/IEEE Std 754-1985, pp. 1–20, https://doi.org/10.1109/IEEESTD.1985.82928, 1985. a, b
Holton, J. and Hakim, G.: An Introduction to Dynamic Meteorology, Academic Press, Elsevier Science, Amsterdam, Boston, Heidelberg, London, New York, Oxford, Paris, San Diego, San Francisco, Singapore, Sydney, Tokyo, 2013. a
Stackpole, J. D.: GRIB (Edition 1) The WMO Format for the Storage of Weather Product Information and the Exchange of Weather Product Messages in Gridded Binary Form, Office note 388, U.S. Department of Commerce, National Oceanic and Atmospheric Administration, National Weather Service, National Meteorological Center, MD, USA, 1994. a
Zender, C. S.: Bit Grooming: statistically accurate precision-preserving quantization with compression, evaluated in the netCDF Operators (NCO, v4.4.8+), Geosci. Model Dev., 9, 3199–3211, https://doi.org/10.5194/gmd-9-3199-2016, 2016. a, b, c, d, e, f, g
Download
Short summary
Resetting of non-significant figures (precision trimming) enables efficient data compression and helps to avoid excessive use of storage space and network bandwidth while having well-constrained distortion to the data. The paper analyses accuracy losses and artifacts caused by trimming methods and by the widely used linear packing method. The paper presents several methods with implementation, evaluation, and illustrations and includes subroutines directly usable in geoscientific models.