Articles | Volume 14, issue 1
https://doi.org/10.5194/gmd-14-377-2021
https://doi.org/10.5194/gmd-14-377-2021
Development and technical paper
 | 
22 Jan 2021
Development and technical paper |  | 22 Jan 2021

A note on precision-preserving compression of scientific data

Rostislav Kouznetsov

Related authors

Air quality modeling intercomparison and multi-scale ensemble chain for Latin America
Jorge E. Pachon, Mariel Opazo, Pablo Lichtig, Nicolas Hunneus, Idir Bouarar, Guy Brasseur, Cathy W. Y. Li, Johannes Flemming, Laurent Menut, Camilo Menares, Laura Gallardo, Michael Gauss, Mikhail Sofiev, Rostislav Kouznetsov, Julia Palamarchuk, Laura Dawidowski, Nestor Y. Rojas, Maria de Fatima Andrade, Mario E. Gavidia-Calderón, Alejandro H. Delgado Peralta, and Daniel Schuch
EGUsphere, https://doi.org/10.5194/egusphere-2024-815,https://doi.org/10.5194/egusphere-2024-815, 2024
Short summary
A bottom-up emission estimate for the 2022 Nord Stream gas leak: derivation, simulations, and evaluation
Rostislav Kouznetsov, Risto Hänninen, Andreas Uppstu, Evgeny Kadantsev, Yalda Fatahi, Marje Prank, Dmitrii Kouznetsov, Steffen Manfred Noe, Heikki Junninen, and Mikhail Sofiev
Atmos. Chem. Phys., 24, 4675–4691, https://doi.org/10.5194/acp-24-4675-2024,https://doi.org/10.5194/acp-24-4675-2024, 2024
Short summary
Shipping and algae emissions have a major impact on ambient air mixing ratios of non-methane hydrocarbons (NMHCs) and methanethiol on Utö Island in the Baltic Sea
Heidi Hellén, Rostislav Kouznetsov, Kaisa Kraft, Jukka Seppälä, Mika Vestenius, Jukka-Pekka Jalkanen, Lauri Laakso, and Hannele Hakola
Atmos. Chem. Phys., 24, 4717–4731, https://doi.org/10.5194/acp-24-4717-2024,https://doi.org/10.5194/acp-24-4717-2024, 2024
Short summary
Positive semi-definite variants of CBM4 and CBM05 chemistry schemes for atmospheric composition models
Risto Matias Hänninen, Rostislav Kouznetsov, and Mikhail Sofiev
Geosci. Model Dev. Discuss., https://doi.org/10.5194/gmd-2023-3,https://doi.org/10.5194/gmd-2023-3, 2023
Preprint withdrawn
Short summary
Characterization of volatile organic compounds and submicron organic aerosol in a traffic environment
Sanna Saarikoski, Heidi Hellén, Arnaud P. Praplan, Simon Schallhart, Petri Clusius, Jarkko V. Niemi, Anu Kousa, Toni Tykkä, Rostislav Kouznetsov, Minna Aurela, Laura Salo, Topi Rönkkö, Luis M. F. Barreira, Liisa Pirjola, and Hilkka Timonen
Atmos. Chem. Phys., 23, 2963–2982, https://doi.org/10.5194/acp-23-2963-2023,https://doi.org/10.5194/acp-23-2963-2023, 2023
Short summary

Related subject area

Numerical methods
NorSand4AI: a comprehensive triaxial test simulation database for NorSand constitutive model materials
Luan Carlos de Sena Monteiro Ozelim, Michéle Dal Toé Casagrande, and André Luís Brasil Cavalcante
Geosci. Model Dev., 17, 3175–3197, https://doi.org/10.5194/gmd-17-3175-2024,https://doi.org/10.5194/gmd-17-3175-2024, 2024
Short summary
ParticleDA.jl v.1.0: a distributed particle-filtering data assimilation package
Daniel Giles, Matthew M. Graham, Mosè Giordano, Tuomas Koskela, Alexandros Beskos, and Serge Guillas
Geosci. Model Dev., 17, 2427–2445, https://doi.org/10.5194/gmd-17-2427-2024,https://doi.org/10.5194/gmd-17-2427-2024, 2024
Short summary
HETerogeneous vectorized or Parallel (HETPv1.0): an updated inorganic heterogeneous chemistry solver for the metastable-state NH4+–Na+–Ca2+–K+–Mg2+–SO42−–NO3–Cl–H2O system based on ISORROPIA II
Stefan J. Miller, Paul A. Makar, and Colin J. Lee
Geosci. Model Dev., 17, 2197–2219, https://doi.org/10.5194/gmd-17-2197-2024,https://doi.org/10.5194/gmd-17-2197-2024, 2024
Short summary
Three-dimensional geological modelling of igneous intrusions in LoopStructural v1.5.10
Fernanda Alvarado-Neves, Laurent Ailleres, Lachlan Grose, Alexander R. Cruden, and Robin Armit
Geosci. Model Dev., 17, 1975–1993, https://doi.org/10.5194/gmd-17-1975-2024,https://doi.org/10.5194/gmd-17-1975-2024, 2024
Short summary
Estimating volcanic ash emissions using retrieved satellite ash columns and inverse ash transport modeling using VolcanicAshInversion v1.2.1, within the operational eEMEP (emergency European Monitoring and Evaluation Programme) volcanic plume forecasting system (version rv4_17)
André R. Brodtkorb, Anna Benedictow, Heiko Klein, Arve Kylling, Agnes Nyiri, Alvaro Valdebenito, Espen Sollum, and Nina Kristiansen
Geosci. Model Dev., 17, 1957–1974, https://doi.org/10.5194/gmd-17-1957-2024,https://doi.org/10.5194/gmd-17-1957-2024, 2024
Short summary

Cited articles

ANSI/IEEE: IEEE Standard for Binary Floating-Point Arithmetic, ANSI/IEEE Std 754-1985, pp. 1–20, https://doi.org/10.1109/IEEESTD.1985.82928, 1985. a, b
Holton, J. and Hakim, G.: An Introduction to Dynamic Meteorology, Academic Press, Elsevier Science, Amsterdam, Boston, Heidelberg, London, New York, Oxford, Paris, San Diego, San Francisco, Singapore, Sydney, Tokyo, 2013. a
Stackpole, J. D.: GRIB (Edition 1) The WMO Format for the Storage of Weather Product Information and the Exchange of Weather Product Messages in Gridded Binary Form, Office note 388, U.S. Department of Commerce, National Oceanic and Atmospheric Administration, National Weather Service, National Meteorological Center, MD, USA, 1994. a
Zender, C. S.: Bit Grooming: statistically accurate precision-preserving quantization with compression, evaluated in the netCDF Operators (NCO, v4.4.8+), Geosci. Model Dev., 9, 3199–3211, https://doi.org/10.5194/gmd-9-3199-2016, 2016. a, b, c, d, e, f, g
Download
Short summary
Resetting of non-significant figures (precision trimming) enables efficient data compression and helps to avoid excessive use of storage space and network bandwidth while having well-constrained distortion to the data. The paper analyses accuracy losses and artifacts caused by trimming methods and by the widely used linear packing method. The paper presents several methods with implementation, evaluation, and illustrations and includes subroutines directly usable in geoscientific models.