Articles | Volume 14, issue 1
https://doi.org/10.5194/gmd-14-377-2021
https://doi.org/10.5194/gmd-14-377-2021
Development and technical paper
 | 
22 Jan 2021
Development and technical paper |  | 22 Jan 2021

A note on precision-preserving compression of scientific data

Rostislav Kouznetsov

Related authors

Copernicus Atmosphere Monitoring Service – Regional Air Quality Production System v1.0
Augustin Colette, Gaëlle Collin, François Besson, Etienne Blot, Vincent Guidard, Frederik Meleux, Adrien Royer, Valentin Petiot, Claire Miller, Oihana Fermond, Alizé Jeant, Mario Adani, Joaquim Arteta, Anna Benedictow, Robert Bergström, Dene Bowdalo, Jorgen Brandt, Gino Briganti, Ana C. Carvalho, Jesper Heile Christensen, Florian Couvidat, Ilia D’Elia, Massimo D’Isidoro, Hugo Denier van der Gon, Gaël Descombes, Enza Di Tomaso, John Douros, Jeronimo Escribano, Henk Eskes, Hilde Fagerli, Yalda Fatahi, Johannes Flemming, Elmar Friese, Lise Frohn, Michael Gauss, Camilla Geels, Guido Guarnieri, Marc Guevara, Antoine Guion, Jonathan Guth, Risto Hänninen, Kaj Hansen, Ulas Im, Ruud Janssen, Marine Jeoffrion, Mathieu Joly, Luke Jones, Oriol Jorba, Evgeni Kadantsev, Michael Kahnert, Jacek W. Kaminski, Rostislav Kouznetsov, Richard Kranenburg, Jeroen Kuenen, Anne Caroline Lange, Joachim Langner, Victor Lannuque, Francesca Macchia, Astrid Manders, Mihaela Mircea, Agnes Nyiri, Miriam Olid, Carlos Pérez García-Pando, Yuliia Palamarchuk, Antonio Piersanti, Blandine Raux, Miha Razinger, Lennard Robertson, Arjo Segers, Martijn Schaap, Pilvi Siljamo, David Simpson, Mikhail Sofiev, Anders Stangel, Joanna Struzewska, Carles Tena, Renske Timmermans, Thanos Tsikerdekis, Svetlana Tsyro, Svyatoslav Tyuryakov, Anthony Ung, Andreas Uppstu, Alvaro Valdebenito, Peter van Velthoven, Lina Vitali, Zhuyun Ye, Vincent-Henri Peuch, and Laurence Rouïl
EGUsphere, https://doi.org/10.5194/egusphere-2024-3744,https://doi.org/10.5194/egusphere-2024-3744, 2024
This preprint is open for discussion and under review for Geoscientific Model Development (GMD).
Short summary
Air quality modeling intercomparison and multiscale ensemble chain for Latin America
Jorge E. Pachón, Mariel A. Opazo, Pablo Lichtig, Nicolas Huneeus, Idir Bouarar, Guy Brasseur, Cathy W. Y. Li, Johannes Flemming, Laurent Menut, Camilo Menares, Laura Gallardo, Michael Gauss, Mikhail Sofiev, Rostislav Kouznetsov, Julia Palamarchuk, Andreas Uppstu, Laura Dawidowski, Nestor Y. Rojas, María de Fátima Andrade, Mario E. Gavidia-Calderón, Alejandro H. Delgado Peralta, and Daniel Schuch
Geosci. Model Dev., 17, 7467–7512, https://doi.org/10.5194/gmd-17-7467-2024,https://doi.org/10.5194/gmd-17-7467-2024, 2024
Short summary
A bottom-up emission estimate for the 2022 Nord Stream gas leak: derivation, simulations, and evaluation
Rostislav Kouznetsov, Risto Hänninen, Andreas Uppstu, Evgeny Kadantsev, Yalda Fatahi, Marje Prank, Dmitrii Kouznetsov, Steffen Manfred Noe, Heikki Junninen, and Mikhail Sofiev
Atmos. Chem. Phys., 24, 4675–4691, https://doi.org/10.5194/acp-24-4675-2024,https://doi.org/10.5194/acp-24-4675-2024, 2024
Short summary
Shipping and algae emissions have a major impact on ambient air mixing ratios of non-methane hydrocarbons (NMHCs) and methanethiol on Utö Island in the Baltic Sea
Heidi Hellén, Rostislav Kouznetsov, Kaisa Kraft, Jukka Seppälä, Mika Vestenius, Jukka-Pekka Jalkanen, Lauri Laakso, and Hannele Hakola
Atmos. Chem. Phys., 24, 4717–4731, https://doi.org/10.5194/acp-24-4717-2024,https://doi.org/10.5194/acp-24-4717-2024, 2024
Short summary
Positive semi-definite variants of CBM4 and CBM05 chemistry schemes for atmospheric composition models
Risto Matias Hänninen, Rostislav Kouznetsov, and Mikhail Sofiev
Geosci. Model Dev. Discuss., https://doi.org/10.5194/gmd-2023-3,https://doi.org/10.5194/gmd-2023-3, 2023
Preprint withdrawn
Short summary

Related subject area

Numerical methods
A joint reconstruction and model selection approach for large-scale linear inverse modeling (msHyBR v2)
Malena Sabaté Landman, Julianne Chung, Jiahua Jiang, Scot M. Miller, and Arvind K. Saibaba
Geosci. Model Dev., 17, 8853–8872, https://doi.org/10.5194/gmd-17-8853-2024,https://doi.org/10.5194/gmd-17-8853-2024, 2024
Short summary
Assimilation of snow water equivalent from AMSR2 and IMS satellite data utilizing the local ensemble transform Kalman filter
Joonlee Lee, Myong-In Lee, Sunlae Tak, Eunkyo Seo, and Yong-Keun Lee
Geosci. Model Dev., 17, 8799–8816, https://doi.org/10.5194/gmd-17-8799-2024,https://doi.org/10.5194/gmd-17-8799-2024, 2024
Short summary
The Paleochrono-1.1 probabilistic model to derive a common age model for several paleoclimatic sites using absolute and relative dating constraints
Frédéric Parrenin, Marie Bouchet, Christo Buizert, Emilie Capron, Ellen Corrick, Russell Drysdale, Kenji Kawamura, Amaëlle Landais, Robert Mulvaney, Ikumi Oyabu, and Sune Olander Rasmussen
Geosci. Model Dev., 17, 8735–8750, https://doi.org/10.5194/gmd-17-8735-2024,https://doi.org/10.5194/gmd-17-8735-2024, 2024
Short summary
Explicit stochastic advection algorithms for the regional-scale particle-resolved atmospheric aerosol model WRF-PartMC (v1.0)
Jeffrey H. Curtis, Nicole Riemer, and Matthew West
Geosci. Model Dev., 17, 8399–8420, https://doi.org/10.5194/gmd-17-8399-2024,https://doi.org/10.5194/gmd-17-8399-2024, 2024
Short summary
Enhancing Single-Precision with Quasi Double-Precision: Achieving Double-Precision Accuracy in the Model for Prediction Across Scales-Atmosphere (MPAS-A) version 8.2.1
Jiayi Lai, Lanning Wang, Qizhong Wu, Yizhou Yang, and Fang Wang
EGUsphere, https://doi.org/10.5194/egusphere-2024-2986,https://doi.org/10.5194/egusphere-2024-2986, 2024
Short summary

Cited articles

ANSI/IEEE: IEEE Standard for Binary Floating-Point Arithmetic, ANSI/IEEE Std 754-1985, pp. 1–20, https://doi.org/10.1109/IEEESTD.1985.82928, 1985. a, b
Holton, J. and Hakim, G.: An Introduction to Dynamic Meteorology, Academic Press, Elsevier Science, Amsterdam, Boston, Heidelberg, London, New York, Oxford, Paris, San Diego, San Francisco, Singapore, Sydney, Tokyo, 2013. a
Stackpole, J. D.: GRIB (Edition 1) The WMO Format for the Storage of Weather Product Information and the Exchange of Weather Product Messages in Gridded Binary Form, Office note 388, U.S. Department of Commerce, National Oceanic and Atmospheric Administration, National Weather Service, National Meteorological Center, MD, USA, 1994. a
Zender, C. S.: Bit Grooming: statistically accurate precision-preserving quantization with compression, evaluated in the netCDF Operators (NCO, v4.4.8+), Geosci. Model Dev., 9, 3199–3211, https://doi.org/10.5194/gmd-9-3199-2016, 2016. a, b, c, d, e, f, g
Download
Short summary
Resetting of non-significant figures (precision trimming) enables efficient data compression and helps to avoid excessive use of storage space and network bandwidth while having well-constrained distortion to the data. The paper analyses accuracy losses and artifacts caused by trimming methods and by the widely used linear packing method. The paper presents several methods with implementation, evaluation, and illustrations and includes subroutines directly usable in geoscientific models.