Articles | Volume 9, issue 9
https://doi.org/10.5194/gmd-9-3199-2016
https://doi.org/10.5194/gmd-9-3199-2016
Development and technical paper
 | 
19 Sep 2016
Development and technical paper |  | 19 Sep 2016

Bit Grooming: statistically accurate precision-preserving quantization with compression, evaluated in the netCDF Operators (NCO, v4.4.8+)

Charles S. Zender

Related authors

The fully coupled regionally refined model of E3SM version 2: overview of the atmosphere, land, and river results
Qi Tang, Jean-Christophe Golaz, Luke P. Van Roekel, Mark A. Taylor, Wuyin Lin, Benjamin R. Hillman, Paul A. Ullrich, Andrew M. Bradley, Oksana Guba, Jonathan D. Wolfe, Tian Zhou, Kai Zhang, Xue Zheng, Yunyan Zhang, Meng Zhang, Mingxuan Wu, Hailong Wang, Cheng Tao, Balwinder Singh, Alan M. Rhoades, Yi Qin, Hong-Yi Li, Yan Feng, Yuying Zhang, Chengzhu Zhang, Charles S. Zender, Shaocheng Xie, Erika L. Roesler, Andrew F. Roberts, Azamat Mametjanov, Mathew E. Maltrud, Noel D. Keen, Robert L. Jacob, Christiane Jablonowski, Owen K. Hughes, Ryan M. Forsyth, Alan V. Di Vittorio, Peter M. Caldwell, Gautam Bisht, Renata B. McCoy, L. Ruby Leung, and David C. Bader
Geosci. Model Dev., 16, 3953–3995, https://doi.org/10.5194/gmd-16-3953-2023,https://doi.org/10.5194/gmd-16-3953-2023, 2023
Short summary
The E3SM Diagnostics Package (E3SM Diags v2.7): a Python-based diagnostics package for Earth system model evaluation
Chengzhu Zhang, Jean-Christophe Golaz, Ryan Forsyth, Tom Vo, Shaocheng Xie, Zeshawn Shaheen, Gerald L. Potter, Xylar S. Asay-Davis, Charles S. Zender, Wuyin Lin, Chih-Chieh Chen, Chris R. Terai, Salil Mahajan, Tian Zhou, Karthik Balaguru, Qi Tang, Cheng Tao, Yuying Zhang, Todd Emmenegger, Susannah Burrows, and Paul A. Ullrich
Geosci. Model Dev., 15, 9031–9056, https://doi.org/10.5194/gmd-15-9031-2022,https://doi.org/10.5194/gmd-15-9031-2022, 2022
Short summary
The role of föhn winds in eastern Antarctic Peninsula rapid ice shelf collapse
Matthew K. Laffin, Charles S. Zender, Melchior van Wessem, and Sebastián Marinsek
The Cryosphere, 16, 1369–1381, https://doi.org/10.5194/tc-16-1369-2022,https://doi.org/10.5194/tc-16-1369-2022, 2022
Short summary
SNICAR-ADv4: a physically based radiative transfer model to represent the spectral albedo of glacier ice
Chloe A. Whicker, Mark G. Flanner, Cheng Dang, Charles S. Zender, Joseph M. Cook, and Alex S. Gardner
The Cryosphere, 16, 1197–1220, https://doi.org/10.5194/tc-16-1197-2022,https://doi.org/10.5194/tc-16-1197-2022, 2022
Short summary
SNICAR-ADv3: a community tool for modeling spectral snow albedo
Mark G. Flanner, Julian B. Arnheim, Joseph M. Cook, Cheng Dang, Cenlin He, Xianglei Huang, Deepak Singh, S. McKenzie Skiles, Chloe A. Whicker, and Charles S. Zender
Geosci. Model Dev., 14, 7673–7704, https://doi.org/10.5194/gmd-14-7673-2021,https://doi.org/10.5194/gmd-14-7673-2021, 2021
Short summary

Related subject area

Numerical methods
Numerical stabilization methods for level-set-based ice front migration
Gong Cheng, Mathieu Morlighem, and G. Hilmar Gudmundsson
Geosci. Model Dev., 17, 6227–6247, https://doi.org/10.5194/gmd-17-6227-2024,https://doi.org/10.5194/gmd-17-6227-2024, 2024
Short summary
Modelling chemical advection during magma ascent
Hugo Dominguez, Nicolas Riel, and Pierre Lanari
Geosci. Model Dev., 17, 6105–6122, https://doi.org/10.5194/gmd-17-6105-2024,https://doi.org/10.5194/gmd-17-6105-2024, 2024
Short summary
Consistent point data assimilation in Firedrake and Icepack
Reuben W. Nixon-Hill, Daniel Shapero, Colin J. Cotter, and David A. Ham
Geosci. Model Dev., 17, 5369–5386, https://doi.org/10.5194/gmd-17-5369-2024,https://doi.org/10.5194/gmd-17-5369-2024, 2024
Short summary
A computationally efficient parameterization of aerosol, cloud and precipitation pH for application at global and regional scale (EQSAM4Clim-v12)
Swen Metzger, Samuel Rémy, Jason E. Williams, Vincent Huijnen, and Johannes Flemming
Geosci. Model Dev., 17, 5009–5021, https://doi.org/10.5194/gmd-17-5009-2024,https://doi.org/10.5194/gmd-17-5009-2024, 2024
Short summary
Assessing the benefits of approximately exact step sizes for Picard and Newton solver in simulating ice flow (FEniCS-full-Stokes v.1.3.2)
Niko Schmidt, Angelika Humbert, and Thomas Slawig
Geosci. Model Dev., 17, 4943–4959, https://doi.org/10.5194/gmd-17-4943-2024,https://doi.org/10.5194/gmd-17-4943-2024, 2024
Short summary

Cited articles

Burtscher, M. and Ratanaworabhan, P.: FPC: A high-speed compressor for double-precision floating-point data, IEEE T. Comput., 58, 18–31, https://doi.org/10.1109/TC.2008.131, 2009.
Caron, J.: Compression by scaling and offset, available at: http://www.unidata.ucar.edu/blogs/developer/entry/compression_by_scaling_and_offfset (last access: 13 September 2016), 2014a.
Caron, J.: Compression by bit shaving, available at: http://www.unidata.ucar.edu/blogs/developer/entry/compression_by_bit_shaving (last access: 13 September 2016), 2014b.
Collet, Y.: LZ4 lossless compression algorithm, available at: http://lz4.org (last access: 13 September 2016), 2013.
Dennis, J. M., Edwards, J., Evans, K. J., Guba, O., Lauritzen, P. H., Mirin, A. A., St-Cyr, A., Taylor, M. A., and Worley, P. H.: CAM-SE: A scalable spectral element dynamical core for the Community Atmosphere Model, Int. J. High Perform. C., 26, 74–89, https://doi.org/10.1177/1094342011428142, 2012.
Download
Short summary
We introduce Bit Grooming, a lossy compression algorithm that removes the bloat due to false precision, those bits and bytes beyond the meaningful precision of the data. Bit Grooming is statistically unbiased, applies to all floating-point numbers, and is easy to use. Bit Grooming reduces data storage requirements by 25–80 %. Unlike its best-known competitor Linear Packing, Bit Grooming imposes no software overhead on users, and guarantees its precision throughout the whole floating-point range.