Geoscientific Model Development
Geoscientific Model Development
GMD
Articles | Volume 9, issue 9
Articles | Volume 9, issue 9
https://doi.org/10.5194/gmd-9-3199-2016
© Author(s) 2016. This work is distributed under
the Creative Commons Attribution 3.0 License.
https://doi.org/10.5194/gmd-9-3199-2016
© Author(s) 2016. This work is distributed under
the Creative Commons Attribution 3.0 License.
Articles | Volume 9, issue 9
Development and technical paper
 | 
19 Sep 2016
Development and technical paper |  | 19 Sep 2016

Bit Grooming: statistically accurate precision-preserving quantization with compression, evaluated in the netCDF Operators (NCO, v4.4.8+)

Charles S. Zender

Viewed

Total article views: 5,244 (including HTML, PDF, and XML)
HTML PDF XML Total Supplement BibTeX EndNote
3,476 1,493 275 5,244 750 288 308
  • HTML: 3,476
  • PDF: 1,493
  • XML: 275
  • Total: 5,244
  • Supplement: 750
  • BibTeX: 288
  • EndNote: 308
Views and downloads (calculated since 21 Apr 2016)
Cumulative views and downloads (calculated since 21 Apr 2016)
Latest update: 07 Nov 2025
Download
Short summary
We introduce Bit Grooming, a lossy compression algorithm that removes the bloat due to false precision, those bits and bytes beyond the meaningful precision of the data. Bit Grooming is statistically unbiased, applies to all floating-point numbers, and is easy to use. Bit Grooming reduces data storage requirements by 25–80 %. Unlike its best-known competitor Linear Packing, Bit Grooming imposes no software overhead on users, and guarantees its precision throughout the whole floating-point range.
Read more
Share