Geoscientific Model Development
Geoscientific Model Development
GMD
Articles | Volume 10, issue 1
Articles | Volume 10, issue 1
https://doi.org/10.5194/gmd-10-413-2017
© Author(s) 2017. This work is distributed under
the Creative Commons Attribution 3.0 License.
https://doi.org/10.5194/gmd-10-413-2017
© Author(s) 2017. This work is distributed under
the Creative Commons Attribution 3.0 License.
Articles | Volume 10, issue 1
Development and technical paper
 | 
27 Jan 2017
Development and technical paper |  | 27 Jan 2017

The compression–error trade-off for large gridded data sets

Jeremy D. Silver and Charles S. Zender

Viewed

Total article views: 4,836 (including HTML, PDF, and XML)
HTML PDF XML Total Supplement BibTeX EndNote
3,302 1,216 318 4,836 458 315 374
  • HTML: 3,302
  • PDF: 1,216
  • XML: 318
  • Total: 4,836
  • Supplement: 458
  • BibTeX: 315
  • EndNote: 374
Views and downloads (calculated since 29 Jul 2016)
Cumulative views and downloads (calculated since 29 Jul 2016)

Cited

Saved (final revised paper)

Latest update: 17 Aug 2026
Download
Short summary
Many modern scientific research projects generate large amounts of data. Storage space is valuable and may be limited; hence compression is vital. We tested different compression methods for large gridded data sets, assessing the space savings and the amount of precision lost. We found a general trade-off between precision and compression, with compression well-predicted by the entropy of the data set. A method introduced here proved to be a competitive archive format for gridded numerical data.
Read more
Share