Articles | Volume 12, issue 9
Geosci. Model Dev., 12, 4099–4113, 2019
https://doi.org/10.5194/gmd-12-4099-2019
Geosci. Model Dev., 12, 4099–4113, 2019
https://doi.org/10.5194/gmd-12-4099-2019

Development and technical paper 23 Sep 2019

Development and technical paper | 23 Sep 2019

Evaluation of lossless and lossy algorithms for the compression of scientific datasets in netCDF-4 or HDF5 files

Xavier Delaunay et al.

Viewed

Total article views: 2,144 (including HTML, PDF, and XML)
HTML PDF XML Total Supplement BibTeX EndNote
1,271 843 30 2,144 142 45 40
  • HTML: 1,271
  • PDF: 843
  • XML: 30
  • Total: 2,144
  • Supplement: 142
  • BibTeX: 45
  • EndNote: 40
Views and downloads (calculated since 20 Nov 2018)
Cumulative views and downloads (calculated since 20 Nov 2018)

Viewed (geographical distribution)

Total article views: 1,818 (including HTML, PDF, and XML) Thereof 1,809 with geography defined and 9 with unknown origin.
Country # Views %
  • 1
1
 
 
 
 

Cited

Latest update: 05 Dec 2021
Download
Short summary
This research aimed at finding a compression method suitable for the ground processing of CFOSAT and SWOT satellite datasets. Lossless algorithms did not allow enough compression. That is why we began studying lossy alternatives. This work introduces the digit rounding algorithm which reduces the volume of scientific datasets keeping only the significant digits in each sample value. The number of digits kept is relative to each sample so that both small and high values are similarly preserved.