Articles | Volume 12, issue 9
https://doi.org/10.5194/gmd-12-4099-2019
https://doi.org/10.5194/gmd-12-4099-2019
Development and technical paper
 | 
23 Sep 2019
Development and technical paper |  | 23 Sep 2019

Evaluation of lossless and lossy algorithms for the compression of scientific datasets in netCDF-4 or HDF5 files

Xavier Delaunay, Aurélie Courtois, and Flavien Gouillon

Viewed

Total article views: 3,752 (including HTML, PDF, and XML)
HTML PDF XML Total Supplement BibTeX EndNote
2,298 1,392 62 3,752 247 92 69
  • HTML: 2,298
  • PDF: 1,392
  • XML: 62
  • Total: 3,752
  • Supplement: 247
  • BibTeX: 92
  • EndNote: 69
Views and downloads (calculated since 20 Nov 2018)
Cumulative views and downloads (calculated since 20 Nov 2018)

Viewed (geographical distribution)

Total article views: 3,752 (including HTML, PDF, and XML) Thereof 3,359 with geography defined and 393 with unknown origin.
Country # Views %
  • 1
1
 
 
 
 

Cited

Latest update: 08 Dec 2024
Download
Short summary
This research aimed at finding a compression method suitable for the ground processing of CFOSAT and SWOT satellite datasets. Lossless algorithms did not allow enough compression. That is why we began studying lossy alternatives. This work introduces the digit rounding algorithm which reduces the volume of scientific datasets keeping only the significant digits in each sample value. The number of digits kept is relative to each sample so that both small and high values are similarly preserved.