Geoscientific Model Development
Geoscientific Model Development
GMD
Articles | Volume 12, issue 9
Articles | Volume 12, issue 9
https://doi.org/10.5194/gmd-12-4099-2019
© Author(s) 2019. This work is distributed under
the Creative Commons Attribution 4.0 License.
https://doi.org/10.5194/gmd-12-4099-2019
© Author(s) 2019. This work is distributed under
the Creative Commons Attribution 4.0 License.
Articles | Volume 12, issue 9
Development and technical paper
 | 
23 Sep 2019
Development and technical paper |  | 23 Sep 2019

Evaluation of lossless and lossy algorithms for the compression of scientific datasets in netCDF-4 or HDF5 files

Xavier Delaunay, Aurélie Courtois, and Flavien Gouillon

Viewed

Total article views: 3,735 (including HTML, PDF, and XML)
HTML PDF XML Total Supplement BibTeX EndNote
2,290 1,383 62 3,735 245 92 69
  • HTML: 2,290
  • PDF: 1,383
  • XML: 62
  • Total: 3,735
  • Supplement: 245
  • BibTeX: 92
  • EndNote: 69
Views and downloads (calculated since 20 Nov 2018)
Cumulative views and downloads (calculated since 20 Nov 2018)

Viewed (geographical distribution)

Total article views: 3,735 (including HTML, PDF, and XML) Thereof 3,342 with geography defined and 393 with unknown origin.
Country # Views %
  • 1
1
 
 
 
 

Cited

Latest update: 22 Nov 2024
Download
Short summary
This research aimed at finding a compression method suitable for the ground processing of CFOSAT and SWOT satellite datasets. Lossless algorithms did not allow enough compression. That is why we began studying lossy alternatives. This work introduces the digit rounding algorithm which reduces the volume of scientific datasets keeping only the significant digits in each sample value. The number of digits kept is relative to each sample so that both small and high values are similarly preserved.
Read more