Journal cover Journal topic
Geoscientific Model Development An interactive open-access journal of the European Geosciences Union
Journal topic

Journal metrics

Journal metrics

  • IF value: 5.240 IF 5.240
  • IF 5-year value: 5.768 IF 5-year
    5.768
  • CiteScore value: 8.9 CiteScore
    8.9
  • SNIP value: 1.713 SNIP 1.713
  • IPP value: 5.53 IPP 5.53
  • SJR value: 3.18 SJR 3.18
  • Scimago H <br class='hide-on-tablet hide-on-mobile'>index value: 71 Scimago H
    index 71
  • h5-index value: 51 h5-index 51
Preprints
https://doi.org/10.5194/gmd-2020-124
© Author(s) 2020. This work is distributed under
the Creative Commons Attribution 4.0 License.
https://doi.org/10.5194/gmd-2020-124
© Author(s) 2020. This work is distributed under
the Creative Commons Attribution 4.0 License.

Submitted as: development and technical paper 02 Jun 2020

Submitted as: development and technical paper | 02 Jun 2020

Review status
This preprint is currently under review for the journal GMD.

Adaptive lossy compression of climate model data based on hierarchical tensor with Adaptive-HGFDR (v1.0)

Zhaoyuan Yu1,2, Zhengfang Zhang1, Dongshuang Li3,4, Wen Luo1,2, Yuan Liu1, Uzair Bhatti1, and Linwang Yuan1,2 Zhaoyuan Yu et al.
  • 1Key Laboratory of Virtual Geographic Environment, Ministry of Education, Nanjing Normal University, Nanjing, China
  • 2Jiangsu Center for Collaborative Innovation in Geographical Information Resource Development and Application, Nanjing, China
  • 3Jiangsu Key Laboratory of Crop Genetics and Physiology/Jiangsu Key Laboratory of Crop Cultivation and Physiology, Agricultural College of Yangzhou University, Yangzhou, China
  • 4Jiangsu Co Innovation Center for Modern Production Technology of Grain Crops, Yangzhou University, Yangzhou, China

Abstract. Lossy compression has been applied to large-scale experimental model data compression due to its advantages of a high compression ratio. However, few methods consider the uneven distribution of compression errors affecting compression quality. Here we develop an adaptive lossy compression method with the stable compression error for earth system model data based on Hierarchical Geospatial Field Data Representation (HGFDR). We extended the original HGFDR by firstly dividing the original data into a series of the local block according to the exploratory experiment to maximize the local correlations of the data. After that, from the mathematical model of the HGFDR, the relationship between the compression parameter and compression error in HGFDR for each block is analyzed and calculated. Using optimal compression parameter selection rule and an adaptive compression algorithm, our method, the Adaptive-HGFDR, achieved the data compression under the constraints that the compression error is as stable as possible through each dimension. Experiments concerning model data compression are carried out based on the Community Earth System Model (CESM) data. The results show that our method has higher compression ratio and more uniform error distributions, compared with other commonly used lossy compression methods, such as the Fixed-Rate Compressed Floating-Point Arrays method.

Zhaoyuan Yu et al.

Interactive discussion

Status: open (until 28 Jul 2020)
Status: open (until 28 Jul 2020)
AC: Author comment | RC: Referee comment | SC: Short comment | EC: Editor comment
[Subscribe to comment alert] Printer-friendly Version - Printer-friendly version Supplement - Supplement

Zhaoyuan Yu et al.

Data sets

AndyWZJ/Adaptive-lossy-compression- v1.0 W. Z. J. Andy https://doi.org/10.5281/zenodo.3862130

Model code and software

AndyWZJ/Adaptive-lossy-compression- v1.0 W. Z. J. Andy https://doi.org/10.5281/zenodo.3862130

Executable research compendia (ERC)

AndyWZJ/Adaptive-lossy-compression- v1.0 W. Z. J. Andy https://doi.org/10.5281/zenodo.3862130

Zhaoyuan Yu et al.

Viewed

Total article views: 188 (including HTML, PDF, and XML)
HTML PDF XML Total BibTeX EndNote
140 38 10 188 9 10
  • HTML: 140
  • PDF: 38
  • XML: 10
  • Total: 188
  • BibTeX: 9
  • EndNote: 10
Views and downloads (calculated since 02 Jun 2020)
Cumulative views and downloads (calculated since 02 Jun 2020)

Viewed (geographical distribution)

Total article views: 122 (including HTML, PDF, and XML) Thereof 122 with geography defined and 0 with unknown origin.
Country # Views %
  • 1
1
 
 
 
 

Cited

Saved

No saved metrics found.

Discussed

No discussed metrics found.
Latest update: 10 Jul 2020
Publications Copernicus
Download
Short summary
Few methods consider the uneven distribution of compression errors affecting compression quality. Here we develop an adaptive lossy compression method with the stable compression error for earth system model data. The results show that our method has higher compression ratio and more uniform error distributions, compared with other commonly used lossy compression methods, such as the Fixed-Rate Compressed Floating-Point Arrays method.
Few methods consider the uneven distribution of compression errors affecting compression...
Citation