Articles | Volume 14, issue 2
https://doi.org/10.5194/gmd-14-875-2021
https://doi.org/10.5194/gmd-14-875-2021
Development and technical paper
 | 
11 Feb 2021
Development and technical paper |  | 11 Feb 2021

Lossy compression of Earth system model data based on a hierarchical tensor with Adaptive-HGFDR (v1.0)

Zhaoyuan Yu, Dongshuang Li, Zhengfang Zhang, Wen Luo, Yuan Liu, Zengjie Wang, and Linwang Yuan

Related authors

An improved method of the Globally Resolved Energy Balance model by the Bayesian networks
Zhenxia Liu, Zengjie Wang, Jian Wang, Zhengfang Zhang, Dongshuang Li, Zhaoyuan Yu, Linwang Yuan, and Wen Luo
Geosci. Model Dev., 16, 2939–2955, https://doi.org/10.5194/gmd-16-2939-2023,https://doi.org/10.5194/gmd-16-2939-2023, 2023
Short summary
Clifford algebra-based structure filtering analysis for geophysical vector fields
Z. Yu, W. Luo, L. Yi, Y. Hu, and L. Yuan
Nonlin. Processes Geophys., 20, 563–570, https://doi.org/10.5194/npg-20-563-2013,https://doi.org/10.5194/npg-20-563-2013, 2013

Related subject area

Climate and Earth system modeling
Development of a plant carbon–nitrogen interface coupling framework in a coupled biophysical-ecosystem–biogeochemical model (SSiB5/TRIFFID/DayCent-SOM v1.0)
Zheng Xiang, Yongkang Xue, Weidong Guo, Melannie D. Hartman, Ye Liu, and William J. Parton
Geosci. Model Dev., 17, 6437–6464, https://doi.org/10.5194/gmd-17-6437-2024,https://doi.org/10.5194/gmd-17-6437-2024, 2024
Short summary
Dynamical Madden–Julian Oscillation forecasts using an ensemble subseasonal-to-seasonal forecast system of the IAP-CAS model
Yangke Liu, Qing Bao, Bian He, Xiaofei Wu, Jing Yang, Yimin Liu, Guoxiong Wu, Tao Zhu, Siyuan Zhou, Yao Tang, Ankang Qu, Yalan Fan, Anling Liu, Dandan Chen, Zhaoming Luo, Xing Hu, and Tongwen Wu
Geosci. Model Dev., 17, 6249–6275, https://doi.org/10.5194/gmd-17-6249-2024,https://doi.org/10.5194/gmd-17-6249-2024, 2024
Short summary
Implementation of a brittle sea ice rheology in an Eulerian, finite-difference, C-grid modeling framework: impact on the simulated deformation of sea ice in the Arctic
Laurent Brodeau, Pierre Rampal, Einar Ólason, and Véronique Dansereau
Geosci. Model Dev., 17, 6051–6082, https://doi.org/10.5194/gmd-17-6051-2024,https://doi.org/10.5194/gmd-17-6051-2024, 2024
Short summary
HSW-V v1.0: localized injections of interactive volcanic aerosols and their climate impacts in a simple general circulation model
Joseph P. Hollowed, Christiane Jablonowski, Hunter Y. Brown, Benjamin R. Hillman, Diana L. Bull, and Joseph L. Hart
Geosci. Model Dev., 17, 5913–5938, https://doi.org/10.5194/gmd-17-5913-2024,https://doi.org/10.5194/gmd-17-5913-2024, 2024
Short summary
A 3D-Var assimilation scheme for vertical velocity with CMA-MESO v5.0
Hong Li, Yi Yang, Jian Sun, Yuan Jiang, Ruhui Gan, and Qian Xie
Geosci. Model Dev., 17, 5883–5896, https://doi.org/10.5194/gmd-17-5883-2024,https://doi.org/10.5194/gmd-17-5883-2024, 2024
Short summary

Cited articles

Andrew, P., Joseph, N., Noah, Feldman., Allison, H. B., Alexander, P., and Dorit, M. H.: A statistical analysis of lossily compressed climate model data, Comput. Geosci., 145, 104599, https://doi.org/10.1016/j.cageo.2020.104599, 2020. 
Baker, A. H., Xu, H., Dennis, J. M., Levy, M. N., Nychka, D., Mickelson, S. A., Edwards, J., Vertenstein, M., and Wegener, A.: A methodology for evaluating the impact of data compression on climate simulation data, in: Proceedings of the 23rd International Symposium on High-Performance Parallel and Distributed Computing, Vancouver, Canada, 23–27 June 2014. 
Baker, A. H., Hammerling, D. M., Mickelson, S. A., Xu, H., Stolpe, M. B., Naveau, P., Sanderson, B., Ebert-Uphoff, I., Samarasinghe, S., De Simone, F., Carbone, F., Gencarelli, C. N., Dennis, J. M., Kay, J. E., and Lindstrom, P.: Evaluating lossy data compression on climate simulation data within a large ensemble, Geosci. Model Dev., 9, 4381–4403, https://doi.org/10.5194/gmd-9-4381-2016, 2016. 
Bengua, J. A., Phien, H. N., Tuan, H. D., and Do, M. N.: Matrix product state for higher-order tensor compression and classification, IEEE Trans. Signal Process., 65, 4019–4030, https://doi.org/10.1109/TSP.2017.2703882, 2016. 
Cai, J. Y., Chen, X., and Lu, P.: Non-negative weighted #csps: an effective complexity dichotomy, Comput. Sci., 6, 45–54, https://doi.org/10.1109/CCC.2011.32, 2012. 
Download
Short summary
Few lossy compression methods consider both the global and local multidimensional coupling correlations, which could lead to information loss in data compression. Here we develop an adaptive lossy compression method, Adaptive-HGFDR, to capture both the global and local variation of multidimensional coupling correlations and improve approximation accuracy. The method can achieve good compression performances for most flux variables with significant spatiotemporal heterogeneity.