Evaluating lossy data compression on climate simulation data within a large ensemble

Baker, Allison H.; Hammerling, Dorit M.; Mickelson, Sheri A.; Xu, Haiying; Stolpe, Martin B.; Naveau, Phillipe; Sanderson, Ben; Ebert-Uphoff, Imme; Samarasinghe, Savini; De Simone, Francesco; Carbone, Francesco; Gencarelli, Christian N.; Dennis, John M.; Kay, Jennifer E.; Lindstrom, Peter

doi:https://doi.org/10.5194/gmd-9-4381-2016

Articles | Volume 9, issue 12

https://doi.org/10.5194/gmd-9-4381-2016

© Author(s) 2016. This work is distributed under
the Creative Commons Attribution 3.0 License.

https://doi.org/10.5194/gmd-9-4381-2016

© Author(s) 2016. This work is distributed under
the Creative Commons Attribution 3.0 License.

Articles | Volume 9, issue 12

Development and technical paper

|

07 Dec 2016

Development and technical paper |

| 07 Dec 2016

Evaluating lossy data compression on climate simulation data within a large ensemble

Allison H. Baker, Dorit M. Hammerling, Sheri A. Mickelson, Haiying Xu, Martin B. Stolpe, Phillipe Naveau, Ben Sanderson, Imme Ebert-Uphoff, Savini Samarasinghe, Francesco De Simone, Francesco Carbone, Christian N. Gencarelli, John M. Dennis, Jennifer E. Kay, and Peter Lindstrom

Download

Final revised paper (published on 07 Dec 2016)
Preprint (discussion started on 25 Jul 2016)

Interactive discussion

Status: closed

AC: Author comment | RC: Referee comment | SC: Short comment | EC: Editor comment

- Printer-friendly version

- Supplement

RC1: 'Lossy compression is possible - but it is complicated', Anonymous Referee #1, 12 Sep 2016
- AC2: 'Response to review RC 1', Allison H. Baker, 17 Oct 2016
RC2: 'A remarquable contribution to reduce storage with lossly and adequate compression for climate simulations.', Anonymous Referee #2, 19 Sep 2016
- AC1: 'Response to review RC 2', Allison H. Baker, 17 Oct 2016

Peer-review completion

AR: Author's response | RR: Referee report | ED: Editor decision

AR by Allison H. Baker on behalf of the Authors (21 Oct 2016) Author's response Manuscript

ED: Publish as is (07 Nov 2016) by James Annan

AR by Allison H. Baker on behalf of the Authors (16 Nov 2016)

Short summary

We apply lossy data compression to output from the Community Earth System Model Large Ensemble Community Project. We challenge climate scientists to examine features of the data relevant to their interests and identify which of the ensemble members have been compressed, and we perform direct comparisons on features critical to climate science. We find that applying lossy data compression to climate model data effectively reduces data volumes with minimal effect on scientific results.