the Creative Commons Attribution 3.0 License.
the Creative Commons Attribution 3.0 License.
Importance of bitwise identical reproducibility in earth system modeling and status report
Abstract. Reproducibility is a fundamental principle of scientific research. Bitwise identical reproducibility, i.e., bitwise computational results can be reproduced, guarantees the reproduction of exactly the same results. Here we show the importance of bitwise identical reproducibility to Earth system modeling but the importance has not yet been widely recognized. Modeled mean climate states, variability and trends at different scales may be significantly changed or even lead to opposing results due to a slight change in the original simulation setting during a reproduction. Out of the large body of Earth system modeling publications, few thoroughly describe the whole original simulation setting. As a result, the reproduction of a particular simulation experiment by fellow scientists heavily depends on the interaction with the original authors, which is often inconvenient or even impossible. We anticipate bitwise identical reproducibility to be promoted as a worldwide standard, to guarantee the independent reproduction of simulation results and to further improve model development and scientific research.
- Preprint
(6109 KB) - Metadata XML
- Companion paper
-
Supplement
(195 KB) - BibTeX
- EndNote
-
RC C2158: 'Reviewer's comment', Anonymous Referee #1, 23 Sep 2015
-
AC C2163: 'Responses to Referee #1 for gmdd-8-C2158-2015', Li Liu, 24 Sep 2015
-
RC C2356: 'Review follow-up', Anonymous Referee #1, 01 Oct 2015
- AC C2377: 'Responses to Referee #1 for gmdd-8-C2356-2015', Li Liu, 02 Oct 2015
-
RC C2356: 'Review follow-up', Anonymous Referee #1, 01 Oct 2015
-
AC C2163: 'Responses to Referee #1 for gmdd-8-C2158-2015', Li Liu, 24 Sep 2015
- RC C2720: 'Reviewer's comment', Anonymous Referee #2, 29 Oct 2015
-
RC C2158: 'Reviewer's comment', Anonymous Referee #1, 23 Sep 2015
-
AC C2163: 'Responses to Referee #1 for gmdd-8-C2158-2015', Li Liu, 24 Sep 2015
-
RC C2356: 'Review follow-up', Anonymous Referee #1, 01 Oct 2015
- AC C2377: 'Responses to Referee #1 for gmdd-8-C2356-2015', Li Liu, 02 Oct 2015
-
RC C2356: 'Review follow-up', Anonymous Referee #1, 01 Oct 2015
-
AC C2163: 'Responses to Referee #1 for gmdd-8-C2158-2015', Li Liu, 24 Sep 2015
- RC C2720: 'Reviewer's comment', Anonymous Referee #2, 29 Oct 2015
Viewed
HTML | XML | Total | Supplement | BibTeX | EndNote | |
---|---|---|---|---|---|---|
1,482 | 758 | 96 | 2,336 | 315 | 79 | 86 |
- HTML: 1,482
- PDF: 758
- XML: 96
- Total: 2,336
- Supplement: 315
- BibTeX: 79
- EndNote: 86
Cited
6 citations as recorded by crossref.
- SLEEF: A Portable Vectorized Library of C Standard Mathematical Functions N. Shibata & F. Petrogalli 10.1109/TPDS.2019.2960333
- Bitwise identical compiling setup: prospective for reproducibility and reliability of Earth system modeling R. Li et al. 10.5194/gmd-9-731-2016
- SEDA: A software package for the Statistical Earthquake Data Analysis A. Lombardi 10.1038/srep44171
- Machine dependence and reproducibility for coupled climate simulations: the HadGEM3-GC3.1 CMIP Preindustrial simulation M. Guarino et al. 10.5194/gmd-13-139-2020
- Dense agent-based HPC simulation of cell physics and signaling with real-time user interactions N. Merchant et al. 10.3389/fcomp.2023.1085867
- Geoscience and the Technological Revolution [Perspectives] Y. Bai et al. 10.1109/MGRS.2016.2635018