Articles | Volume 13, issue 8
https://doi.org/10.5194/gmd-13-3607-2020
https://doi.org/10.5194/gmd-13-3607-2020
Development and technical paper
 | 
19 Aug 2020
Development and technical paper |  | 19 Aug 2020

An offline framework for high-dimensional ensemble Kalman filters to reduce the time to solution

Yongjun Zheng, Clément Albergel, Simon Munier, Bertrand Bonan, and Jean-Christophe Calvet

Related authors

Assimilation of passive microwave vegetation optical depth in LDAS-Monde: a case study over the continental USA
Anthony Mucia, Bertrand Bonan, Clément Albergel, Yongjun Zheng, and Jean-Christophe Calvet
Biogeosciences, 19, 2557–2581, https://doi.org/10.5194/bg-19-2557-2022,https://doi.org/10.5194/bg-19-2557-2022, 2022
Short summary
Data assimilation for continuous global assessment of severe conditions over terrestrial surfaces
Clément Albergel, Yongjun Zheng, Bertrand Bonan, Emanuel Dutra, Nemesio Rodríguez-Fernández, Simon Munier, Clara Draper, Patricia de Rosnay, Joaquin Muñoz-Sabater, Gianpaolo Balsamo, David Fairbairn, Catherine Meurey, and Jean-Christophe Calvet
Hydrol. Earth Syst. Sci., 24, 4291–4316, https://doi.org/10.5194/hess-24-4291-2020,https://doi.org/10.5194/hess-24-4291-2020, 2020
Short summary
An ensemble square root filter for the joint assimilation of surface soil moisture and leaf area index within the Land Data Assimilation System LDAS-Monde: application over the Euro-Mediterranean region
Bertrand Bonan, Clément Albergel, Yongjun Zheng, Alina Lavinia Barbu, David Fairbairn, Simon Munier, and Jean-Christophe Calvet
Hydrol. Earth Syst. Sci., 24, 325–347, https://doi.org/10.5194/hess-24-325-2020,https://doi.org/10.5194/hess-24-325-2020, 2020
Short summary
The ESCAPE project: Energy-efficient Scalable Algorithms for Weather Prediction at Exascale
Andreas Müller, Willem Deconinck, Christian Kühnlein, Gianmarco Mengaldo, Michael Lange, Nils Wedi, Peter Bauer, Piotr K. Smolarkiewicz, Michail Diamantakis, Sarah-Jane Lock, Mats Hamrud, Sami Saarinen, George Mozdzynski, Daniel Thiemert, Michael Glinton, Pierre Bénard, Fabrice Voitus, Charles Colavolpe, Philippe Marguinaud, Yongjun Zheng, Joris Van Bever, Daan Degrauwe, Geert Smet, Piet Termonia, Kristian P. Nielsen, Bent H. Sass, Jacob W. Poulsen, Per Berg, Carlos Osuna, Oliver Fuhrer, Valentin Clement, Michael Baldauf, Mike Gillard, Joanna Szmelter, Enda O'Brien, Alastair McKinstry, Oisín Robinson, Parijat Shukla, Michael Lysaght, Michał Kulczewski, Milosz Ciznicki, Wojciech Piątek, Sebastian Ciesielski, Marek Błażewicz, Krzysztof Kurowski, Marcin Procyk, Pawel Spychala, Bartosz Bosak, Zbigniew P. Piotrowski, Andrzej Wyszogrodzki, Erwan Raffin, Cyril Mazauric, David Guibert, Louis Douriez, Xavier Vigouroux, Alan Gray, Peter Messmer, Alexander J. Macfaden, and Nick New
Geosci. Model Dev., 12, 4425–4441, https://doi.org/10.5194/gmd-12-4425-2019,https://doi.org/10.5194/gmd-12-4425-2019, 2019
Short summary
Simulation of the performance and scalability of message passing interface (MPI) communications of atmospheric models running on exascale supercomputers
Yongjun Zheng and Philippe Marguinaud
Geosci. Model Dev., 11, 3409–3426, https://doi.org/10.5194/gmd-11-3409-2018,https://doi.org/10.5194/gmd-11-3409-2018, 2018
Short summary

Related subject area

Climate and Earth system modeling
A rapid-application emissions-to-impacts tool for scenario assessment: Probabilistic Regional Impacts from Model patterns and Emissions (PRIME)
Camilla Mathison, Eleanor J. Burke, Gregory Munday, Chris D. Jones, Chris J. Smith, Norman J. Steinert, Andy J. Wiltshire, Chris Huntingford, Eszter Kovacs, Laila K. Gohar, Rebecca M. Varney, and Douglas McNeall
Geosci. Model Dev., 18, 1785–1808, https://doi.org/10.5194/gmd-18-1785-2025,https://doi.org/10.5194/gmd-18-1785-2025, 2025
Short summary
The DOE E3SM version 2.1: overview and assessment of the impacts of parameterized ocean submesoscales
Katherine M. Smith, Alice M. Barthel, LeAnn M. Conlon, Luke P. Van Roekel, Anthony Bartoletti, Jean-Christophe Golaz, Chengzhu Zhang, Carolyn Branecky Begeman, James J. Benedict, Gautam Bisht, Yan Feng, Walter Hannah, Bryce E. Harrop, Nicole Jeffery, Wuyin Lin, Po-Lun Ma, Mathew E. Maltrud, Mark R. Petersen, Balwinder Singh, Qi Tang, Teklu Tesfa, Jonathan D. Wolfe, Shaocheng Xie, Xue Zheng, Karthik Balaguru, Oluwayemi Garuba, Peter Gleckler, Aixue Hu, Jiwoo Lee, Ben Moore-Maley, and Ana C. Ordoñez
Geosci. Model Dev., 18, 1613–1633, https://doi.org/10.5194/gmd-18-1613-2025,https://doi.org/10.5194/gmd-18-1613-2025, 2025
Short summary
WRF-ELM v1.0: a regional climate model to study land–atmosphere interactions over heterogeneous land use regions
Huilin Huang, Yun Qian, Gautam Bisht, Jiali Wang, Tirthankar Chakraborty, Dalei Hao, Jianfeng Li, Travis Thurber, Balwinder Singh, Zhao Yang, Ye Liu, Pengfei Xue, William J. Sacks, Ethan Coon, and Robert Hetland
Geosci. Model Dev., 18, 1427–1443, https://doi.org/10.5194/gmd-18-1427-2025,https://doi.org/10.5194/gmd-18-1427-2025, 2025
Short summary
Modeling commercial-scale CO2 storage in the gas hydrate stability zone with PFLOTRAN v6.0
Michael Nole, Jonah Bartrand, Fawz Naim, and Glenn Hammond
Geosci. Model Dev., 18, 1413–1425, https://doi.org/10.5194/gmd-18-1413-2025,https://doi.org/10.5194/gmd-18-1413-2025, 2025
Short summary
DiuSST: a conceptual model of diurnal warm layers for idealized atmospheric simulations with interactive sea surface temperature
Reyk Börner, Jan O. Haerter, and Romain Fiévet
Geosci. Model Dev., 18, 1333–1356, https://doi.org/10.5194/gmd-18-1333-2025,https://doi.org/10.5194/gmd-18-1333-2025, 2025
Short summary

Cited articles

Albergel, C., Munier, S., Leroux, D. J., Dewaele, H., Fairbairn, D., Barbu, A. L., Gelati, E., Dorigo, W., Faroux, S., Meurey, C., Le Moigne, P., Decharme, B., Mahfouf, J.-F., and Calvet, J.-C.: Sequential assimilation of satellite-derived vegetation and soil moisture products using SURFEX_v8.0: LDAS-Monde assessment over the Euro-Mediterranean area, Geosci. Model Dev., 10, 3889–3912, https://doi.org/10.5194/gmd-10-3889-2017, 2017. a
Anderson, J. L.: An ensemble adjustment Kalman filter for data assimilation, Mon. Weather Rev., 129, 2884–2903, 2001. a, b
Anderson, J. L. and Collins, N.: Scalable Implementations of Ensemble Filter Algorithms for Data Assimilation, J. Atmos. Ocean. Tech., 24, 1452–1463, https://doi.org/10.1175/JTECH2049.1, 2007. a
Bannister, R. N.: A review of operational methods of variational and ensemble-variational data assimilation, Q. J. Roy. Meteor. Soc., 143, 607–633, 2017. a
Bishop, C. H., Etherton, B. J., and Majumdar, S. J.: Adaptive sampling with the ensemble transform Kalman filter. Part I: theoretical aspects, Mon. Weather Rev., 129, 420–436, 2001. a, b
Download
Short summary
This study proposes a sophisticated dynamically running job scheme as well as an innovative parallel IO algorithm to reduce the time to solution of an offline framework for high-dimensional ensemble Kalman filters. The offline and online modes of ensemble Kalman filters are built to comprehensively assess their time to solution efficiencies. The offline mode is substantially faster than the online mode in terms of time to solution, especially for large-scale assimilation problems.
Share