Articles | Volume 13, issue 8
https://doi.org/10.5194/gmd-13-3607-2020
https://doi.org/10.5194/gmd-13-3607-2020
Development and technical paper
 | 
19 Aug 2020
Development and technical paper |  | 19 Aug 2020

An offline framework for high-dimensional ensemble Kalman filters to reduce the time to solution

Yongjun Zheng, Clément Albergel, Simon Munier, Bertrand Bonan, and Jean-Christophe Calvet

Related authors

Assimilation of passive microwave vegetation optical depth in LDAS-Monde: a case study over the continental USA
Anthony Mucia, Bertrand Bonan, Clément Albergel, Yongjun Zheng, and Jean-Christophe Calvet
Biogeosciences, 19, 2557–2581, https://doi.org/10.5194/bg-19-2557-2022,https://doi.org/10.5194/bg-19-2557-2022, 2022
Short summary
Data assimilation for continuous global assessment of severe conditions over terrestrial surfaces
Clément Albergel, Yongjun Zheng, Bertrand Bonan, Emanuel Dutra, Nemesio Rodríguez-Fernández, Simon Munier, Clara Draper, Patricia de Rosnay, Joaquin Muñoz-Sabater, Gianpaolo Balsamo, David Fairbairn, Catherine Meurey, and Jean-Christophe Calvet
Hydrol. Earth Syst. Sci., 24, 4291–4316, https://doi.org/10.5194/hess-24-4291-2020,https://doi.org/10.5194/hess-24-4291-2020, 2020
Short summary
An ensemble square root filter for the joint assimilation of surface soil moisture and leaf area index within the Land Data Assimilation System LDAS-Monde: application over the Euro-Mediterranean region
Bertrand Bonan, Clément Albergel, Yongjun Zheng, Alina Lavinia Barbu, David Fairbairn, Simon Munier, and Jean-Christophe Calvet
Hydrol. Earth Syst. Sci., 24, 325–347, https://doi.org/10.5194/hess-24-325-2020,https://doi.org/10.5194/hess-24-325-2020, 2020
Short summary
The ESCAPE project: Energy-efficient Scalable Algorithms for Weather Prediction at Exascale
Andreas Müller, Willem Deconinck, Christian Kühnlein, Gianmarco Mengaldo, Michael Lange, Nils Wedi, Peter Bauer, Piotr K. Smolarkiewicz, Michail Diamantakis, Sarah-Jane Lock, Mats Hamrud, Sami Saarinen, George Mozdzynski, Daniel Thiemert, Michael Glinton, Pierre Bénard, Fabrice Voitus, Charles Colavolpe, Philippe Marguinaud, Yongjun Zheng, Joris Van Bever, Daan Degrauwe, Geert Smet, Piet Termonia, Kristian P. Nielsen, Bent H. Sass, Jacob W. Poulsen, Per Berg, Carlos Osuna, Oliver Fuhrer, Valentin Clement, Michael Baldauf, Mike Gillard, Joanna Szmelter, Enda O'Brien, Alastair McKinstry, Oisín Robinson, Parijat Shukla, Michael Lysaght, Michał Kulczewski, Milosz Ciznicki, Wojciech Piątek, Sebastian Ciesielski, Marek Błażewicz, Krzysztof Kurowski, Marcin Procyk, Pawel Spychala, Bartosz Bosak, Zbigniew P. Piotrowski, Andrzej Wyszogrodzki, Erwan Raffin, Cyril Mazauric, David Guibert, Louis Douriez, Xavier Vigouroux, Alan Gray, Peter Messmer, Alexander J. Macfaden, and Nick New
Geosci. Model Dev., 12, 4425–4441, https://doi.org/10.5194/gmd-12-4425-2019,https://doi.org/10.5194/gmd-12-4425-2019, 2019
Short summary
Simulation of the performance and scalability of message passing interface (MPI) communications of atmospheric models running on exascale supercomputers
Yongjun Zheng and Philippe Marguinaud
Geosci. Model Dev., 11, 3409–3426, https://doi.org/10.5194/gmd-11-3409-2018,https://doi.org/10.5194/gmd-11-3409-2018, 2018
Short summary

Related subject area

Climate and Earth system modeling
A protocol for model intercomparison of impacts of marine cloud brightening climate intervention
Philip J. Rasch, Haruki Hirasawa, Mingxuan Wu, Sarah J. Doherty, Robert Wood, Hailong Wang, Andy Jones, James Haywood, and Hansi Singh
Geosci. Model Dev., 17, 7963–7994, https://doi.org/10.5194/gmd-17-7963-2024,https://doi.org/10.5194/gmd-17-7963-2024, 2024
Short summary
An extensible perturbed parameter ensemble for the Community Atmosphere Model version 6
Trude Eidhammer, Andrew Gettelman, Katherine Thayer-Calder, Duncan Watson-Parris, Gregory Elsaesser, Hugh Morrison, Marcus van Lier-Walqui, Ci Song, and Daniel McCoy
Geosci. Model Dev., 17, 7835–7853, https://doi.org/10.5194/gmd-17-7835-2024,https://doi.org/10.5194/gmd-17-7835-2024, 2024
Short summary
Coupling the regional climate model ICON-CLM v2.6.6 to the Earth system model GCOAST-AHOI v2.0 using OASIS3-MCT v4.0
Ha Thi Minh Ho-Hagemann, Vera Maurer, Stefan Poll, and Irina Fast
Geosci. Model Dev., 17, 7815–7834, https://doi.org/10.5194/gmd-17-7815-2024,https://doi.org/10.5194/gmd-17-7815-2024, 2024
Short summary
A fully coupled solid-particle microphysics scheme for stratospheric aerosol injections within the aerosol–chemistry–climate model SOCOL-AERv2
Sandro Vattioni, Rahel Weber, Aryeh Feinberg, Andrea Stenke, John A. Dykema, Beiping Luo, Georgios A. Kelesidis, Christian A. Bruun, Timofei Sukhodolov, Frank N. Keutsch, Thomas Peter, and Gabriel Chiodo
Geosci. Model Dev., 17, 7767–7793, https://doi.org/10.5194/gmd-17-7767-2024,https://doi.org/10.5194/gmd-17-7767-2024, 2024
Short summary
An improved representation of aerosol in the ECMWF IFS-COMPO 49R1 through the integration of EQSAM4Climv12 – a first attempt at simulating aerosol acidity
Samuel Rémy, Swen Metzger, Vincent Huijnen, Jason E. Williams, and Johannes Flemming
Geosci. Model Dev., 17, 7539–7567, https://doi.org/10.5194/gmd-17-7539-2024,https://doi.org/10.5194/gmd-17-7539-2024, 2024
Short summary

Cited articles

Albergel, C., Munier, S., Leroux, D. J., Dewaele, H., Fairbairn, D., Barbu, A. L., Gelati, E., Dorigo, W., Faroux, S., Meurey, C., Le Moigne, P., Decharme, B., Mahfouf, J.-F., and Calvet, J.-C.: Sequential assimilation of satellite-derived vegetation and soil moisture products using SURFEX_v8.0: LDAS-Monde assessment over the Euro-Mediterranean area, Geosci. Model Dev., 10, 3889–3912, https://doi.org/10.5194/gmd-10-3889-2017, 2017. a
Anderson, J. L.: An ensemble adjustment Kalman filter for data assimilation, Mon. Weather Rev., 129, 2884–2903, 2001. a, b
Anderson, J. L. and Collins, N.: Scalable Implementations of Ensemble Filter Algorithms for Data Assimilation, J. Atmos. Ocean. Tech., 24, 1452–1463, https://doi.org/10.1175/JTECH2049.1, 2007. a
Bannister, R. N.: A review of operational methods of variational and ensemble-variational data assimilation, Q. J. Roy. Meteor. Soc., 143, 607–633, 2017. a
Bishop, C. H., Etherton, B. J., and Majumdar, S. J.: Adaptive sampling with the ensemble transform Kalman filter. Part I: theoretical aspects, Mon. Weather Rev., 129, 420–436, 2001. a, b
Download
Short summary
This study proposes a sophisticated dynamically running job scheme as well as an innovative parallel IO algorithm to reduce the time to solution of an offline framework for high-dimensional ensemble Kalman filters. The offline and online modes of ensemble Kalman filters are built to comprehensively assess their time to solution efficiencies. The offline mode is substantially faster than the online mode in terms of time to solution, especially for large-scale assimilation problems.