Articles | Volume 13, issue 8
https://doi.org/10.5194/gmd-13-3607-2020
https://doi.org/10.5194/gmd-13-3607-2020
Development and technical paper
 | 
19 Aug 2020
Development and technical paper |  | 19 Aug 2020

An offline framework for high-dimensional ensemble Kalman filters to reduce the time to solution

Yongjun Zheng, Clément Albergel, Simon Munier, Bertrand Bonan, and Jean-Christophe Calvet

Related authors

Assimilation of passive microwave vegetation optical depth in LDAS-Monde: a case study over the continental USA
Anthony Mucia, Bertrand Bonan, Clément Albergel, Yongjun Zheng, and Jean-Christophe Calvet
Biogeosciences, 19, 2557–2581, https://doi.org/10.5194/bg-19-2557-2022,https://doi.org/10.5194/bg-19-2557-2022, 2022
Short summary
Data assimilation for continuous global assessment of severe conditions over terrestrial surfaces
Clément Albergel, Yongjun Zheng, Bertrand Bonan, Emanuel Dutra, Nemesio Rodríguez-Fernández, Simon Munier, Clara Draper, Patricia de Rosnay, Joaquin Muñoz-Sabater, Gianpaolo Balsamo, David Fairbairn, Catherine Meurey, and Jean-Christophe Calvet
Hydrol. Earth Syst. Sci., 24, 4291–4316, https://doi.org/10.5194/hess-24-4291-2020,https://doi.org/10.5194/hess-24-4291-2020, 2020
Short summary
An ensemble square root filter for the joint assimilation of surface soil moisture and leaf area index within the Land Data Assimilation System LDAS-Monde: application over the Euro-Mediterranean region
Bertrand Bonan, Clément Albergel, Yongjun Zheng, Alina Lavinia Barbu, David Fairbairn, Simon Munier, and Jean-Christophe Calvet
Hydrol. Earth Syst. Sci., 24, 325–347, https://doi.org/10.5194/hess-24-325-2020,https://doi.org/10.5194/hess-24-325-2020, 2020
Short summary
The ESCAPE project: Energy-efficient Scalable Algorithms for Weather Prediction at Exascale
Andreas Müller, Willem Deconinck, Christian Kühnlein, Gianmarco Mengaldo, Michael Lange, Nils Wedi, Peter Bauer, Piotr K. Smolarkiewicz, Michail Diamantakis, Sarah-Jane Lock, Mats Hamrud, Sami Saarinen, George Mozdzynski, Daniel Thiemert, Michael Glinton, Pierre Bénard, Fabrice Voitus, Charles Colavolpe, Philippe Marguinaud, Yongjun Zheng, Joris Van Bever, Daan Degrauwe, Geert Smet, Piet Termonia, Kristian P. Nielsen, Bent H. Sass, Jacob W. Poulsen, Per Berg, Carlos Osuna, Oliver Fuhrer, Valentin Clement, Michael Baldauf, Mike Gillard, Joanna Szmelter, Enda O'Brien, Alastair McKinstry, Oisín Robinson, Parijat Shukla, Michael Lysaght, Michał Kulczewski, Milosz Ciznicki, Wojciech Piątek, Sebastian Ciesielski, Marek Błażewicz, Krzysztof Kurowski, Marcin Procyk, Pawel Spychala, Bartosz Bosak, Zbigniew P. Piotrowski, Andrzej Wyszogrodzki, Erwan Raffin, Cyril Mazauric, David Guibert, Louis Douriez, Xavier Vigouroux, Alan Gray, Peter Messmer, Alexander J. Macfaden, and Nick New
Geosci. Model Dev., 12, 4425–4441, https://doi.org/10.5194/gmd-12-4425-2019,https://doi.org/10.5194/gmd-12-4425-2019, 2019
Short summary
Simulation of the performance and scalability of message passing interface (MPI) communications of atmospheric models running on exascale supercomputers
Yongjun Zheng and Philippe Marguinaud
Geosci. Model Dev., 11, 3409–3426, https://doi.org/10.5194/gmd-11-3409-2018,https://doi.org/10.5194/gmd-11-3409-2018, 2018
Short summary

Related subject area

Climate and Earth system modeling
INFERNO-peat v1.0.0: a representation of northern high-latitude peat fires in the JULES-INFERNO global fire model
Katie R. Blackford, Matthew Kasoar, Chantelle Burton, Eleanor Burke, Iain Colin Prentice, and Apostolos Voulgarakis
Geosci. Model Dev., 17, 3063–3079, https://doi.org/10.5194/gmd-17-3063-2024,https://doi.org/10.5194/gmd-17-3063-2024, 2024
Short summary
The 4DEnVar-based weakly coupled land data assimilation system for E3SM version 2
Pengfei Shi, L. Ruby Leung, Bin Wang, Kai Zhang, Samson M. Hagos, and Shixuan Zhang
Geosci. Model Dev., 17, 3025–3040, https://doi.org/10.5194/gmd-17-3025-2024,https://doi.org/10.5194/gmd-17-3025-2024, 2024
Short summary
Continental-scale bias-corrected climate and hydrological projections for Australia
Justin Peter, Elisabeth Vogel, Wendy Sharples, Ulrike Bende-Michl, Louise Wilson, Pandora Hope, Andrew Dowdy, Greg Kociuba, Sri Srikanthan, Vi Co Duong, Jake Roussis, Vjekoslav Matic, Zaved Khan, Alison Oke, Margot Turner, Stuart Baron-Hay, Fiona Johnson, Raj Mehrotra, Ashish Sharma, Marcus Thatcher, Ali Azarvinand, Steven Thomas, Ghyslaine Boschat, Chantal Donnelly, and Robert Argent
Geosci. Model Dev., 17, 2755–2781, https://doi.org/10.5194/gmd-17-2755-2024,https://doi.org/10.5194/gmd-17-2755-2024, 2024
Short summary
G6-1.5K-SAI: a new Geoengineering Model Intercomparison Project (GeoMIP) experiment integrating recent advances in solar radiation modification studies
Daniele Visioni, Alan Robock, Jim Haywood, Matthew Henry, Simone Tilmes, Douglas G. MacMartin, Ben Kravitz, Sarah J. Doherty, John Moore, Chris Lennard, Shingo Watanabe, Helene Muri, Ulrike Niemeier, Olivier Boucher, Abu Syed, Temitope S. Egbebiyi, Roland Séférian, and Ilaria Quaglia
Geosci. Model Dev., 17, 2583–2596, https://doi.org/10.5194/gmd-17-2583-2024,https://doi.org/10.5194/gmd-17-2583-2024, 2024
Short summary
Modeling the effects of tropospheric ozone on the growth and yield of global staple crops with DSSAT v4.8.0
Jose Rafael Guarin, Jonas Jägermeyr, Elizabeth A. Ainsworth, Fabio A. A. Oliveira, Senthold Asseng, Kenneth Boote, Joshua Elliott, Lisa Emberson, Ian Foster, Gerrit Hoogenboom, David Kelly, Alex C. Ruane, and Katrina Sharps
Geosci. Model Dev., 17, 2547–2567, https://doi.org/10.5194/gmd-17-2547-2024,https://doi.org/10.5194/gmd-17-2547-2024, 2024
Short summary

Cited articles

Albergel, C., Munier, S., Leroux, D. J., Dewaele, H., Fairbairn, D., Barbu, A. L., Gelati, E., Dorigo, W., Faroux, S., Meurey, C., Le Moigne, P., Decharme, B., Mahfouf, J.-F., and Calvet, J.-C.: Sequential assimilation of satellite-derived vegetation and soil moisture products using SURFEX_v8.0: LDAS-Monde assessment over the Euro-Mediterranean area, Geosci. Model Dev., 10, 3889–3912, https://doi.org/10.5194/gmd-10-3889-2017, 2017. a
Anderson, J. L.: An ensemble adjustment Kalman filter for data assimilation, Mon. Weather Rev., 129, 2884–2903, 2001. a, b
Anderson, J. L. and Collins, N.: Scalable Implementations of Ensemble Filter Algorithms for Data Assimilation, J. Atmos. Ocean. Tech., 24, 1452–1463, https://doi.org/10.1175/JTECH2049.1, 2007. a
Bannister, R. N.: A review of operational methods of variational and ensemble-variational data assimilation, Q. J. Roy. Meteor. Soc., 143, 607–633, 2017. a
Bishop, C. H., Etherton, B. J., and Majumdar, S. J.: Adaptive sampling with the ensemble transform Kalman filter. Part I: theoretical aspects, Mon. Weather Rev., 129, 420–436, 2001. a, b
Download
Short summary
This study proposes a sophisticated dynamically running job scheme as well as an innovative parallel IO algorithm to reduce the time to solution of an offline framework for high-dimensional ensemble Kalman filters. The offline and online modes of ensemble Kalman filters are built to comprehensively assess their time to solution efficiencies. The offline mode is substantially faster than the online mode in terms of time to solution, especially for large-scale assimilation problems.