Articles | Volume 15, issue 15
https://doi.org/10.5194/gmd-15-6197-2022
© Author(s) 2022. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
https://doi.org/10.5194/gmd-15-6197-2022
© Author(s) 2022. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
Development and technical paper
| 
11 Aug 2022
Development and technical paper |
| 11 Aug 2022
| 11 Aug 2022
Hybrid ensemble-variational data assimilation in ABC-DA within a tropical framework
Joshua Chun Kwang Lee
CORRESPONDING AUTHOR
Centre for Climate Research Singapore, Meteorological Service Singapore, Singapore
University of Reading, Department of Meteorology, Reading, UK
Javier Amezcua
University of Reading and UK National Centre for Earth Observation, Reading, UK
Tecnologico de Monterrey, Campus Ciudad de Mexico, Mexico City, Mexico
Ross Noel Bannister
University of Reading and UK National Centre for Earth Observation, Reading, UK
Related authors
Mike Bush, David L. A. Flack, Huw W. Lewis, Sylvia I. Bohnenstengel, Chris J. Short, Charmaine Franklin, Adrian P. Lock, Martin Best, Paul Field, Anne McCabe, Kwinten Van Weverberg, Segolene Berthou, Ian Boutle, Jennifer K. Brooke, Seb Cole, Shaun Cooper, Gareth Dow, John Edwards, Anke Finnenkoetter, Kalli Furtado, Kate Halladay, Kirsty Hanley, Margaret A. Hendry, Adrian Hill, Aravindakshan Jayakumar, Richard W. Jones, Humphrey Lean, Joshua C. K. Lee, Andy Malcolm, Marion Mittermaier, Saji Mohandas, Stuart Moore, Cyril Morcrette, Rachel North, Aurore Porson, Susan Rennie, Nigel Roberts, Belinda Roux, Claudio Sanchez, Chun-Hsu Su, Simon Tucker, Simon Vosper, David Walters, James Warner, Stuart Webster, Mark Weeks, Jonathan Wilkinson, Michael Whitall, Keith D. Williams, and Hugh Zhang
Geosci. Model Dev., 18, 3819–3855, https://doi.org/10.5194/gmd-18-3819-2025, https://doi.org/10.5194/gmd-18-3819-2025, 2025
Short summary
Short summary
RAL configurations define settings for the Unified Model atmosphere and Joint UK Land Environment Simulator. The third version of the Regional Atmosphere and Land (RAL3) science configuration for kilometre- and sub-kilometre-scale modelling represents a major advance compared to previous versions (RAL2) by delivering a common science definition for applications in tropical and mid-latitude regions. RAL3 has more realistic precipitation distributions and an improved representation of clouds and visibility.
Mike Bush, David L. A. Flack, Huw W. Lewis, Sylvia I. Bohnenstengel, Chris J. Short, Charmaine Franklin, Adrian P. Lock, Martin Best, Paul Field, Anne McCabe, Kwinten Van Weverberg, Segolene Berthou, Ian Boutle, Jennifer K. Brooke, Seb Cole, Shaun Cooper, Gareth Dow, John Edwards, Anke Finnenkoetter, Kalli Furtado, Kate Halladay, Kirsty Hanley, Margaret A. Hendry, Adrian Hill, Aravindakshan Jayakumar, Richard W. Jones, Humphrey Lean, Joshua C. K. Lee, Andy Malcolm, Marion Mittermaier, Saji Mohandas, Stuart Moore, Cyril Morcrette, Rachel North, Aurore Porson, Susan Rennie, Nigel Roberts, Belinda Roux, Claudio Sanchez, Chun-Hsu Su, Simon Tucker, Simon Vosper, David Walters, James Warner, Stuart Webster, Mark Weeks, Jonathan Wilkinson, Michael Whitall, Keith D. Williams, and Hugh Zhang
Geosci. Model Dev., 18, 3819–3855, https://doi.org/10.5194/gmd-18-3819-2025, https://doi.org/10.5194/gmd-18-3819-2025, 2025
Short summary
Short summary
RAL configurations define settings for the Unified Model atmosphere and Joint UK Land Environment Simulator. The third version of the Regional Atmosphere and Land (RAL3) science configuration for kilometre- and sub-kilometre-scale modelling represents a major advance compared to previous versions (RAL2) by delivering a common science definition for applications in tropical and mid-latitude regions. RAL3 has more realistic precipitation distributions and an improved representation of clouds and visibility.
Ieuan Higgs, Ross Bannister, Jozef Skákala, Alberto Carrassi, and Stefano Ciavatta
EGUsphere, https://doi.org/10.48550/arXiv.2504.05218, https://doi.org/10.48550/arXiv.2504.05218, 2025
Short summary
Short summary
We explored how machine learning can improve computer models that simulate ocean ecosystems. These models help us understand how the ocean works, but they often struggle due to limited observations and complex processes. Our approach uses machine learning to better connect the parts of the system we can observe with those we cannot. This leads to more accurate and efficient predictions, offering a promising way to improve future ocean monitoring and forecasting tools.
Ross Noel Bannister and Chris Wilson
EGUsphere, https://doi.org/10.5194/egusphere-2024-655, https://doi.org/10.5194/egusphere-2024-655, 2024
Preprint archived
Short summary
Short summary
Prior information is essential for the top-down estimation of CH4 surface fluxes. Errors in the prior are correlated in time/space, but accounting for correlations can be costly. We report on an efficient scheme to represent correlations in the inverse modelling system, INVICAT. The method is tested by assimilating CH4 observations using the scheme. Our findings show that accounting for spatio-temporal correlations improve CH4 flux estimates, demonstrating that the method should be further used.
Ieuan Higgs, Jozef Skákala, Ross Bannister, Alberto Carrassi, and Stefano Ciavatta
Biogeosciences, 21, 731–746, https://doi.org/10.5194/bg-21-731-2024, https://doi.org/10.5194/bg-21-731-2024, 2024
Short summary
Short summary
A complex network is a way of representing which parts of a system are connected to other parts. We have constructed a complex network based on an ecosystem–ocean model. From this, we can identify patterns in the structure and areas of similar behaviour. This can help to understand how natural, or human-made, changes will affect the shelf sea ecosystem, and it can be used in multiple future applications such as improving modelling, data assimilation, or machine learning.
Jiangshan Zhu and Ross Noel Bannister
Geosci. Model Dev., 16, 6067–6085, https://doi.org/10.5194/gmd-16-6067-2023, https://doi.org/10.5194/gmd-16-6067-2023, 2023
Short summary
Short summary
We describe how condensation and evaporation are included in the existing (otherwise dry) simplified ABC model. The new model (Hydro-ABC) includes transport of vapour and condensate within a dynamical core, and it transitions between these two phases via a micro-physics scheme. The model shows the development of an anvil cloud and excitation of atmospheric waves over many frequencies. The covariances that develop between variables are also studied together with indicators of convective motion.
Bo Dong, Ross Bannister, Yumeng Chen, Alison Fowler, and Keith Haines
Geosci. Model Dev., 16, 4233–4247, https://doi.org/10.5194/gmd-16-4233-2023, https://doi.org/10.5194/gmd-16-4233-2023, 2023
Short summary
Short summary
Traditional Kalman smoothers are expensive to apply in large global ocean operational forecast and reanalysis systems. We develop a cost-efficient method to overcome the technical constraints and to improve the performance of existing reanalysis products.
Nicholas Williams, Nicholas Byrne, Daniel Feltham, Peter Jan Van Leeuwen, Ross Bannister, David Schroeder, Andrew Ridout, and Lars Nerger
The Cryosphere, 17, 2509–2532, https://doi.org/10.5194/tc-17-2509-2023, https://doi.org/10.5194/tc-17-2509-2023, 2023
Short summary
Short summary
Observations show that the Arctic sea ice cover has reduced over the last 40 years. This study uses ensemble-based data assimilation in a stand-alone sea ice model to investigate the impacts of assimilating three different kinds of sea ice observation, including the novel assimilation of sea ice thickness distribution. We show that assimilating ice thickness distribution has a positive impact on thickness and volume estimates within the ice pack, especially for very thick ice.
Ewan Pinnington, Javier Amezcua, Elizabeth Cooper, Simon Dadson, Rich Ellis, Jian Peng, Emma Robinson, Ross Morrison, Simon Osborne, and Tristan Quaife
Hydrol. Earth Syst. Sci., 25, 1617–1641, https://doi.org/10.5194/hess-25-1617-2021, https://doi.org/10.5194/hess-25-1617-2021, 2021
Short summary
Short summary
Land surface models are important tools for translating meteorological forecasts and reanalyses into real-world impacts at the Earth's surface. We show that the hydrological predictions, in particular soil moisture, of these models can be improved by combining them with satellite observations from the NASA SMAP mission to update uncertain parameters. We find a 22 % reduction in error at a network of in situ soil moisture sensors after combining model predictions with satellite observations.
Cited articles
Amezcua, J., Ide, K., Bishop, C. H., and Kalnay, E.: Ensemble clustering in
deterministic ensemble Kalman filters, Tellus A, 64, 18039, https://doi.org/10.3402/tellusa.v64i0.18039, 2012. a
Asch, M., Bocquet, M., and Nodet, M.: Data Assimilation: Methods, Algorithms,
and Applications, Fundamentals of Algorithms, SIAM, Society for Industrial
and Applied Mathematics,
https://books.google.co.uk/books?id=A3Q6vgAACAAJ (last access: 20 February 2022), 2016. a
Bannister, R. N.: A review of forecast error covariance statistics in
atmospheric variational data assimilation. I: Characteristics and
measurements of forecast error covariances, Q. J. Roy.
Meteor. Soc. A, 134, 1951–1970, 2008a. a
Bannister, R. N.: A review of forecast error covariance statistics in
atmospheric variational data assimilation. II: Modelling the forecast
error covariance statistics, Q. J. Roy. Meteor.
Soc. A, 134, 1971–1996, 2008b. a
Bannister, R. N.: ABC-DA_1.4da: Data assimilation for ABC model, Zenodo [code], https://doi.org/10.5281/zenodo.3531926, 2019. a
Bannister, R. N.: The ABC-DA system (v1.4): a variational data assimilation system for convective-scale assimilation research with a study of the impact of a balance constraint, Geosci. Model Dev., 13, 3789–3816, https://doi.org/10.5194/gmd-13-3789-2020, 2020. a, b, c, d, e, f, g, h, i, j, k, l, m, n, o, p, q
Bannister, R. N.: Balance conditions in variational data assimilation for a
high-resolution forecast model, Q. J. Roy. Meteor.
Soc., https://doi.org/10.1002/qj.4106, 2021. a
Bédard, J., Caron, J.-F., Buehner, M., Baek, S.-J., and Fillion, L.: Hybrid
Background Error Covariances for a Limited-Area Deterministic Weather
Prediction System, Weather Forecast., 35, 1051–1066, 2020. a
Berre, L., Ştefaănescu, S. E., and Pereira, M. B.: The
representation of the analysis effect in three error simulation techniques,
Tellus A, 58, 196–209, 2006. a
Bishop, C. H., Etherton, B. J., and Majumdar, S. J.: Adaptive sampling with the
ensemble transform Kalman filter. Part I: Theoretical aspects, Mon.
Weather Rev., 129, 420–436, 2001. a
Buizza, R., Tribbia, J., Molteni, F., and Palmer, T.: Computation of optimal
unstable structures for a numerical weather prediction model, Tellus A, 45,
388–407, 1993. a
Evensen, G.: Sequential data assimilation with a nonlinear quasi-geostrophic
model using Monte Carlo methods to forecast error statistics, J.
Geophys. Res.-Oceans, 99, 10143–10162, 1994. a
Evensen, G.: Data Assimilation: The Ensemble Kalman Filter, Springer
Berlin Heidelberg,
https://books.google.co.uk/books?id=VJ2oOecHhOYC (last access: 20 February 2022), 2006. a
Fortin, V., Abaza, M., Anctil, F., and Turcotte, R.: Why should ensemble spread
match the RMSE of the ensemble mean?, J. Hydrometeorol., 15,
1708–1713, 2014. a
Goodliff, M., Amezcua, J., and Van Leeuwen, P. J.: Comparing hybrid data
assimilation methods on the Lorenz 1963 model with increasing
non-linearity, Tellus A, 67, 26928, https://doi.org/10.3402/tellusa.v67.26928,
2015. a
Hamill, T. M., Whitaker, J. S., and Snyder, C.: Distance-dependent filtering of
background error covariance estimates in an ensemble Kalman filter, Mon.
Weather Rev., 129, 2776–2790, 2001. a
Heng, B. P., Tubbs, R., Huang, X.-Y., Macpherson, B., Barker, D. M., Boyd, D. F., Kelly, G., North, R., Stewart, L., Webster, S., and Wlasak, M.: SINGV-DA:
A data assimilation system for convective-scale numerical weather
prediction over Singapore, Q. J. Roy. Meteor.
Soc., 146, 1923–1938, 2020. a
Houtekamer, P. and Derome, J.: Methods for ensemble prediction, Mon. Weather
Rev., 123, 2181–2196, 1995. a
Houtekamer, P. L. and Mitchell, H. L.: A sequential ensemble Kalman filter
for atmospheric data assimilation, Mon. Weather Rev., 129, 123–137,
2001. a
Ingleby, N. B.: The statistical structure of forecast errors and its
representation in the Met. Office global 3-D variational data
assimilation scheme, Q. J. Roy. Meteor. Soc.,
127, 209–231, 2001. a
Lee, J. C. K. and Bannister, R. N.: ABC-DA_1.5da_hybrid,
Zenodo [code], https://doi.org/10.5281/zenodo.6646951, 2022. a
Kalnay, E.: Atmospheric modeling, data assimilation and predictability,
Cambridge university press, 2003. a
Leutbecher, M.: Diagnosis of ensemble forecasting systems, in: Seminar on
Diagnosis of Forecasting and Data Assimilation Systems, 235–266, 2009. a
Montmerle, T., Michel, Y., Arbogast, E., Ménétrier, B., and Brousseau,
P.: A 3D ensemble variational data assimilation scheme for the limited-area
AROME model: Formulation and preliminary results, Q. J.
Roy. Meteor. Soc., 144, 2196–2215, 2018. a
Parrish, D. F. and Derber, J. C.: The National Meteorological Center's
spectral statistical-interpolation analysis system, Mon. Weather Rev.,
120, 1747–1763, 1992. a
Penny, S. G.: The hybrid local ensemble transform Kalman filter, Mon.
Weather Rev., 142, 2139–2149, 2014. a
Toth, Z. and Kalnay, E.: Ensemble forecasting at NCEP and the breeding
method, Mon. Weather Rev., 125, 3297–3319, 1997. a
Wang, X., Snyder, C., and Hamill, T. M.: On the theoretical equivalence of
differently proposed ensemble–3DVAR hybrid analysis schemes, Mon.
Weather Rev., 135, 222–227, 2007. a
Wang, X., Barker, D. M., Snyder, C., and Hamill, T. M.: A hybrid
ETKF–3DVAR data assimilation scheme for the WRF model. Part II:
Real observation experiments, Mon. Weather Rev., 136, 5132–5147,
2008b. a
Short summary
In this article, we implement a novel data assimilation method for the ABC–DA system which combines traditional data assimilation approaches in a hybrid approach. We document the technical development and test the hybrid approach in idealised experiments within a tropical framework of the ABC–DA system. Our findings indicate that the hybrid approach outperforms individual traditional approaches. Its potential benefits have been highlighted and should be explored further within this framework.
In this article, we implement a novel data assimilation method for the ABC–DA system which...
