Articles | Volume 14, issue 9
https://doi.org/10.5194/gmd-14-5623-2021
© Author(s) 2021. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
https://doi.org/10.5194/gmd-14-5623-2021
© Author(s) 2021. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
Combining ensemble Kalman filter and reservoir computing to predict spatiotemporal chaotic systems from imperfect observations and models
Futo Tomizawa
CORRESPONDING AUTHOR
School of Engineering, the University of Tokyo, Tokyo, Japan
Yohei Sawada
School of Engineering, the University of Tokyo, Tokyo, Japan
Meteorological Research Institute, Japan Meteorological Agency,
Tsukuba, Japan
RIKEN Center for Computational Science, Kobe, Japan
Related authors
No articles found.
Sneha Kulkarni, Yohei Sawada, Yared Bayissa, and Brian Wardlow
Hydrol. Earth Syst. Sci., 29, 4341–4370, https://doi.org/10.5194/hess-29-4341-2025, https://doi.org/10.5194/hess-29-4341-2025, 2025
Short summary
Short summary
How drought impacts communities is complex and not yet fully understood. We examined a disaster dataset and compared various drought measures to pinpoint affected regions. Our new combined drought indicator (CDI) was found to be the most effective in identifying drought events compared to other traditional drought indices. This underscores the CDI's importance in evaluating drought risks and directing attention to the most impacted areas.
Yohei Sawada
EGUsphere, https://doi.org/10.48550/arXiv.2403.06371, https://doi.org/10.48550/arXiv.2403.06371, 2024
Preprint archived
Short summary
Short summary
It is generally difficult to control large-scale and complex systems, such as Earth systems, using small forces. In this paper, a new method to control such systems is proposed. The new method is inspired by the similarity between simulation-observation integration methods in geoscience and model predictive control theory in control engineering. The proposed method is particularly suitable to find the efficient strategies of weather modification.
Le Duc and Yohei Sawada
Hydrol. Earth Syst. Sci., 27, 1827–1839, https://doi.org/10.5194/hess-27-1827-2023, https://doi.org/10.5194/hess-27-1827-2023, 2023
Short summary
Short summary
The Nash–Sutcliffe efficiency (NSE) is a widely used score in hydrology, but it is not common in the other environmental sciences. One of the reasons for its unpopularity is that its scientific meaning is somehow unclear in the literature. This study attempts to establish a solid foundation for NSE from the viewpoint of signal progressing. This approach is shown to yield profound explanations to many open problems related to NSE. A generalized NSE that can be used in general cases is proposed.
Yuya Kageyama and Yohei Sawada
Hydrol. Earth Syst. Sci., 26, 4707–4720, https://doi.org/10.5194/hess-26-4707-2022, https://doi.org/10.5194/hess-26-4707-2022, 2022
Short summary
Short summary
This study explores the link between hydrometeorological droughts and their socioeconomic impact at a subnational scale based on the newly developed disaster dataset with subnational location information. Hydrometeorological drought-prone areas were generally consistent with socioeconomic drought-prone areas in the disaster dataset. Our analysis clarifies the importance of the use of subnational disaster information.
Yohei Sawada, Rin Kanai, and Hitomu Kotani
Hydrol. Earth Syst. Sci., 26, 4265–4278, https://doi.org/10.5194/hess-26-4265-2022, https://doi.org/10.5194/hess-26-4265-2022, 2022
Short summary
Short summary
Although flood early warning systems (FEWS) are promising, they inevitably issue false alarms. Many false alarms undermine the credibility of FEWS, which we call a cry wolf effect. Here, we present a simple model that can simulate the cry wolf effect. Our model implies that the cry wolf effect is important if a community is heavily protected by infrastructure and few floods occur. The cry wolf effects get more important as the natural scientific skill to predict flood events is improved.
Yohei Sawada and Risa Hanazaki
Hydrol. Earth Syst. Sci., 24, 4777–4791, https://doi.org/10.5194/hess-24-4777-2020, https://doi.org/10.5194/hess-24-4777-2020, 2020
Short summary
Short summary
In socio-hydrology, human–water interactions are investigated. Researchers have two major methodologies in socio-hydrology, namely mathematical modeling and empirical data analysis. Here we propose a new method for bringing the synergic effect of models and data to socio-hydrology. We apply sequential data assimilation, which has been widely used in geoscience, to a flood risk model to analyze the human–flood interactions by model–data integration.
Cited articles
Asanjan, A., Yang, T., Hsu, K., Sorooshian, S., Lin, J., and Peng, Q.:
Short-Term Precipitation Forecast Based on the PERSIANN System and LSTM
Recurrent Neural Networks, J. Geophys. Res.-Atmos., 123, 12543–12563,
https://doi.org/10.1029/2018JD028375, 2018.
Bannister, R. N.: A review of operational methods of variational and
ensemble-variational data assimilation, Q. J. Roy. Meteor. Soc., 143,
607–633, https://doi.org/10.1002/qj.2982, 2017.
Bocquet, M. and Sakov, P.: Joint state and parameter estimation with an iterative ensemble Kalman smoother, Nonlin. Processes Geophys., 20, 803–818, https://doi.org/10.5194/npg-20-803-2013, 2013.
Bocquet, M., Brajard, J., Carrassi, A., and Bertino, L.: Data assimilation as a learning tool to infer ordinary differential equation representations of dynamical models, Nonlin. Processes Geophys., 26, 143–162, https://doi.org/10.5194/npg-26-143-2019, 2019.
Bocquet, M., Farchi, A., and Malartic, Q.: Online learning of both state and
dynamics using ensemble Kalman filters, Found. Data Sci.,
https://doi.org/10.3934/fods.2020015, 2020.
Brajard, J., Carrassi, A., Bocquet, M., and Bertino, L.: Combining data
assimilation and machine learning to emulate a dynamical model from sparse
and noisy observations: a case study with the Lorenz 96 model, J. Comput.
Sci., 44, 101171, https://doi.org/10.1016/j.jocs.2020.101171, 2020.
Chattopadhyay, A., Hassanzadeh, P., and Subramanian, D.: Data-driven predictions of a multiscale Lorenz 96 chaotic system using machine-learning methods: reservoir computing, artificial neural network, and long short-term memory network, Nonlin. Processes Geophys., 27, 373–389, https://doi.org/10.5194/npg-27-373-2020, 2020.
Dueben, P. D. and Bauer, P.: Challenges and design choices for global weather and climate models based on machine learning, Geosci. Model Dev., 11, 3999–4009, https://doi.org/10.5194/gmd-11-3999-2018, 2018.
Hochreiter, S. and Schmidhuber, J.: Long Short-Term Memory, Neural Comput.,
9, 1735–1780, https://doi.org/10.1162/neco.1997.9.8.1735, 1997.
Houtekamer, P. L. and Zhang, F.: Review of the ensemble Kalman filter for
atmospheric data assimilation, Mon. Weather Rev., 144, 4489–4532,
https://doi.org/10.1175/MWR-D-15-0440.1, 2016.
Hunt, B. R., Kostelich, E. J., and Szunyogh, I.: Efficient data assimilation
for spatiotemporal chaos: A local ensemble transform Kalman filter, Phys. D
Nonlinear Phenom., 230, 112–126, https://doi.org/10.1016/j.physd.2006.11.008,
2007.
Jaeger, H. and Haas, H.: Harnessing Nonlinearity: Predicting Chaotic Systems
and Saving Energy in Wireless Communication, Science, 304,
78–80, 2004.
Jiang, J. and Lai, Y.-C.: Model-free prediction of spatiotemporal dynamical
systems with recurrent neural networks: Role of network spectral radius,
Phys. Rev. Res., 1, 33056, https://doi.org/10.1103/physrevresearch.1.033056, 2019.
Karniadakis, G. E., Kevrekidis, I. G., Lu, L., Perdikaris, P., Wang, S., and
Yang, L.: Physics-?informed machine learning, Nat. Rev. Phys., 3, 422–440,
https://doi.org/10.1038/s42254-021-00314-5, 2021.
Kotsuki, S., Greybush, S. J., and Miyoshi, T.: Can we optimize the
assimilation order in the serial ensemble Kalman filter? A study with the
Lorenz-96 model, Mon. Weather Rev., 145, 4977–4995,
https://doi.org/10.1175/MWR-D-17-0094.1, 2017.
Lorenz, E. N. and Emanuel, K. A.: Optimal sites for supplementary weather
observations: Simulation with a small model, J. Atmos. Sci., 55,
399–414, https://doi.org/10.1175/1520-0469(1998)055<0399:OSFSWO>2.0.CO;2, 1998.
Lu, Z., Pathak, J., Hunt, B., Girvan, M., Brockett, R., and Ott, E.:
Reservoir observers: Model-free inference of unmeasured variables in chaotic
systems, Chaos, 27, 041102, https://doi.org/10.1063/1.4979665, 2017.
Miyoshi, T.: Ensemble kalman filter experiments with a primitive-equation
global model, PhD Diss. Univ. Maryland, Coll. Park, 197 pp., 2005.
Miyoshi, T.: Source code for Local Ensemble Transform Kalman Filter, github [code], available at: https://github.com/takemasa-miyoshi/letkf, last access: 2016.
Miyoshi, T. and Yamane, S.: Local ensemble transform Kalman filtering with
an AGCM at a T159/L48 resolution, Mon. Weather Rev., 135, 3841–3861,
https://doi.org/10.1175/2007MWR1873.1, 2007.
Nguyen, D. H. and Bae, D. H.: Correcting mean areal precipitation forecasts
to improve urban flooding predictions by using long short-term memory
network, J. Hydrol., 584, 124710,
https://doi.org/10.1016/j.jhydrol.2020.124710, 2020.
Pathak, J., Lu, Z., Hunt, B. R., Girvan, M., and Ott, E.: Using machine
learning to replicate chaotic attractors and calculate Lyapunov exponents
from data, Chaos, 27, 121102, https://doi.org/10.1063/1.5010300, 2017.
Pathak, J., Wikner, A., Fussell, R., Chandra, S., Hunt, B. R., Girvan, M.
and Ott, E.: Hybrid forecasting of chaotic processes: Using machine learning
in conjunction with a knowledge-based model, Chaos, 28, 041101,
https://doi.org/10.1063/1.5028373, 2018a.
Pathak, J., Hunt, B., Girvan, M., Lu, Z., and Ott, E.: Model-Free Prediction
of Large Spatiotemporally Chaotic Systems from Data: A Reservoir Computing
Approach, Phys. Rev. Lett., 120, 024102, https://doi.org/10.1103/PhysRevLett.120.024102,
2018b.
Penny, S. G.: The hybrid local ensemble transform Kalman filter, Mon.
Weather Rev., 142, 2139–2149, https://doi.org/10.1175/MWR-D-13-00131.1, 2014.
Raboudi, N. F., Ait-El-Fquih, B., and Hoteit, I.: Ensemble Kalman filtering
with one-step-ahead smoothing, Mon. Weather Rev., 146, 561–581,
https://doi.org/10.1175/MWR-D-17-0175.1, 2018.
Rajendra, P. and Brahmajirao, V.: Modeling of dynamical systems through deep
learning, Biophys. Rev., 12, 1311–1320, https://doi.org/10.1007/s12551-020-00776-4,
2020.
Sawada, Y., Okamoto, K., Kunii, M., and Miyoshi, T.: Assimilating
Every-10-minute Himawari-8 Infrared Radiances to Improve Convective
Predictability, J. Geophys. Res.-Atmos., 124, 2546–2561,
https://doi.org/10.1029/2018JD029643, 2019.
Schraff, C., Reich, H., Rhodin, A., Schomburg, A., Stephan, K.,
Periáñez, A., and Potthast, R.: Kilometre-scale ensemble data
assimilation for the COSMO model (KENDA), Q. J. Roy. Meteor. Soc., 142,
1453–1472, https://doi.org/10.1002/qj.2748, 2016.
Tomizawa, F.: f-tomizawa/RC_Analysis_Loren96 v1.0 (v1.0), Zenodo, https://doi.org/10.5281/zenodo.3907291, 2020.
Vlachas, P. R., Byeon, W., Wan, Z. Y., Sapsis, T. P., and Koumoutsakos, P.:
Data-driven forecasting of high-dimensional chaotic systems with long
short-Term memory networks, Proc. R. Soc. A Math. Phys. Eng. Sci.,
474, 20170844, https://doi.org/10.1098/rspa.2017.0844, 2018.
Vlachas, P. R., Pathak, J., Hunt, B. R., Sapsis, T. P., Girvan, M., Ott, E.,
and Koumoutsakos, P.: Backpropagation algorithms and Reservoir Computing in
Recurrent Neural Networks for the forecasting of complex spatiotemporal
dynamics, Neural Networks, 126, 191–217, https://doi.org/10.1016/j.neunet.2020.02.016,
2020.
Weyn, J. A., Durran, D. R., and Caruana, R.: Can Machines Learn to Predict
Weather? Using Deep Learning to Predict Gridded 500-hPa Geopotential Height
From Historical Weather Data, J. Adv. Model. Earth Syst., 11, 2680–2693,
https://doi.org/10.1029/2019MS001705, 2019.
Wikner, A., Pathak, J., Hunt, B., Girvan, M., Arcomano, T., Szunyogh, I.,
Pomerance, A., and Ott, E.: Combining machine learning with knowledge-based
modeling for scalable forecasting and subgrid-scale closure of large,
complex, spatiotemporal systems, Chaos, 30, 053111, https://doi.org/10.1063/5.0005541, 2020.
Yokota, S., Seko, H., Kunii, M., Yamauchi, H., and Sato, E.: Improving
Short-Term Rainfall Forecasts by Assimilating Weather Radar Reflectivity
Using Additive Ensemble Perturbations, J. Geophys. Res.-Atmos., 123,
9047–9062, https://doi.org/10.1029/2018JD028723, 2018.
Zhang, F., Minamide, M., and Clothiaux, E. E.: Potential impacts of
assimilating all-sky infrared satellite radiances from GOES-R on
convection-permitting analysis and prediction of tropical cyclones, Geophys.
Res. Lett., 43, 2954–2963, https://doi.org/10.1002/2016GL068468, 2016.
Short summary
A new method to predict chaotic systems from observation and process-based models is proposed by combining machine learning with data assimilation. Our method is robust to the sparsity of observation networks and can predict more accurately than a process-based model when it is biased. Our method effectively works when both observations and models are imperfect, which is often the case in geoscience. Therefore, our method is useful to solve a wide variety of prediction problems in this field.
A new method to predict chaotic systems from observation and process-based models is proposed by...