Articles | Volume 15, issue 22
https://doi.org/10.5194/gmd-15-8325-2022
© Author(s) 2022. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
https://doi.org/10.5194/gmd-15-8325-2022
© Author(s) 2022. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
Development and technical paper
| 
18 Nov 2022
Development and technical paper |
| 18 Nov 2022
| 18 Nov 2022
A local particle filter and its Gaussian mixture extension implemented with minor modifications to the LETKF
Shunji Kotsuki
CORRESPONDING AUTHOR
RIKEN Center for Computational Science, Kobe, Japan
Center for Environmental Remote Sensing, Chiba University, Chiba,
Japan
PRESTO, Japan Science and Technology Agency, Chiba, Japan
Takemasa Miyoshi
CORRESPONDING AUTHOR
RIKEN Center for Computational Science, Kobe, Japan
RIKEN Interdisciplinary Theoretical and Mathematical Sciences Program,
Kobe, Japan
RIKEN Cluster for Pioneering Research, Kobe, Japan
Japan Agency for Marine-Earth Science and Technology, Yokohama, Japan
Department of Atmospheric and Oceanic Science, University of Maryland,
College Park, Maryland, USA
Keiichi Kondo
Meteorological Research Institute, Japan Meteorological Agency,
Tsukuba, Japan
RIKEN Center for Computational Science, Kobe, Japan
Roland Potthast
Deutscher Wetterdienst, Offenbach, Germany
Applied Mathematics, University of Reading, Reading, UK
Related authors
Rikuto Nagai, Yang Bai, Masaki Ogura, Shunji Kotsuki, and Naoki Wakamiya
Nonlin. Processes Geophys., 32, 281–292, https://doi.org/10.5194/npg-32-281-2025, https://doi.org/10.5194/npg-32-281-2025, 2025
Short summary
Short summary
Controlling chaotic systems is a key step toward weather control. The control simulation experiment (CSE) modifies weather systems using small perturbations, as shown in studies with the Lorenz-63 model. However, the effectiveness of CSE compared to other methods is unclear. This study evaluates CSE against model predictive control (MPC). Simulations reveal that MPC achieves higher success rates with less effort under certain conditions, linking control theory and atmospheric science.
Fumitoshi Kawasaki, Atsushi Okazaki, Kenta Kurosawa, Tadashi Tsuyuki, and Shunji Kotsuki
EGUsphere, https://doi.org/10.5194/egusphere-2025-1785, https://doi.org/10.5194/egusphere-2025-1785, 2025
Short summary
Short summary
A major challenge in weather control aimed at mitigating extreme weather events is identifying effective control inputs under limited computational resources. This study proposes a novel control framework called model predictive control with foreseeing horizon, designed to efficiently control chaotic dynamical systems. Using a 40-variable chaotic dynamical model, the proposed method successfully mitigated extreme events and reduced computational cost compared to the conventional approach.
Pascal Oettli, Keita Tokuda, Yusuke Imoto, and Shunji Kotsuki
EGUsphere, https://doi.org/10.5194/egusphere-2025-1458, https://doi.org/10.5194/egusphere-2025-1458, 2025
This preprint is open for discussion and under review for Geoscientific Model Development (GMD).
Short summary
Short summary
A tropical cyclone is a circular air movement that emerges over warm waters of the tropical ocean and its movement is guided by complex interactions between the ocean and the atmosphere. To better understand this complexity, we adopted ideas and techniques from biology and bioinformatics, to have a fresh look at this matter. This led to the creation of "MeteoScape," a tool that calculates the probability of paths for tropical cyclones can take and visualize them in an understandable way.
Atsushi Okazaki, Diego Carrio, Quentin Dalaiden, Jarrah Harrison-Lofthouse, Shunji Kotsuki, and Kei Yoshimura
EGUsphere, https://doi.org/10.5194/egusphere-2025-1389, https://doi.org/10.5194/egusphere-2025-1389, 2025
Short summary
Short summary
Data assimilation (DA) has been used to reconstruct paleoclimate fields. DA integrates model simulations and climate proxies based on their error sizes. Consequently, error information is vital for DA to function optimally. This study estimated observation errors using "innovation statistics" and demonstrated DA with estimated errors outperformed previous studies.
Takahito Mitsui, Shunji Kotsuki, Naoya Fujiwara, Atsushi Okazaki, and Keita Tokuda
EGUsphere, https://doi.org/10.5194/egusphere-2025-987, https://doi.org/10.5194/egusphere-2025-987, 2025
Short summary
Short summary
Extreme weather poses serious risks, making prevention crucial. Using the Lorenz 96 model as a testbed, we propose a bottom-up approach to mitigate extreme events via local interventions guided by multi-scenario ensemble forecasts. Unlike control-theoretic methods, our approach selects the best control scenario from available options. Achieving up to 99.4 % success, it outperforms previous methods while keeping costs reasonable, offering a practical way to reduce disasters with limited control.
Kenta Kurosawa, Atsushi Okazaki, Fumitoshi Kawasaki, and Shunji Kotsuki
EGUsphere, https://doi.org/10.5194/egusphere-2025-595, https://doi.org/10.5194/egusphere-2025-595, 2025
Short summary
Short summary
We propose Ensemble Model Predictive Control (EnMPC), a novel method that improves control of complex systems like weather by integrating control theory with data assimilation. Unlike traditional methods, which are computationally expensive, EnMPC uses ensemble simulations to efficiently handle uncertainties and optimize solutions. This approach reduces computational cost while maintaining accuracy, making it a promising step toward real-world applications in dynamic system control.
Yuka Muto and Shunji Kotsuki
Hydrol. Earth Syst. Sci., 28, 5401–5417, https://doi.org/10.5194/hess-28-5401-2024, https://doi.org/10.5194/hess-28-5401-2024, 2024
Short summary
Short summary
It is crucial to improve global precipitation estimates to understand water-related disasters and water resources. This study proposes a new methodology to interpolate global precipitation fields from ground rain gauge observations using ensemble data assimilation and the precipitation of a numerical weather prediction model. Our estimates agree better with independent rain gauge observations than existing precipitation estimates, especially in mountainous or rain-gauge-sparse regions.
Shunji Kotsuki, Kenta Shiraishi, and Atsushi Okazaki
EGUsphere, https://doi.org/10.48550/arXiv.2407.17781, https://doi.org/10.48550/arXiv.2407.17781, 2024
Short summary
Short summary
Artificial intelligence (AI) is playing a bigger role in weather forecasting, often competing with physical models. However, combining AI models with data assimilation, a process that improves weather forecasts by incorporating observation data, is still relatively unexplored. This study explored coupling ensemble data assimilation with an AI weather prediction model ClimaX, succeeded in employing weather forecasts stably by applying techniques conventionally used for physical models.
Fumitoshi Kawasaki and Shunji Kotsuki
Nonlin. Processes Geophys., 31, 319–333, https://doi.org/10.5194/npg-31-319-2024, https://doi.org/10.5194/npg-31-319-2024, 2024
Short summary
Short summary
Recently, scientists have been looking into ways to control the weather to lead to a desirable direction for mitigating weather-induced disasters caused by torrential rainfall and typhoons. This study proposes using the model predictive control (MPC), an advanced control method, to control a chaotic system. Through numerical experiments using a low-dimensional chaotic system, we demonstrate that the system can be successfully controlled with shorter forecasts compared to previous studies.
Toshiyuki Ohtsuka, Atsushi Okazaki, Masaki Ogura, and Shunji Kotsuki
EGUsphere, https://doi.org/10.48550/arXiv.2405.19546, https://doi.org/10.48550/arXiv.2405.19546, 2024
Preprint withdrawn
Short summary
Short summary
We utilize weather forecasts in the reverse direction and determine how much we should change the temperature or humidity of the atmosphere at a certain time to change the future rainfall as desired. Even though a weather phenomenon is complicated, we can superimpose the effects of small changes in the atmosphere and find suitable small changes to realize desirable rainfall by solving an optimization problem. We examine this idea on a realistic weather simulator and show it is promising.
Shunji Kotsuki, Fumitoshi Kawasaki, and Masanao Ohashi
Nonlin. Processes Geophys., 31, 237–245, https://doi.org/10.5194/npg-31-237-2024, https://doi.org/10.5194/npg-31-237-2024, 2024
Short summary
Short summary
In Earth science, data assimilation plays an important role in integrating real-world observations with numerical simulations for improving subsequent predictions. To overcome the time-consuming computations of conventional data assimilation methods, this paper proposes using quantum annealing machines. Using the D-Wave quantum annealer, the proposed method found solutions with comparable accuracy to conventional approaches and significantly reduced computational time.
Kenta Kurosawa, Shunji Kotsuki, and Takemasa Miyoshi
Nonlin. Processes Geophys., 30, 457–479, https://doi.org/10.5194/npg-30-457-2023, https://doi.org/10.5194/npg-30-457-2023, 2023
Short summary
Short summary
This study aimed to enhance weather and hydrological forecasts by integrating soil moisture data into a global weather model. By assimilating atmospheric observations and soil moisture data, the accuracy of forecasts was improved, and certain biases were reduced. The method was found to be particularly beneficial in areas like the Sahel and equatorial Africa, where precipitation patterns vary seasonally. This new approach has the potential to improve the precision of weather predictions.
Mao Ouyang, Keita Tokuda, and Shunji Kotsuki
Nonlin. Processes Geophys., 30, 183–193, https://doi.org/10.5194/npg-30-183-2023, https://doi.org/10.5194/npg-30-183-2023, 2023
Short summary
Short summary
This research found that weather control would change the chaotic behavior of an atmospheric model. We proposed to introduce chaos theory in the weather control. Experimental results demonstrated that the proposed approach reduced the manipulations, including the control times and magnitudes, which throw light on the weather control in a real atmospheric model.
Rikuto Nagai, Yang Bai, Masaki Ogura, Shunji Kotsuki, and Naoki Wakamiya
Nonlin. Processes Geophys., 32, 281–292, https://doi.org/10.5194/npg-32-281-2025, https://doi.org/10.5194/npg-32-281-2025, 2025
Short summary
Short summary
Controlling chaotic systems is a key step toward weather control. The control simulation experiment (CSE) modifies weather systems using small perturbations, as shown in studies with the Lorenz-63 model. However, the effectiveness of CSE compared to other methods is unclear. This study evaluates CSE against model predictive control (MPC). Simulations reveal that MPC achieves higher success rates with less effort under certain conditions, linking control theory and atmospheric science.
Arata Amemiya and Takemasa Miyoshi
EGUsphere, https://doi.org/10.5194/egusphere-2025-2543, https://doi.org/10.5194/egusphere-2025-2543, 2025
Short summary
Short summary
The accurate estimation of atmospheric state variables from radar observation in rapidly growing deep convection, which causes heavy thunderstorms, is a major challenge. This study examines the advantage of incorporating radar observation data with very high frequency such as 30 seconds compared with the conventional case of 5 minutes, from a theoretical perspective.
Juan Martin Guerrieri, Manuel Arturo Pulido, Takemasa Miyoshi, Arata Amemiya, and Juan José Ruiz
EGUsphere, https://doi.org/10.5194/egusphere-2025-2420, https://doi.org/10.5194/egusphere-2025-2420, 2025
Short summary
Short summary
This work extends the Mapping Particle Filter to account for local dependencies. Two localization methods are tested: a global particle flow with local kernels, and iterative local mappings based on correlation radius. Using a two-scale Lorenz-96 truth and a one-scale forecast model, experiments with full/partial and linear/nonlinear observations show Root Mean Square Error (RMSE) reductions using localized Gaussian mixture priors, achieving competitive performance against Gaussian filters.
Wolfgang A. Müller, Stephan Lorenz, Trang V. Pham, Andrea Schneidereit, Renate Brokopf, Victor Brovkin, Nils Brüggemann, Fatemeh Chegini, Dietmar Dommenget, Kristina Fröhlich, Barbara Früh, Veronika Gayler, Helmuth Haak, Stefan Hagemann, Moritz Hanke, Tatiana Ilyina, Johann Jungclaus, Martin Köhler, Peter Korn, Luis Kornblüh, Clarissa Kroll, Julian Krüger, Karel Castro-Morales, Ulrike Niemeier, Holger Pohlmann, Iuliia Polkova, Roland Potthast, Thomas Riddick, Manuel Schlund, Tobias Stacke, Roland Wirth, Dakuan Yu, and Jochem Marotzke
EGUsphere, https://doi.org/10.5194/egusphere-2025-2473, https://doi.org/10.5194/egusphere-2025-2473, 2025
Short summary
Short summary
ICON XPP is a newly developed Earth System model configuration based on the ICON modeling framework. It merges accomplishments from the recent operational numerical weather prediction model with well-established climate components for the ocean, land and ocean-biogeochemistry. ICON XPP reaches typical targets of a coupled climate simulation, and is able to run long integrations and large-ensemble experiments, making it suitable for climate predictions and projections, and for climate research.
Fumitoshi Kawasaki, Atsushi Okazaki, Kenta Kurosawa, Tadashi Tsuyuki, and Shunji Kotsuki
EGUsphere, https://doi.org/10.5194/egusphere-2025-1785, https://doi.org/10.5194/egusphere-2025-1785, 2025
Short summary
Short summary
A major challenge in weather control aimed at mitigating extreme weather events is identifying effective control inputs under limited computational resources. This study proposes a novel control framework called model predictive control with foreseeing horizon, designed to efficiently control chaotic dynamical systems. Using a 40-variable chaotic dynamical model, the proposed method successfully mitigated extreme events and reduced computational cost compared to the conventional approach.
Pascal Oettli, Keita Tokuda, Yusuke Imoto, and Shunji Kotsuki
EGUsphere, https://doi.org/10.5194/egusphere-2025-1458, https://doi.org/10.5194/egusphere-2025-1458, 2025
This preprint is open for discussion and under review for Geoscientific Model Development (GMD).
Short summary
Short summary
A tropical cyclone is a circular air movement that emerges over warm waters of the tropical ocean and its movement is guided by complex interactions between the ocean and the atmosphere. To better understand this complexity, we adopted ideas and techniques from biology and bioinformatics, to have a fresh look at this matter. This led to the creation of "MeteoScape," a tool that calculates the probability of paths for tropical cyclones can take and visualize them in an understandable way.
Atsushi Okazaki, Diego Carrio, Quentin Dalaiden, Jarrah Harrison-Lofthouse, Shunji Kotsuki, and Kei Yoshimura
EGUsphere, https://doi.org/10.5194/egusphere-2025-1389, https://doi.org/10.5194/egusphere-2025-1389, 2025
Short summary
Short summary
Data assimilation (DA) has been used to reconstruct paleoclimate fields. DA integrates model simulations and climate proxies based on their error sizes. Consequently, error information is vital for DA to function optimally. This study estimated observation errors using "innovation statistics" and demonstrated DA with estimated errors outperformed previous studies.
Takahito Mitsui, Shunji Kotsuki, Naoya Fujiwara, Atsushi Okazaki, and Keita Tokuda
EGUsphere, https://doi.org/10.5194/egusphere-2025-987, https://doi.org/10.5194/egusphere-2025-987, 2025
Short summary
Short summary
Extreme weather poses serious risks, making prevention crucial. Using the Lorenz 96 model as a testbed, we propose a bottom-up approach to mitigate extreme events via local interventions guided by multi-scenario ensemble forecasts. Unlike control-theoretic methods, our approach selects the best control scenario from available options. Achieving up to 99.4 % success, it outperforms previous methods while keeping costs reasonable, offering a practical way to reduce disasters with limited control.
Michael Goodliff and Takemasa Miyoshi
EGUsphere, https://doi.org/10.5194/egusphere-2025-933, https://doi.org/10.5194/egusphere-2025-933, 2025
Short summary
Short summary
Data-driven models (DDMs) learn from large datasets to make predictions, but data limitations affect reliability. Data assimilation (DA) improves accuracy by combining real-world observations with computational models. This research explores how DA enhances DDMs despite limited data. We propose an algorithm using DA to refine DDM training iteratively. This work has broad implications for fields like meteorology, engineering, and environmental science, where accurate prediction is critical.
Kenta Kurosawa, Atsushi Okazaki, Fumitoshi Kawasaki, and Shunji Kotsuki
EGUsphere, https://doi.org/10.5194/egusphere-2025-595, https://doi.org/10.5194/egusphere-2025-595, 2025
Short summary
Short summary
We propose Ensemble Model Predictive Control (EnMPC), a novel method that improves control of complex systems like weather by integrating control theory with data assimilation. Unlike traditional methods, which are computationally expensive, EnMPC uses ensemble simulations to efficiently handle uncertainties and optimize solutions. This approach reduces computational cost while maintaining accuracy, making it a promising step toward real-world applications in dynamic system control.
Yuka Muto and Shunji Kotsuki
Hydrol. Earth Syst. Sci., 28, 5401–5417, https://doi.org/10.5194/hess-28-5401-2024, https://doi.org/10.5194/hess-28-5401-2024, 2024
Short summary
Short summary
It is crucial to improve global precipitation estimates to understand water-related disasters and water resources. This study proposes a new methodology to interpolate global precipitation fields from ground rain gauge observations using ensemble data assimilation and the precipitation of a numerical weather prediction model. Our estimates agree better with independent rain gauge observations than existing precipitation estimates, especially in mountainous or rain-gauge-sparse regions.
Shunji Kotsuki, Kenta Shiraishi, and Atsushi Okazaki
EGUsphere, https://doi.org/10.48550/arXiv.2407.17781, https://doi.org/10.48550/arXiv.2407.17781, 2024
Short summary
Short summary
Artificial intelligence (AI) is playing a bigger role in weather forecasting, often competing with physical models. However, combining AI models with data assimilation, a process that improves weather forecasts by incorporating observation data, is still relatively unexplored. This study explored coupling ensemble data assimilation with an AI weather prediction model ClimaX, succeeded in employing weather forecasts stably by applying techniques conventionally used for physical models.
Klaus Vobig, Roland Potthast, and Klaus Stephan
EGUsphere, https://doi.org/10.5194/egusphere-2024-2876, https://doi.org/10.5194/egusphere-2024-2876, 2024
Short summary
Short summary
We present a novel approach to targeted covariance inflation (TCI) which aims to improve the assimilation of 3D radar reflectivity and, eventually, the short-term forecast of reflectivity and precipitation.
Using an operational numerical weather prediction framework, our numerical results show that TCI makes the system accurately generate new reflectivity cells and significantly improves the fractional skill score of forecasts over lead times of up to six hours by up to 10 %.
Fumitoshi Kawasaki and Shunji Kotsuki
Nonlin. Processes Geophys., 31, 319–333, https://doi.org/10.5194/npg-31-319-2024, https://doi.org/10.5194/npg-31-319-2024, 2024
Short summary
Short summary
Recently, scientists have been looking into ways to control the weather to lead to a desirable direction for mitigating weather-induced disasters caused by torrential rainfall and typhoons. This study proposes using the model predictive control (MPC), an advanced control method, to control a chaotic system. Through numerical experiments using a low-dimensional chaotic system, we demonstrate that the system can be successfully controlled with shorter forecasts compared to previous studies.
Toshiyuki Ohtsuka, Atsushi Okazaki, Masaki Ogura, and Shunji Kotsuki
EGUsphere, https://doi.org/10.48550/arXiv.2405.19546, https://doi.org/10.48550/arXiv.2405.19546, 2024
Preprint withdrawn
Short summary
Short summary
We utilize weather forecasts in the reverse direction and determine how much we should change the temperature or humidity of the atmosphere at a certain time to change the future rainfall as desired. Even though a weather phenomenon is complicated, we can superimpose the effects of small changes in the atmosphere and find suitable small changes to realize desirable rainfall by solving an optimization problem. We examine this idea on a realistic weather simulator and show it is promising.
Shunji Kotsuki, Fumitoshi Kawasaki, and Masanao Ohashi
Nonlin. Processes Geophys., 31, 237–245, https://doi.org/10.5194/npg-31-237-2024, https://doi.org/10.5194/npg-31-237-2024, 2024
Short summary
Short summary
In Earth science, data assimilation plays an important role in integrating real-world observations with numerical simulations for improving subsequent predictions. To overcome the time-consuming computations of conventional data assimilation methods, this paper proposes using quantum annealing machines. Using the D-Wave quantum annealer, the proposed method found solutions with comparable accuracy to conventional approaches and significantly reduced computational time.
Florian Baur, Leonhard Scheck, Christina Stumpf, Christina Köpken-Watts, and Roland Potthast
Atmos. Meas. Tech., 16, 5305–5326, https://doi.org/10.5194/amt-16-5305-2023, https://doi.org/10.5194/amt-16-5305-2023, 2023
Short summary
Short summary
Near-infrared satellite images have information on clouds that is complementary to what is available from the visible and infrared parts of the spectrum. Using this information for data assimilation and model evaluation requires a fast, accurate forward operator to compute synthetic images from numerical weather prediction model output. We discuss a novel, neural-network-based approach for the 1.6 µm near-infrared channel that is suitable for this purpose and also works for other solar channels.
Kenta Kurosawa, Shunji Kotsuki, and Takemasa Miyoshi
Nonlin. Processes Geophys., 30, 457–479, https://doi.org/10.5194/npg-30-457-2023, https://doi.org/10.5194/npg-30-457-2023, 2023
Short summary
Short summary
This study aimed to enhance weather and hydrological forecasts by integrating soil moisture data into a global weather model. By assimilating atmospheric observations and soil moisture data, the accuracy of forecasts was improved, and certain biases were reduced. The method was found to be particularly beneficial in areas like the Sahel and equatorial Africa, where precipitation patterns vary seasonally. This new approach has the potential to improve the precision of weather predictions.
Mao Ouyang, Keita Tokuda, and Shunji Kotsuki
Nonlin. Processes Geophys., 30, 183–193, https://doi.org/10.5194/npg-30-183-2023, https://doi.org/10.5194/npg-30-183-2023, 2023
Short summary
Short summary
This research found that weather control would change the chaotic behavior of an atmospheric model. We proposed to introduce chaos theory in the weather control. Experimental results demonstrated that the proposed approach reduced the manipulations, including the control times and magnitudes, which throw light on the weather control in a real atmospheric model.
Qiwen Sun, Takemasa Miyoshi, and Serge Richard
Nonlin. Processes Geophys., 30, 117–128, https://doi.org/10.5194/npg-30-117-2023, https://doi.org/10.5194/npg-30-117-2023, 2023
Short summary
Short summary
This paper is a follow-up of a work by Miyoshi and Sun which was published in NPG Letters in 2022. The control simulation experiment is applied to the Lorenz-96 model for avoiding extreme events. The results show that extreme events of this partially and imperfectly observed chaotic system can be avoided by applying pre-designed small perturbations. These investigations may be extended to more realistic numerical weather prediction models.
Tobias Necker, David Hinger, Philipp Johannes Griewank, Takemasa Miyoshi, and Martin Weissmann
Nonlin. Processes Geophys., 30, 13–29, https://doi.org/10.5194/npg-30-13-2023, https://doi.org/10.5194/npg-30-13-2023, 2023
Short summary
Short summary
This study investigates vertical localization based on a convection-permitting 1000-member ensemble simulation. We derive an empirical optimal localization (EOL) that minimizes sampling error in 40-member sub-sample correlations assuming 1000-member correlations as truth. The results will provide guidance for localization in convective-scale ensemble data assimilation systems.
Shun Ohishi, Takemasa Miyoshi, and Misako Kachi
Geosci. Model Dev., 15, 9057–9073, https://doi.org/10.5194/gmd-15-9057-2022, https://doi.org/10.5194/gmd-15-9057-2022, 2022
Short summary
Short summary
An adaptive observation error inflation (AOEI) method was proposed for atmospheric data assimilation to mitigate erroneous analysis updates caused by large observation-minus-forecast differences for satellite brightness temperature around clear- and cloudy-sky boundaries. This study implemented the AOEI with an ocean data assimilation system, leading to an improvement of analysis accuracy and dynamical balance around the frontal regions with large meridional temperature differences.
Shun Ohishi, Tsutomu Hihara, Hidenori Aiki, Joji Ishizaka, Yasumasa Miyazawa, Misako Kachi, and Takemasa Miyoshi
Geosci. Model Dev., 15, 8395–8410, https://doi.org/10.5194/gmd-15-8395-2022, https://doi.org/10.5194/gmd-15-8395-2022, 2022
Short summary
Short summary
We develop an ensemble-Kalman-filter-based regional ocean data assimilation system in which satellite and in situ observations are assimilated at a daily frequency. We find the best setting for dynamical balance and accuracy based on sensitivity experiments focused on how to inflate the ensemble spread and how to apply the analysis update to the model evolution. This study has a broader impact on more general data assimilation systems in which the initial shocks are a significant issue.
Takemasa Miyoshi and Qiwen Sun
Nonlin. Processes Geophys., 29, 133–139, https://doi.org/10.5194/npg-29-133-2022, https://doi.org/10.5194/npg-29-133-2022, 2022
Short summary
Short summary
The weather is chaotic and hard to predict, but the chaos implies an effective control where a small control signal grows rapidly to make a big difference. This study proposes a control simulation experiment where we apply a small signal to control
naturein a computational simulation. Idealized experiments with a low-order chaotic system show successful results by small control signals of only 3 % of the observation error. This is the first step toward realistic weather simulations.
Juan Ruiz, Guo-Yuan Lien, Keiichi Kondo, Shigenori Otsuka, and Takemasa Miyoshi
Nonlin. Processes Geophys., 28, 615–626, https://doi.org/10.5194/npg-28-615-2021, https://doi.org/10.5194/npg-28-615-2021, 2021
Short summary
Short summary
Effective use of observations with numerical weather prediction models, also known as data assimilation, is a key part of weather forecasting systems. For precise prediction at the scales of thunderstorms, fast nonlinear processes pose a grand challenge because most data assimilation systems are based on linear processes and normal distribution errors. We investigate how, every 30 s, weather radar observations can help reduce the effect of nonlinear processes and nonnormal distributions.
Cited articles
Acevedo, W., Fallah, B., Reich, S., and Cubasch, U.: Assimilation of pseudo-tree-ring-width observations into an atmospheric general circulation model, Clim. Past, 13, 545–557, https://doi.org/10.5194/cp-13-545-2017, 2017.
Ades, M. and van Leeuwen, P. J.: An exploration of the equivalent weights
particle filter, Q. J. Roy. Meteor. Soc., 139, 820–840, https://doi.org/10.1002/qj.1995, 2013.
Ades, M. and van Leeuwen, P. J.: The equivalent-weights particle filter in
a high-dimensional system, Q. J. Roy. Meteor. Soc., 141, 484–503, https://doi.org/10.1002/qj.2370, 2015.
Anderson, J. L.: An Ensemble Adjustment Kalman Filter for Data Assimilation, Mon. Weather Rev., 129, 2884–2903, https://doi.org/10.1175/1520-0493(2001)129<2884:AEAKFF>2.0.CO;2, 2001.
Anderson, J. L. and Anderson, S. L.: A Monte Carlo implementation of the
nonlinear filtering problem to produce ensemble assimilations and forecasts, Mon. Weather Rev., 127, 2741–2758, https://doi.org/10.1175/1520-0493(1999)127<2741:AMCIOT>2.0.CO;2, 1999.
Bengtsson, T., Snyder, C., and Nychka, D.: Toward a nonlinear ensemble
filter for high-dimensional systems, J. Geophys. Res., 108, D24, https://doi.org/10.1029/2002JD002900, 2003.
Bishop, C., Etherton, B., and Majumdar, S.: Adaptive Sampling with the
Ensemble Transform Kalman Filter, Part I: Theoretical Aspects, Mon. Weather Rev., 129, 420–436, https://doi.org/10.1175/1520-0493(2001)129<0420:ASWTET>2.0.CO;2, 2001.
Burgers G., van Leeuwen P. J., and Evensen, G.: Analysis scheme in the
ensemble Kalman filter, Mon. Weather Rev., 126, 1719–1724,
https://doi.org/10.1175/1520-0493(1998)126<1719:ASITEK>2.0.CO;2,
1998.
Compo, G. P., Whitaker, J. S., Sardeshmukh, P. D., Matsui, N. R., Allan, J., Yin, X., Gleason, B. E., Vose, R. S.,
Rutledge, G., Bessemoulin, P., Brönnimann, S., Brunet, M., Crouthamel, R. I., Grant, A. N., Groisman, P. Y., Jones, P. D., Kruk, M. C., Kruger, A. C.,
Marshall, G. J., Maugeri, M. H., Mok, Y., Nordli, Ø., Ross, T. F., Trigo, R. M., Wang, X. L., Woodruff, S. D., and Worley, S. J.: The twentieth century reanalysis project, Q. J. Roy. Meteor. Soc., 137, 1–28, https://doi.org/10.1002/qj.776, 2011.
Corazza, M., Kalnay, E., Patil, D. J., Yang, S.-C., Morss, R., Cai, M., Szunyogh, I., Hunt, B. R., and Yorke, J. A.: Use of the breeding technique to estimate the structure of the analysis “errors of the day”, Nonlin. Processes Geophys., 10, 233–243, https://doi.org/10.5194/npg-10-233-2003, 2003.
Desroziers, G., Berre, L., Chapnik, B., and Poli, P.: Diagnosis of observation,
background and analysis-error statistics in observation space, Q. J. Roy. Meteor. Soc., 131, 3385–3396, https://doi.org/10.1256/qj.05.108, 2005.
Evensen, G.: Sequential data assimilation with a nonlinear quasi-geostrophic
model using Monte Carlo methods to forecast error statistics, J. Geophys.
Res., 99, 10143–10162, https://doi.org/10.1029/94JC00572, 1994.
Farchi, A. and Bocquet, M.: Review article: Comparison of local particle filters and new implementations, Nonlin. Processes Geophys., 25, 765–807, https://doi.org/10.5194/npg-25-765-2018, 2018.
Gordon, N. J., Salmond, D. J., and Smith, A. F.: Novel approach to
nonlinear/non-Gaussian Bayesian state estimation, IEE Proc., 140F, 107–113,
https://doi.org/10.1049/ip-f-2.1993.0015, 1993.
Greybush, S. J., Kalnay, E., Miyoshi, T., Ide, K., and Hunt, B. R.: Balance
and Ensemble Kalman Filter Localization Techniques, Mon. Weather Rev., 139,
511–522, https://doi.org/10.1175/2010MWR3328.1, 2011.
Hoteit, I., Pham, D. T., Triantafyllou, G., and Korres, G.: A new
approximate solution of the optimal nonlinear filter for data assimilation
in meteorology and oceanography, Mon. Weather Rev., 136, 317–334, https://doi.org/10.1175/2007MWR1927.1, 2008.
Houtekamer, P. L. and Mitchell, H. L.: Data assimilation using an ensemble
Kalman filter technique, Mon. Weather Rev., 126, 796–811, https://doi.org/10.1175/1520-0493(1998)126<0796:DAUAEK>2.0.CO;2, 1998.
Houtekamer, P. L. and Zhang, F.: Review of the ensemble Kalman filter for
atmospheric data assimilation, Mon. Weather Rev., 144, 4489–4532, https://doi.org/10.1175/MWR-D-15-0440.1, 2016.
Hunt, B. R., Kostelich, E. J., and Szunyogh, I.: Efficient data assimilation
for spatiotemporal chaos: A local ensemble transform Kalman filter, Physica
D, 230, 112–126, https://doi.org/10.1016/j.physd.2006.11.008, 2007.
Kondo, K. and Miyoshi, T.: Impact of removing covariance localization in an
ensemble Kalman filter: Experiments with 10 240 members using an
intermediate AGCM, Mon. Weather Rev., 144, 4849–4865, https://doi.org/10.1175/MWR-D-15-0388.1, 2016.
Kondo, K. and Miyoshi, T.: Non-Gaussian statistics in global atmospheric dynamics: a study with a 10 240-member ensemble Kalman filter using an intermediate atmospheric general circulation model, Nonlin. Processes Geophys., 26, 211–225, https://doi.org/10.5194/npg-26-211-2019, 2019.
Kondo, K., Miyoshi, T., and Tanaka, H.L.: Parameter sensitivities of the
dual-localization approach in the local ensemble transform Kalman filter,
SOLA, 9, 174–178, https://doi.org/10.2151/sola.2013-039, 2013.
Kong, A., Liu, J. S., and Wong, W. H.: Sequential imputations and Bayesian
missing data problems, J. Am. Stat. Assoc., 89, 278–288, https://doi.org/10.1080/01621459.1994.10476469, 1994.
Kotsuki, S.: Processed data and scripts for visualization of Kotsuki et al. (2022; GMDD), Zenodo [data set], https://doi.org/10.5281/zenodo.6586309, 2022.
Kotsuki, S. and Bishop, H. C.: Implementing Hybrid Background Error
Covariance into the LETKF with Attenuation-based Localization: Experiments
with a Simplified AGCM, Mon. Weather Rev., 150, 283–302, https://doi.org/10.1175/MWR-D-21-0174.1, 2022.
Kotsuki, S., Miyoshi, T., Terasaki, K., Lien, G.-Y., and Kalnay, E.:
Assimilating the global satellite mapping of precipitation data with the
Nonhydrostatic Icosahedral Atmospheric Model (NICAM), J. Geophys. Res., 122,
631–650, https://doi.org/10.1002/2016JD025355, 2017a.
Kotsuki, S., Ota, Y., and Miyoshi, T.: Adaptive covariance relaxation
methods for ensemble data assimilation: experiments in the real atmosphere,
Q. J. Roy. Meteor. Soc., 143, 2001–2015, https://doi.org/10.1002/qj.3060, 2017b.
Kotsuki, S., Kurosawa, K., and Miyoshi, T.: On the Properties of Ensemble
Forecast Sensitivity to Observations, Q. J. Roy. Meteor. Soc., 145,
1897–1914, https://doi.org/10.1002/qj.3534, 2019a.
Kotsuki, S., Terasaki, K., Kanemaru, K., Satoh, M., Kubota, T., and Miyoshi, T.:
Predictability of Record-Breaking Rainfall in Japan in July 2018: Ensemble
Forecast Experiments with the Near-real-time Global Atmospheric Data
Assimilation System NEXRA, SOLA, 15A, 1–7, https://doi.org/10.2151/sola.15A-001, 2019b.
Kotsuki, S., Pensoneault, A., Okazaki, A., and Miyoshi, T.: Weight Structure
of the Local Ensemble Transform Kalman Filter: A Case with an Intermediate
AGCM, Q. J. Roy. Meteor. Soc., 146, 3399–3415, https://doi.org/10.1002/qj.3852, 2020.
Kullback, S. and Leibler, R. A.: On information and sufficiency, Ann. Math.
Statist., 22, 79–86, https://doi.org/10.1214/aoms/1177729694, 1951.
Laloyaux, P., Boisseson, E.,
Balmaseda, M., Bidlot, J.-R., Broennimann, S., Buizza, R., Dalhgren, P., Dee, D., Haimberger, L., Hersbach, H., Kosaka, Y., Martin, M., Poli, P., Rayner, N., Rustemeier, E., and Schepers, D.: CERA-20C: A coupled reanalysis of the twentieth
century, J. Adv. Model. Earth Sy., 10, 1172–1195, https://doi.org/10.1029/2018MS001273, 2018.
Lien, G.-Y., Kalnay, E., and Miyoshi, T.: Effective assimilation of global
precipitation: simulation experiments, Tellus A, 65, 1–16, https://doi.org/10.3402/tellusa.v65i0.19915, 2013.
Lien, G.-Y., Kalnay, E., Miyoshi, T., and Huffman, G. J.: Statistical
Properties of Global Precipitation in the NCEP GFS Model and TMPA
Observations for Data Assimilation, Mon. Weather Rev., 144, 663–679, https://doi.org/10.1175/MWR-D-15-0150.1, 2016.
Lorenz, E.: Predictability – A problem partly solved, Proc. Seminar on
Predictability, 4–8 September 1995, Reading, United Kingdom, ECMWF, 1–18, 1996.
Lorenz, E. and Emanuel, K. A.: Optimal Sites for Supplementary Weather
Observations: Simulation with a Small Model, J. Atmos. Sci., 55, 399–414,
https://doi.org/10.1175/1520-0469(1998)055<0399:OSFSWO>2.0.CO;2,
1998
Mitchell H. L. and Houtekamer P. L.: An adaptive ensemble Kalman filter, Mon. Weather Rev., 128, 416–433, https://doi.org/10.1175/1520-0493(2000)128<0416:AAEKF>2.0.CO;2, 2000.
Miyoshi, T.: Ensemble Kalman filter experiments with a primitive-equation
global model, PhD dissertation, University of Maryland, College Park,
197 pp., 2005.
Miyoshi T.: The Gaussian Approach to Adaptive Covariance Inflation and Its
Implementation with the Local Ensemble Transform Kalman Filter, Mon. Weather Rev., 139, 1519–1535, https://doi.org/10.1175/2010MWR3570.1, 2011.
Miyoshi, T.: Source code of the Local Ensemble Transform Kalman Filter, GitHub [code], https://github.com/takemasa-miyoshi/letkf, last access: 16 November 2022.
Miyoshi, T. and Yamane, S.: Local Ensemble Transform Kalman Filtering with
an AGCM at a T159/L48 Resolution, Mon. Weather Rev., 135, 3841–3861, https://doi.org/10.1175/2007MWR1873.1, 2007.
Molteni, F.: Atmospheric simulations using a GCM with simplified physical
parametrizations. I: Model climatology and variability in multi-decadal
experiments, Clim. Dynam., 20, 175–191, https://doi.org/10.1007/s00382-002-0268-2, 2003.
Oczkowski, M., Szunyogh, I., and Patil, D. J.: Mechanisms for the
development of locally low-dimensional atmospheric dynamics, J. Atmos. Sci.,
62, 1135–1156, https://doi.org/10.1175/JAS3403.1, 2005.
Okazaki, A. and Yoshimura, K.: Development and evaluation of a system of proxy data assimilation for paleoclimate reconstruction, Clim. Past, 13, 379–393, https://doi.org/10.5194/cp-13-379-2017, 2017.
Ota, Y., Derber, J. C., Miyoshi, T., and Kalnay, E.: Ensemble-based
observation impact estimates using the NCEP GFS, Tellus, 65A, 20–38,
https://doi.org/10.3402/tellusa.v65i0.20038, 2013.
Ott, E., Hunt, B. R., Szunyogh, I., Zsimin, A. V., Kostelich, E. J., Corazza, M.,
Kalnay, E. Patil, D. J., and Yorke, J. A.: A local ensemble Kalman filter for
atmospheric data assimilation, Tellus A, 56, 415–428, https://doi.org/10.1111/j.1600-0870.2004.00076.x, 2004.
Patil, D. J., Hunt, B. R., Kalnay, E., Yorke, J. A., and Ott, E.: Local Low
Dimensionality of Atmospheric Dynamics, Phys. Rev. Lett., 86, 5878–5881,
https://doi.org/10.1103/PhysRevLett.86.5878, 2001.
Penny, S. G. and Miyoshi, T.: A local particle filter for high-dimensional geophysical systems, Nonlin. Processes Geophys., 23, 391–405, https://doi.org/10.5194/npg-23-391-2016, 2016.
Poterjoy, J.: A localized particle filter for high-dimensional nonlinear
systems, Mon. Weather Rev., 144, 59–76, https://doi.org/10.1175/MWR-D-15-0163.1, 2016.
Poterjoy, J. and Anderson, J. L.: Efficient assimilation of simulated
observations in a high-dimensional geophysical system using a localized
particle filter, Mon. Weather Rev., 144, 2007–2020, https://doi.org/10.1175/MWR-D-15-0322.1, 2016.
Potthast, R., Walter, A., and Rhodin, A.: A Localized Adaptive Particle
Filter within an operational NWP framework, Mon. Weather Rev., 147, 345–362,
https://doi.org/10.1175/MWR-D-18-0028.1, 2019.
Reich, S.: A nonparametric ensemble transform method for Bayesian inference,
SIAM J. Sci. Comput., 35, A2013–A2024, https://doi.org/10.1137/130907367, 2013.
Snyder, C., Bengtsson, T., Bickel, P., and Anderson, J.: Obstacles to
high-dimensional particle filtering, Mon. Weather Rev., 136, 4629–4640, https://doi.org/10.1175/2008MWR2529.1, 2008.
Snyder, C., Bengtsson, T., and Morzfeld, M.: Performance bounds for particle
filters using the optimal proposal, Mon. Weather Rev., 143, 4750–4761, https://doi.org/10.1175/MWR-D-15-0144.1, 2015.
Stordal, A. S., Karlsen, H. A., Nævdal, G., Skaug, H. J., and
Vallès, B.: Bridging the ensemble Kalman filter and particle filters:
the adaptive Gaussian mixture filter, Comput. Geosci., 15, 293–305, https://doi.org/10.1007/s10596-010-9207-1, 2011.
Terasaki, K., Kotsuki, S., and Miyoshi, T.: Multi-year analysis using the
NICAM-LETKF data assimilation system, SOLA, 15, 41–46, https://doi.org/10.2151/sola.2019-009, 2019.
van Leeuwen, P. J.: Particle filtering in geophysical systems, Mon. Weather Rev., 137, 4089–4114, https://doi.org/10.1175/2009MWR2835.1, 2009.
van Leeuwen, P. J.: Nonlinear data assimilation in geosciences: an extremely
efficient particle filter, Q. J. Roy. Meteor. Soc., 136, 1991–1999, https://doi.org/10.1002/qj.699, 2010.
van Leeuwen, P. J.: A consistent interpretation of the stochastic version of
the Ensemble Kalman Filter, Q. J. Roy. Meteor. Soc., 146, 2815–2825, https://doi.org/10.1002/qj.3819, 2020.
van Leeuwen, P. J., Künsch, H. R., Nerger, L., Potthast, R., and Reich,
S.: Particle filters for high-dimensional geoscience applications: A review, Q. J. Roy. Meteor. Soc., 145, 2335–2365, https://doi.org/10.1002/qj.3551, 2019.
Wang, X., Bishop, C. H., and Julier, S. J.: Which is better, an ensemble of
positive–negative pairs or a centered spherical simplex ensemble?, Mon. Weather Rev., 132, 1590–1605, https://doi.org/10.1175/1520-0493(2004)132<1590:WIBAEO>2.0.CO;2, 2004.
Walter, A. and Potthast, R.: Particle Filtering with Model Error -a Localized
Mixture Coefficients Particle Filter (LMCPF), J. Meteor. Soc.
Japan, in review, 2022.
Whitaker J. S. and Hamill T. M.: Ensemble Data Assimilation without
Perturbed Observations, Mon. Weather Rev., 130, 1913–1924,
https://doi.org/10.1175/1520-0493(2002)130<1913:EDAWPO>2.0.CO;2,
2002.
Whitaker, J. S. and Hamill, T. M.: Evaluating Methods to Account for System
Errors in Ensemble Data Assimilation, Mon. Weather Rev., 140, 3078–3089, https://doi.org/10.1175/MWR-D-11-00276.1, 2012.
Yang, S.-C., Kalnay, E., Hunt, B., and Bowler, N. E.: Weight interpolation
for efficient data assimilation with the Local Ensemble Transform Kalman
Filter, Q. J. Roy. Meteor. Soc., 135, 251–262, https://doi.org/10.1002/qj.353, 2009.
Ying, Y. and Zhang, F.: An adaptive covariance relaxation method for ensemble
data assimilation, Q. J. Roy. Meteor. Soc., 141, 2898–2906,
https://doi.org/10.1002/qj.2576, 2015.
Zhang, F., Snyder, C., and Sun, J.: Impacts of Initial Estimate and Observation
Availability on Convective-Scale Data Assimilation with an Ensemble Kalman
Filter, Mon. Weather Rev., 132, 1238–1253,
https://doi.org/10.1175/1520-0493(2004)132<1238:IOIEAO>2.0.CO;2,
2004.
Zhu, M., van Leeuwen, P. J., and Amezcua, J.: Implicit equal-weights
particle filter, Q. J. Roy. Meteor. Soc., 142, 1904–1919, https://doi.org/10.1002/qj.2784, 2016.
Short summary
Data assimilation plays an important part in numerical weather prediction (NWP) in terms of combining forecasted states and observations. While data assimilation methods in NWP usually assume the Gaussian error distribution, some variables in the atmosphere, such as precipitation, are known to have non-Gaussian error statistics. This study extended a widely used ensemble data assimilation algorithm to enable the assimilation of more non-Gaussian observations.
Data assimilation plays an important part in numerical weather prediction (NWP) in terms of...
