Articles | Volume 18, issue 21
https://doi.org/10.5194/gmd-18-8235-2025
© Author(s) 2025. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
https://doi.org/10.5194/gmd-18-8235-2025
© Author(s) 2025. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
Development and technical paper
| 
05 Nov 2025
Development and technical paper |
| 05 Nov 2025
| 05 Nov 2025
A Python interface to the Fortran-based Parallel Data Assimilation Framework: pyPDAF v1.0.2
School of Mathematical, Physical and Computational Sciences, University of Reading, Reading RG6 6ET, UK
National Centre for Earth Observation, University of Reading, Reading RG6 6ET, UK
Lars Nerger
Alfred-Wegener-Institut, Helmholtz-Zentrum für Polar-und Meeresforschung (AWI), 27570 Bremerhaven, Germany
Amos S. Lawless
School of Mathematical, Physical and Computational Sciences, University of Reading, Reading RG6 6ET, UK
National Centre for Earth Observation, University of Reading, Reading RG6 6ET, UK
Related authors
Jozef Skákala, David Ford, Keith Haines, Amos Lawless, Matthew J. Martin, Philip Browne, Marcin Chrust, Stefano Ciavatta, Alison Fowler, Daniel Lea, Matthew Palmer, Andrea Rochner, Jennifer Waters, Hao Zuo, Deep S. Banerjee, Mike Bell, Davi M. Carneiro, Yumeng Chen, Susan Kay, Dale Partridge, Martin Price, Richard Renshaw, Georgy Shapiro, and James While
Ocean Sci., 21, 1709–1734, https://doi.org/10.5194/os-21-1709-2025, https://doi.org/10.5194/os-21-1709-2025, 2025
Short summary
Short summary
UK marine data assimilation (MDA) involves a closely collaborating research community. In this paper, we offer both an overview of the state of the art and a vision for the future across all of the main areas of UK MDA, ranging from physics to biogeochemistry to coupled DA. We discuss the current UK MDA stakeholder applications, highlight theoretical developments needed to advance our systems, and reflect upon upcoming opportunities with respect to hardware and observational missions.
Yumeng Chen, Polly Smith, Alberto Carrassi, Ivo Pasmans, Laurent Bertino, Marc Bocquet, Tobias Sebastian Finn, Pierre Rampal, and Véronique Dansereau
The Cryosphere, 18, 2381–2406, https://doi.org/10.5194/tc-18-2381-2024, https://doi.org/10.5194/tc-18-2381-2024, 2024
Short summary
Short summary
We explore multivariate state and parameter estimation using a data assimilation approach through idealised simulations in a dynamics-only sea-ice model based on novel rheology. We identify various potential issues that can arise in complex operational sea-ice models when model parameters are estimated. Even though further investigation will be needed for such complex sea-ice models, we show possibilities of improving the observed and the unobserved model state forecast and parameter accuracy.
Bo Dong, Ross Bannister, Yumeng Chen, Alison Fowler, and Keith Haines
Geosci. Model Dev., 16, 4233–4247, https://doi.org/10.5194/gmd-16-4233-2023, https://doi.org/10.5194/gmd-16-4233-2023, 2023
Short summary
Short summary
Traditional Kalman smoothers are expensive to apply in large global ocean operational forecast and reanalysis systems. We develop a cost-efficient method to overcome the technical constraints and to improve the performance of existing reanalysis products.
Tobias Sebastian Finn, Charlotte Durand, Alban Farchi, Marc Bocquet, Yumeng Chen, Alberto Carrassi, and Véronique Dansereau
The Cryosphere, 17, 2965–2991, https://doi.org/10.5194/tc-17-2965-2023, https://doi.org/10.5194/tc-17-2965-2023, 2023
Short summary
Short summary
We combine deep learning with a regional sea-ice model to correct model errors in the sea-ice dynamics of low-resolution forecasts towards high-resolution simulations. The combined model improves the forecast by up to 75 % and thereby surpasses the performance of persistence. As the error connection can additionally be used to analyse the shortcomings of the forecasts, this study highlights the potential of combined modelling for short-term sea-ice forecasting.
Sukun Cheng, Yumeng Chen, Ali Aydoğdu, Laurent Bertino, Alberto Carrassi, Pierre Rampal, and Christopher K. R. T. Jones
The Cryosphere, 17, 1735–1754, https://doi.org/10.5194/tc-17-1735-2023, https://doi.org/10.5194/tc-17-1735-2023, 2023
Short summary
Short summary
This work studies a novel application of combining a Lagrangian sea ice model, neXtSIM, and data assimilation. It uses a deterministic ensemble Kalman filter to incorporate satellite-observed ice concentration and thickness in simulations. The neXtSIM Lagrangian nature is handled using a remapping strategy on a common homogeneous mesh. The ensemble is formed by perturbing air–ocean boundary conditions and ice cohesion. Thanks to data assimilation, winter Arctic sea ice forecasting is enhanced.
Yumeng Chen, Alberto Carrassi, and Valerio Lucarini
Nonlin. Processes Geophys., 28, 633–649, https://doi.org/10.5194/npg-28-633-2021, https://doi.org/10.5194/npg-28-633-2021, 2021
Short summary
Short summary
Chaotic dynamical systems are sensitive to the initial conditions, which are crucial for climate forecast. These properties are often used to inform the design of data assimilation (DA), a method used to estimate the exact initial conditions. However, obtaining the instability properties is burdensome for complex problems, both numerically and analytically. Here, we suggest a different viewpoint. We show that the skill of DA can be used to infer the instability properties of a dynamical system.
Yumeng Chen, Konrad Simon, and Jörn Behrens
Geosci. Model Dev., 14, 2289–2316, https://doi.org/10.5194/gmd-14-2289-2021, https://doi.org/10.5194/gmd-14-2289-2021, 2021
Short summary
Short summary
Mesh adaptivity can reduce overall model error by only refining meshes in specific areas where it us necessary in the runtime. Here we suggest a way to integrate mesh adaptivity into an existing Earth system model, ECHAM6, without having to redesign the implementation from scratch. We show that while the additional computational effort is manageable, the error can be reduced compared to a low-resolution standard model using an idealized test and relatively realistic dust transport tests.
Jozef Skákala, David Ford, Keith Haines, Amos Lawless, Matthew J. Martin, Philip Browne, Marcin Chrust, Stefano Ciavatta, Alison Fowler, Daniel Lea, Matthew Palmer, Andrea Rochner, Jennifer Waters, Hao Zuo, Deep S. Banerjee, Mike Bell, Davi M. Carneiro, Yumeng Chen, Susan Kay, Dale Partridge, Martin Price, Richard Renshaw, Georgy Shapiro, and James While
Ocean Sci., 21, 1709–1734, https://doi.org/10.5194/os-21-1709-2025, https://doi.org/10.5194/os-21-1709-2025, 2025
Short summary
Short summary
UK marine data assimilation (MDA) involves a closely collaborating research community. In this paper, we offer both an overview of the state of the art and a vision for the future across all of the main areas of UK MDA, ranging from physics to biogeochemistry to coupled DA. We discuss the current UK MDA stakeholder applications, highlight theoretical developments needed to advance our systems, and reflect upon upcoming opportunities with respect to hardware and observational missions.
Frauke Bunsen, Judith Hauck, Sinhué Torres-Valdés, and Lars Nerger
Ocean Sci., 21, 437–471, https://doi.org/10.5194/os-21-437-2025, https://doi.org/10.5194/os-21-437-2025, 2025
Short summary
Short summary
Computer models are often used to estimate the ocean's CO2 uptake due to a lack of direct observations. Because such idealized models do not match precisely with the real world, we combine real-world observations of ocean temperature and salinity with a model and study the effect on the modeled air–sea CO2 flux (2010–2020). The corrections of temperature and salinity have their largest effect on regional CO2 fluxes in the Southern Ocean in winter and a small effect on the global CO2 uptake.
Hongyi Li, Ting Yang, Lars Nerger, Dawei Zhang, Di Zhang, Guigang Tang, Haibo Wang, Yele Sun, Pingqing Fu, Hang Su, and Zifa Wang
Geosci. Model Dev., 17, 8495–8519, https://doi.org/10.5194/gmd-17-8495-2024, https://doi.org/10.5194/gmd-17-8495-2024, 2024
Short summary
Short summary
To accurately characterize the spatiotemporal distribution of particulate matter <2.5 µm chemical components, we developed the Nested Air Quality Prediction Model System with the Parallel Data Assimilation Framework (NAQPMS-PDAF) v2.0 for chemical components with non-Gaussian and nonlinear properties. NAQPMS-PDAF v2.0 has better computing efficiency, excels when used with a small ensemble size, and can significantly improve the simulation performance of chemical components.
Simon Driscoll, Alberto Carrassi, Julien Brajard, Laurent Bertino, Einar Ólason, Marc Bocquet, and Amos Lawless
EGUsphere, https://doi.org/10.5194/egusphere-2024-2476, https://doi.org/10.5194/egusphere-2024-2476, 2024
Short summary
Short summary
The formation and evolution of sea ice melt ponds (ponds of melted water) are complex, insufficiently understood and represented in models with considerable uncertainty. These uncertain representations are not traditionally included in climate models potentially causing the known underestimation of sea ice loss in climate models. Our work creates the first observationally based machine learning model of melt ponds that is also a ready and viable candidate to be included in climate models.
Jorn Bruggeman, Karsten Bolding, Lars Nerger, Anna Teruzzi, Simone Spada, Jozef Skákala, and Stefano Ciavatta
Geosci. Model Dev., 17, 5619–5639, https://doi.org/10.5194/gmd-17-5619-2024, https://doi.org/10.5194/gmd-17-5619-2024, 2024
Short summary
Short summary
To understand and predict the ocean’s capacity for carbon sequestration, its ability to supply food, and its response to climate change, we need the best possible estimate of its physical and biogeochemical properties. This is obtained through data assimilation which blends numerical models and observations. We present the Ensemble and Assimilation Tool (EAT), a flexible and efficient test bed that allows any scientist to explore and further develop the state of the art in data assimilation.
Changliang Shao and Lars Nerger
Geosci. Model Dev., 17, 4433–4445, https://doi.org/10.5194/gmd-17-4433-2024, https://doi.org/10.5194/gmd-17-4433-2024, 2024
Short summary
Short summary
This paper introduces and evaluates WRF-PDAF, a fully online-coupled ensemble data assimilation (DA) system. A key advantage of the WRF-PDAF configuration is its ability to concurrently integrate all ensemble states, eliminating the need for time-consuming distribution and collection of ensembles during the coupling communication. The extra time required for DA amounts to only 20.6 % per cycle. Twin experiment results underscore the effectiveness of the WRF-PDAF system.
Yumeng Chen, Polly Smith, Alberto Carrassi, Ivo Pasmans, Laurent Bertino, Marc Bocquet, Tobias Sebastian Finn, Pierre Rampal, and Véronique Dansereau
The Cryosphere, 18, 2381–2406, https://doi.org/10.5194/tc-18-2381-2024, https://doi.org/10.5194/tc-18-2381-2024, 2024
Short summary
Short summary
We explore multivariate state and parameter estimation using a data assimilation approach through idealised simulations in a dynamics-only sea-ice model based on novel rheology. We identify various potential issues that can arise in complex operational sea-ice models when model parameters are estimated. Even though further investigation will be needed for such complex sea-ice models, we show possibilities of improving the observed and the unobserved model state forecast and parameter accuracy.
Qi Tang, Hugo Delottier, Wolfgang Kurtz, Lars Nerger, Oliver S. Schilling, and Philip Brunner
Geosci. Model Dev., 17, 3559–3578, https://doi.org/10.5194/gmd-17-3559-2024, https://doi.org/10.5194/gmd-17-3559-2024, 2024
Short summary
Short summary
We have developed a new data assimilation framework by coupling an integrated hydrological model HydroGeoSphere with the data assimilation software PDAF. Compared to existing hydrological data assimilation systems, the advantage of our newly developed framework lies in its consideration of the physically based model; its large selection of different assimilation algorithms; and its modularity with respect to the combination of different types of observations, states and parameters.
Bo Dong, Ross Bannister, Yumeng Chen, Alison Fowler, and Keith Haines
Geosci. Model Dev., 16, 4233–4247, https://doi.org/10.5194/gmd-16-4233-2023, https://doi.org/10.5194/gmd-16-4233-2023, 2023
Short summary
Short summary
Traditional Kalman smoothers are expensive to apply in large global ocean operational forecast and reanalysis systems. We develop a cost-efficient method to overcome the technical constraints and to improve the performance of existing reanalysis products.
Tobias Sebastian Finn, Charlotte Durand, Alban Farchi, Marc Bocquet, Yumeng Chen, Alberto Carrassi, and Véronique Dansereau
The Cryosphere, 17, 2965–2991, https://doi.org/10.5194/tc-17-2965-2023, https://doi.org/10.5194/tc-17-2965-2023, 2023
Short summary
Short summary
We combine deep learning with a regional sea-ice model to correct model errors in the sea-ice dynamics of low-resolution forecasts towards high-resolution simulations. The combined model improves the forecast by up to 75 % and thereby surpasses the performance of persistence. As the error connection can additionally be used to analyse the shortcomings of the forecasts, this study highlights the potential of combined modelling for short-term sea-ice forecasting.
Nicholas Williams, Nicholas Byrne, Daniel Feltham, Peter Jan Van Leeuwen, Ross Bannister, David Schroeder, Andrew Ridout, and Lars Nerger
The Cryosphere, 17, 2509–2532, https://doi.org/10.5194/tc-17-2509-2023, https://doi.org/10.5194/tc-17-2509-2023, 2023
Short summary
Short summary
Observations show that the Arctic sea ice cover has reduced over the last 40 years. This study uses ensemble-based data assimilation in a stand-alone sea ice model to investigate the impacts of assimilating three different kinds of sea ice observation, including the novel assimilation of sea ice thickness distribution. We show that assimilating ice thickness distribution has a positive impact on thickness and volume estimates within the ice pack, especially for very thick ice.
Sukun Cheng, Yumeng Chen, Ali Aydoğdu, Laurent Bertino, Alberto Carrassi, Pierre Rampal, and Christopher K. R. T. Jones
The Cryosphere, 17, 1735–1754, https://doi.org/10.5194/tc-17-1735-2023, https://doi.org/10.5194/tc-17-1735-2023, 2023
Short summary
Short summary
This work studies a novel application of combining a Lagrangian sea ice model, neXtSIM, and data assimilation. It uses a deterministic ensemble Kalman filter to incorporate satellite-observed ice concentration and thickness in simulations. The neXtSIM Lagrangian nature is handled using a remapping strategy on a common homogeneous mesh. The ensemble is formed by perturbing air–ocean boundary conditions and ice cohesion. Thanks to data assimilation, winter Arctic sea ice forecasting is enhanced.
Hao-Cheng Yu, Yinglong Joseph Zhang, Lars Nerger, Carsten Lemmen, Jason C. S. Yu, Tzu-Yin Chou, Chi-Hao Chu, and Chuen-Teyr Terng
EGUsphere, https://doi.org/10.5194/egusphere-2022-114, https://doi.org/10.5194/egusphere-2022-114, 2022
Preprint archived
Short summary
Short summary
We develop a new data assimilative approach by combining two parallel frameworks: PDAF and ESMF. This allows maximum flexibility and easy implementation of data assimilation for fully coupled earth system model applications. It is also validated by using a simple benchmark and applied to a realistic case simulation around Taiwan. The real case test shows significant improvement for temperature, velocity and surface elevation before, during and after typhoon events.
Yumeng Chen, Alberto Carrassi, and Valerio Lucarini
Nonlin. Processes Geophys., 28, 633–649, https://doi.org/10.5194/npg-28-633-2021, https://doi.org/10.5194/npg-28-633-2021, 2021
Short summary
Short summary
Chaotic dynamical systems are sensitive to the initial conditions, which are crucial for climate forecast. These properties are often used to inform the design of data assimilation (DA), a method used to estimate the exact initial conditions. However, obtaining the instability properties is burdensome for complex problems, both numerically and analytically. Here, we suggest a different viewpoint. We show that the skill of DA can be used to infer the instability properties of a dynamical system.
Yumeng Chen, Konrad Simon, and Jörn Behrens
Geosci. Model Dev., 14, 2289–2316, https://doi.org/10.5194/gmd-14-2289-2021, https://doi.org/10.5194/gmd-14-2289-2021, 2021
Short summary
Short summary
Mesh adaptivity can reduce overall model error by only refining meshes in specific areas where it us necessary in the runtime. Here we suggest a way to integrate mesh adaptivity into an existing Earth system model, ECHAM6, without having to redesign the implementation from scratch. We show that while the additional computational effort is manageable, the error can be reduced compared to a low-resolution standard model using an idealized test and relatively realistic dust transport tests.
Cited articles
Abernathey, R., rochanotes, Ross, A., Jansen, M., Li, Z., Poulin, F. J., Constantinou, N. C., Sinha, A., Balwada, D., SalahKouhen, Jones, S., Rocha, C. B., Wolfe, C. L. P., Meng, C., van Kemenade, H., Bourbeau, J., Penn, J., Busecke, J., Bueti, M., and Tobias: pyqg/pyqg: v0.7.2, Zenodo [code], https://doi.org/10.5281/zenodo.6563667, 2022. a, b
Ahmed, S. E., Pawar, S., and San, O.: PyDA: A Hands-On Introduction to Dynamical Data Assimilation with Python, Fluids, 5, https://doi.org/10.3390/fluids5040225, 2020. a
Anderson, J., Hoar, T., Raeder, K., Liu, H., Collins, N., Torn, R., and Avellano, A.: The Data Assimilation Research Testbed: A Community Facility, Bulletin of the American Meteorological Society, 90, 1283–1296, https://doi.org/10.1175/2009BAMS2618.1, 2009. a
Anderson, J. L.: An Ensemble Adjustment Kalman Filter for Data Assimilation, Monthly Weather Review, 129, 2884–2903, https://doi.org/10.1175/1520-0493(2001)129<2884:AEAKFF>2.0.CO;2, 2001. a
Bannister, R. N.: A review of operational methods of variational and ensemble-variational data assimilation, Quarterly Journal of the Royal Meteorological Society, 143, 607–633, https://doi.org/10.1002/qj.2982, 2017. a, b
Bi, K., Xie, L., Zhang, H., Chen, X., Gu, X., and Tian, Q.: Accurate medium-range global weather forecasting with 3D neural networks, Nature, 619, 533–538, https://doi.org/10.1038/s41586-023-06185-3, 2023. a, b
Bishop, C. H., Etherton, B. J., and Majumdar, S. J.: Adaptive Sampling with the Ensemble Transform Kalman Filter. Part I: Theoretical Aspects, Monthly Weather Review, 129, 420–436, https://doi.org/10.1175/1520-0493(2001)129<0420:ASWTET>2.0.CO;2, 2001. a, b
Bruggeman, J., Bolding, K., Nerger, L., Teruzzi, A., Spada, S., Skákala, J., and Ciavatta, S.: EAT v1.0.0: a 1D test bed for physical–biogeochemical data assimilation in natural waters, Geosci. Model Dev., 17, 5619–5639, https://doi.org/10.5194/gmd-17-5619-2024, 2024. a
Carrassi, A., Bocquet, M., Bertino, L., and Evensen, G.: Data assimilation in the geosciences: An overview of methods, issues, and perspectives, WIREs Climate Change, 9, e535, https://doi.org/10.1002/wcc.535, 2018. a
Cehelsky, P. and Tung, K. K.: Theories of Multiple Equilibria and Weather Regimes – A Critical Reexamination. Part II: Baroclinic Two-Layer Models, Journal of Atmospheric Sciences, 44, 3282–3303, https://doi.org/10.1175/1520-0469(1987)044<3282:TOMEAW>2.0.CO;2, 1987. a
Chen, Y.: yumengch/PDAF-MAOOAM: Plotting code update for 2nd revision, Zenodo [code], https://doi.org/10.5281/zenodo.15490719, 2025a. a
Chen, Y.: yumengch/pyPDAF: v1.0.2, Zenodo [code], https://doi.org/10.5281/zenodo.15025742, 2025b. a
Chen, Y.: pyPDAF – Parallelisation Strategy, https://yumengch.github.io/pyPDAF/parallel.html, last access: 20 March 2025c. a
Cheng, S., Min, J., Liu, C., and Arcucci, R.: TorchDA: A Python package for performing data assimilation with deep learning forward and transformation functions, Computer Physics Communications, 306, 109359, https://doi.org/10.1016/j.cpc.2024.109359, 2025. a
Cruz, L. D., Demaeyer, J., and Tondeur, M.: Climdyn/MAOOAM: MAOOAM v1.3 stochastic, Zenodo [code], https://doi.org/10.5281/zenodo.1308192, 2018. a
Demaeyer, J.: MAOOAM v1.4, GitHub [code], https://github.com/Climdyn/MAOOAM/releases/tag/v1.4 (last access: 30 October 2025), 2020. a
Döll, P., Hasan, H. M. M., Schulze, K., Gerdener, H., Börger, L., Shadkam, S., Ackermann, S., Hosseini-Moghari, S.-M., Müller Schmied, H., Güntner, A., and Kusche, J.: Leveraging multi-variable observations to reduce and quantify the output uncertainty of a global hydrological model: evaluation of three ensemble-based approaches for the Mississippi River basin, Hydrol. Earth Syst. Sci., 28, 2259–2295, https://doi.org/10.5194/hess-28-2259-2024, 2024. a
Evensen, G.: Sequential data assimilation with a nonlinear quasi-geostrophic model using Monte Carlo methods to forecast error statistics, Journal of Geophysical Research: Oceans, 99, 10143–10162, https://doi.org/10.1029/94JC00572, 1994. a
Evensen, G., Vossepoel, F. C., and van Leeuwen, P. J.: Data assimilation fundamentals: A unified formulation of the state and parameter estimation problem, Springer Nature, ISBN 978-3-030-96709-3, 2022. a
filterpy PyPI: FilterPy – Kalman filters and other optimal and non-optimal estimation filters in Python, https://pypi.org/project/filterpy/, last access: 29 August 2024. a
Hamill, T. M., Whitaker, J. S., and Snyder, C.: Distance-Dependent Filtering of Background Error Covariance Estimates in an Ensemble Kalman Filter, Monthly Weather Review, 129, 2776–2790, https://doi.org/10.1175/1520-0493(2001)129<2776:DDFOBE>2.0.CO;2, 2001. a
Hunt, B. R., Kostelich, E. J., and Szunyogh, I.: Efficient data assimilation for spatiotemporal chaos: A local ensemble transform Kalman filter, Physica D: Nonlinear Phenomena, 230, 112–126, https://doi.org/10.1016/j.physd.2006.11.008, 2007. a
Installation – pyPDAF documentation: pyPDAF – A Python interface to Parallel Data Assimilation Framework, https://yumengch.github.io/pyPDAF/, last access: 25 March 2025. a
Kurth, T., Subramanian, S., Harrington, P., Pathak, J., Mardani, M., Hall, D., Miele, A., Kashinath, K., and Anandkumar, A.: FourCastNet: Accelerating Global High-Resolution Weather Forecasting Using Adaptive Fourier Neural Operators, in: The Platform for Advanced Scientific Computing 2023, Association for Computing Machinery, New York, NY, USA, ISBN 9798400701900, https://doi.org/10.1145/3592979.3593412, 2023. a
Kurtz, W., He, G., Kollet, S. J., Maxwell, R. M., Vereecken, H., and Hendricks Franssen, H.-J.: TerrSysMP–PDAF (version 1.0): a modular high-performance data assimilation framework for an integrated land surface–subsurface model, Geosci. Model Dev., 9, 1341–1360, https://doi.org/10.5194/gmd-9-1341-2016, 2016. a
Lam, R., Sanchez-Gonzalez, A., Willson, M., Wirnsberger, P., Fortunato, M., Alet, F., Ravuri, S., Ewalds, T., Eaton-Rosen, Z., Hu, W., Merose, A., Hoyer, S., Holland, G., Vinyals, O., Stott, J., Pritzel, A., Mohamed, S., and Battaglia, P.: Learning skillful medium-range global weather forecasting, Science, 382, 1416–1421, https://doi.org/10.1126/science.adi2336, 2023. a
Losa, S. N., Danilov, S., Schröter, J., Nerger, L., Maβmann, S., and Janssen, F.: Assimilating NOAA SST data into the BSH operational circulation model for the North and Baltic Seas: Inference about the data, Journal of Marine Systems, 105–108, 152–162, https://doi.org/10.1016/j.jmarsys.2012.07.008, 2012. a
McGibbon, J., Brenowitz, N. D., Cheeseman, M., Clark, S. K., Dahm, J. P. S., Davis, E. C., Elbert, O. D., George, R. C., Harris, L. M., Henn, B., Kwa, A., Perkins, W. A., Watt-Meyer, O., Wicky, T. F., Bretherton, C. S., and Fuhrer, O.: fv3gfs-wrapper: a Python wrapper of the FV3GFS atmospheric model, Geosci. Model Dev., 14, 4401–4409, https://doi.org/10.5194/gmd-14-4401-2021, 2021. a, b
Message Passing Interface Forum: MPI: A Message-Passing Interface Standard Version 4.1, https://www.mpi-forum.org/docs/mpi-4.1/mpi41-report.pdf (last access: 30 October 2025), 2023. a
Nerger, L.: Data assimilation for nonlinear systems with a hybrid nonlinear Kalman ensemble transform filter, Quarterly Journal of the Royal Meteorological Society, 148, 620–640, https://doi.org/10.1002/qj.4221, 2022. a
Nerger, L.: PDAF Version 2.3.1, Zenodo [code], https://doi.org/10.5281/zenodo.14216770, 2024. a
Nerger, L. and Hiller, W.: Software for ensemble-based data assimilation systems – Implementation strategies and scalability, Computers & Geosciences, 55, 110–118, https://doi.org/10.1016/j.cageo.2012.03.026, 2013a. a
Nerger, L. and Hiller, W.: Software for Ensemble-based Data Assimilation Systems – Implementation Strategies and Scalability, Computers & Geosciences, 55, 110–118, 2013b. a
Nerger, L., Hiller, W., and Schröter, J.: PDAF – The parallel data assimilation framework: experiences with Kalman filtering, in: Use of High Performance Computing in Meteorology, World Scientific Publishing Co. Pte. Ltd., 63–83, https://doi.org/10.1142/9789812701831_0006, 2005. a, b, c
Nerger, L., Janjić, T., Schröter, J., and Hiller, W.: A Unification of Ensemble Square Root Kalman Filters, Monthly Weather Review, 140, 2335–2345, https://doi.org/10.1175/MWR-D-11-00102.1, 2012. a, b
Nerger, L., Tang, Q., and Mu, L.: Efficient ensemble data assimilation for coupled models with the Parallel Data Assimilation Framework: example of AWI-CM (AWI-CM-PDAF 1.0), Geosci. Model Dev., 13, 4305–4321, https://doi.org/10.5194/gmd-13-4305-2020, 2020. a
PDAF: The Parallel Data Assimilation Framework, https://pdaf.awi.de/, last access: 13 February 2024. a
Pham, D. T.: Stochastic Methods for Sequential Data Assimilation in Strongly Nonlinear Systems, Monthly Weather Review, 129, 1194–1207, https://doi.org/10.1175/1520-0493(2001)129<1194:SMFSDA>2.0.CO;2, 2001. a, b, c
Pham, D. T., Verron, J., and Christine Roubaud, M.: A singular evolutive extended Kalman filter for data assimilation in oceanography, Journal of Marine Systems, 16, 323–340, https://doi.org/10.1016/S0924-7963(97)00109-7, 1998. a, b
Pohlmann, H., Brune, S., Fröhlich, K., Jungclaus, J. H., Sgoff, C., and Baehr, J.: Impact of ocean data assimilation on climate predictions with ICON-ESM, Climate Dynamics, 61, 357–373, https://doi.org/10.1007/s00382-022-06558-w, 2023. a
Python Software Foundation: The Python Language Reference: https://docs.python.org/3/reference/introduction.html#alternate-implementations, last access: 13 February 2024. a
Raanes, P. N., Chen, Y., and Grudzien, C.: DAPPER: Data Assimilation with Python: a Package for Experimental Research, Journal of Open Source Software, 9, 5150, https://doi.org/10.21105/joss.05150, 2024. a, b
SALOME: The Open Source Integration Platform for Numerical Simulation, http://www.salome-platform.org/, last access: 29 August 2024. a
Shao, C. and Nerger, L.: WRF-PDAF v1.0: implementation and application of an online localized ensemble data assimilation framework, Geosci. Model Dev., 17, 4433–4445, https://doi.org/10.5194/gmd-17-4433-2024, 2024. a, b
Simon, E. and Bertino, L.: Gaussian anamorphosis extension of the DEnKF for combined state parameter estimation: Application to a 1D ocean ecosystem model, Journal of Marine Systems, 89, 1–18, https://doi.org/10.1016/j.jmarsys.2011.07.007, 2012. a
Strebel, L., Bogena, H. R., Vereecken, H., and Hendricks Franssen, H.-J.: Coupling the Community Land Model version 5.0 to the parallel data assimilation framework PDAF: description and applications, Geosci. Model Dev., 15, 395–411, https://doi.org/10.5194/gmd-15-395-2022, 2022. a
Tang, Q., Mu, L., Goessling, H. F., Semmler, T., and Nerger, L.: Strongly coupled data assimilation of ocean observations into an ocean-atmosphere model, Geophys. Res. Lett., 48, e2021GL094941, https://doi.org/10.1029/2021GL094941, 2021. a
Tang, Q., Delottier, H., Kurtz, W., Nerger, L., Schilling, O. S., and Brunner, P.: HGS-PDAF (version 1.0): a modular data assimilation framework for an integrated surface and subsurface hydrological model, Geosci. Model Dev., 17, 3559–3578, https://doi.org/10.5194/gmd-17-3559-2024, 2024. a
Tödter, J. and Ahrens, B.: A Second-Order Exact Ensemble Square Root Filter for Nonlinear Data Assimilation, Monthly Weather Review, 143, 1347–1367, https://doi.org/10.1175/MWR-D-14-00108.1, 2015. a
van Leeuwen, P. J., Künsch, H. R., Nerger, L., Potthast, R., and Reich, S.: Particle filters for high-dimensional geoscience applications: A review, Quarterly Journal of the Royal Meteorological Society, 145, 2335–2365, https://doi.org/10.1002/qj.3551, 2019. a
Vetra-Carvalho, S., van Leeuwen, P. J., Nerger, L., Barth, A., Altaf, M. U., Brasseur, P., Kirchgessner, P., and Beckers, J.-M.: State-of-the-art stochastic data assimilation methods for high-dimensional non-Gaussian problems, Tellus A, 70, 1445364, https://doi.org/10.1080/16000870.2018.1445364, 2018. a
Villa, U., Petra, N., and Ghattas, O.: HIPPYlib: An Extensible Software Framework for Large-Scale Inverse Problems Governed by PDEs: Part I: Deterministic Inversion and Linearized Bayesian Inference, ACM Trans. Math. Softw., 47, https://doi.org/10.1145/3428447, 2021. a
Whitaker, J. S. and Hamill, T. M.: Ensemble Data Assimilation without Perturbed Observations, Mon. Wea. Rev., 130, 1913–1927, 2002. a
Williams, N., Byrne, N., Feltham, D., Van Leeuwen, P. J., Bannister, R., Schroeder, D., Ridout, A., and Nerger, L.: The effects of assimilating a sub-grid-scale sea ice thickness distribution in a new Arctic sea ice data assimilation system, The Cryosphere, 17, 2509–2532, https://doi.org/10.5194/tc-17-2509-2023, 2023. a
Ying, Y. M.: nansencenter/NEDAS: v1.0-beta, Zenodo [code], https://doi.org/10.5281/zenodo.10525331, 2024. a
Zhao, F., Liang, X., Tian, Z., Li, M., Liu, N., and Liu, C.: Southern Ocean Ice Prediction System version 1.0 (SOIPS v1.0): description of the system and evaluation of synoptic-scale sea ice forecasts, Geosci. Model Dev., 17, 6867–6886, https://doi.org/10.5194/gmd-17-6867-2024, 2024. a
Short summary
In this paper, we present pyPDAF, a Python interface to the parallel data assimilation framework (PDAF) allowing for coupling with Python-based models. We demonstrate the capability and efficiency of pyPDAF under a coupled data assimilation setup.
In this paper, we present pyPDAF, a Python interface to the parallel data assimilation framework...
