the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
4DVarNetSSH: endtoend learning of variational interpolation schemes for nadir and wideswath satellite altimetry
Maxime Beauchamp
Quentin Febvre
Hugo Georgenthum
Ronan Fablet
The reconstruction of sea surface currents from satellite altimeter data is a key challenge in spatial oceanography, especially with the upcoming wideswath SWOT (Surface Water and Ocean and Topography) altimeter mission. Operational systems, however, generally fail to retrieve mesoscale dynamics for horizontal scales below 100 km and timescales below 10 d. Here, we address this challenge through the 4DVarnet framework, an endtoend neural scheme backed on a variational data assimilation formulation. We introduce a parameterization of the 4DVarNet scheme dedicated to the space–time interpolation of satellite altimeter data. Within an observing system simulation experiment (NATL60), we demonstrate the relevance of the proposed approach, both for nadir and nadir plus SWOT altimeter configurations for two contrasting case study regions in terms of upper ocean dynamics. We report a relative improvement with respect to the operational optimal interpolation between 30 % and 60 % in terms of the reconstruction error. Interestingly, for the nadir plus SWOT altimeter configuration, we reach resolved space–timescales below 70 km and 7 d. The code is open source to enable reproducibility and future collaborative developments. Beyond its applicability to largescale domains, we also address the uncertainty quantification issues and generalization properties of the proposed learning setting. We discuss further future research avenues and extensions to other ocean data assimilation and space oceanography challenges.
 Article
(11797 KB)  Fulltext XML
 BibTeX
 EndNote
Satellite altimetry is the main data source for the observation and reconstruction of sea surface dynamics on a global scale (Chelton et al., 2001). Current satellite altimeters only deliver alongtrack nadir observations. This results in a very scarce sampling of the ocean surface. Interpolation schemes are then key components of the operational processing of satellite altimetry data. Current operational products (Taburet et al., 2019; Lellouche et al., 2018), however, show a limited ability to retrieve the full range of mesoscale dynamics. The upcoming wideswath altimetry SWOT (Surface Water and Ocean and Topography) mission (see, e.g., Gaultier et al., 2015) will provide, for the first time, a twodimensional observation of the sea surface height (SSH). The space–time sampling of satellite altimeters will, however, still remain scarce for a long time, which has motivated the recent surge in research literature towards the finding an improvement of the interpolation of satellitederived SSH fields (see, e.g., LopezRadcenco et al., 2019, Lguensat et al., 2017, Beauchamp et al., 2021, and Ballarotta et al., 2019).
Besides operational schemes based on optimal interpolation techniques (Taburet et al., 2019) and data assimilation schemes for ocean circulation models (Benkiran et al., 2021), we may sort the proposed SSH interpolation schemes into three main categories, namely extension of optimal interpolation approaches towards multiscale schemes (Ardhuin et al., 2020), data assimilation schemes using sea surface dynamical priors such as quasigeostrophic (QG) dynamics (Le Guillou et al., 2020), and datadriven interpolation methods. The latter comprises both EOFbased (empirical orthogonal function) techniques (Beckers and Rixen, 2003b; AlveraAzcárate et al., 2009), analog approaches (Lguensat et al., 2017; Tandeo et al., 2020), and, more recently, deep learning schemes (Fablet et al., 2020; Fablet and Chapron, 2022; Manucharyan et al., 2021; Beauchamp et al., 2020).
Here, we further explore this avenue and, more specifically, the 4DVarNet framework recently introduced in Fablet et al. (2021). As it relies on a variational data assimilation formulation, it appears to be particularly suited to the space–time interpolation of sea surface variables from irregularly sampled observations. We propose a parameterization of the 4DVarNet scheme dedicated to SSH interpolation from satellite altimeter data and report OSSE (observing system simulation experiment) results to support the relevance of the proposed scheme. Our main contributions are as follows:

The proposed 4DVarNetSSH scheme delivers an endtoend neural architecture using raw satellite altimeter data and optimally interpolated fields as input. We also address uncertainty quantification issues using an ensemble method.

For the OSSE on two case study regions, respectively, along the GULFSTREAM, and for an openocean area dominated by mesoscale eddy dynamics, the 4DVarNetSSH scheme outperforms previous work and significantly improves the performance metrics with respect to the operational processing. We also support the relevance of wideswath SWOT altimeter data to significantly improve the reconstruction of sea surface dynamics compared to nadironly satellite altimeters.

We deliver an opensource code for the proposed 4DVarNetSSH scheme. It relies on PyTorch and associated stateoftheart packages. As such, it supports multiGPU configuration and can scale up to largescale domains.
We believe that these contributions are able to help in the development of deep learning approaches for satellite altimetry and, more broadly, for operational oceanography.
This paper is organized as follows. Section 2 briefly reviews the key methodological aspects and related work. We describe the proposed 4DVarNetSSH approach in Sect. 3, and Sect. 4 presents the considered OSSE setting. We report our results in Sect. 5 and further discuss our main contributions in Sect. 6.
From a methodological point of view, interpolation problems in geoscience are classically regarded as data assimilation issues (Asch et al., 2016). They aim at estimating the state x_{t} of a multidimensional dynamical system as follows:
The first equation relates to the forecast step which describes the evolution of the system from time t to t+dt, according to the potentially nonlinear model ${\mathit{x}}_{k+\mathrm{1}}=\mathcal{M}\left({\mathit{x}}_{k}\right)$. The second equation introduces the observations y_{t} at time t, where ℋ_{t} is the corresponding observation operator, which is usually known and also potentially learnable. η(t) is the model error and ε(t) the observation error. Both errors are generally assumed to be Gaussian, unbiased, and uncorrelated over time. When discretized on a spatiotemporal grid, where index $k=\mathrm{1},\mathrm{\cdots},T$ refers to time t_{k}, their associated covariance matrices are ${\mathbf{Q}}_{k}\in {\mathbb{R}}^{m\times m}$ and ${\mathbf{R}}_{k}\in {\mathbb{R}}^{{p}_{k}\times {p}_{k}}$.
Broadly speaking, a vast family of data assimilation methods stems from the minimization of some energy or function which involves two terms, a dynamical prior, and an observation term. We may distinguish two main categories of data assimilation approaches (Evensen, 2009), namely variational and statistical data assimilation. Specifically, within a variational data assimilation framework, the state analysis x^{a} results in a gradientbased minimization of the defined variational cost $\mathcal{J}\left(\mathit{x}\right)={\mathcal{J}}_{\mathrm{\Phi}}(\mathit{x},\mathit{y},\mathrm{\Omega})$ (Asch et al., 2016). The latter generally combines the sum of an observation term and a regularization term involving an operator Φ, as follows:
The prior operator Φ_{k} is a timestepping operator at time t_{k}. In a modelbased data assimilation, it generally relates to a dynamical model ℳ to provide a background estimation (i.e., the physical prior) corresponding to the deterministic forecast. $\mathit{x}=\mathit{\{}{x}_{kL},\mathrm{\cdots},{x}_{k+L}\mathit{\}}$, respectively, denotes the temporal vectors of sizes $(\mathrm{2}L+\mathrm{1})\times m$, and ${\prod}_{i=kL}^{k+L}{p}_{i}$ associated with the state of the system and the observations within the data assimilation window (DAW) of length 2L+1 centered around t_{k}. ℋ_{k} is the observation operator, and Ω={Ω_{k}} is the set of subdomains of 𝒟, with observations at times t_{k}, $k=\mathrm{1},\mathrm{\cdots},T$. Last, Q_{k} and R_{k} are the background and the observation error covariance matrices. This formulation of functional ${\mathcal{J}}_{\mathrm{\Phi}}(\mathit{x},\mathit{y},\mathrm{\Omega})$ directly relates to weak constraint 4DVar (see, e.g., Carrassi et al., 2018), which aims at estimating the optimal trajectory of a system in a predefined DAW, given the additional constraint of model uncertainty in the objective function 𝒥.
Regarding statistical data assimilation, many stateoftheart methods rely on optimal interpolation (OI), which is the basic block of all statistical methods, especially regarding SSHrelated datasets. OI has been used for decades (Taburet et al., 2019) for the interpolation of alongtrack nadir altimeter datasets and is still used today for the operational marine (Copernicus Marine Environment Monitoring Service, CMEMS) and climate (Copernicus Climate Change Service, C3S) production of the EU Copernicus program. It involves a significant smoothing for solving spatial scales up to 150 km. Extensions of OI schemes to multiscales to better account for mesoscale sea surface dynamics have recently been proposed (Ardhuin et al., 2020; Ubelmann et al., 2016).
Variational DA schemes have also been widely explored for the assimilation of satellite altimeter data in ocean general circulation models (see, e.g., Ngodock et al., 2015, Benkiran et al., 2021, or Li et al., 2021). Previous works have also considered quasigeostrophic (QG) dynamics as an approximate and reducedorder dynamical prior for sea surface dynamics, leading to stateoftheart performance (Ubelmann et al., 2016; Le Guillou et al., 2020).
Whereas modeldriven and optimal interpolation approaches are the stateoftheart solutions for operational products, datadriven strategies have recently emerged as promising alternatives to improve the space–time resolution of interpolated products. We may cite, among others, DINEOF (Data Interpolating Empirical Orthogonal Functions; Beckers and Rixen, 2003a; AlveraAzcárate et al., 2005, 2009) and the analog data assimilation (AnDA; Lguensat et al., 2017; Tandeo et al., 2020) and the recent developments of deep learning schemes (Barth et al., 2019). Beauchamp et al. (2020) have reported a benchmarking experiment, which supported the relevance of datadriven schemes compared with the operational OI product.
Here, we further explore deep learning approaches, and more particularly the 4DVarNet scheme (Fablet and Chapron, 2022), which bridges variational data assimilation and deep learning. Because the analyzed state obtained from OI matches the minimization of the 3DVar cost function, this establishes the formal link between the statistical DA framework and the optimal control theory used in the variational formulation. When adding time as an extra dimension, 4DVar generalizes the stationary case of the 3DVar formulation (see, e.g., Carrassi et al., 2018). It makes the 4DVarNet framework relevant for comparison with traditional DA methods. The BOOSTSWOT 2020 data challenge (https://github.com/oceandatachallenges/2020a_SSH_mapping_NATL60, last access: 2022) provides a representative benchmarking framework to assess the performance of SSH mapping schemes for nadironly and nadir plus SWOT (denoted as nadir+swot in the figures) altimetry datasets.
As detailed hereafter, we introduce a parameterization of the 4DVarNet scheme dedicated to SSH interpolation issues and demonstrate its relevance in the context of the benchmarking settings introduced in the BOOSTSWOT 2020 data challenge.
This section details the proposed learningbased framework for the interpolation of satellite altimeter data. We first briefly review 4DVarNet framework recently introduced in Fablet et al. (2021) in Sect. 3.1 and present the proposed parameterization for SSH mapping from nadir and SWOT altimeter data in Sect. 3.2. We describe the resulting PyTorch package and its associated implementation details in Sect. 3.4 and the proposed learning setting in Sect. 3.3.
3.1 4DVarNet framework
The 4DVarNet framework introduced in Fablet et al. (2021) provides a generic approach for the training of 4DVar models and solvers. They have been shown to outperform classic 4DVar solvers for toy case studies, such as Lorenz63 and Lorenz96 dynamics, when considering partially observed systems. The 4DVarNet framework can be regarded as an extension that used trainable, gradientbased solvers of the deep learning scheme, which led to the best SSH interpolation performance in our previous work (Beauchamp et al., 2020).
From a methodological point of view, the 4DVarNet framework derives an endtoend neural architecture from an underlying variational data assimilation (DA) formulation (see Sect. 2 again) as follows:
where λ_{1,2} are predefined or tunable scalar weights, and we replaced the Mahalanobis norms $\left\right.{}_{R}^{\mathrm{1}}$ and $\left\right.{}_{Q}^{\mathrm{1}}$ with a standard mean square norm for the sake of simplicity. In the regularization term, we substitute the traditional dynamical prior ℳ with a neural operator Φ based on a convolutional architecture. Then, we can exploit the automatic differentiation tools embedded in deep learning libraries to consider the following iterative gradientbased solver, denoted as Γ, for the minimization of variational cost 𝒥_{Φ} with regard to the state x, as follows:
where LSTM denotes a convolutional long shortterm memory model (see, e.g., Shi et al., 2015), α a is normalization scalar, h(i) and c(i) denote the internal states of the LSTM, and 𝒯 is a linear mapping. The key idea relies on the capability of the LSTM to learn an adaptive gradient update g^{(i+1)} from the gradient of the variational cost ∇_{x}𝒥_{Φ}(x^{(i)}) in order to considerably speed up the optimization and reach the corresponding optimal state. This iterative rule, based on a trainable LSTM operator, is similar to metalearning schemes (Andrychowicz et al., 2016). Due to the ability of LSTM models to capture longterm dependencies, it results in a trainable gradient descent with momentum.
Overall, a 4DVarNet scheme defines a neural architecture which runs a predefined number of iterative gradientbased updates (see Eq. 3). Let us denote ${\mathrm{\Psi}}_{\mathrm{\Phi},\mathrm{\Gamma}}({\mathit{x}}^{\left(\mathrm{0}\right)},\mathit{y},\mathrm{\Omega})$ as the output of the 4DVarNet architecture for a given prior Φ and solver Γ, the initialization x^{(0)} of the state x, and the observations y on the domain Ω. The resulting neural architecture is referred as an endtoend architecture, since it uses as input raw observation data and an initial guess and directly provides as output the reconstructed state.
Then, the joint training of operators {Φ,Γ} is stated as the minimization of a reconstruction cost $\mathcal{L}(\mathit{x},{\mathit{x}}^{\star})$, which is typically the root mean squared error (RMSE) between the true state x and its reconstruction x^{⋆} and additional regularization terms (fully described in Sect. 3.3), as follows:
Let us stress that the outer loss function ℒ differs from the inner variational cost 𝒥_{Φ} in order to take advantage of a supervised configuration (true states are known during training). Such a formulation turns out to be particularly efficient when applied to Gaussian processes for which the optimal solution is known (see, e.g., Beauchamp et al., 2022), with promising transfer to nonGaussian/nonlinear dynamics.
In Appendix A, a parameterfree fixed point version of the solver is also given, based on the previous results of (Beauchamp et al., 2020). In addition, Beauchamp et al. (2021) have already shown how the iterative gradientbased update is more efficient than the simpler fixedpoint formulation.
3.2 4DVarNetSSH parameterization
The proposed 4DVarNetSSH framework aims at exploiting and improving the mapping performance of current operational OI products. This section draws from the generic 4DVarNet formulation presented above and adapts its target components, given that OI products retrieve consistent largescale dynamics. Then, we rely on the following multiscale decomposition:
where the anomaly dx is seen as the difference between the true state x and the largescale components $\stackrel{\mathrm{\u203e}}{\mathit{x}}$. Regarding the observation data, let us denote by y(Ω)={y_{k}(Ω_{k})} the partial and potentially noisy altimetry observations associated with masks $\mathrm{\Omega}=\mathit{\left\{}{\mathrm{\Omega}}_{k}\mathit{\right\}}\subset \mathcal{D}$, where $\stackrel{\mathrm{\u203e}}{{\mathrm{\Omega}}_{k}}$ corresponds to the gappy part of the field and index k refers to time t_{k}. We use the operational OI product as a gapfree observation data, denoted as $\stackrel{\mathrm{\u203e}}{\mathit{y}}$, for the state component $\stackrel{\mathrm{\u203e}}{\mathit{x}}$, whereas the observation data for anomaly dx are $\mathit{y}\stackrel{\mathrm{\u203e}}{\mathit{y}}$ over domain Ω.
Numerical experiments showed that an augmentedstate formulation led to better interpolation performance regarding the potential stripping of artifacts due to the nadir alongtrack sampling. This results in the application of 4DVarNet model (see Eq. 4) to augmented states $\stackrel{\mathrm{\u0303}}{\mathit{x}}$ and observations $\stackrel{\mathrm{\u0303}}{\mathit{y}}$ are defined as follows:
This augmentedstate parameterization introduces two anomaly components, dx_{1} and dx_{2}, with corresponding observations. While only the first one is actually observed, the reconstructed SSH state is, however, given by the addition of the coarse component $\stackrel{\mathrm{\u203e}}{\mathit{x}}$ and the latent anomaly dx_{2}, where ${\mathit{x}}^{\star}=\stackrel{\mathrm{\u203e}}{\mathit{x}}+\mathrm{d}{\mathit{x}}_{\mathrm{2}}$.
Following Fablet et al. (2021), the operator Φ follows a purely datadriven parameterization with twoscale residual architectures involving bilinear units (Fablet et al., 2020). The number of residual blocks is set to two, and the bilinear units are made of two hidden convolutional layers, respectively, with linear and rectified linear unit (ReLU) activations, followed by a linear scheme combining the outputs of the second layer. A final convolutional layer with linear activation is involved to bring the outputs back to the initialstate dimension. In its current implementation, Φ contains about 500 000 parameters. In any case, the number of gradient iterations for the solver Γ is fixed at five. Complementary tests showed that a higher number of iterations leads to a large increase in the training time (because of the implicit number of parameters which grows linearly with this number of iterations) without a significant gain in terms of the 4DVarNet reconstruction skills.
Regarding the initial state for iterative gradientbased rule (Eq. 3), we consider the OI field $\stackrel{\mathrm{\u203e}}{\mathit{y}}$ for the state component $\stackrel{\mathrm{\u203e}}{\mathit{x}}$, $\mathit{y}\stackrel{\mathrm{\u203e}}{\mathit{y}}$ for the anomaly component dx_{1}, and a zero state for the anomaly component dx_{2}. For anomaly component dx_{1}, gaps are initialized to 0.
3.3 Learning setting
We implement a classic supervised learning strategy using gapfree targets. The considered training loss ℒ combines reconstruction losses and additional regularization terms as follows:
i.e., the L2 norm of the difference between the state x and reconstruction x^{⋆}, in addition to their gradients, and regularization losses according to the prior Φ is to enforce that both the true states and the reconstructed ones are correctly encoded by prior Φ. w={w_{i}}, $i=\mathrm{1},\mathrm{\cdots},N$ denote a weighting vector along the data assimilation window of size N (=7 here). To give more importance to the center of the DAW, we use the following:
This training loss is used in Sect. 4 for the OSSEbased BOOSTSWOT data challenge framework.
Regarding the training configuration, when the domain is small (see the GULFSTREAM and OSMOSIS regions defined in Sect. 4), we use a single GPU and Adam optimizer with a batch size of 2 over 200 epochs. The same set of parameters holds for larger domains (NATL and cNATL; see again Table 1), but we use the 4DVarNetdistributed version of the code over 4 GPUs. The computational time of the training procedure lies between 4 and 5 h for the smalldomain setup and between 7 and 8 h for the largedomain setup.
3.4 Implementation aspects
We provide an opensource PyTorch implementation of the 4DVarNetSSH scheme. (The code is available at https://doi.org/10.5281/zenodo.7186322, hgeorgenthum et al., 2023). PyTorch is a stateoftheart deep learning framework. We benefit from the associated packages such as lightning and hydra to provide a highlevel environment and make the reproduction of the experiments and the development of other applications easier. Through the lightning package, our implementation supports multiGPU distributed learning configurations. This may be highly relevant for speeding up the training process.
Regarding computational issues, the OSSEbased applications (see Sect. 4) involve the processing of $\mathrm{7}\times \mathrm{240}\times \mathrm{240}$ tensors (i.e., 7 d time series over a $\mathrm{12}{}^{\circ}\times \mathrm{12}{}^{\circ}$ domain with a $\mathrm{1}/\mathrm{20}{}^{\circ}$ resolution). GPUs with a significant RAM (typically above 30 Gb), such as NVIDIA V100, A40, and A100, can process such tensors through the proposed 4DVarNet architecture. The direct training 4DVarNet models over larger spatial domains is, however, limited by the GPU memory. To address this issue, we develop a specific data management module, through socalled data loaders. Our data loader module automatically extracts patches of a predefined size (typically, $\mathrm{7}\times \mathrm{240}\times \mathrm{240}$ in the reported experiments) from the considered training dataset according to stride parameters (as sketched in Fig. 2). One can exploit the same approach to apply a learned model to a large domain during the evaluation or production stage. In both cases, we benefit from the fully convolutional feature of the considered neural architecture. This guarantees that, up to border effects, the 4DVarNet processing is translation invariant.
Let us specify that the size of the tensors relates to the maximal space–time distance with significant autocorrelation of the SSH. Then, we use a data assimilation window of length $N=\mathrm{2}L+\mathrm{1}$, meaning that we use temporal sequences of the state space ${\mathit{x}}_{k\pm L}={\mathit{x}}_{kL:k+L}$. The idea is to optimize the results for the time t_{k} at the center of the window $[{t}_{kL};{t}_{k+L}]$, and the value of N has to be chosen according to the dynamics of the geophysical field considered, which is the SSH here. In the following experiments, we use a value of N=7, which seems to be enough to describe the spatiotemporal correlations of the anomaly between the ground truth and the DUACS (Data Unification and Altimeter Combination System) OI scheme. To apply 4DVarNet directly on the SSH dataset, without providing the DUACS OI baseline as a coarse version of the reconstruction, the value of N shall increase up to ∼20 d (see, e.g., Beauchamp et al., 2022). In the same vein, the spatial size of the patches is 240 × 240 pixels, with a corresponding 0.05^{∘} resolution, where 12^{∘} is large enough to consider the spatial autocorrelation as negligible outside of the patch.
This section details the experimental setup considered in this study for the quantitative evaluation of the proposed framework. We first introduce the simulation dataset used in our experiments as well as the case study regions. Section 4.2 reviews the simulation satellite altimetry datasets and Sect. 4.3 describes our evaluation framework.
4.1 NATL60 dataset and case study regions
In our study, the nature run (NR) corresponds to the NATL60 configuration (Molines, 2018) of the NEMO (Nucleus for European Modelling of the Ocean) model. It is one of the most advanced, stateoftheart, basinscale, highresolution ($\mathrm{1}/\mathrm{60}{}^{\circ}$) simulations available today, whose surface field effective resolution is about 7 km.
In this work, we will use the following five different subdomains of the North Atlantic basin (see Fig. 3):

two ${\mathrm{10}}^{\circ}\times {\mathrm{10}}^{\circ}$ GULFSTREAM and GULFSTREAM2 domains,

two ${\mathrm{8}}^{\circ}\times {\mathrm{10}}^{\circ}$ OSMOSIS and OSMOSIS2 openocean domains, and

a large ${\mathrm{20}}^{\circ}\times {\mathrm{40}}^{\circ}$ cNATL domain, at the center North Atlantic basin, used to assess 4DVarNet training on large domains, without any areas of land inside to avoid any issues in the learning process.
The GULFSTREAM and OSMOSIS domains (solid blue and red lines in Fig. 3) are the domains used by the BOOSTSWOT project in the framework of the NATL60 OSSE throughout the different related studies (see their 2020 ocean data challenges in Le Guillou et al., 2020). Because we aim at exploring the capabilities of 4DVarNet to deploy at the basin scale, we also propose the two alternate GULFSTREAM2 and OSMOSIS2 domains (dashed blue and red lines in Fig. 3), with similar dynamical properties to the two initial domains, and a larger domain centered in the North Atlantic basin (cNATL; dashed purple lines). The full extent of the subdomains is summarized in Table 1.
The GULFSTREAM regions display physical processes 100 times more energetic at scales larger than 100 km, with a greater temporal variability than the OSMOSIS regions. As a consequence, the SSH spatial gradient at scales above 100 km is lower for OSMOSIS regions, which explains why we can see more smallscalerelated structures on such domains. In addition to their intrinsic differences in terms of the dynamical regimes, the latitudes of GULFSTREAMbased and OSMOSISbased regions implies different SWOT temporal samplings. For OSMOSIS regions, one SWOT observation is available every day, while over the lowlatitude GULFSTREAM domains, the SWOT sampling is irregular, leading to sequences of several days with only pseudonadir observations.
Over these regions, the SSH resolution of the nature run is downgraded to $\mathrm{1}/\mathrm{20}{}^{\circ}$, which is enough to capture both mesoscale dynamical regimes and the OSMOSISrelated smaller scales, while avoiding unnecessary heavy computation time.
The NATL60 nature run will then be used as the reference ground truth (GT) in an observing system simulation experiments (OSSEs). The pseudoaltimetric nadir and SWOT observational datasets will be generated by a realistic subsampling of satellite constellations.
4.2 Simulated altimetry datasets
In this section, we provide a technical description of the two observational datasets used to train 4DVarNet, namely the four nadir and one SWOT plus four nadir configurations. Regarding the pseudonadir altimetry dataset, representative of the current preSWOT observational altimetric dataset, we use the ground tracks of four altimetric missions (TOPEX/Poseidon, Geosat, Jason1, and Envisat) picked up from the 2003 constellation to interpolate the NATL60 simulation from 1 October 2012 to 29 September 2013. A Gaussian white noise, with variance σ^{2}=(4⋯9) cm^{2}, is added to the interpolated NATL60 simulation by the SWOT simulator tool to mimic noise with a spectrum of error consistent with global estimates from the Jason2 altimeter (Dufau et al., 2016). We aggregate the nadir pseudoobservations on a daily basis to procure the gappy daily fields used as input by 4DVarNetSSH. Figures 4c vs. d and Figs. 5c vs. d illustrate the resulting nadir altimetry data on 25 October 2012.
We proceed similarly to simulate the SWOT pseudoobservations using the SWOT simulator tool (Gaultier et al., 2015) in its swath mode, with an alongtrack and acrosstrack 2 km spatial resolution (the same theoretical resolution that the upcoming SWOTmissionderived products are expected to provide). Let us note that we consider errorfree SWOT pseudoobservations.
4.3 Evaluation framework
Our evaluation framework exploits and extends the one introduced in Le Guillou et al. (2020), as follows:

Training and evaluation setting. Because the NATL60 dataset is made of 365 daily simulations, and the reference data used for training never have to be used during the optimization, we train all learningbased models using the time period from 4 February to 30 September 2013. During the training procedure, we select the best model according to the metrics computed over the validation period from 1 January to 2 February 2013. Overall, we evaluate the performance metrics over the test period from 22 October to 2 December 2012, which is 42 d, corresponding to two SWOT cycles in the SWOT sciencephase orbit. In doing so, the test period can be considered uncorrelated to the training and validation period.

Evaluation metrics. We use BOOSTSWOT DC (data challenge) metrics to benchmark the 4DVarNetSSH scheme with respect to the stateoftheart SSH interpolation schemes. They comprise the following:
 –
$\stackrel{\mathrm{\u203e}}{{\mathrm{RMSE}}_{\mathrm{s}}\left(t\right)}$, for the mean RMSE score (normalized RMSE),
 –
σ[RMSE_{s}(t)], for the RMSE(t) standard deviation of the RMSE(t), which gives some information regarding the temporal stability of the reconstruction,
 –
λ_{x}, for which the minimum spatial scale is resolved (wavelength in degrees),
 –
λ_{t}, for which the minimum temporal scale is resolved (wavelength in days),
where ${\mathrm{RMSE}}_{\mathrm{s}}\left(t\right)=\mathrm{1}\frac{\mathrm{RMSE}\left(t\right)}{\mathrm{RMS}\left(\mathit{x}\right)}$, RMS denotes the root mean square function, N is the number of pixels included in the study domain, and $\mathrm{RMSE}\left(t\right)=\sqrt{\frac{\mathrm{1}}{N}{\sum}_{i=\mathrm{1}}^{N}\left({\mathit{x}}^{\star}\right(t,i)\mathit{x}(t,i){)}^{\mathrm{2}}}$. Last, the spectral analysis (λ_{x} and λ_{t}) is based on the wavenumber frequency power spectral density score PSD${}_{\mathrm{S}}^{\mathrm{wf}}$, which is defined as PSD${}_{\mathrm{S}}^{\mathrm{wf}}=\mathrm{1}\frac{{\mathrm{PSD}}^{\mathrm{wf}}({\mathit{x}}^{\star}\mathit{x})}{{\mathrm{PSD}}^{\mathrm{wf}}\left(\mathit{x}\right)}$. We refer the reader to Le Guillou et al. (2020) for additional descriptions regarding these metrics. Besides these quantitative metrics, we also analyze the space–time distribution of the interpolation error and explore the impact of the interpolation for the characterization of mesoscale eddy dynamics. Based on the work of Mason et al. (2014), we detect anticyclonic and cyclonic eddies in the ground truth NATL60 outputs, interpolate SSH fields using the pyeddytracker toolbox (Delepoulle et al., 2022), and analyze how key features of matching eddies, such as speed radius (km), outer radius (km), amplitude (cm), and speed max (cm s^{−1}), are retrieved.
 –
This section presents the considered OSSE for the evaluation of the 4DVarNetSSH scheme. We first report the benchmarking experiments with respect to the state of the art (Sect. 5.1). Section 5.2 studies the impact of wideswath SWOT data to improve the reconstruction of finerscale SSH pattern. Last, we analyze generalization issues and uncertainty quantification in Sect. 5.3 and 5.4.
5.1 Benchmarking experiments
Regarding the BOOSTSWOT OSSE data challenge on the GULFSTREAM domain, we provide both performance with four nadirs and one SWOT plus four nadirs in Table 2. For both settings, the improvement is quite significant with respect to all benchmarked schemes, i.e., not only compared to DUACS OI (Taburet et al., 2019) but also with respect to the recently proposed SSH interpolation schemes Le Guillou et al. (2020), DYMOST (dynamic OI accounting for the SSH nonlinear temporal propagation; see, e.g., Ballarotta et al., 2020) and MIOST (multiscale OI) in Ardhuin et al. (2020). While DUACS OI has a minimal spatial and temporal resolution of 1.42^{∘} (four nadirs)$/$1.22^{∘} (one SWOT plus four nadirs) and 12 d (four nadirs)$/$11.15 d (one SWOT plus four nadirs), 4DVarNetSSH reaches 0.83^{∘} (four nadirs)$/$0.62^{∘} (one SWOT plus four nadirs) and 8.01 d (four nadirs)$/$5.29 d (one SWOT plus four nadirs). It amounts to a gain of up to 33 % in the fournadir setup and 50 % in the one SWOT plus four nadir configuration.
Figure 6 displays the SSH gradient field of DUACS OI and 4DVarNetSSH interpolations on 25 October. The comparison to the associated ground truth displayed in Fig. 4b clearly reveals the improvement brought by 4DVarNetSSH, in particular along the main meander of the GULFSTREAM.
We can draw similar conclusions from the experiments reported in Table 3 and Fig. 7 for the OSMOSIS domain. We may emphasize that 4DVarNetSSH interpolation for the one SWOT plus four nadir configuration (see, e.g., Fig. 7) retrieves most of the finescale features of the SSH fields, which are smoothed out by the optimal interpolation.
5.2 Impact of SWOT data on the interpolation performance
Thanks to its ability to reconstruct finerscale patterns, 4DVarNetSSH complements the assessment of the potential impact of SWOT data onto the reconstruction of mesoscale sea surface dynamics. Though the interpolation performance (Tables 2 and 3) improves with the use of SWOT data for all the interpolation methods, the relative improvement strongly depends on the interpolation method. Interestingly, contrary to the DUACS OI scheme, we report a significant improvement when using SWOT data with 4DVarNetSSH for both GULFSTREAM and OSMOSIS regions. These results emphasize the ability of our scheme to exploit irregularly sampled highresolution data. For instance, for the OSMOSIS region, we truly benefit from SWOT data for reconstructing mesoscale dynamics up to 0.4^{∘} and 7 d, whereas OI DUACS smooths out the altimetry signals in the mesoscale range below 1^{∘} and 14 d.
While we report relative gains of 20 %–25 % for the GULFSTREAM region for the different evaluation metrics, it reaches 40 %–60 % for the OSMOSIS domain. We interpret these results as a direct consequence of differences in the space–time sampling of SWOT data for these two regions. As revealed by Figs. 8b and 9b, no SWOT data may be available over 4 (respectively, 1) consecutive days for the GULFSTREAM (respectively, OSMOSIS) domain. This time variability in the sampling pattern translates to a periodic variability in the MSE (mean squared error) time series in the GULFSTREAM region. By contrast, the OSMOSIS region leads to a much lower time variability in the interpolation performance. The PSDbased analysis reported in Figs. 8c and 9c further supports these conclusions.
To complement with the analysis of the contribution of SWOT altimetry on the interpolation performance, Fig. 10 displays the eddy identification results for 25 October 2022 after application of a 200 km highpass filter when using a one SWOT plus four nadir configuration. Additional figures are given in Appendix B for illustrations of both the GULFSTREAM and OSMOSIS domains in the two observational configurations (four nadirs and one SWOT plus four nadirs). Clearly, 4DVarNetSSH improves the matching between the true and interpolated eddies (39 vs. 35), and the features of the matching eddies are also more similar to those of the true eddies, in terms of the speed radius (km), outer radius (km), amplitude (cm), and speed max (cm s^{−1}), with respect to their true values. Again, the interpolation of eddyrelated dynamics significantly improves with the exploitation of SWOT data.
5.3 Generalization performance
Whereas the results reported in the previous sections involve 4DVarNetSSH models evaluated on the same domain as the training one, we assess how 4DVarNetSSH schemes trained for a specific domain may also apply to another one. Besides the GULFSTREAM and OSMOSIS regions, we consider the following three additional domains:

cNATL domain, which is a larger 20${}^{\circ}\times $40^{∘} North Atlantic domain that involves a variety of dynamical regimes,

GULFSTREAM2 domain, which is a domain similar to the reference GULFSTREAM domain in terms of upperocean dynamics but with a disjointed spatial extent, and

OSMOSIS2 domain, which is a domain similar to the reference OSMOSIS domain in terms of upperocean dynamics but with a disjointed spatial extent.
For the one SWOT plus four nadir configuration, we train 4DVarNetSSH schemes on these three domains. We then evaluate how these models compare with the models reported in Sect. 5.1 for the GULFSTREAM and OSMOSIS domains. We also evaluate how the different models apply to the cNATL domain. Table 4 summarizes the resulting performance metrics.
As expected for each evaluation domain, we retrieve the best performance for the model trained on this domain. For the GULFSTREAM regions, the difference in terms of the minimal temporal scales is negligible, while the minimal spatial scales may exhibit an increase of 30 % when using the model trained on the GULFSTREAM2 domain. This does not hold in the opposite direction when applying on the GULFSTREAM2 domain a model learned on GULFSTREAM, as similar spatial scales resolved in the end. The same conclusions hold for the OSMOSIS regions, except that the minimal resolved temporal scales also display a slight increase (lower than 20 %) over OSMOSIS. These results are consistent with the dynamical properties given in Sect. 4 and support the generalization capabilities of 4DVarNetSSH schemes. The comparison with the performance metrics reported for the model trained on the cNATL domain suggests that the considered 4DVarNetSSH parameterization applies to a regional scale. This training configuration only leads to a relatively marginal gain with regard to OI DUACS when applied to the GULFSTREAM region. We report a slightly better performance for the OSMOSIS domain. We expect future work to explore new 4DVarNetSSH parameterizations, which could better account for basinscale variabilities.
5.4 Uncertainty quantification for 4DVarNetSSH interpolations
Besides gapfree fields, operational interpolation products generally require us to provide some evaluation of the reconstruction uncertainty. While this is a builtin feature of OI and statistical DA methods, uncertainty quantification may involve specific methodological or computational methods for other data assimilation schemes, among which ensemble methods represent a widely considered family of approaches (see, e.g., Asch et al., 2016). Their common feature is to generate an ensemble of solutions, generally through some randomization process.
Here, we benefit from the stochastic nature of the training procedure of 4DVarNetSSH schemes (Goodfellow et al., 2016). Similar to most deep learning schemes, we exploit a stochastic gradient descent during the learning stage and a random initialization of model parameters. As such, for a given training configuration, we can train an ensemble of 4DVarNetSSH schemes by running multiple training procedures.
We apply this approach to build an ensemble of nine 4DVarNetSSH schemes for a given training configuration, which comprises a training dataset, the considered 4DVarNetSSH parameterization, and given training hyperparameters (i.e., number of epochs, learning rates, and optimizers). For a given observation time window, we then retrieve nine interpolations from which we can compute a median field and the associated standard deviation. We report the performance metrics for the GULFSTREAM domain of the nine trained models and the median model in Table 5. It reveals the internal variability in the training process. Though it does not reach the best performance, the median model combines a resolved spatial scale below 0.7^{∘} and a resolved timescale below 5 d, which is only the case for 6 out of 9 of the trained models. Figure 12a further illustrates this aspect. Interestingly, the standard deviation of the ensemble of 4DVarNetSSH schemes correlates to the interpolation error, with an R^{2} coefficient of determination equal to 0.86. Even if the scales between the interpolation error and the trainingrelated 4DVarNet internal variability differ (see Fig. 13), the latter can be regarded as an indicator of the interpolation error, usually with an appropriate localization of large errors. In future works, we plan to draw from traditional ensemble DA methods or ensemble Gaussianbased simulations to address all the components of the interpolation error related to the data assimilation scheme.
This paper introduced the 4DVarNetSSH scheme, an endtoend neural architecture for the space–time interpolation of SSH fields from nadir and wideswath satellite altimetry data. The 4DVarNetSSH scheme draws from recent methodological development to bridge data assimilation and deep learning with a view to training 4DVar DA models and solvers from data. Numerical experiments within an OSSE setting support the relevance of the 4DVarNetSSH scheme with respect to the state of the art.
We further discuss our main contributions according to three aspects, namely the added value of a deep learning scheme for satellite altimetry and operational oceanography, the exploitation of upcoming SWOT data, and the ability to scale up learning approaches from regional case studies to the global scale.

Deep learning for satellite altimetry and operational oceanography. This study contributes to a growing research effort regarding the potential benefit of deep learning schemes for space and operational oceanography challenges (see, e.g., Ballarotta et al., 2020). Given the sampling of available satellite and in situ data sources, interpolation problems naturally arise as critical challenges. This study brings additional evidence of the potential of deep learning schemes to outperform the stateoftheart operational techniques, which are generally based on optimal interpolation and data assimilation. Importantly, we do not rely on the offtheshelf application of some reference deep learning architectures. The considered class of neural architecture relates to a variational DA formulation, such that it can be regarded as the implementation of a neural and trainable version of a DA model and solver. Our results for satellite altimetry are in line with other recent studies for other ocean parameters, such as sea surface temperature (Barth et al., 2019), suspended sediments (Vient et al., 2022), and 3D temperature and salinity fields (Pauthenet et al., 2022). All these studies support the potential of neural approaches to retrieve finerscale variabilities from available satellite and/or in situ observations. Regarding satellite altimetry, a future challenge includes the application to real altimetry datasets (see, e.g., the 2021 Observing System Experiments (OSEs) BOOSTSWOT data challenge at https://github.com/oceandatachallenges/2021a_SSH_mapping_OSE, last access: 2022) and the exploitation of multimodal synergies (Fablet and Chapron, 2022).

Making the most of SWOT data. Our study brings new evidence that the wideswath space–time sampling of the upcoming SWOT mission could lead to a very significant improvement in the reconstruction of mesoscale sea surface dynamics. For the considered case study regions, with contrasting dynamical regimes at play and different revisit times of SWOT orbits, we report relative gains from 20 % to 60 % compared to nadir altimetry data only in terms of RMSE and resolved space–timescales. These results assume an errorfree SWOT product. Therefore, exploring further how these results could generalize to errorprone (EstebanFernandez, 2014; Gaultier and Ubelmann, 2010) and uncalibrated SWOT data (Febvre et al., 2022) is a critical challenge. Preliminary preprocessing of the pseudoSWOT observations (Metref et al., 2020) to filter out the correlated components and avoid major issues in the assimilation and/or learning process of the interpolation methods may also be considered. The extension of the considered OSSE to multiSWOT configurations could also provide new means to optimize the deployment of multisatellite configurations in coming years.

Scaling up to a global scale with a learningbased scheme. Our numerical experiments focused mainly on a regional scale, typically $\mathrm{10}{}^{\circ}\times \mathrm{10}{}^{\circ}$ domains, as illustrated by the GULFSTREAM and OSMOSIS regions. The reported results support the relevance of the proposed 4DVarNetSSH parameterization to account for such regional space–time variabilities. Scaling up to a basin scale or even the global scale naturally arises as a key challenge for future work. Through the builtin features of the PyTorch framework and its associated packages, our opensource code can leverage multiGPU distribution learning schemes and onthefly minibatch generation tools to deal with largerscale datasets from a computational point of view. To account for a greater diversity in the dynamical regimes at play on the global scale, or even on a basin scale, it also seems necessary to explore more complex 4DVarNetSSH parameterizations, especially regarding dynamical prior Φ. This could benefit from the variety of neural architectures recently introduced in computational imaging (Barbastathis et al., 2019), especially when using attention mechanisms (Vaswani et al., 2017) to achieve some decomposition of the underlying space–time variabilities.
Let note that when replacing both CNN (convolutional neural networks) and/or LSTM cells by the identity operator and the minimization function ${\mathcal{J}}_{\mathrm{\Phi}}(\mathit{x},\mathit{y},\mathrm{\Omega})$ by its single regularization term ${\mathcal{J}}_{\mathrm{\Phi}}^{b}\left(\mathit{x}\right)$, the gradientbased solver simply leads to a parameterfree fixedpoint version of the algorithm, the same used in Beauchamp et al. (2020); Fablet et al. (2019), which is similar to the DINEOF approach (see Fig. A1).
This fixedpoint solver is parameter free and easily implemented as a neural network (NN) in a joint solution with the NN parameterization of 𝒥_{Φ} for the interpolation problem.
The opensource 4DVarNet version of the code is available at https://doi.org/10.5281/zenodo.7186322 (hgeorgenthum et al., 2023). The datasets are shared through the BOOSTSWOT data challenge also available on GitHub (https://github.com/oceandatachallenges/2020a_SSH_mapping_NATL60, last access: 2022).
The animations corresponding to the 4DVarNet comparison to DUACS OI on the BOOSTSWOT DC test period are given for both GULFSTREAM and OSMOSIS domains in the four nadirs and one SWOT plus four nadir configuration. They can be found on the OceaniXAI YouTube channel under the following:

GULFSTREAM (four nadirs) at https://youtube.com/shorts/QKXukB_Rd5E (Beauchamp, 2022a),

GULFSTREAM (one SWOT plus four nadirs) at https://youtube.com/shorts/i91Z1pMm4gY (Beauchamp, 2022b),

OSMOSIS (four nadirs) at https://youtube.com/shorts/Pxcsd0Afco0 (Beauchamp, 2022c), and

OSMOSIS (one SWOT plus four nadirs) at https://youtube.com/shorts/HbVSJFtdG6Q (Beauchamp, 2022d).
MB designed the experiments, ran the analysis of the results, and wrote the paper. RF is the principal investigator of the 4DVarNet methodology. QF led the developments of the 4DVarNet implementation on large domains. HG ran the experiments used in this paper. All the authors actively participated to create the opensource 4DVarNet version of the code available at https://doi.org/10.5281/zenodo.7186322 (hgeorgenthum et al., 2023).
The contact author has declared that none of the authors has any competing interests.
Publisher's note: Copernicus Publications remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
This work has been supported by the LEFE program (LEFE MANU project IAOAC), CNES (grant OSTST DUACSHR), and ANR Projects Melody and OceaniX. It has benefited from HPC and GPU resources from Azure (Microsoft Azure grant).
This research has been supported by GENCIIDRIS (grant no. 2020101030).
This paper was edited by Xiaomeng Huang and reviewed by two anonymous referees.
AlveraAzcárate, A., Barth, A., Rixen, M., and Beckers, J. M.: Reconstruction of incomplete oceanographic data sets using empirical orthogonal functions: application to the Adriatic Sea surface temperature, Ocean Model., 9, 325–346, https://doi.org/10.1016/j.ocemod.2004.08.001, 2005. a
AlveraAzcárate, A., Barth, A., Sirjacobs, D., and Beckers, J.M.: Enhancing temporal correlations in EOF expansions for the reconstruction of missing data using DINEOF, Ocean Sci., 5, 475–485, https://doi.org/10.5194/os54752009, 2009. a, b
Andrychowicz, M., Denil, M., Gomez, S., Hoffman, M. W., Pfau, D., Schaul, T., Shillingford, B., and De Freitas, N.: Learning to learn by gradient descent by gradient descent, in: Advances in neural information processing systems, 3981–3989, https://doi.org/10.48550/arXiv.1606.04474, 2016. a
Ardhuin, F., Ubelmann, C., Dibarboure, G., Gaultier, L., Ponte, A., Ballarotta, M., and Faugère, Y.: Reconstructing Ocean Surface Current Combining Altimetry and Future Spaceborne Doppler Data, ESS Open Archive [preprint], p. 22, https://doi.org/10.1002/essoar.10505014.1, 2020. a, b, c
Asch, M., Bocquet, M., and Nodet, M.: Data Assimilation, in: Fundamentals of Algorithms, Society for Industrial and Applied Mathematics, https://doi.org/10.1137/1.9781611974546, 2016. a, b, c
Ballarotta, M., Ubelmann, C., Pujol, M.I., Taburet, G., Fournier, F., Legeais, J.F., Faugère, Y., Delepoulle, A., Chelton, D., Dibarboure, G., and Picot, N.: On the resolutions of ocean altimetry maps, Ocean Sci., 15, 1091–1109, https://doi.org/10.5194/os1510912019, 2019. a
Ballarotta, M., Ubelmann, C., Rogé, M., Fournier, F., Faugère, Y., Dibarboure, G., Morrow, R., and Picot, N.: Dynamic Mapping of AlongTrack Ocean Altimetry: Performance from Real Observations, J. Atmos. Ocean. Tech., 37, 1593–1601, https://doi.org/10.1175/JTECHD200030.1, 2020. a, b
Barbastathis, G., Ozcan, A., and Situ, G.: On the use of deep learning for computational imaging, Optica, 6, 921–943, https://doi.org/10.1364/OPTICA.6.000921, 2019. a
Barth, A., AlveraAzcárate, A., Licer, M., and Beckers, J.M.: DINCAE 1.0: a convolutional neural network with error estimates to reconstruct sea surface temperature satellite observations, Geoscientific Model Development Discussions, 2019, 1–21, https://doi.org/10.5194/gmd2019128, 2019. a, b
Beauchamp, M.: GF (four nadirs) application of 4DVarNetSSH, Youtube [video], https://youtube.com/shorts/QKXukB_Rd5E, last access: 26 August 2022a. a
Beauchamp, M.: GF (one SWOT plus four nadirs) application of 4DVarNetSSH, Youtube [video], https://youtube.com/shorts/i91Z1pMm4gY, last access: 26 August 2022b. a
Beauchamp, M.: OSMOSIS (four nadirs) application of 4DVarNetSSH, Youtube [video], https://youtube.com/shorts/Pxcsd0Afco0, last access: 26 August 2022c. a
Beauchamp, M.: OSMOSIS (one SWOT plus four nadirs) application of 4DVarNetSSH, Youtube [video], https://youtube.com/shorts/HbVSJFtdG6Q, last access: 26 August 2022d. a
Beauchamp, M., Fablet, R., Ubelmann, C., Ballarotta, M., and Chapron, B.: Intercomparison of DataDriven and LearningBased Interpolations of AlongTrack Nadir and WideSwath SWOT Altimetry Observations, Remote Sensing, 12, 3806, https://doi.org/10.3390/rs12223806, 2020. a, b, c, d, e
Beauchamp, M., Amar, M. M., Febvre, Q., and Fablet, R.: EndtoEnd Learning of Variational Interpolation Schemes for SatelliteDerived SSH Data, in: 2021 IEEE International Geoscience and Remote Sensing Symposium IGARSS, Brussels, Belgium, 2021, 7418–7421, https://doi.org/10.1109/IGARSS47720.2021.9554800, 2021. a, b
Beauchamp, M., Thompson, J., Georgenthum, H., Febvre, Q., and Fablet, R.: Learning Neural Optimal Interpolation Models and Solvers, arXiv [preprint], https://doi.org/10.48550/ARXIV.2211.07209, 2022. a, b
Beckers, J. M. and Rixen, M.: EOF Calculations and Data Filling from Incomplete Oceanographic Datasets, J. Atmos. Ocean. Tech., 20, 1839–1856, https://doi.org/10.1175/15200426(2003)020<1839:ECADFF>2.0.CO;2, 2003a. a
Beckers, J. M. and Rixen, M.: EOF Calculations and Data Filling from Incomplete Oceanographic Datasets, J. Atmos. Ocean. Tech., 20, 1839–1856, 2003b. a
Benkiran, M., Ruggiero, G., Greiner, E., Le Traon, P.Y., Rémy, E., Lellouche, J. M., BourdalléBadie, R., Drillet, Y., and Tchonang, B.: Assessing the Impact of the Assimilation of SWOT Observations in a Global HighResolution Analysis and Forecasting System Part 1: Methods, Front. Mar. Sci., 8, https://doi.org/10.3389/fmars.2021.691955, 2021. a, b
Carrassi, A., Bocquet, M., Bertino, L., and Evensen, G.: Data assimilation in the geosciences: An overview of methods, issues, and perspectives, WIREs Clim. Change, 9, e535, https://doi.org/10.1002/wcc.535, 2018. a, b
Chelton, D. B., Ries, J., Haines, B. J., Fu, L.L., and Callahan, P. S.: Satellite Altimetry, in: International Geophysics, edited by: Cazenave, A. and Fu, L.L., vol. 69 of Satellite Altimetry and Earth SciencesA Handbook of Techniques and Applications, 1–ii, Academic Press, http://www.sciencedirect.com/science/article/pii/S0074614201801467 (last access: 11 April 2023), 2001. a
Delepoulle, A., evanmason, Clément, CoriPegliasco, Capet, A., Troupin, C., and Koldunov, N.: AntSimi/pyeddytracker: v3.6.1, Zenodo [code], https://doi.org/10.5281/zenodo.7197432, 2022. a
Dufau, C., Orsztynowicz, M., Dibarboure, G., Morrow, R., and Le Traon, P.Y.: Mesoscale resolution capability of altimetry: Present and future, J. Geophys. Res.Oceans, 121, 4910–4927, https://doi.org/10.1002/2015JC010904, 2016. a
EstebanFernandez, D.: SWOT project mission performance and error budget document, Tech. rep., JPL D79084, NASA, 2014. a
Evensen, G.: Data Assimilation, Springer Berlin Heidelberg, Berlin, https://doi.org/10.1007/9783642037115, 2009. a
Fablet, R. and Chapron, B.: Multimodal learningbased inversion models for the spacetime reconstruction of satellitederived geophysical fields, ArXiv [preprint], https://doi.org/10.48550/ARXIV.2203.10640, 2022. a, b, c
Fablet, R., Drumetz, L., and Rousseau, F.: Endtoend learning of optimal interpolators for geophysical dynamics, CI 2019: 9th International Workshop on Climate Informatics, Paris, France, https://imtatlantique.hal.science/hal02285701 (last access: 11 April 2023), 2019. a
Fablet, R., Drumetz, L., and Rousseau, F.: Joint learning of variational representations and solvers for inverse problems with partiallyobserved data, arXiv [preprint], https://doi.org/10.48550/arXiv.2006.03653, 2020. a, b
Fablet, R., Beauchamp, M., Drumetz, L., and Rousseau, F.: Joint Interpolation and Representation Learning for Irregularly Sampled SatelliteDerived Geophysical Fields, Front. Appl. Math. Stat., 7, 655224, https://doi.org/10.3389/fams.2021.655224, 2021. a, b, c, d
Febvre, Q., Fablet, R., Sommer, J. L., and Ubelmann, C.: Joint Calibration and Mapping of Satellite Altimetry Data Using Trainable Variational Models, in: ICASSP 2022 – 2022 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), 1536–1540, https://doi.org/10.1109/ICASSP43922.2022.9746889, 2022. a
Gaultier, L. and Ubelmann, C.: SWOT Simulator Documentation, Tech. rep., JPL, NASA, 2010. a
Gaultier, L., Ubelmann, C., and Fu, L.L.: The Challenge of Using Future SWOT Data for Oceanic Field Reconstruction, J. Atmos. Ocean. Tech., 33, 119–126, https://doi.org/10.1175/JTECHD150160.1, 2015. a, b
Goodfellow, I., Bengio, Y., and Courville, A.: Deep Learning, MIT Press, http://www.deeplearningbook.org (last access: 11 April 2023), 2016. a
hgeorgenthum, Febvre, Q., maxbeauchamp, Fablet, R., Carpentier, B., and MMAMAR: CIAOceanix/4dvarnetcore: Release for 4DVarNetMMSSH code (4dvarnetmmsshtgrs2022), Zenodo [code], https://doi.org/10.5281/zenodo.7503266, 2023. a, b, c
Le Guillou, F., Metref, S., Cosme, E., Ubelmann, C., Ballarotta, M., Verron, J., and Le Sommer, J.: Mapping altimetry in the forthcoming SWOT era by backandforth nudging a onelayer quasigeostrophic model, Earth and Space Science Open Archive [preprint], p. 15, https://doi.org/10.1002/essoar.10504575.1, 2020. a, b, c, d, e, f
Lellouche, J.M., Greiner, E., Le Galloudec, O., Garric, G., Regnier, C., Drevillon, M., Benkiran, M., Testut, C.E., BourdalleBadie, R., Gasparin, F., Hernandez, O., Levier, B., Drillet, Y., Remy, E., and Le Traon, P.Y.: Recent updates to the Copernicus Marine Service global ocean monitoring and forecasting realtime 1∕12° highresolution system, Ocean Sci., 14, 1093–1126, https://doi.org/10.5194/os1410932018, 2018. a
Lguensat, R., Tandeo, P., Aillot, P., and Fablet, R.: The Analog Data Assimilation, Mon. Weather Rev., 145, 4093–4107, https://doi.org/10.1175/MWRD160441.1, 2017. a, b, c
Li, Z., Archer, M., Wang, J., and Fu, L.L.: Formulation and demonstration of an extended3DVAR multiscale data assimilation system for the SWOT altimetry era, Ocean Sci. Discuss. [preprint], https://doi.org/10.5194/os202189, 2021. a
LopezRadcenco, M., Pascual, A., GomezNavarro, L., AissaElBey, A., Chapron, B., and Fablet, R.: Analog Data Assimilation of AlongTrack Nadir and WideSwath SWOT Altimetry Observations in the Western Mediterranean Sea, IEEE J. Sel. Top. Appl., 12, 2530–2540, https://doi.org/10.1109/JSTARS.2019.2903941, 2019. a
Manucharyan, G. E., Siegelman, L., and Klein, P.: A Deep Learning Approach to Spatiotemporal Sea Surface Height Interpolation and Estimation of Deep Currents in Geostrophic Ocean Turbulence, J. Adv. Model. Earth Sy., 13, e2019MS001965, https://doi.org/10.1029/2019MS001965, 2021. a
Mason, E., Pascual, A., and McWilliams, J. C.: A New Sea Surface Height–Based Code for Oceanic Mesoscale Eddy Tracking, J. Atmos. Ocean. Tech., 31, 1181–1188, https://doi.org/10.1175/JTECHD1400019.1, 2014. a
Metref, S., Cosme, E., Le Guillou, F., Le Sommer, J., Brankart, J.M., and Verron, J.: WideSwath Altimetric Satellite Data Assimilation With CorrelatedError Reduction, Front. Mar. Sci., 6, 822, https://doi.org/10.3389/fmars.2019.00822, 2020. a
Molines, J.M.: meomconfigurations/NATL60CJM165: NATL60 code used for CJM165 experiment, Zenodo [code], https://doi.org/10.5281/zenodo.1210116, 2018. a
Ngodock, H., Carrier, M., Souopgui, I., Smith, S., Martin, P., Muscarella, P., and Jacobs, G.: On the direct assimilation of alongtrack seasurface height observations into a freesurface ocean model using a weak constraints fourdimensional variational (4DVar) method, Q. J. Roy. Meteor. Soc., 142, 1160–1170, https://doi.org/10.1002/qj.2721, 2015. a
Pauthenet, E., Bachelot, L., Balem, K., Maze, G., Tréguier, A.M., Roquet, F., Fablet, R., and Tandeo, P.: Fourdimensional temperature, salinity and mixedlayer depth in the Gulf Stream, reconstructed from remotesensing and in situ observations with neural networks, Ocean Sci., 18, 1221–1244, https://doi.org/10.5194/os1812212022, 2022. a
Shi, X., Chen, Z., Wang, H., Yeung, D.Y., Wong, W.K., and WOO, W.C.: Convolutional LSTM Network: A Machine Learning Approach for Precipitation Nowcasting, in: Advances in Neural Information Processing Systems, edited by: Cortes, C., Lawrence, N., Lee, D., Sugiyama, M., and Garnett, R., vol. 28, Curran Associates, Inc., https://proceedings.neurips.cc/paper/2015/file/07563a3fe3bbe7e3ba84431ad9d055afPaper.pdf (last access: 11 April 2023), 2015. a
Taburet, G., SanchezRoman, A., Ballarotta, M., Pujol, M.I., Legeais, J.F., Fournier, F., Faugere, Y., and Dibarboure, G.: DUACS DT2018: 25 years of reprocessed sea level altimetry products, Ocean Sci., 15, 1207–1224, https://doi.org/10.5194/os1512072019, 2019. a, b, c, d
Tandeo, P., Ailliot, P., Bocquet, M., Carrassi, A., Miyoshi, T., Pulido, M., and Zhen, Y.: A Review of InnovationBased Methods to Jointly Estimate Model and Observation Error Covariance Matrices in Ensemble Data Assimilation, Mon. Weather Rev., 148, 3973–3994, https://doi.org/10.1175/mwrd190240.1, 2020. a, b
Ubelmann, C., Cornuelle, B., and Fu, L.L.: Dynamic Mapping of AlongTrack Ocean Altimetry: Method and Performance from Observing System Simulation Experiments, J. Atmos. Ocean. Tech., 33, 1691–1699, https://doi.org/10.1175/JTECHD150163.1, 2016. a, b
Vaswani, A., Shazeer, N., Parmar, N., Uszkoreit, J., Jones, L., Gomez, A. N., Kaiser, L., and Polosukhin, I.: Attention is All you Need, in: Advances in Neural Information Processing Systems, edited by: Guyon, I., Luxburg, U. V., Bengio, S., Wallach, H., Fergus, R., Vishwanathan, S., and Garnett, R., vol. 30, Curran Associates, Inc., https://proceedings.neurips.cc/paper/2017/file/3f5ee243547dee91fbd053c1c4a845aaPaper.pdf (last access: 11 April 2023), 2017. a
Vient, J.M., Fablet, R., Jourdin, F., and Delacourt, C.: EndtoEnd Neural Interpolation of SatelliteDerived Sea Surface Suspended Sediment Concentrations, Remote Sensing, 14, 4024, https://doi.org/10.3390/rs14164024, 2022. a
 Abstract
 Introduction
 Background and related work
 Method
 Observation system simulation experiments
 Results
 Conclusion and discussion
 Appendix A: Fixedpoint formulation of the solver
 Appendix B: Additional results on the 4DVarNet generalization capabilities
 Appendix C: Eddy identifications
 Code and data availability
 Video supplement
 Author contributions
 Competing interests
 Disclaimer
 Acknowledgements
 Financial support
 Review statement
 References
 Abstract
 Introduction
 Background and related work
 Method
 Observation system simulation experiments
 Results
 Conclusion and discussion
 Appendix A: Fixedpoint formulation of the solver
 Appendix B: Additional results on the 4DVarNet generalization capabilities
 Appendix C: Eddy identifications
 Code and data availability
 Video supplement
 Author contributions
 Competing interests
 Disclaimer
 Acknowledgements
 Financial support
 Review statement
 References