Articles | Volume 17, issue 21
https://doi.org/10.5194/gmd-17-7595-2024
https://doi.org/10.5194/gmd-17-7595-2024
Model description paper
 | 
30 Oct 2024
Model description paper |  | 30 Oct 2024

FLEXPART version 11: improved accuracy, efficiency, and flexibility

Lucie Bakels, Daria Tatsii, Anne Tipka, Rona Thompson, Marina Dütsch, Michael Blaschek, Petra Seibert, Katharina Baier, Silvia Bucci, Massimo Cassiani, Sabine Eckhardt, Christine Groot Zwaaftink, Stephan Henne, Pirmin Kaufmann, Vincent Lechner, Christian Maurer, Marie D. Mulder, Ignacio Pisso, Andreas Plach, Rakesh Subramanian, Martin Vojta, and Andreas Stohl
Abstract

Numerical methods and simulation codes are essential for the advancement of our understanding of complex atmospheric processes. As technology and computer hardware continue to evolve, the development of sophisticated code is vital for accurate and efficient simulations. In this paper, we present the recent advancements made in the FLEXible PARTicle dispersion model (FLEXPART), a Lagrangian particle dispersion model, which has been used in a wide range of atmospheric transport studies over the past 3 decades, extending from tracing radionuclides from the Fukushima nuclear disaster, to inverse modelling of greenhouse gases, and to the study of atmospheric moisture cycles.

This version of FLEXPART includes notable improvements in accuracy and computational efficiency. (1) By leveraging the native vertical coordinates of European Centre for Medium Range Weather Forecasts (ECMWF) Integrated Forecasting System (IFS) instead of interpolating to terrain-following coordinates, we achieved an improvement in trajectory accuracy, leading to a ∼8 %–10 % reduction in conservation errors for quasi-conservative quantities like potential vorticity. (2) The shape of aerosol particles is now accounted for in the gravitational settling and dry-deposition calculation, increasing the simulation accuracy for non-spherical aerosol particles such as microplastic fibres. (3) Wet deposition has been improved by the introduction of a new below-cloud scheme, by a new cloud identification scheme, and by improving the interpolation of precipitation. (4) Functionality from a separate version of FLEXPART, the FLEXPART CTM (chemical transport model), is implemented, which includes linear chemical reactions. Additionally, the incorporation of Open Multi-Processing parallelisation makes the model better suited for handling large input data. Furthermore, we introduced novel methods for the input and output of particle properties and distributions. Users now have the option to run FLEXPART with more flexible particle input data, providing greater adaptability for specific research scenarios (e.g. effective backward simulations corresponding to satellite retrievals). Finally, a new user manual (https://flexpart.img.univie.ac.at/docs/, last access: 11 September 2024) and restructuring of the source code into modules will serve as a basis for further development.

1 Introduction

Atmospheric transport modelling plays an important role in understanding many of the complex interactions within our atmosphere. Traditionally, Eulerian methods have been widely used for such modelling. These methods solve the atmospheric advection–diffusion equation on a fixed grid and give the concentration of tracer gases or aerosols at each grid point as a function of time. Eulerian methods offer a convenient means of accounting for all processes that occur during transport, including nonlinear atmospheric chemistry. However, they typically have a relatively high level of numerical diffusion (e.g. Reithmeier and Sausen2002; Cassiani et al.2016), limiting their capability of preserving plumes over long transport distances (Rastigejev et al.2010), and the spatial resolution of the concentration fields is limited by the grid spacing of the model. Lagrangian methods, on the other hand, follow individual “computational particles” (from now on referred to as “particle”) and simulate their transport based on large-scale winds from Eulerian input data and parameterised small-scale fluctuations. They are independent of the computational grid and can therefore produce concentration fields with potentially infinitesimal spatial resolution at relatively low computational cost, especially if several tracers are to be transported simultaneously. Another advantage of Lagrangian methods is that they can provide a direct link between regions along particle trajectories.

Atmospheric transport models using the Lagrangian method with the parameterisation of sub-grid processes are typically referred to as Lagrangian particle dispersion models (LPDMs). One prominent LPDM is the FLEXible PARTicle dispersion model (FLEXPART), which was developed nearly 3 decades ago to simulate the dispersion of radionuclides resulting from nuclear disasters such as the Chernobyl accident (Stohl et al.1998). Since its inception, FLEXPART has proven to be a valuable tool for studying a wide range of environmental problems in both research and operational settings. Its applications now cover large parts of atmospheric research, including the simulation of the transport of heat and water in the atmosphere (e.g. Baier et al.2022; Peng et al.2022), volcanic and wildfire plumes (e.g. Stohl et al.2006, 2011; Moxnes et al.2014), transport and fall-out after nuclear accidents or explosions (e.g. Stohl et al.2012; Arnold et al.2015), transport of aerosols such as dust (e.g. Groot Zwaaftink et al.2017; Ryder et al.2019) and microplastics (e.g. Evangelou et al.2024; Evangeliou et al.2020), the interpretation of biogenic secondary organic aerosol compound measurements (e.g. Martinsson et al.2017), the transport of pollutants into remote regions like the Arctic (e.g. Dada et al.2022; Zhu et al.2020), the interpretation of ice cores (e.g. Eckhardt et al.2023; McConnell et al.2024), and the modelling of emission sensitivities for greenhouse gas atmospheric concentrations (e.g. Bergamaschi et al.2022; Vojta et al.2022).

Besides FLEXPART, several other LPDMs exist, such as HYSPLIT (Draxler and Hess1998), STILT (Lin et al.2003), TRACMASS (Döös et al.2017), MPTRAC (Hoffmann et al.2022), ATTILA (Brinkop and Jöckel2019), NAME (Jones et al.2007), SPRAY (Tinarelli et al.2000), and the Canadian Meteorological Centre (CMC)'s dispersion modelling suite (D'Amours et al.2015). FLEXPART combines the following capabilities: (i) a detailed parameterisations for Gaussian (Stohl and Thomson1999) and non-Gaussian (Cassiani et al.2015) turbulence in the atmospheric boundary layer (ABL), which both take into account the vertical gradient of air density; (ii) a sub-grid convection parameterisation (Forster et al.2007); (iii) treatment of radioactive decay in the atmosphere and on the ground (Stohl et al.1998); (iv) detailed parameterisations for dry and wet deposition and gravitational settling (Stohl et al.2005); (v) linear chemical reaction with hydroxyl radicals (Pisso et al.2019); (vi) the capability of running the model backward in time to create sensitivities of atmospheric concentrations and depositions to emission sources (Seibert and Frank2004; Eckhardt et al.2017) that can be interfaced directly with an inverse modelling code for determining emissions (Thompson and Stohl2014); and (vii) a domain-filling option, where the entire atmosphere can be filled with particles (Stohl and James2004), which is useful for producing Lagrangian climate diagnostics (e.g. Schicker et al.2010; Baier et al.2022) and three-dimensional concentration fields of greenhouse gases that may serve as initial conditions for inverse modelling (Groot Zwaaftink et al.2018; Vojta et al.2022).

This paper describes a new model version, FLEXPART 11, that adds four important new features to FLEXPART's capabilities, as well as other improvements. First, when driven with data from the European Centre for Medium Range Weather Forecasts (ECMWF), FLEXPART 11 offers the option to keep the original model layers intact for the transport with resolved-scale winds, instead of interpolating to a coordinate system with fixed heights above terrain as previous versions did (see Sect. 3). We show that this improves the overall accuracy of FLEXPART simulations. Second, FLEXPART 11 can calculate the drag coefficient of non-spherical aerosol particles of various shapes, which improves the calculated gravitational settling of such particles substantially and thereby has a large effect on their overall simulated transport in the atmosphere (see Sect. 4). Third, a new below-cloud scavenging scheme for aerosols is introduced, as well as an improved interpolation scheme for precipitation and a new cloud layer identification scheme (see Sect. 5). Last, linear chemical reactions are implemented based on the initial work of Henne et al. (2018), who developed the FLEXPART CTM from FLEXPART 8 (where CTM stands for chemical transport model), which was first described in Groot Zwaaftink et al. (2018) (see Sect. 6). In addition to enhancing the model's core functionality, we have improved the user interface by incorporating additional options for ways of running FLEXPART (see Sect. 9).

Computational efficiency is another important consideration. Legacy models such as earlier versions of FLEXPART or HYSPLIT (Draxler and Hess1998) were originally designed for serial processing. An important step was made with FLEXPART 10.4, which introduced the option to use the Message Passing Interface (MPI) parallelisation (Pisso et al.2019). However, especially with the increasing size of the meteorological input data, the memory requirement became problematic in parallel mode. For this reason, we opted for a different parallelisation strategy, using OpenMP (Open Multi-Processing), following the FLEXPART CTM (Henne et al.2018) (see Sect. 8). Furthermore, numerous features added over a period of more than 25 years that often deviate from the original coding standards make the FLEXPART 10.4 source code difficult to understand and maintain. Models that were created recently, such as MPTRAC (Hoffmann et al.2022), are designed from scratch to run on current hardware, for instance, by utilising the acceleration offered by graphics processing units (GPUs), while not being under the constraint of a legacy code base. However, as FLEXPART is a model that is well tested for a wide range of applications, offers many features not available in other models, and has a large user community, a complete rewrite of the code did not seem appealing. Instead, the approach that started with FLEXPART 8 and 10 to introduce features of modern FORTRAN standards into the source code was continued. In FLEXPART 11, all programme subunits have been encapsulated into modules, and more use has been made of whole-array syntax.

We validate our changes by comparing FLEXPART 11 to tracer experiments (Sect. 7). We also test the conservation of meteorological tracers (Sect. 3.2), the degree to which particles in a global-domain-filling simulation stay well mixed (Sect. 3.3), and the removal processes by reproducing the Fukushima Daiichi Nuclear Power Plant accident (Sect. 5.4).

For users unfamiliar with FLEXPART, a short overview of the FLEXPART 11 capabilities, input data, and code reorganisation can be found in the Supplement (see Appendix A). Accompanying this paper is a completely revised technical documentation, including a download and installation guide, of FLEXPART (https://flexpart.img.univie.ac.at/docs, last access: 11 September 2024); a snapshot of the code used in this work is available at https://doi.org/10.5281/zenodo.12706632 (Bakels et al.2024). We recommend that users of FLEXPART consult this living document for updates and future code developments.

2 Input data

FLEXPART calculates particle trajectories using meteorological data interpolated in time and space from time sequences of three-dimensional fields of, e.g., wind velocities, density, temperature, specific humidity, and cloud liquid and ice water content. FLEXPART 11 supports two input formats of data from the European Centre for Medium Range Weather Forecasts (ECMWF) and from the National Centers for Environmental Prediction (NCEP) forecast systems, namely the Integrated Forecasting System (IFS) and Global Forecast System (GFS), respectively. See Appendix A1 for further details.

For the examples provided in this paper, we use the most recent re-analysis dataset of ECMWF, ERA5 (Hersbach et al.2020), with hourly 0.5° × 0.5° data on all of the 137 model levels as input to FLEXPART.

3 Grid-scale advection based on ECMWF fields on native coordinate surfaces

While we know that FLEXPART does not quickly produce strong anomalies in particle distributions in domain-filling simulations (Stohl and James2004), the degree to which older versions of FLEXPART obeyed the well-mixed criterion with respect to particle positions over periods of months to years was not entirely satisfying. For this reason, we decided to switch from z to η coordinates (see Sect. 3.1), as it might reduce interpolation errors (see Sect. 3.2) and improve particle transport accuracy and particle distribution in domain-filling simulations (see Sect. 3.3).

3.1 The η-coordinate system

The ECMWF's IFS employs hybrid pressure base vertical coordinates, where the η surfaces are given by

(1) η k = a k / P 0 + b k .

Here, ηk is the value of η at the kth model level; P0= 101 325 Pa is the reference pressure; and ak and bk are coefficients chosen such that the levels closest to the surface follow the topography, the highest levels are pressure surfaces, and intermediate levels are hybrids between the two. The pressure in the η-coordinate system is determined by the surface pressure Ps, which varies in space and time:

(2) P k ( λ , ϕ , t ) = a k + b k P s ( λ , ϕ , t ) .

Here, λ, ϕ, and t denote longitude, latitude, and time, respectively. In this system, the vertical velocity is also represented in η coordinates, where negative values indicate upward motion. Detailed information on the η-coordinate system can be found in the ECMWF – IFS documentation (2023). While ECMWF meteorological data can also be downloaded on pressure levels, pressure level data are less accurate, since they are interpolated between the η levels, and fewer levels are available.

The boundary layer turbulence scheme utilised by FLEXPART (Hanna1982; Stohl et al.1998) is based on the terrain-following geometric height z as a vertical coordinate, with turbulent velocities expressed in units of metres per second (m s−1). For this reason, and to avoid frequent time-consuming coordinate transformations, older versions of FLEXPART used an internal terrain-following Cartesian (z) coordinate system, and all meteorological data were interpolated to these internal z coordinates. However, this approach introduced additional interpolation errors, since the meteorological data needed to be interpolated first from η to z levels and then to particle positions.

To mitigate these interpolation errors and improve computational accuracy, FLEXPART 11 retains the η-coordinate system whenever possible. Only in the ABL, where the Hanna turbulence scheme (Hanna1982) is used, are the z levels kept as the main coordinate system. However, interpolation errors are smaller in the ABL than in higher layers of the atmosphere, since the lowest η levels follow the topography, and z levels are chosen to coincide closely to η levels, with the best agreement near the surface and an almost perfect agreement for surface pressure values that are typical of the sea level. Everywhere else, the native η-coordinate system is used in FLEXPART 11 to interpolate meteorological data to the particle positions and advect the particles. The η coordinates are utilised in FLEXPART 11 by default but can be switched off at the time of the compilation by building the FLEXPART 11 executable with the addition of eta=no. In this case, meteorological data are interpolated to z coordinates as in previous FLEXPART versions. Below, we demonstrate that the switch of coordinate system clearly increases the accuracy of the model computations. We evaluate conservation errors in the quasi-conservative properties in Sect. 3.2 and the error in the particle density distribution of a global domain-filling simulation in Sect. 3.3.

3.2 Quasi-conservative properties

It is not a trivial task to prove that changes in a Lagrangian model lead to improved trajectory accuracy, since ground truth trajectories are usually not available. To show the increase in accuracy obtained as a consequence of keeping ECMWF's η-coordinate system largely intact (except for within the ABL), we followed Stohl and Seibert (1998) and evaluate the conservation of quasi-conservative properties along trajectories (Fig. 1), such as potential vorticity (PV), potential temperature (Θ), and specific humidity (q). These properties are expected to be reasonably well conserved in the absence of diabatic processes. Therefore, for a date in each season, we released 6 million particles that are globally distributed using the domain-filling option and followed their trajectories for 48 h. At heights above 5 km, diabatic processes related to surface interactions can be excluded, and furthermore, the differences between η and z levels are substantial. Therefore, we traced the trajectories of all particles between 5 and 10 km and between 10 and 20 km above ground level using FLEXPART in two simulations using η and z coordinates. We removed particles that left the specified height range, and to avoid diabatic heating by water phase changes, we removed particles that went through regions where the relative humidity was above 90 %. We only used particles outside the subtropics and tropics, excluding the zone between 40° N and 40° S, as we expect the tracer conservation in this region to be worse in general, where the geostrophic balance is weak, and deep convection is frequent. To avoid sampling biases, we selected particles from regions that keep similar density distributions over time (see Fig. 2), resulting in not including particles that reside north of 80° N or south of 80° S. We also switched off both the turbulence and convection parameterisations in FLEXPART and used short time steps (LSYNCTIME=600).

https://gmd.copernicus.org/articles/17/7595/2024/gmd-17-7595-2024-f01

Figure 1Mean absolute tracer conservation errors (ATCEs) in quasi-conservative particle properties. (a) Potential vorticity; (b) potential temperature; (c) specific humidity. Results are shown for altitudes between 5 and 10 km (indigo lines) and between 10 and 20 km (grey lines) above ground level as a function of time since the initiation of a trajectory. The figure illustrates these errors for both the η (solid lines) and the z vertical coordinate system (dashed lines). Each line represents the mean over around 330 000 trajectories that are selected between 40 and 80° N and 40 and 80° S and a relative humidity below 90 %. Thin lines represent one simulation in each season of 2020, starting on the first day of January, April, July, and October at 00:00 UTC. Each thick line shows the average of the four seasons. All FLEXPART parameterisations (e.g. turbulence and convection) are switched off. Transition periods between ERA5 12-hourly data assimilation windows are highlighted with lavender shades, beginning 9 h after the FLEXPART simulation's start. At the top left of each panel, the error reductions that are gained using the η coordinates as compared to the z coordinates are given in percentages, both excluding and including (in parentheses) data assimilation window transition periods.

Download

Using these trajectories, we computed the absolute transport conservation errors (ATCEs) as a function of time along the trajectory, given by

(3) ATCE ( γ , t ) = 1 N i = 1 N | γ i ( t ) - γ i ( t 0 ) | ,

where γi(t) and γi(t0) are the quasi-conservative properties of particle i at times t and t0 of its trajectory, and N is the total number of particles in the domain between [40° N, 80° N] and [80° S, 40° S] latitude that fulfilled our selection criteria. ATCE values indicate how strongly the considered variables, on average, deviate from the perfect conservation along the trajectories.

Figure 1 shows ATCE values for PV (left panel), Θ (middle panel), and q (right panel) as a function of time along the trajectories. The first thing to notice is that the ATCE values for PV and Θ show stepwise jumps every 12 h. These jumps occur during the 1 h transition of hourly re-analysis data from one 12 h long data assimilation window to the next in the ERA5 reanalysis production and can be explained by the dynamical inconsistencies between two different assimilation periods. The resulting step-wise increases in conservation errors are a problem inherent to the ERA5 data and not related to FLEXPART. While the inconsistencies themselves do not necessarily lead directly to trajectory position errors, they do indicate uncertainties in the analysed state of the atmosphere, which will lead to trajectory position errors. Notably, Fig. 1 also shows wiggly lines with an hourly periodicity, best visible in the left panel, indicating that the errors grow most rapidly in the middle of two consecutive hourly wind fields. These wiggles can be attributed to the fact that the temporal interpolation errors are largest when the time difference to the closest available wind field is largest (at 30 min in between two wind fields).

Most interestingly for our purpose, Fig. 1 shows that ATCE values for PV, Θ, and q for trajectories between 10 and 20 km are, respectively, 15.4 %, 60.6 %, and 16.9 % lower for the calculations using η coordinates than for those using z coordinates after 48 h, ignoring assimilation window transition periods. Corresponding differences for particles between 5 and 10 km are 8.1 %, 1.8 %, and 1.5 %, respectively. The relative differences are larger for the higher trajectory starting points, which is expected because our screening to avoid regions of turbulence, convection, and clouds is not perfect, and it is to be expected that the trajectories starting from the lower levels are more strongly affected by diabatic processes there, which can lead to large conservation errors, regardless of which coordination system is used, thereby reducing relative differences between the two trajectory calculations. In summary, our results indicate a substantial reduction in tracer conservation errors when avoiding the interpolation of meteorological data from the original η levels to a secondary z-coordinate system and thus an improved accuracy of trajectory calculations with FLEXPART 11 compared to its predecessor versions. While it is impossible to directly quantify improvements in trajectory position accuracy because of a lack of ground truth data, it is expected that better tracer conservation also indicates more accurate trajectories. Similarly, while we cannot use the dynamical tracers for quantifying conservation errors in the lower troposphere, we certainly also expect improvements in trajectory accuracy there.

3.3 Density distribution

Validation of FLEXPART based on the conservation of quasi-conservative quantities is restricted to certain regions of the atmosphere and does not directly allow us to evaluate the accuracy of trajectory positions. Another validation possibility is to test how accurately the well-mixed criterion is fulfilled. The well-mixed criterion states that if a species of passively marked particles without sources or sinks is initially mixed uniformly in the position and velocity space in a turbulent flow, it will stay that way (Thomson1987). Generally, Lagrangian transport models could be expected to encounter challenges in this regard, as evident from works in the broader literature discussing specific conservational issues for (stochastic) particle methods, such as Wang et al. (2015), Meyer and Jenny (2004), and Bahlali et al. (2020), making the test especially relevant. Lagrangian particle models, including FLEXPART (Stohl and Thomson1999; Cassiani et al.2015), are usually tested for this criterion for simulations of turbulent dispersion in the ABL on short timescales. However, this criterion should also be fulfilled (and tested) in the atmosphere as a whole and on long timescales, similar to what was done by Cassiani et al. (2016).

To see whether the switch from z to η coordinates improved the particle distribution, we performed two 6-month global domain-filling simulations of a passive air tracer based on z and η coordinates, respectively. In total, 6 million particles were initially globally distributed, perfectly in accordance with the local air density, and ideally, the particle density distribution should closely follow the air density distribution throughout the entire simulation, even though the particles were allowed us to move through the atmosphere without any further constraint on their distribution. We used short time steps, with the basic integration time step LSYNCTIME= 600 s, and both the CTL and IFINE options set to 10 (thus allowing for reduced time steps in turbulence calculations; see Appendix A2.2) to optimise the accuracy of the simulation of turbulent transport in the ABL. For an evaluation of the results, we averaged the densities of the particles over the sixth month after the start of the simulations and compared those to the air densities given by the ECMWF ERA5 data. This is a comprehensive test, as it involves transport in the whole atmosphere and also includes sub-grid-scale parameterisations of convection and turbulence.

https://gmd.copernicus.org/articles/17/7595/2024/gmd-17-7595-2024-f02

Figure 2Averaged density distribution of particles as compared to the density of air given by the ERA5 data (black lines) after 6 months of running FLEXPART. The results are averaged over the sixth month (July) of the η- (solid blue lines) and z-coordinate (dashed red lines) system simulations, after initially starting with a perfectly fitting particle density distribution. The results are separated into three regions: polar regions (a), midlatitudes (b), and the tropics (c). The right-hand side of each panel shows the absolute errors in the η (blue) and z (red) simulations. Thick horizontal lavender lines represent the average ABL height (solid) and tropopause height (broken).

Download

Figure 2 shows vertical particle density profiles averaged over polar regions, midlatitudes, and tropics, respectively. Overall, the η-coordinate system version reproduces the vertical air density profile more accurately than the z-coordinate system version. In the midlatitudes and the tropics, both model runs reproduce the vertical air density profiles relatively well; however, for the midlatitudes, the η version is clearly performing better than the z version throughout almost the entire depth of the troposphere. For the tropics, better results are seen for the lowest 2 km of the atmosphere. Especially in the ABL, the z version underestimates the air density on average by ∼2 % (midlatitudes) and ∼3 % (tropics). Only in the stratosphere, above about 15 km, does the z version perform slightly better than the η version. Both model runs overestimate the density below about 1 km in polar regions quite substantially, by up to ∼3.6 %. The z version shows somewhat better agreement there, with a weighted average of ∼1.2 % better up to ∼1km. However, this reverses above about 1 km, and in the polar lower stratosphere, the z version shows a substantial deviation from air density, peaking at ∼20.3 %, and here the η version shows much better agreement. The underestimation of particle density in the tropical troposphere and the overestimation in the polar stratosphere by the z version show that this version tends to move too many particles from the low to the high latitudes and also to higher altitudes near the poles. This deficiency is less pronounced for the η version, which shows a much better agreement overall of particle density profiles with air density profiles in most of the atmosphere (with the exception of the lowest kilometre in the polar regions and in the stratosphere at lower latitudes). This again indicates the improved trajectory accuracy of FLEXPART 11 compared to previous FLEXPART versions. However, it is also clear that even FLEXPART 11 deviates somewhat from how well it is mixed.

We attribute these deviations to a number of possible causes. First, the ECMWF input data are not perfectly mass-consistent, with additional implicit mass flow violations likely being introduced by the interpolation procedures to generate the sub-grid-scale velocity field, following the considerations in Wang et al. (2015) and Meyer and Jenny (2004). Second, aspects related to grid-scale stochastics could also play a role, as particles may be transferred from regions with higher variability in grid-scale winds towards regions with lower variability because there is no drift correction applied to the grid-scale winds. Last, dynamical inconsistencies between data assimilation periods may lead to the production of spurious trajectories.

4 Gravitational settling

The gravitational settling of aerosol particles is called at each time step and added to the vertical motion. In FLEXPART 11, a settling module, settling_mod.f90, has been introduced and contains all the relevant procedures. The module contains several improvements for the calculation of the drag coefficient, Cd, of aerosol particles, which is needed to determine their gravitational settling velocity. While previous versions of FLEXPART only considered spherical particles, FLEXPART 11 is also able to calculate the settling velocity for non-spherical particles and takes into account different types of particle orientations (see below). One limitation is that the gravitational settling is only calculated if a particle carries a single-aerosol species with non-zero mass. This is necessary, since aerosols of different size, shape, or density exhibit different settling velocities and follow different trajectories. In contrast, a particle can represent any number of gaseous tracers, as they all follow the same trajectory.

https://gmd.copernicus.org/articles/17/7595/2024/gmd-17-7595-2024-f03

Figure 3Comparison of the atmospheric transport of particles of different shapes. Shown are the FLEXPART simulation results of the monthly averaged total atmospheric deposition for daily releases from a point in Vienna, Austria (white dot), in January 2018 of spheres with a diameter of 50 µm (a) and volume-equivalent straight fibres with an aspect ratio (AR) of 50 (b). In both cases, dry-deposition accounts for more than 90 % of the total deposition. Values for the monthly mean horizontal transport distance (D) and its standard deviations are also reported near the bottom in the left and middle panel. The probability density function (PDF) of horizontal travel distance of spheres (light blue) and fibres (dark blue) is displayed in panel (c).

4.1 Spherical particles

Earlier versions of FLEXPART only considered the settling of spherical particles. The drag coefficient of spheres in the laminar flow regime can be calculated with Stokes' law. However, Stokes' law is only valid for the case of

(4) Re = ρ d eq w s μ 1 ,

where Re is the Reynolds number, ρ the density of air (in kg m−3), deq the volume-equivalent diameter of the particle (in m), ws the settling velocity (in m s−1), and μ the dynamic viscosity of the air (in Pa s). Substantial deviations from Stokes' law can be expected for particles with diameters larger than 10–30 µm in a laminar regime (Drakaki et al.2022; Saxby et al.2018; Alfano et al.2011). To account also for larger Reynolds numbers, earlier FLEXPART versions used the drag coefficient approximation by Bird et al. (1960). However, this approximation still shows a significant settling velocity mismatch for Reynolds numbers > 400 compared to other drag coefficient models (Näslund and Thaning1991). Therefore, in FLEXPART 11, we replaced this scheme with the drag coefficient formulation of Clift and Gauvin (1971), which is valid for Reynolds numbers up to 105 and is within 6 % of experimentally determined values (Clift et al.2005):

(5) C d = 24 Re 1 + 0.15 Re 0.687 + 0.42 1 + 42 500 Re 1.16 .

Using this more accurate scheme changes the settling velocities for large particles substantially. For example, particles with a diameter of 100 µm have a settling velocity lower by about 16 % as compared to the old scheme.

4.2 Non-spherical particles

Experiments show that non-spherical particles experience a larger drag in the atmosphere and therefore have lower settling velocities than volume-equivalent spherical ones (Tatsii et al.2024). To take this into account, we have extended the gravitational settling scheme and the calculation of dry-deposition velocities to allow for non-spherical particle shapes. This was done by implementing the scheme of Bagheri and Bonadonna (2016) with modifications by Tatsii et al. (2024). The scheme determines a particle's drag coefficient Cd based on its shape, providing the following three options for the orientation of a particle in the atmosphere: (i) random orientation; (ii) the particle's maximum projection area being perpendicular to the vector of gravity, which corresponds to its maximum drag or horizontal orientation and thus lowest settling velocity; or (iii) the particle's orientation corresponding to the average of the first two options. The equations defining Stokes' and Newton's drag corrections (kS and kN) for the three options are given in Table B2. The drag coefficient is then computed as follows:

(6) C d = 24 k S Re 1 + 0.125 Re k N k S 2 / 3 + 0.46 k N 1 + 5330 k S Re k N .

The scheme was tested in laboratory experiments with microplastic fibres, where it was found to give best results for the average orientation option (Tatsii et al.2024). The settling velocities of fibres can be less than one-third of those of spherical particles with the same volume, which has major implications for their atmospheric transport and deposition. Figure 3 compares the atmospheric deposition of spheres and equivalent-volume fibres from a point source release, showing the much greater distances travelled by the fibres. For example, for releases from Vienna, Austria, spherical particles with a diameter of 50 µm are deposited mainly in central Europe, whereas volume equivalent fibres with an aspect ratio of 50 are also deposited in eastern and southern Europe (Fig. 3a, b). The longer atmospheric transport of fibres results in an average horizontal travel distance that is 2.7 times greater than that of spherical particles (Fig. 3c).

In terms of technical implementation, parameters defining a particle's shape and orientation are to be provided in the SPECIES file. If the three characteristic dimensions (longest axis PLA, intermediate axis PIA, and smallest axis PSA) of a non-spherical particle (Blott and Pye2008) are known, the user should set PSHP=1 and provide the three-dimensional parameters in units of micrometres. If the particle dimensions are not fully known, FLEXPART can compute PLA, PIA, and PSA values for a few specific non-spherical particle shapes, assuming that the particles have the same equivalent volume as a sphere with the given diameter PDIA. For cylinders (PSHP=2), the user also needs to set the aspect ratio PASPR, i.e. ratio of the cylinder's length (PLA) to its diameter (PSA). Other options are cubes (PSHP=3), regular tetrahedrons (PSHP=4), regular octahedrons (PSHP=5), and a regular rotational ellipsoid (PSHP=6) characterised by PLA=2 PIA=2 PSA. PSA needs to be specified by the user. These options are particularly useful for a direct comparison of the atmospheric transport properties of non-spherical particles with those of corresponding spherical particles with the same volume.

The particle orientation in the atmosphere can be specified with the option PORIENT, with horizontal or maximum drag (PORIENT=0), random orientation (PORIENT=1), and the average of the two (PORIENT=2). If straight or bent cylindrical particles with aspect ratios equal to or greater than 20 are used, it is recommended to select the averaged orientation option, as this model best fits the experimental data on the gravitational settling of cylinders (Tatsii et al.2024).

5 Wet scavenging

Wet scavenging is the process by which trace substances are removed from the atmosphere through precipitation. The mass of particles is reduced, and that amount is deposited to the ground. Three main changes were implemented to improve the wet-deposition scheme in FLEXPART 11. A full discussion with comprehensive tests will be provided in a forthcoming publication led by Anne Tipka.

https://gmd.copernicus.org/articles/17/7595/2024/gmd-17-7595-2024-f04

Figure 4Accumulated wet deposition (shading) 66 h after a point release of 1 kg of aerosols with a diameter of 0.4 µm and a density of 2×103kg m−3 for FLEXPART 10.4 (a), FLEXPART 11 with standard precipitation fields (b), and FLEXPART 11 using two additional precipitation fields (c). In total, 10 million particles were released at a constant rate between 18 January 1995 03:00 UTC and 19 January 1995 03:00 UTC from the location of the Ascó Nuclear Power Plant (41°12 N, 0°3 E; red star). Total and maximum deposition amounts are reported at the top of each panel.

5.1 New below-cloud scavenging scheme for aerosols

A major change with respect to wet scavenging was introduced in FLEXPART version 8, differentiating between in-cloud and below-cloud scavenging. For the below-cloud scavenging of aerosol particles, the scheme of Laakso et al. (2003) was used with parameters for snow, as given by Kyrö et al. (2009). This scheme was derived for small particles only, with diameters between 10 and 510 nm. For FLEXPART 11, a new parameterisation scheme has been introduced that is valid for a wider size range, namely the scheme of Wang et al. (2014), which covers particles from 1 nm (nucleation mode) to 100 µm (coarse mode). This is important especially for larger particles like dust, sea salt, or pollen.

5.2 Improved interpolation scheme for precipitation

Version 10 of FLEXPART used a nearest-neighbour method to obtain the precipitation rate and cloud information at the location of each particle at the given time; however, everywhere else in FLEXPART, linear interpolation is used. The nearest-neighbour scheme for precipitation results in unrealistic “checkerboard-like” deposition fields, which become visible when time intervals between meteorological fields are large, e.g. 3 h (Hittmeir et al.2018), and especially in incremental deposition fields. The underlying problem, which led the authors of FLEXPART 10.4 to remove the linear interpolation of precipitation as implemented before, is related to the fact that the precipitation data are not given as an instantaneous rate but as an accumulation over a time interval (Hittmeir et al.2018; Tipka et al.2020). Hittmeir et al. (2018) therefore proposed a new reconstruction algorithm for Lagrangian particle dispersion models, like FLEXPART, which can be applied in conjunction with linear interpolation and which ensures the conservation of integral precipitation within each time interval, maintains continuity at interval boundaries, and conserves non-negativity.

In order to use this new interpolation scheme, the flag numpf in par_mod.f90 must be set to three. This causes FLEXPART to read in two sets of precipitation fields (a set of three large-scale and convective precipitation fields each, making it six fields in total) per input time interval instead of one. These additional fields represent two additional supporting time steps in between the original ones to represent precipitation as point values and, at the same time, preserve the integral precipitation in each time interval, guarantee continuity at interval boundaries, and maintain non-negativity (see Hittmeir et al.2018, for more details). They can be produced with flex_extract version 7 (Tipka et al.2020). If this is not set, precipitation will be linearly interpolated between the two precipitation fields assigned to the same times as the other quantities, which is still considered an improvement on the nearest-neighbour scheme used in FLEXPART 10.4. The example shown in Fig. 4 clearly illustrates the reduction in artefacts moving from the nearest-neighbour method to simple linear interpolation and finally the algorithm by Hittmeir et al. (2018) (numpf=3). In this example, 3-hourly input data were used, which make the artefacts more pronounced than with 1-hourly data.

5.3 New cloud layer identification scheme

The cloud identification scheme has been improved in FLEXPART 11. One problem is that the cloud water content is provided as instantaneous fields in the ECMWF meteorological input data, whereas precipitation is an accumulated forecast product. Their combination in the scavenging scheme can, at times, produce inconsistencies such as precipitation occurring when no (or only a very thin) cloud is present, and this can lead to unrealistic in-cloud scavenging rates in FLEXPART. To prevent such unrealistic combinations, the following steps are taken to identify clouds. If cloud water content is available from the meteorological data, the cloud water mass is integrated vertically and used later on for the in-cloud scavenging, as already done in version 10. Iterating from the surface upwards, the first instance of cloud water is taken as the height of the bottom of the cloud and the last instance as the top of the cloud, as in version 10. If, however, the cloud water content is not available, the presence of a cloud is assumed between the lowest level, with relative humidity greater than rhmin, and the highest level with that value. Relative humidity is calculated over water for temperatures above 20 °C and over ice for temperatures below. The value of rhmin is set in par_mod.f90 (default is 0.90). A minimum thickness of min_cloudthck (defined in par_mod.f90; default 50 m) is required for a cloud. Spurious clouds below this thickness are eliminated, as they would not be expected to produce precipitation, but if precipitation were present in the data, it would cause unrealistic in-cloud scavenging rates.

For the case of convective precipitation, a simple fix was implemented; it requires that clouds associated with convective precipitation stronger than precmin (in par_mod.f90; default is 0.002 mm h−1) must have a top of at least 6 km and a bottom below 3 km (adjustable by conv_clrange in par_mod.f90). If this is not fulfilled, the cloud bottom and top will be set to a bottom and top of 0.5 and 8 km for precipitation rates below 0.1 mm h−1, and to 0 and 10 km for heavier precipitation (parameters are set in par_mod.f90 to highconvp_clrange and lowconvp_clrange). The results of the preliminary tests indicate that the deposition resulting from convective clouds is not significantly influenced by the parameters used in this fix. However, further investigation is required to ascertain the full extent of the influence of these parameters and possible further optimisation.

5.4 Fukushima test

To validate that changes made to the precipitation scheme did not introduce errors, several tests have been carried out to check the behaviour of the code with respect to the removal processes. Here, we show a series of tests reproducing the Fukushima Daiichi Nuclear Power Plant accident of March 2011, where the aerosol-bound radioactive isotope caesium-137 (137Cs) and the noble gas xenon-133 (133Xe) were released in large quantities. As demonstrated by Kristiansen et al. (2016), after correcting for radioactive decay, the ratio of caesium-137 and xenon-133 can be used to evaluate the modelled aerosol lifetimes. They obtained aerosol lifetimes for 19 widely used chemical transport models (including FLEXPART 9) and compared the model results with the aerosol lifetime obtained from experimental measurements. Their results showed, for the aerosol e-folding lifetime (among all the models), a model mean of 10.7 d and a model median of 9.4 d. FLEXPART 9 resulted in a shorter aerosol lifetime of 5.8 d, using the original Hertel et al. (1995) definition of the cloud liquid water content, cl (see Sect. A3.2). The observations, as discussed in Kristiansen et al. (2016), suggested a rather longer aerosol lifetime of 14.3 d. More recently, Pisso et al. (2019) re-evaluated the aerosol lifetime in FLEXPART 10.4 with the Grythe et al. (2017) improved scheme and obtained an aerosol e-folding lifetime of 10 d for caesium-137. Figure 5 shows the aerosol lifetime obtained for three different FLEXPART configurations using different values of ratio_incloud, which is the in-cloud replenishment rate ricl (see Appendix A3.2 for a full description). An e-folding lifetime of 9.3 d is obtained for FLEXPART 11 when using ratio_incloud=0.005, very close to the previously obtained model median by Kristiansen et al. (2016), and therefore the default value set in par_mod.f90. A value of ratio_incloud=0.001 (results not shown here) gave a e-folding lifetime of about 20 d.

https://gmd.copernicus.org/articles/17/7595/2024/gmd-17-7595-2024-f05

Figure 5Global decrease in the ratio of caesium-137 with respect to xenon-133 (decay corrected) as obtained at several measurement stations as a function of time after the Fukushima nuclear reactor accident. Panels (a), (b), and (c) show the results using values of 0.01, 0.0062, and 0.005, respectively, for the replenishment rate ricl of cloud water during precipitation (parameter ratio_incloud in FLEXPART 11). Corresponding e-folding lifetimes of the aerosol were 6.99, 8.58, and 9.32 d, respectively. Red boxes show the ratio of the sum of caesium-137 and the sum of xenon-133 over all stations.

Download

6 Linear Chemistry Module

The Linear Chemistry Module (LCM) is based on the initial work of Henne et al. (2018), who developed the FLEXPART CTM from FLEXPART 8, and which was first described and evaluated in Groot Zwaaftink et al. (2018). This model was an extension of the domain-filling capability of FLEXPART and added the possibility of initialising particles' mixing ratio from pre-defined fields, accounting for the influence of surface fluxes and simple linear chemistry on the particles' mass, and sampling the particle-mixing ratios at user-defined receptor locations.

The essence of the FLEXPART CTM code has been implemented into FLEXPART 11, which can be run in all its usual configurations but now includes the CTM configuration. Note that the CTM configuration is renamed the Linear Chemistry Module, reflecting the fact that it is not a separate model to FLEXPART and that only linear chemical reactions are implemented.

LCM uses the possibility in FLEXPART to fill a global domain with particles that are constantly advected throughout the atmosphere. This scheme was introduced by Stohl and James (2004) for air tracers and has been used for studies of heat and water transport in the atmosphere. However, each particle can carry multiple chemical species. Emissions of a species are not simulated as releases of new particles representing the emitted mass, as it would be done in a standard FLEXPART run, but are taken up by particles passing by close to the emission source (note that emission in this sense can be positive or negative fluxes; e.g. carbon dioxide could be removed from the atmosphere), thereby changing the mass of the species carried by these particles. The mass of the particles for each species can also change due to first-order chemical reactions. Deposition of particles is at present not considered.

In the LCM, the mixing ratios are output by sampling the particles on a grid (specified by OUTGRID) at receptor locations (specified by RECEPTORS and, new in FLEXPART 11, for satellite receptors (specified by NetCDF files generated from a satellite pre-processor, prep_satellite, and can be created using software obtainable from https://git.nilu.no/flexpart/flexinvertplus, last access: 24 October 2024). The mixing ratios for each species are calculated using the ratio of the mass of the species over the mass of air, where the mass of air is always carried by species number 1. This method was chosen over using the mass of the species divided by the air density and volume, which is the standard method because it leads to less noisy results and avoids problems with the spurious accumulation of particles (see Sect. 3.3).

The LCM mode is switched on in FLEXPART in COMMAND with the switch LCMMODE=1. In addition, the following options in COMMAND should be set: MDOMAINFILL=1, IND_SOURCE=1, and IND_RECEPTOR=1. When these options are set, mixing ratios will be calculated using the ratio of masses method. The domain-filling mode uses the RELEASES file to define the species, the domain, and the total number of particles to use. For LCM, the first species in RELEASES must always be AIRTRACER.

A full discussion with tests and examples will be provided in a forthcoming publication led by Rona Thompson. Nudging to observations, as implemented in FLEXPART CTM (Groot Zwaaftink et al.2018), is not yet available in the LCM module but will be added in the near future.

7 Comparison with tracer experiments

In Sect. 3, we have shown how quasi-conservative properties of particles are better conserved, better mixed, and better fulfilled when using η instead of z vertical coordinates. However, we also made large modifications in other parts of the source code, and therefore it was important to validate FLEXPART 11 for a large range of different applications, including output of gridded properties. One excellent validation possibility is to compare the model against tracer experiments. We chose to follow Stohl and Koffi (1998) and applied FLEXPART 11 to the first European Tracer Experiment (ETEX) (Nodop et al.1998) and the Cross APpalachian Tracer EXperiment (CAPTEX) (Raynor et al.1984; Ferber et al.1986). Following Stohl and Koffi (1998), we compute the following:

  • the normalised mean square error, NMSE=(1/N)i=1N(Pi-Mi)2/(PM), where P and M represent the model predictions and measurements, respectively, and N is the number of measurements;

  • the root mean square error, RMSE=(1/N)i=1N(Pi-Mi)2, where P and M represent the model predictions and measurements, respectively, and N is the number of measurements;

  • the Spearman rank-ordered correlation coefficient (SCC);

  • the Pearson correlation coefficient (PCC);

  • the figure of merit in space, FMS=100ApAm/ApAm, where Ap and Am represent the model-predicted and model-measured concentrations above 0.1 ng m−3, respectively;

  • the fraction of model predictions that lie within 2 times (FA2) and 5 times (FA5) the measured values; and

  • the frequency of over- and underpredictions, FOEX=100(NPi>Mi/N-0.5), with NPi>Mi as the number of overpredictions.

We computed the statistical measures for two different settings of FLEXPART 11, using the η coordinates and z coordinates. To ensure consistency with the previous FLEXPART version, we also calculated the statistics for FLEXPART 10.4, using the same input options as for FLEXPART 11. We used ERA5 meteorological input data, simulated a passive tracer and used time steps shorter than 10 % of the Lagrangian turbulent timescale (settings CTL=10 and IFINE=10). We use an output grid with 0.1° × 0.1° resolution.

https://gmd.copernicus.org/articles/17/7595/2024/gmd-17-7595-2024-f06

Figure 6Comparison of the concentration fields obtained by FLEXPART 11 (blue contours), using η coordinates on a 0.1°×0.1° grid, and the ETEX measurements (markers) 48 h after the ETEX-1 release. Small grey circles represent each zero measurement that corresponds to a zero model result. Large grey circles represent the stations with non-zero measurements at which the model also found a signal. Indigo triangles represent stations with non-zero measurements at which the model found no significant signal, and indigo crosses show where the opposite is the case. Shading within the circles and triangles shows the concentrations measured at the corresponding stations. The initial release location near Rennes is marked by a red star. Note that results using z coordinates and FLEXPART 10.4 do not show significant differences.

7.1 ETEX

On 23 October 1994, 340 kg perfluoromethylcyclohexane (PMCH) was emitted near Rennes, France. The release lasted 12 h, and measurements were taken for the next 90 h across 168 stations distributed all over Europe (see Fig. 6). We recreated this experiment by releasing 1 million particles equally spread over the 12 h time frame with altitudes between 8 and 20 m above ground level.

Table 1Statistical measures of how well FLEXPART 10.4 and FLEXPART 11, using η- and z-coordinate systems, respectively, perform compared to the ETEX observations (top) and compared to the CAPTEX aircraft measurements (bottom). CAPTEX results show the mean statistics over six releases. n gives the total number of model–observation pairs used for the analysis. The RMSE is given in ngm-3.

Download Print Version | Download XLSX

The results of the statistical measures are shown in Table 1. The versions using the z- and η-coordinate systems give almost identical results. This is not unexpected, as most of the gas stays in the turbulent ABL, which is where the z-coordinate system is always used. Importantly, FLEXPART 11, using the z-coordinate system version, produced similar results as FLEXPART 10.4, which demonstrates that the many code changes did not result in undesired performance losses.

7.2 CAPTEX

During the Cross APpalachian Tracer EXperiment (CAPTEX), seven separate PMCH releases were made in North America (Ferber et al.1986), and both ground-based and airborne PMCH concentration measurements were made. Even though all aircraft measurements were made below 3053 m a.s.l., and many within the ABL, the values at these altitudes are more likely to be affected by the changes in the coordinate system than those at the ground level; therefore, we present FLEXPART results only for the aircraft measurements. To compare the difference in densities between the aircraft measurements and the FLEXPART output, we use the mass of particles present in a volume of a 0.5° by 0.5° by 100 m box around the measurement locations.

In Table 1, we list the means of the statistical measures for all CAPTEX releases, excluding release 6, for which the number of valid observations was very small. We show the mean of the statistical indicators, instead of highlighting the spread in accuracy between the different releases. Table 1 mainly shows that using the η-coordinate system as compared to the z-coordinate version leads to no substantial differences. We also see no large systematic differences between FLEXPART 10.4 and FLEXPART 11.

8 OpenMP parallelisation

Pisso et al. (2019) implemented a pure Message Passing Interface (MPI) method for the parallelisation of FLEXPART. MPI often performs equally well or better compared to other multi-processing options without excessive communication between processes and potentially low overhead. However, FLEXPART runs on input meteorological data that is ever growing in size, and without domain decomposition, each MPI process needs to keep a copy of the same meteorological data in memory. This leads to a large memory footprint that can easily exhaust the memory of a compute node. Consequently, we have followed a different parallelisation strategy for FLEXPART 11 that is based on OpenMP, which shares memory between processes. While the OpenMP option limits the number of parallel processes to the number of cores available on a compute node, this is not a significant limitation for typical FLEXPART applications. Furthermore, because of the linear nature of FLEXPART calculations, a trivial parameterisation by splitting a simulation into several separate run instances, each running on a different node, is always possible for particularly large simulations. One drawback of OpenMP compared to serial code is that it is more difficult to modify. To avoid errors related to parallel execution, users unfamiliar with OpenMP are strongly advised to make changes in the form of subroutines and functions and avoid the use of global variables.

8.1 Parallelisation strategy

The way in which the computational time used in a FLEXPART run is partitioned between different parts of the code depends on the set-up and thus on the peculiarities of the application considered. For example, if many particles are released from a single point and only a small computational domain is used, then initially most of the time is spent on particle trajectory computations. However, when a global high-resolution domain for the meteorological input data is used in a global domain-filling simulation, a significant share of the CPU time is spent on the convection parameterisation (see Appendix A2.1). On the other hand, if relatively few particles are used, then computations related to the gridded meteorological input data (e.g. coordinate transformations) are taking a larger share. For this reason, the OpenMP parallelisation was implemented throughout the various components of the model, trying to avoid bottlenecks for all these cases, especially for the most common set-ups.

We parallelised all particle-based computations, apart from their initial release in the releaseparticles subroutine. On top of that, we parallelised the convection, wet and dry deposition, and the vertical coordinate transformation of the fields. Last, we parallelised the computations needed for the output for both the gridded output and the particle dump.

The total number of threads for gridded-output-related computations can be set by the user (MAXTHREADGRID=<number of threads> in the COMMAND file) with a maximum of the general requested number of threads. The reason for this is that parallelisation is applied to the particles, and therefore each thread needs its own set of output grid variables. Depending on the resolution of the output grid, this can significantly increase the memory required. On top of that, depending on the number of particles in the simulation, the related computational overhead might outweigh the speed-up. The default of MAXTHREADGRID is set to a maximum of 1 task, thus switching off parallel computations related to the grid. A number of threads >1 should only be set after having tested with the specific set-up to be used. For example, for a simulation with 10 million particles and a 0.5° by 0.5° global output grid, using more than 16 threads will degrade the performance (with the optimum number being 6), while for a simulation with only 10 000 particles and a 0.1° by 0.1° output grid, parallelisation is not at all efficient, and MAXTHREADGRID should be left at its default value of 1.

8.2 Code performance and scalability

To evaluate the scalability of the OpenMP parallelisation across different FLEXPART running options, we select a few test cases across the spectrum of typical FLEXPART applications.

  • Case Tracer. This is a domain-filling simulation with particles representing a passive air tracer distributed across the globe following air density. Every hour, all particle information but no gridded output is written to NetCDF files (see Sect. 9.1). We run FLEXPART for 5 h, using 10 min time steps, and we set the turbulence options CTL=10 and IFINE=10. This option covers a large range of different computations within FLEXPART (i.e. convection and turbulence in all possible conditions and particle output) and is therefore a difficult condition to obtain perfect scalability for.

  • Case Aerosol. This involves aerosol particles that are initially homogeneously distributed in the bottom 100 m across the globe. Every hour, gridded properties are written to NetCDF files on the same horizontal resolution as the input data (0.5° by 0.5° global grid) and cover four vertical levels. FLEXPART is run for 5 h, using 15 min time steps and turbulence options CTL=10 and IFINE=4. Case Aerosol simulations generally take much longer than Case Tracer simulations. On the one hand, this is because of the extra computations in the wet and dry deposition and gravitational settling routines. On the other hand, this is because all particles start within the ABL, where solving the Langevin equations of the turbulence parameterisation requires very short time steps. We set MAXTHREADGRID to 16, meaning that the gridded computations are using a maximum of 16 threads.

  • Case Nuclear. A single xenon-133 point release, using the CBL option for the skewed turbulence (see Appendix A2.2) and CTL=40 and IFINE=5, with a nested input domain and nested gridded output over Europe with 0.25°×0.25° resolution. Unlike with MPI parallelisation, OpenMP parallelisation is only active within specified regions of the code. With this third case, we want to complete our demonstration of the parallelisation of all possible parts of FLEXPART, including radioactive decay, skewed turbulence, and computations on the nested grid. Gridded computations are conducted on a single thread.

We use two different computers to demonstrate the performance of FLEXPART 11 across platforms. The first one is the local department server (called “Jet”), which has 9 Intel Skylake compute nodes, each with 2×20 cores and 80 threads in total and 768 GB memory. The second one is the Vienna Scientific Cluster 5 (VSC-5), which has 564 AMD EPYC Milan compute nodes, each with 2×64 cores and 256 threads in total, 512 GB RAM, and 1.92 TB solid-state drive (SSD) storage. For both computers, we use the GNU FORTRAN compiler with the optimisation flag -O3, and since we have Intel central processing units (CPUs) on Jet, we use -march=skylake-avx512 for the compiler to correctly recognise the hardware architecture. The compiler versions are the GNU compiler collection (GCC) 8.5.0 on Jet and GCC 12.2.0 on the VSC-5. We set export OMP_PLACES=cores and export OMP_PROC_BIND=true for the best use of non-uniform memory access (NUMA) and therefore the fastest performance. To make the comparison between the two versions clearer, we do not make use of the hyperthreading capabilities of the computers. This means that the number of OpenMP threads is equal to the number of tasks used by MPI, and we use threads and cores interchangeably when referring to OpenMP processes.

https://gmd.copernicus.org/articles/17/7595/2024/gmd-17-7595-2024-f07

Figure 7Demonstration of the strong scalability of the OpenMP parallelisation of FLEXPART 11. Shown is the computation time as a function of the number of cores used (Ncore). Perfect strong scalability is represented by the slope of the straight and thin dotted black lines. The left column of the panels, shaded in blue, shows the results for globally distributed passive tracer particles (Case Tracer), using 106 (a1), 107 (a2), and 108 (a3) particles. The middle column, shaded in magenta, shows results for globally distributed aerosols (Case Aerosol), using 105 (b1), 106 (b2), and 107 (b3) particles. The right column, shaded in maroon, shows results for xenon-133 emitted from a single point source (Case Nuclear), using 105 (c1), 106 (c2), and 107 (c3) particles. In black, the total of 5 h running time is plotted for FLEXPART 11 (solid black lines). The MPI-parallelised FLEXPART 10.4 equivalent is plotted for reference (solid grey lines). The dashed coloured lines represent the break-down of the computational time spent in different components of FLEXPART 11; the blue lines represent the total computational time per hourly time step minus the input/output (I/O) operations (green lines) and initialisation of the run (orange lines). Note that for some cases, green lines cannot be seen, as the I/O operations fall below the limits of the y axis but are of a similar order to the I/O operations of the same case with fewer particles. The runs represented by the thick lines and the FLEXPART 10.4 run were executed on the VSC-5 machine, and the thin dashed–dotted black lines show the total FLEXPART 11 running time on our local server, Jet. Note that the black lines are not the sum of all other lines, since the black lines show the total time that the simulation took, while the I/O operations and computations are shown per hour of simulation time. This was done for clarity of presentation, i.e. to better separate the lines from each other.

Download

https://gmd.copernicus.org/articles/17/7595/2024/gmd-17-7595-2024-f08

Figure 8The memory footprint of FLEXPART 11 (solid lines for z; dotted lines for η-coordinate system) and FLEXPART 10.4 (dashed lines) simulations as a function of the number of cores. Shown are the results for Case Tracer, a domain-filling simulation using 1 million (thick purple), 10 million (orchid), and 100 million (thin grey) particles. Note that the FLEXPART 11 cases using 1 and 10 million particles largely overlap.

Download

Table 2Weak scaling and serial comparison of different applications described in Sect. 8.2. All values are given in percentages.

Download Print Version | Download XLSX

We investigate both the strong and weak scalability of our OpenMP parallelisation for each case. Strong scaling refers to the speed-up by increasing the number of threads. Ideally, the simulation time should scale close to the inverse number of cores, which is 1/Ncores for all cases (e.g. ideally giving a speed-up of 10 when using 10 times the number of cores). We separated the initialisation, which only happens once and would thus become relatively less important for longer model runs than our rather short 5 h test cases, and input/output (I/O) operations, which are very dependent on the output needs of the user (e.g. output frequency of the particle dump), from the computations that are done every time step, which probably best represent the overall model performance in realistic cases. Weak scaling refers to the relative speed when increasing the size of the problem in proportion with increasing the number of cores used for the computation (e.g. running 10 times the problem size on 10 times the computational resources should ideally take the same amount or less time). In Table 2, this is defined by the time it takes to run A particles on 1 core compared to running B particles on 10 cores, i.e. [t(B10)-t(A1)]/t(A1). In addition, we provide a serial comparison, which is done by comparing the time it takes to run A particles and run a single B particle 10 times, both on one core, i.e. [t(B1)-10t(A1)]/10t(A1). In our case, we only increase the number of particles but keep the size of the meteorological input data constant for all parallel runs, since most users do not switch between data types. That means that the problem size does not entirely increase 10-fold when running 10 times the number of particles.

Scalability of computation times is not the only issue to consider for evaluating the FLEXPART performance. Equally important is the memory requirement of the model. Therefore, we also compare the memory footprint of FLEXPART 11 with the MPI-parallelised version of FLEXPART 10.4.

8.2.1 Case Tracer

The left column of Fig. 7 shows how the strong scalability for Case Tracer depends on the number of particles used in a simulation by benchmarking FLEXPART 11 using 1 million (top), 10 million (middle), and 100 million particles (bottom). Every panel also shows a comparison to the FLEXPART 10.4 MPI version. For 100 million particles, FLEXPART 10.4 with MPI and FLEXPART 11 are performing similarly, while for smaller particle numbers, FLEXPART 11 clearly scales better than FLEXPART 10.4. The scalability of the main computations (blue lines) is dependent on the number of particles that are used; for example, on VSC-5, when using 32 cores, we find a ∼1.8-, ∼2.5-, and ∼2.8-fold increase in computational time compared to the perfect scaling for the three problem sizes of 1 million, 10 million, and 100 million particles, respectively. On Jet, the performance is worse, with ∼2.3, ∼3.0, and ∼4.1, for the three problem sizes, respectively. The large difference between VSC-5 and Jet is likely the result of using a more recent version of the GCC compiler on VSC-5 compared to Jet (GCC 12.2.0 instead of GCC 8.5.0), which optimises the non-parallelised regions more effectively. The time it takes to write the NetCDF particle dump files is less than 10 % of all the computations per step when using only a few cores. This increases to up to 43.1 % when using 128 cores because the writing of NetCDF files cannot be parallelised when using OpenMP. Since the output size for the Case Tracer increases linearly with the number of particles used, the total scalability suffers from the relatively inefficient writing of output files when using many cores.

The weak scalability depends heavily on the number of particles of the simulation. We find a decrease of more than 50 % in the computation time when running 10 million particles on 10 cores instead of running 1 million particles on 1 core (see the top row of Table 2), which can be explained by the parallelisation of the convection computations, since these take an (almost) equal amount of time, regardless of the number of particles in a grid column. Increasing the number of particles from 10 million to 100 million, however, increases the computation time by more than a third. Profiling indicates the likely cause to be inefficient communication between NUMA regions. Therefore, for large problem sizes, it could be worthwhile to parallelise by splitting the problem into multiple smaller ones that are simulated separately. However, fewer CPU hours in total will be consumed when simulating more particles at once on a single core; the serial comparison in Table 2 shows that in the range of 1 million to 100 million particles, it always takes less time to simulate more particles at once than splitting them up into multiple smaller runs.

8.2.2 Case Aerosol

For Case Aerosol (middle column of Fig. 7), we chose to use 100 000, 1 million, and 10 million particles for our benchmark testing, separating the computation in the same way as described in Case Tracer. Generally, the performance of FLEXPART 11 is similar to or better than that of FLEXPART 10.4, with the exception of the serial version, where FLEXPART 10.4 is faster. Large improvements in performance for version 11 are especially visible when using smaller numbers of particles on more cores, where the MPI version suffers from more overhead.

The main computations (without I/O and initialisation) of Case Aerosol generally have better scalability than Case Tracer, coming close to perfect scaling for all particle number cases, especially when using up to eight cores. For the example of 32 cores, scaling is only 1.7 (2.5), 1.4 (2.0), and 1.4 (1.9) times slower for 100 000, 1 million, and 10 million particles on VSC-5 (Jet), respectively, than perfectly scaled code would be. The I/O per step, reading meteorological data, and the organisation and writing of information to the grid in NetCDF format are only improving slightly with the number of cores, but there is a significant bottleneck only for the smallest problem size (100 000 particles). Here, it takes up ∼4 % of the time of all computations in serial mode and ∼57 % when using all 128 cores as a consequence of the excellent scaling of the other computations. The largest problem size reports a minimum of ∼0.2 % (serial mode) and a maximum of ∼8 % (128 cores) time being spent on I/O operations.

The weak scalability of the main computations is adequate, as shown in the middle row of Table 2, taking about a fifth less time to compute a time step of 1 million particles on 10 cores as compared to 100 000 particles on 1 core but taking slightly more time for the larger problem size. When running FLEXPART in a serial mode, fewer CPU hours are consumed by simulating many particles at once compared to splitting the problem into multiple smaller simulations, although this gain decreases when moving towards larger problem sizes.

8.2.3 Case Nuclear

For Case Nuclear (right column of Fig. 7), we chose a single release of 100 000, 1 million, and 10 million particles. Similar to Case Aerosol, the strong scaling of the main computations for 1 million and 10 million particles is reasonably good and only 1.3 (1.4) and 1.3 (1.2) times slower, respectively, than perfect scaling when using 32 cores on VSC-5 (Jet). For the 100 000 particle run, this becomes 2.1 (2.9) times slower. For all problem sizes and number of cores, FLEXPART 11 outperforms FLEXPART 10.4. The I/O computations take no more than ∼3.4 % of all computations per step in serial mode and a maximum of ∼36 % when using the full 128 cores for the smallest problem size. For the largest problem size, this ranges between ∼0.08 % (serial) and ∼8.2 % (128 cores).

The weak scaling relation is within the range of the other two cases. Table 2 shows that a run using 1 million particles divided on 10 cores takes approximately the same time as simulating 100 000 particles on 1 core. And a run using 10 million particles divided on 10 cores takes between ∼10 %–15 % more time than a run of 1 million particles on only 1 core. However, when running FLEXPART on a single core, fewer CPU hours are consumed by simulating many particles at once compared to splitting the problem into multiple smaller simulations, although this gain is marginal when requiring a total number of more than 10 million particles.

8.2.4 Memory requirements

In the previous section, we showed that in most cases, OpenMP parallelisation results in better speed-up than the MPI parallelisation of FLEXPART 10.4. However, the main advantage of using OpenMP over MPI is that data (especially the meteorological input fields) are shared between the processes instead of requiring separate copies on each core. This reduces the memory footprint substantially for runs on shared-memory systems. Typically, work group servers and most high-performance computers today provide many cores per node but only a limited amount (some GB) of RAM per core. For example, as shown in Fig. 8, when running FLEXPART 11 on Case Tracer with 106 particles, approximately 11 GB of memory are used, regardless of the number of cores used. An equivalent simulation with FLEXPART 10.4 on 32 cores, requires about 132 GB – more than 10 times the memory footprint of FLEXPART 11. Running FLEXPART 10.4 on one full node with 128 cores on the VSC-5 exceeds the node's available memory of 500 GB. We note that without parallelisation, FLEXPART 11 needs somewhat more memory than FLEXPART 10.4 (e.g. 11 GB instead of 7 GB for the example above), which is mainly due to the extra memory needed for the η-coordinate system, moving to a necessary double-precision default for some variables in FLEXPART 11, and added functionality.

9 Running FLEXPART: new input and output options

In this section, we give an overview of new user functionalities of FLEXPART 11. For general information about how to run FLEXPART, we strongly recommend users to check the instruction manual (https://flexpart.img.univie.ac.at/docs, last access: 11 September 2024), since this page will be updated with any future additions and changes.

9.1 Particle output

In addition to the gridded output, FLEXPART can also write out information related to each particle, its position, and meteorological information associated with it. In FLEXPART 10.4, this was possible already, and for reasons of efficiency, unformatted binary files per output time step were produced. Since users found it cumbersome to work with these, for FLEXPART 11, particle information is now written to NetCDF files instead. With HDF5-based compression, NetCDF files are about ∼50 %–60 % smaller than their binary equivalents. Another advantage of the NetCDF output is that it is easier to modify the content or structure of the information to be written, especially with respect to safe post-processing. Taking advantage of this, it is now possible to specify which particle properties are to be written out. The desired parameters can now be specified in a new option file, PARTOPTIONS. It is now required if particle properties are to be written out (i.e. when IPOUT=1 is set in the COMMAND file). Currently, the available variables are particle position (longitude, latitude, and height in metres above ground), PV, specific humidity, air density, temperature, pressure, particle mass, cumulative loss of mass by dry and wet deposition (separately), settling velocity, 3D grid-scale particle velocities, the height of the ABL, the tropopause, and the topography. Each property can be written out as an average over the preceding output time interval and/or as instantaneous values.

In previous FLEXPART versions, the memory location of terminated particles was reused for newly released particles in order to minimise the memory requirement. This, however, complicates the tracking of individual particles. Hence, in FLEXPART 11, if particle output is switched on (IPOUT=1), terminated particles are kept in the simulation, but values associated with them are set to“NaN” (not a number) instead of being overwritten by newly released particles in the NetCDF output. This comes with no additional computational cost, but it may require more memory than running without the particle output option switched on. The previous behaviour of overwriting terminated particles when using particle output can be restored, as explained in the instruction manual (https://flexpart.img.univie.ac.at/docs, last access: 11 September 2024), and will be needed for domain-filling simulations with a limited domain, where particles are continuously produced at the inflowing boundary and destroyed at the outflowing boundary.

9.2 Starting a simulation from user-defined particle data

To give users complete control over the initial conditions of a simulation, in FLEXPART 11 we implemented an option to start a simulation from particle information provided in an additional input file in the NetCDF format. This file must hold information about the initial particle positions, their time of release, and their initial mass (see the manual for a full description). This option is used if IPIN=3 is set (IPIN=4 in the case of a simulation to be restarted). The user then needs to provide a file part_ic.nc in the options directory, as specified in the pathnames file. The RELEASES file in the input directory is ignored in this case. This option is particularly useful if release geometries are complicated and latitude–longitude–altitude boxes are not suitable. In Bucci et al. (2024), this option was used to produce a global release at the ocean surface. Other possible applications are FLEXPART runs for satellite observations, with non-trivial geometry of the pixel at the Earth's surface and height-varying kernel sensitivities. In such a case, for a backward simulation to determine the sensitivities of column-averaged molar fractions to emissions and/or initial conditions, one would fill the volume relevant for a specific satellite measurement with particles, horizontally homogeneous, and with a vertical profile proportional to the pressure-interval-weighted satellite retrieval kernel. Figure 9 shows such an example of a satellite observation over India.

https://gmd.copernicus.org/articles/17/7595/2024/gmd-17-7595-2024-f09

Figure 9Methane emission sensitivity produced with a 7 d FLEXPART backward simulation from a TROPOspheric Monitoring Instrument (TROPOMI) methane remote-sensing observation (Schneising et al.2023). (a) Emission sensitivity obtained for the location of the TROPOMI observation. The inset (b) shows all TROPOMI methane observations that were made in the region inside the blue square, with one single observation near the centre highlighted by a red outline. The FLEXPART backward simulation was done for this single observation. (c) Vertical profile of the FLEXPART particle density per pressure interval (given as number of particles per hPa). The number of particles, Pn, released in layer n of the 20 TROPOMI retrieval layers was calculated as Pn=PAnWn, where P is the total number of particles used for the simulation (1 million), An is the averaging kernel value for retrieval layer n, and Wn is the pressure weight. The particles are uniformly distributed horizontally, based on the geometry of the satellite data pixel (i.e. the pixel marked with a red outline in panel (b)). Also shown in panel (c) is the averaging kernel and the air density. FLEXPART particle releases were made using the user-defined initial particle conditions option (file part_ic.nc).

9.3 Restarting a simulation

As a FLEXPART run may be interrupted (e.g. because of server maintenance or reaching the maximum allowed wall-clock time), already in FLEXPART 10.4 there was an option to restart a simulation from a saved simulation state. However, this required the user to request a particle dump to the binary files, which was done at every output time step; this could substantially slow down the whole simulation. Furthermore, the gridded deposition data lacked the information from the previous run. In FLEXPART 11, we created a separate option in the COMMAND file which sets the time interval for the output of the binary restart files (LOUTRESTART). The content of these files has been amended so that the restarted simulation will receive all the relevant information. For restarting, set IPIN=1 in the COMMAND file and rename or link the desired start point file from restart_XXX file to restart.bin in the output directory. It is recommended to set LOUTRESTART to a relatively large value in order to minimise the computational and storage overhead.

9.4 Dynamical allocation of arrays

In FLEXPART 11 it is no longer necessary to specify dimensions of (nested) input fields, receptors, or particle- or species-related arrays at the compilation time by manually setting the dimensions in the par_mod.f90 file. These arrays are now dynamically allocated as required by the size of the input data, enhancing the user-friendliness. Another advantage is that it allows us to containerise FLEXPART.

9.5 Updated SPECIES files

Together with the model code, a set of input files describing the physical–chemical behaviour for various species is provided as templates (SPECIES_xxx, with “xxx” being a number in the model input directory); these properties can and should be set by the users and are at their own discretion. Each file is dedicated to one “species” which represents a real-world species or group of species with a specific behaviour in the model. The information contained in that file is used to calculate wet and dry deposition, gravitational settling (radioactive) decay, or destruction due to the reaction with the hydroxyl radical, OH (OH fields have to be prescribed). The parameter values in the template files provided contain suggested parameter values; short references (name of the first author, year of publication, or a web link) are provided to the sources from which the parameter values were taken. A more detailed description is given in Appendix B.

10 Platform for interaction of users and developers

FLEXPART is a community model, allowing everyone to modify the code according to their specific needs, to fix bugs, to add functionality, and to communicate with the current developers. Since its inception, it has been available under the General Public License (GPL) V3 as free and open software. A web-based project management and bug-tracking system is available for use by developers and for interaction with users. With FLEXPART 11, this has been switched from a trac hosted by the Central Institute for Meteorology and Geodynamics (now GeoSphere Austria) to a GitLab instance hosted at University of Vienna. It includes a continuous integration (CI) functionality. The University of Vienna provides this open GitLab instance within the Phaidra (Permanent Hosting, Archiving and Indexing of Digital Resources and Assets) service for long-term research data storage (PHAIDRA2008). Currently, a few simple tests are bundled with FLEXPART, which are used in the CI. They should be seen as a starting point for future enhancements. The continuous code testing supports community code development and provides additional information on the deployment of FLEXPART under various scenarios (e.g. compilers and dependencies). It further allows us to provide a FLEXPART container that is ready for deployment and easy porting of FLEXPART to various high-performance computing environments or cloud instances.

11 Conclusions

We have presented the new version 11 of FLEXPART. A large number of development steps have been carried out which improve the accuracy, enhance computational properties, and add functionality.

The following new features improve the accuracy of FLEXPART simulations:

  1. The possibility of performing transport calculations in the native η vertical coordinate system for ECMWF data, instead of internally converting all fields to vertical coordinates in metres, results in reduced absolute transport conservation errors in PV and other quasi-conservative variables and a better, but still not perfect, fulfilment of the well-mixed criterion in global domain-filling simulations.

  2. An improved parameterisation scheme for the wet scavenging of aerosols below clouds, an improved precipitation interpolation method, and a more transparent cloud layer identification method were introduced, resulting in the removal of artefacts that were present in previous model versions.

  3. More accurate drag coefficients for aerosol particles of different sizes and shapes, which can be characterised in all three dimensions, in some cases dramatically improve the simulation of the atmospheric transport of coarse-mode aerosols.

  4. The implementation of the optional linear chemistry module turns FLEXPART into a simple linear chemistry transport model. When activated, it is possible to initialise particle-mixing ratios, incorporate the influence of surface fluxes and linear chemistry, and sample particle-mixing ratios at receptor locations.

In terms of computational enhancements, the switch from MPI to OpenMP parallelisation brings better memory utilisation and improved scalability across a wide range of applications. However, we note that significant improvements could still be achieved using co-arrays or a hybrid OpenMP–MPI implementation, especially in combination with a domain decomposition of the meteorological input data.

Finally, new use options were introduced in FLEXPART 11, and the SPECIES template files have now been documented. The option to replace the conventional particle release information (fixed release rates for a list of given spatiotemporal domains) with arbitrary initial particle conditions adds flexibility and, for certain cases, efficiency. The option to restart a FLEXPART simulation after an unforeseen or planned termination has been made more complete and more computationally efficient. Particle information can now be dumped in a configurable manner in a compressed NetCDF format.

Finally, to aid the user community, an instruction manual (https://flexpart.img.univie.ac.at/docs, last access: 11 September 2024) has been written as a living document. A continuous integration environment based on GitLab is available for current developers and those who wish to contribute to the further development of FLEXPART.

Appendix A: FLEXPART overview and code reorganisation

In FLEXPART, the modelling of computational particle movement involves a combination of interpolating properties from meteorological input data and computing properties that are intrinsic to each particle. This hybrid approach allows for a more comprehensive and realistic representation of particle behaviour in the atmosphere. Computational particles can represent one or more species, which may be gases or aerosols with certain properties. For brevity, computational particles are hereafter referred to as particles.

This overview of the code is divided into three parts: meteorological input data used by FLEXPART (see Appendix A1), computations related to the transport of particles (see Appendix A2), and computations affecting the properties of particles (see Appendix A3). We will only provide short summaries, since these three parts have all been documented in publications accompanying previous releases (e.g. Stohl et al.2005; Pisso et al.2019) and are described in more detail in the manual at https://flexpart.img.univie.ac.at/docs (last access: 11 September 2024). The main purpose here is to document how these computations are now organised within the source code, following its restructuring.

A1 Input data

FLEXPART advances particles based on interpolated meteorological fields, namely grid-scale three-dimensional fields of wind velocities, temperature, specific humidity, cloud liquid water, and ice content, as well as precipitation and various surface fields. In principle, any gridded dataset could be used. Data formats and coordinate systems used, as well as differences in the meteorological variables provided, would, however, make a generic input interface rather complex. The main FLEXPART code described here supports two input formats, namely data from the ECMWF and NCEP forecast systems (IFS and GFS, respectively). For ECMWF data, the flex_extract software package (Tipka et al.2020) is provided to extract, process, and store the required fields for use as FLEXPART input, including support for ECMWF's reanalyses. Note that in the case of ECMWF-based input, data on all model layers are used, whereas NCEP-based input comprises only pressure-level fields. Other formats could be read in by writing the appropriate gridcheck and readwind subroutines and adding them to the windfields_mod.f90 module. A full list of necessary input fields can be found in Table B1. With the exception of the option of reading three precipitation fields per input time interval (see Sect. 5), nothing has changed compared to FLEXPART 10.4.

Other variants of FLEXPART were developed to accommodate fields produced by specific meteorological models., e.g. FLEXPART-WRF (Brioude et al.2013), FLEXPART-COSMO (Henne et al.2016), FLEXPART-AROME (Verreyken et al.2019), FLEXPART-HIRLAM (Foreback2023), and FLEXPART–NorESM/CAM (Cassiani et al.2016). There also exists a FLEXPART version for very high-resolution simulations (1 km), where turbulence parameterisations have been adapted to account for the fact that turbulence is partly already resolved by the meteorological input data (Katharopoulos et al.2022).

A2 Particle transport

The transport of particles is central to a LPDM and straightforward. FLEXPART advances particles using motion vectors. At each time step, these motion vectors combine the grid-scale wind velocity (v¯) from linearly interpolated meteorological input data, the parameterised turbulent wind velocity (vt; see Appendix A2.2), and, for aerosols, the settling velocity (vs; see Appendix A2.3). The resultant motion vector for that time step is v=v¯+vt+vs. The new particle position is then given by

(A1) X ( t + Δ t ) = X ( t ) + v ( X , t ) Δ t ,

where Δt is the internal time step of the model. In addition, particles may be displaced vertically due to convection (see Appendix A2.1).

As shown in Fig. A1, the time manager module (timemanager_mod.f90) initiates, at each time step, the various processes. Particles first undergo convection (if required), which only affects their vertical position, and then the advance module (advance_mod.f90) is called, separately for each particle. Depending on the vertical position of the particle, different turbulence parameterisations are selected (see Appendix A2.2). After having derived the displacement vector and obtained a first guess for the new location of the particle, one Petterssen correction step (Petterssen1940) is executed for greater numerical accuracy to move the particle to its final new position. This is a second-order numerical scheme, which is accurate enough for the purpose of trajectory calculations, given sufficiently short time steps (Seibert1993). Particle positions are updated within the particle module (particle_mod.f90), which is directly or indirectly called from the advance module.

https://gmd.copernicus.org/articles/17/7595/2024/gmd-17-7595-2024-f10

Figure A1Simplified call tree for the transport of particles; green boxes represent modules containing subroutines (blue boxes) responsible for updating the location of particles through time.

Download

A2.1 Convection

Vertical transport by moist, sub-grid-scale convection is parameterised using the scheme of Emanuel and Živković-Rothman (1999). In FLEXPART 11, all convection-related computations are located in the convection module (conv_mod.f90). The steps required are handled by convmix and include the computation of the matrix describing the convective redistribution of mass in a grid column (calcmatrix), making use of the convection scheme of Emanuel and Živković-Rothman (1999) (convect and tlift), followed by the actual convective displacement of particles in redist. The sorting algorithm used in convmix has been changed to use the FORTRAN Standard Library (https://fortran-lang.org/, last access: 11 September 2024), which codes the algorithm of Musser (1997). This new sorting algorithm is 4 orders of magnitudes faster; it is located in a separate module, namely sort_mod.f90.

A2.2 Turbulence

In FLEXPART 11, all turbulence-related computations have been organised in subroutines inside the turbulence module. This includes the turbulence computations inside of the atmospheric boundary layer (ABL), based on the Hanna and Chaughy 1982 scheme (Hanna1982), with added features from Ryall and Maryon (1998) and a skewed turbulence option by Cassiani et al. (2015); the turbulence above the ABL, a parameterisation based on pseudo-random number sampling and the length of the computational time step (Legras et al.2003); and the mesoscale turbulence, parameterised using the method described by Maryon (1998), which uses the standard deviation of the wind velocities in the wind fields at the surrounding grid points. These turbulence schemes are called from the advance module and can now be completely turned off by an option in the COMMAND file by setting LTURBULENCE=0. Mesoscale turbulence is switched off by default and can be switched on in addition by setting LTURBULENCE_MESO=1. Below, we give a short description of the different turbulence schemes and options that are currently implemented in FLEXPART.

Turbulence in the atmospheric boundary layer

Turbulence in the ABL is parameterised, assuming a Markov chain based on the Langevin equation (Thomson1987). The Lagrangian timescales and turbulent velocity statistics for Gaussian turbulence are computed following either the scheme of Hanna (1982) or that of Ryall and Maryon (1998). Both distinguish neutral, stable, and unstable conditions. Turbulent motions can either be calculated using FLEXPART's fixed synchronisation time step, Δts, set by LSYNCTIME in the COMMAND file or use shorter time steps, depending on the Lagrangian timescale ΔtL. The former option is computationally very efficient but is inaccurate, as velocity auto-correlation cannot be taken into account if ΔtstL. It is suitable only for long-range transport processes, where details of turbulence in the ABL are less important. Adaptive time steps are enabled by CTL>1 in the COMMAND; CTL determines by which factor the computational time step is kept shorter than ΔtL. For Gaussian turbulence, CTL values of at least 5 are recommended, and for the skewed turbulence scheme, even larger values are needed. With CTL>1, the time steps for the vertical component of turbulent motion can be further refined by setting IFINE>1, with the value of IFINE determining the factor by which the time step is further reduced.

FLEXPART offers the option to choose between Gaussian (Stohl and Thomson1999) and skewed turbulence (Cassiani et al.2015). Gaussian turbulence is a suitable approximation for stable and neutral conditions. The error when using Gaussian turbulence under convective conditions is relatively small for sufficiently long transport distances, where particles become well mixed throughout the ABL. Only for short-range (i.e.  1 h) dispersion in the convective ABL, however, is it recommended to use the skewed turbulence scheme (Cassiani et al.2015) by setting the switch CBL to 1 in the COMMAND file, as this scheme considerably increases computation time.

Turbulence in the free troposphere and stratosphere

Turbulent velocities above the ABL, both in the stratosphere and in the troposphere, are computed following Legras et al. (2003), using a constant vertical diffusivity (Dz=0.1 m2 s−1) to compute vertical turbulent velocities in the stratosphere and a constant horizontal diffusivity (Dh=50 m2 s−1) to compute horizontal turbulent velocities in the free troposphere. These default values can be modified in the input files from version 10.4 onwards. A linear transition layer of 1 km is used between the troposphere and stratosphere. The tropopause is defined as the first stable layer to fulfil the thermal tropopause criterion (i.e. the vertical temperature gradient is smaller than 0.002 K km−1). Standard deviations of each of the velocity components (i=1,,3) are then obtained as

(A2) σ v i = 2 D i Δ t .

Horizontal diffusion is neglected in the stratosphere and vertical diffusion in the free troposphere. Already 20 years ago, an attempt was made to include a clear-air turbulence (CAT) parameterisation in FLEXPART, but due to the difficulties inherent to this problem (CAT can only be diagnosed probabilistically, and it is hard to establish Lagrangian timescales for it), it was not pursued further. Recently work done for the NAME model (Mirza et al.2024) may show a future way forward – also for FLEXPART.

A2.3 Gravitational settling

The gravitational settling of particles is called at each time step. The settling velocity of each particle is computed following Näslund and Thaning (1991), with a temperature-dependent dynamic viscosity, according to Sutherland (1893), and then added to the vertical motion. In FLEXPART 11, a settling module, settling_mod.f90, has been introduced containing all the relevant procedures. While previous versions of FLEXPART only considered spherical particles, FLEXPART 11 is also able to calculate the settling velocity for non-spherical particles and takes into account different types of particle orientations (see Sect. 4). Gravitational settling is only calculated if a particle carries a single aerosol species with non-zero mass. This is necessary since aerosols of different size, shape, or density exhibit different settling velocities; however, a particle can only follow a single trajectory.

A3 Evolution of particle properties

In the previous subsection, we discussed how particles are advanced, using parameterisation schemes and meteorological data interpolated to the particle position. In addition, FLEXPART tracks certain properties of one or more so-called species for each individual particle. The main property considered is the “mass” of the particles. Upon release, particles are assigned a certain mass, usually representing a fraction of the total mass to be released as specified in file RELEASES. In the most simple case, this mass is physical mass; if applied to radioactivity, it can be understood to represent activity. In the case of backward simulations, it represents mass (or activity) mixing ratios (Seibert and Frank2004). Nevertheless, for simplicity, we often refer just to the mass (roman font) of a particle.

During the simulation, FLEXPART takes into account various processes that may alter a particle's mass (or what mass actually represents) over time. For instance, particles can undergo dry and wet deposition, by which their mass is reduced, as described in Appendix A3.1 and A3.2. Additionally, radioactive decay and chemical reaction with the hydroxyl radical are other important processes that lead to a reduction in particle mass over time (Appendix A3.3). It should be noted that particles are hypothetical entities used for discretisation in the Lagrangian framework. They should not be considered actual aerosol particles. By considering the evolving mass of the particles, FLEXPART can simulate the transport, dispersion, and fate of gases and aerosols in a realistic manner. It allows the model to account for the varying lifetimes of different substances based on their specific properties and the environmental conditions they encounter.

A3.1 Dry deposition

Gases and aerosols can both undergo dry deposition, with the result of losing mass to the Earth's surface. The (dry-) deposition velocity vd is calculated for a reference height (href) of 15 m above ground. The value of href can be changed by the user, keeping in mind that it should not be too low, so that a statistically sufficient number of particles are considered, and not too high, as the calculation of dry deposition becomes inaccurate if 2 href falls outside the constant-flux layer. Dry deposition is applied for all particles below 2 href as

(A3) Δ m = m ( t ) 1 - exp - v d ( h ref ) Δ t 2 h ref ,

where Δm is the amount of mass transferred from the particle to the dry-deposition field. The deposition velocity is a function of height above ground and defined as

(A4) v d ( z ) = - F C C ( z ) ,

where FC is the deposition flux to the surface, and C(z) is the concentration of the species at height z. This deposition velocity can be prescribed as a constant value (in the associated SPECIES file) or can be computed within FLEXPART, using the resistance method as described in Wesely and Hicks (1977) for gases and Slinn (1982) for aerosols. For using the resistance method, certain chemical and/or physical properties of the species considered must be provided by the user in the respective SPECIES file. For a full description of the dry-deposition scheme, see Stohl et al. (2005).

In FLEXPART 11, all routines related to dry deposition are collected in drydepo_mod.f90. For aerosols, the module now also considers new formulations of gravitational settling velocity for spherical and non-spherical particles as described in Sect. 4.

A3.2 Wet deposition

The wet-deposition scheme in FLEXPART distinguishes between aerosols and gases and between in-cloud and below-cloud scavenging. In FLEXPART 11, cloud parameters and precipitation are interpolated to the particle position, and the scheme for below-cloud scavenging of aerosols has been replaced. Routines related to wet deposition are now collected in the wetdepo_mod.f90 module. The revised wet-deposition scheme is explained in more detail in Sect. 5.

The in-cloud scavenging is based on the approach of Hertel et al. (1995), with advancements introduced by Grythe et al. (2017). The in-cloud scavenging coefficient, λi (s−1), is defined by (Hertel et al.1995)

(A5) λ i = S i I H i ,

where Si is the dimensionless scavenging ratio between the concentration of a substance in precipitation and the concentration in air, I is the precipitation rate (m s−1), and Hi is the cloud depth at which the precipitation occurs (in m). For gases, Si is defined as

(A6) S i = 1 - c l H eff R T + c l .

Here, Heff is Henry's law constant, R is the perfect gas constant, and T is the temperature. cl is the cloud liquid water content (expressed in m3 of water per m3 of cloud air), a dimensionless quantity.

For particles, Si is defined as

(A7) S i = f nuc c l ,

where fnuc is the fraction of aerosol that is activated. Grythe et al. (2017) introduced a new parameterisation for fnuc, which takes into account the different efficiencies of aerosols in acting as cloud condensation nuclei or ice nuclei.

In the original Hertel et al. (1995) work, cl was obtained from the purely empirical relationship as follows:

(A8) c l = 2 × 10 - 7 I 0.36 .

This formulation is still used in FLEXPART when the cloud liquid water content cl is not available. Aside from the new parameterisation of fnuc, Grythe et al. (2017) also introduced an improved expression for λi that can be expressed in terms of Si,

(A9) S i = f nuc H i I ρ water c TWC I r icl ,

where cTWC is the cloud total water content (kg m−2), and Iρwater is the mass of water precipitating per unit time and area (kg s−1 m−2). The dimensionless empirical constant ricl is introduced to account for the replenishment rate of cloud water during precipitation and can be set in FLEXPART by incloud_ratio in par_mod.f90. This accounts for the replenishment of cloud water from condensing water vapour (Grythe et al.2017). Noting that the cloud water washout ratio (Rw in s−1) can be defined as

(A10) R w = I ρ water c TWC ,

introducing the in-cloud replenishment correction, ricl, gives

(A11) R w = I ρ water c TWC r icl ,

and results in a decreased washout ratio (i.e. increased washout timescale) by ricl<1. We note that the current definition of ricl (a dimensionless empirical parameter) is different from the original one used in Grythe et al. (2017), since they included the density of water in the empirical constant that was therefore dimensional, i.e. ricl,Grythe = riclρwater. This has now been changed in the FLEXPART 11 code for clarity and readability. Removing the density of water from the empirical constant means that the value of ricl,Grythe=6.2 kg m−3, as reported in Grythe et al. (2017), now corresponds to ricl=0.0062 (dimensionless). For completeness, as in Grythe et al. (2017), we rewrite the in-cloud scavenging coefficient in terms of the new expression for Si directly as

(A12) λ i = f nuc I ρ water c TWC r icl .

As a fallback in the case of lacking cloud water data, FLEXPART 11 uses the simple parameterisation for the total scavenging, which was used since the early versions of the model and which is common for regulatory nuclear applications (BASE2012), namely Λ=AIB. Parameters A and B have to be provided in the SPECIES file as weta and wetb. Note that we use Λ here instead of λ to be in agreement with previous literature referring to bulk values.

In previous FLEXPART versions, the precipitation rate was augmented on the base of a sub-grid-scale parameterisation, considering that only a fraction (F<1) of a grid cell would actually experience precipitation (Stohl et al.2005). It was based on horizontal-resolution (150 km× 150 km) data (Hertel et al.1995). As it is unclear which values would be appropriate for various finer grids of current or future meteorological models, we considered it justified to remove this parameterisation in FLEXPART 11. The wet scavenging in convective clouds will need to receive further attention in the future, ideally coupling it to the convection scheme.

A3.3 Radioactive and chemical decay

FLEXPART is able to account for radioactive and/or chemical decay of particles by defining a half-life T1/2 (parameter pdecay >0 in the corresponding SPECIES file; there is no decay if pdecay <0). The decay affects the mass on particles travelling through the atmosphere and deposited mass as follows:

(A13) m ( t + Δ t ) = m ( t ) e α Δ t ,

with α being the decay constant,

(A14) α = ln 2 T 1 / 2 .

The treatment of radioactive and/or chemical decay remains unchanged compared to previous versions. Decay is computed alongside dry and wet deposition and can be found in the corresponding modules. Decayed mass is subtracted from the mass of each particle in the time-manager module (timemanager_mod.f90).

A3.4 Chemical reactions

With the introduction of the linear chemistry module into FLEXPART, simple linear reactions can generally be computed (e.g. OH and Cl reactions). Loss processes related to reactions with radicals are represented as a first-order linear approximation in FLEXPART 11 — identical to FLEXPART 10.4 (Pisso et al.2019) for OH but now expanded to any linear reaction. The chemistry-related mass loss, m, is calculated as

(A15) m ( t + Δ t ) = m ( t ) e κ Δ t ,

with Δt being the reaction time step given by lsynctime. The temperature-dependent reaction rate κ (s−1) is then calculated as

(A16) κ = C T N e - D T c reagent ,

where C, N, and D are the species-specific constants defined in the SPECIES file (parameters pcconst, pnconst, and pdconst, respectively; turned off with negative values). T is the absolute temperature, and creagent is the hourly concentration of the reagent (Atkinson1997).

The OH radical is the most important oxidant in the troposphere, and although atmospheric chemistry can be highly non-linear, a first-order linear loss approximation using prescribed OH fields is often still adequate, e.g. to simulate methane in the atmosphere (for FLEXPART 11 there are monthly averaged 3°×5° OH fields with 17 vertical layers, following the GEOS-Chem model by Bey et al. (2001) and read in from NetCDF files). Hourly OH variations are accounted for by modifying the monthly fields with the hourly photolysis rate of ozone j, based on a simple parameterisation for cloud-free conditions and depending on the solar zenith angle,

(A17) OH = j j * OH * ,

where j* and OH* are the monthly mean photolysis rate and OH concentration taken from the OH fields, respectively.

In order to be able to use chemistry fields with higher spatial and temporal resolution (as in, e.g., Fang et al.2016, for OH), the user has to implement the reading and utilising of such data in the chemistry-related FLEXPART subroutines (readreagents, getchemfield, readchemfield, getchemhourly, and chemreaction located in the chemistry_mod.f90 module).

Appendix B: SPECIES files

Species in FLEXPART are either gases or particles (the case of air tracer can be considered an inert gas); each category requires different parameters to be specified in the respective SPECIES file. Values of parameters which are not required are ignored. The parameter values contained in the template SPECIES files bundled with FLEXPART are listed in Table B3 for gaseous substances and in Table B4 for particulate substances.

B1 Gaseous species

The parameters required for the dry deposition of gases are the inverse of the diffusivity relative to that of H2O (D; PRELDIFF), the reactivity relative to that of O3 (f0; PF0, originally taken from Wesely (1989)), and Henry's constant (PHENRY; describing solubility). The relative diffusivity of gases (CO, SO2, CH4, C2H6, PCB−28, γ−HCH (lindane), and N2O) could be calculated approximately using the square root of the ratio of molar weights between water and the respective species. The source for the relative reactivity f0 is Table 2 in Wesely (1989), with values for CO and CH4 taken from Clifton et al. (2022).

A collection of values of Henry's constant for many atmospheric compounds was recently compiled by Sander (2023); the list of values can also be found at https://www.henrys-law.org/henry/ (last access: 11 September 2024). For most of the species, they are close to or identical to the previously used values from Wesely (1989). More significant differences were found for HNO3, SO2, NH3, and HNO2. Now, values from Sander (2023) haven been used, except for the persistent organic pollutants, where well-established values exist from other sources, namely for PCB28 from Mackay et al. (2006) (as in FLEXPART 10.4) and for γ-HCH from Sahsuvar et al. (2003) (modified).

Concerning the parameters relevant for the wet deposition of gases, in-cloud scavenging depends on Henry's constant and the diffusivity, which were already discussed above. The values of weta for the coefficient of the simplified, fallback scavenging parameterisation were originally taken from Asman (1995) for gases. Now, some values have been modified, as described in Table B3.

Radioactive noble gases are inert and do not undergo relevant wet or dry deposition. Depending on their half-life and the timescales under consideration, their decay may be considered. Otherwise they are to be treated like air tracers. Radioactive decay (for gaseous and particulate species) may either be simulated directly in the FLEXPART simulation or be considered during post-processing. The latter approach may be useful if several nuclides with different half-lives but otherwise identical properties are simulated, so that not only CPU time but also memory and output file size can be reduced. In some cases, activities are desired for a given reference time – then it would also not make sense to include the decay in the simulation. For applying a decay correction to the mean concentration or deposition during an output time interval for species simulated without decay, see Seibert et al. (2013). Half-life data of different nuclides can be obtained from the International Atomic Energy Agency's LiveChart of Nuclides at https://www-nds.iaea.org/relnsd/vcharthtml/VChartHTML.html (last access: 11 September 2024), or the U.S. National Nuclear Data Center at Brookhaven National Laboratory at https://www.nndc.bnl.gov/ (last access: 11 September 2024); half-life values given in days need to be multiplied by 86 400 to obtain the value in seconds as needed for FLEXPART.

B2 Particulate species

The most important parameter for both the dry and wet deposition of particles is their diameter, or, if maxndia is set to >1 in par_mod.f90, their size distribution, which in FLEXPART is assumed to be log-normal. Thus, a mean geometric diameter and a logarithmic standard deviation have to be specified.

For the mean geometric particle diameter (PDIA) for accumulation-mode aerosol, such as ammonium nitrate or sulfate, as well as radionuclides bound to such aerosol particles, a typical value of 0.4 µm is proposed, as in previous versions. Note that this is a quantity that is variable according to the environmental conditions. We have also introduced a template for fine and coarse dust, with typical diameters of 0.2 µm and, respectively, 10 µm.

Radioactive iodine as released from nuclear reactors in the case of accidents mainly consists of gaseous elemental iodine (I2). This gas tends to deposit on accumulation-mode aerosol particles. Some radioiodine may also be present as methyl iodide (CH3I) (Nair et al.2000). A new SPECIES file was created for methyl iodide, with wet-deposition parameters of elemental and methyl iodide taken from Asman (1995) and Päsler-Sauer (2000). Concerning dry deposition, Henry's constant and reactivity data could not be found in the literature, so a mean value for the deposition velocity (vdep) of 0.1×10-3m s−1 was introduced for methyl iodide (Müller and Pröhl1993). Particle-bound iodine behaves like other particle-bound nuclides (see below).

Concerning the wet deposition of particle-bound caesium-137, Van Leuven et al. (2023) have tried to adjust the FLEXPART deposition parameters based on inverse modelling; however, as the wet-deposition scheme has been changed from version 10.4 (used by these authors) to version 11, and the inverse method is also subject to significant uncertainties, we generally refrain from recommending their values.

Bolton (1980)(Berkowicz and Prahm1982)Berkowicz and Prahm (1982)

Table B1List of input variables.

Download Print Version | Download XLSX

Table B2Set of equations to calculate the drag coefficient Cd of aerosol particles for three types of orientation based on the shape correction scheme of Bagheri and Bonadonna (2016). L, I, and S are the longest, intermediate, and smallest axes of a particle, respectively. ρp and ρf are the density of the particle and the density of the fluid, respectively. kS is Stokes' and kN Newton's drag correction, FS is Stokes' form factor, FN is Newton's form factor, deq is the diameter of a sphere of equivalent volume, and α and β are sigmoidal functions of the particle-to-fluid density ratio of ρρpρf. If non-spherical particles are assumed to be ellipsoids or fibres with L/I>20, the term (deq3LIS) can be neglected for the calculation of FS and FN (i.e. FS=fe1.3; FN=f2e). f and e are the flatness (PSA/PIA) and elongation (PIA/PLA) of the particles, respectively. For more details, see Bagheri and Bonadonna (2016).

Download Print Version | Download XLSX

Table B3List of gaseous FLEXPART species, including their parameter values and references, if available. The asterisk (*) denotes values modified in FLEXPART 11, and the double asterisk (**) denotes newly added species. T1/2 refers to the half-life in seconds; weta and wetb relate to dimensionless below-cloud scavenging coefficients; reldiff, f0, and Henry's constant (in M atm−1) relate to parameters for dry deposition; M relates to the molecular weight in mol; and cconst, dconst, and nconst relate to C (in cm3molec.-1s-1), D (in K), and dimensionless N, respectively, used to calculate reaction rates (see Eq. A16).

n/a: not applicable. If no other values are known, weta=1E-5 and wetb=0.8 are recommended for aerosol particles (BASE2012). a Asman (1995); b Wesely (1989); c Clifton et al. (2022); d Atkinson (1997); e Mackay et al. (2006); f Sahsuvar et al. (2003); g Grythe et al. (2017); h Tunved et al. (2013); i Groot Zwaaftink et al. (2022); j Päsler-Sauer (2000); k https://www.henrys-law.org/henry/ (last access: 11 September 2024).

Download Print Version | Download XLSX

Table B4List of particulate FLEXPART species, including their parameter values and references, if available. The single asterisk (*) denotes values modified in FLEXPART 11, and the double asterisk (**) denotes newly added species. T1/2 refers to the half-life in second; crain_aero and csnow_aero are below-cloud scavenging efficiencies; ccn_aero and in_aero are in-cloud scavenging parameters; density gives the density of an aerosol particle (in kg m−3); dia is the diameter of an aerosol particle in metres; dsigma is the geometric standard deviation. A template for particulate radionuclides and an irregularly shaped particle is provided in the repository.

n/a: not applicable. If no other values are known, weta=1E-5 and wetb=0.8 are recommended for aerosol particles (BASE2012). a Asman (1995); b Wesely (1989); c Clifton et al. (2022); d Atkinson (1997); e Mackay et al. (2006); f Sahsuvar et al. (2003); g Grythe et al. (2017); h Tunved et al. (2013); i Groot Zwaaftink et al. (2022); j Päsler-Sauer (2000); k https://www.henrys-law.org/henry/ (last access: 11 September 2024).

Download Print Version | Download XLSX

Code and data availability

The code as described in this paper is available as a tarball from https://doi.org/10.5281/zenodo.12706632 (Bakels et al.2024). For future releases, and in order to obtain the latest version from the Git repository, as well as bug reports and feature requests, please visit https://gitlab.phaidra.org/flexpart/flexpart (last access: 24 October 2024), which is also accessible through the general FLEXPART home page at https://flexpart.eu (last access: 24 October 2024). All results in this work can be reproduced using the FLEXPART version presented here (https://doi.org/10.5281/zenodo.12706632, Bakels et al.2024) and using the scripts provided in the Supplement.

Supplement

The supplement related to this article is available online at: https://doi.org/10.5194/gmd-17-7595-2024-supplement.

Author contributions

LB led the code development, analysis, and testing; contributed ideas; wrote the paper; and created most figures. DT implemented the new settling scheme, performed testing, and wrote the gravitational settling section and created its figures. AT, in collaboration with PS, made improvements to the code, including the new wet-deposition scheme. RT implemented the LCM functionality, performed testing, and wrote the linear chemistry module section. MD contributed to code development, bug fixing, and provided text and feedback. MB maintained version control, implemented developer tools, and provided text. PS came up with the idea of using hybrid coordinates (with AS), contributed to code development, and provided text and feedback. KB participated in testing and discussions and provided feedback on the text. SB conducted testing, participated in discussions (especially on the new-user functionality), and provided textual feedback. MC contributed to code development and testing and created the Fukushima section. SE contributed to code development and testing and provided the graphical abstract. CGZ adapted FLEXDUST to FLEXPART 11, tested the LCM module, and provided textual feedback. SH did the initial OpenMP development and created the FLEXPART_CTM version that is now included in the Linear Chemistry Module in FLEXPART 11. PK contributed to bug fixing and provided feedback on code development and text. VL contributed to the analysis of the density profiles and contributed to the text. CM and MDM conducted and wrote the literature review on the FLEXPART SPECIES files. IP contributed to the backwards compatibility of meteorological input, including GFS and the deposition scheme, testing, and version control. AP conducted testing of backward trajectories, did code development, wrote part of the FLEXPART overview, and provided feedback. RS created the figure that shows the use of part_ic.nc for inverse satellite modelling. MV performed testing for creating inverse modelling input and provided feedback on the text. AS provided ideas and suggestions for improving the code and contributed to the text.

Competing interests

At least one of the (co-)authors is a member of the editorial board of Geoscientific Model Development. The peer-review process was guided by an independent editor, and the authors also have no other competing interests to declare.

Disclaimer

The views expressed in this study are those of the authors and do not necessarily represent the views of the CTBTO Preparatory Commission.

Publisher's note: Copernicus Publications remains neutral with regard to jurisdictional claims made in the text, published maps, institutional affiliations, or any other geographical representation in this paper. While Copernicus Publications makes every effort to include appropriate place names, the final responsibility lies with the authors.

Acknowledgements

First, we would like to thank Pieter de Meutter, Helen Webster, and an anonymous reviewer for their valuable contributions. We acknowledge Christine Forsetlund Solbakken (NILU and https://www.colourbox.com, last access: 11 September 2024) for the creation of the graphical abstract. We acknowledge valuable input from Nikolaos Evangeliou and Anjumol Raju. This study has been supported by the Dr Gottfried and Dr Vera Weiss Science Foundation and the Austrian Science Fund in the framework of the project no. P 34170-N, “A demonstration of a Lagrangian re-analysis (LARA)”. Rona Thompson and Christine Groot Zwaaftink received financial support from the ReGAME project funded by the Research Council of Norway (grant no. 325610). The computational results presented have been achieved, in part, using the Vienna Scientific Cluster (VSC). In addition, we acknowledge various public Python packages that have benefited our study: NumPy (Harris et al.2020), Matplotlib (Hunter2007), Xarray (Hoyer and Hamman2017), SciPy (Virtanen et al.2020), and cartopy (Met Office2010–2015). We also acknowledge the use of Scitools and the FORTRAN documenter (FORD; https://github.com/Fortran-FOSS-Programmers/ford, last access: 11 September 2024) in order to analyse the FLEXPART code.

Financial support

This research has been supported by the Austrian Science Fund (grant no. P 34170-N) and the Research Council of Norway (grant no. 325610).

Review statement

This paper was edited by Slimane Bekki and reviewed by Pieter De Meutter, Helen Webster, and one anonymous referee.

References

Alfano, F., Bonadonna, C., Delmelle, P., and Costantini, L.: Insights on tephra settling velocity from morphological observations, J. Volcanol. Geoth. Res., 208, 86–98, https://doi.org/10.1016/j.jvolgeores.2011.09.013, 2011. a

Arnold, D., Maurer, C., Wotawa, G., Draxler, R., Saito, K., and Seibert, P.: Influence of the meteorological input on the atmospheric transport modelling with FLEXPART of radionuclides from the Fukushima Daiichi nuclear accident, J. Environ. Radioactiv., 139, 212–225, https://doi.org/10.1016/j.jenvrad.2014.02.013, 2015. a

Asman, W. A.: Parameterization of below-cloud scavenging of highly soluble gases under convective conditions, Atmos. Environ., 29, 1359–1368, https://doi.org/10.1016/1352-2310(95)00065-7, 1995. a, b, c, d

Atkinson, R.: Gas-Phase Tropospheric Chemistry of Volatile Organic Compounds: 1. Alkanes and Alkenes, J. Phys. Chem. Ref. Data, 26, 215–290, https://doi.org/10.1063/1.556012, 1997. a, b, c

Bagheri, G. and Bonadonna, C.: On the drag of freely falling non-spherical particles, Powder Technol., 301, 526–544, https://doi.org/10.1016/j.powtec.2016.06.015, 2016. a, b, c

Bahlali, M. L., Henry, C., and Carissimo, B.: On the well-mixed condition and consistency issues in hybrid Eulerian/Lagrangian stochastic models of dispersion, Bound.-Lay. Meteorol., 174, 275–296, https://doi.org/10.1007/s10546-019-00486-9, 2020. a

Baier, K., Duetsch, M., Mayer, M., Bakels, L., Haimberger, L., and Stohl, A.: The Role of Atmospheric Transport for El Niño-Southern Oscillation Teleconnections, Geophys. Res. Lett., 49, e2022GL100906, https://doi.org/10.1029/2022GL100906, 2022. a, b

Bakels, L., Duetsch, M., Tatsii, D., Tipka, A., Seibert, P., Thompson, R., Blaschek, M., Plach, A., Bucci, S., Vojta, M., Cassiani, M., Henne, S., Marie D., M., Maurer, C., Lechner, V., Eckhardt, S., Groot-Zwaaftink, C., Kaufmann, P., Baier, K., Pisso, I., Subramanian, R., and Stohl, A.: FLEXPART-v11, Zenodo [code], https://doi.org/10.5281/zenodo.12706632, 2024. a, b, c

BASE: Allgemeine Verwaltungsvorschrift zu § 47 der Strahlenschutzverordnung (Ermittlung der Strahlenexposition durch die Ableitung radioaktiver Stoffe aus Anlagen oder Einrichtungen), Handbuch Reaktorsicherheit und Strahlenschutz, Bundesamt für die Sicherheit der nuklearen Entsorgung, Germany, https://www.base.bund.de/SharedDocs/Downloads/BASE/DE/rsh/2-allgemeine-verwaltung/2_1.html;jsessionid=EC733D5F5C8A22A710EEAC325FF67330.internet981 (last access: 11 September 2024), 2012. a, b, c

Bergamaschi, P., Segers, A., Brunner, D., Haussaire, J.-M., Henne, S., Ramonet, M., Arnold, T., Biermann, T., Chen, H., Conil, S., Delmotte, M., Forster, G., Frumau, A., Kubistin, D., Lan, X., Leuenberger, M., Lindauer, M., Lopez, M., Manca, G., Müller-Williams, J., O'Doherty, S., Scheeren, B., Steinbacher, M., Trisolino, P., Vítková, G., and Yver Kwok, C.: High-resolution inverse modelling of European CH4 emissions using the novel FLEXPART-COSMO TM5 4DVAR inverse modelling system, Atmos. Chem. Phys., 22, 13243–13268, https://doi.org/10.5194/acp-22-13243-2022, 2022. a

Berkowicz, R. and Prahm, L.: Evaluation of the profile method for estimation of surface fluxes of momentum and heat, Atmos. Environ., 16, 2809–2819, https://doi.org/10.1016/0004-6981(82)90032-4, 1982. a, b

Bey, I., Jacob, D. J., Logan, J. A., and Yantosca, R. M.: Asian chemical outflow to the Pacific in spring: Origins, pathways, and budgets, J. Geophys. Res.-Atmos., 106, 23097–23113, https://doi.org/10.1029/2001JD000806, 2001. a

Bird, R. B., Stewart, W. E., and Lightfoot, E. N.: Transport phenomena, American Institute of Chemical Engineers Journal, 7, 5J–6J, https://doi.org/10.1002/aic.690070245, 1960. a

Blott, S. J. and Pye, K.: Particle shape: a review and new methods of characterization and classification, Sedimentology, 55, 31–63, https://doi.org/10.1111/j.1365-3091.2007.00892.x, 2008. a

Bolton, D.: The Computation of Equivalent Potential Temperature, Mon. Weather Rev., 108, 1046–1053, https://doi.org/10.1175/1520-0493(1980)108<1046:TCOEPT>2.0.CO;2, 1980. a

Brinkop, S. and Jöckel, P.: ATTILA 4.0: Lagrangian advective and convective transport of passive tracers within the ECHAM5/MESSy (2.53.0) chemistry–climate model, Geosci. Model Dev., 12, 1991–2008, https://doi.org/10.5194/gmd-12-1991-2019, 2019. a

Pisso, I., Sollum, E., Grythe, H., Kristiansen, N. I., Cassiani, M., Eckhardt, S., Arnold, D., Morton, D., Thompson, R. L., Groot Zwaaftink, C. D., Evangeliou, N., Sodemann, H., Haimberger, L., Henne, S., Brunner, D., Burkhart, J. F., Fouilloux, A., Brioude, J., Philipp, A., Seibert, P., and Stohl, A.: The Lagrangian particle dispersion model FLEXPART version 10.4, Geosci. Model Dev., 12, 4955–4997, https://doi.org/10.5194/gmd-12-4955-2019, 2019. a

Bucci, S., Richon, C., and Bakels, L.: Exploring the Transport Path of Oceanic Microplastics in the Atmosphere, Environ. Sci. Technol., 58, 14338–14347, https://doi.org/10.1021/acs.est.4c03216, 2024. a

Cassiani, M., Stohl, A., and Brioude, J.: Lagrangian stochastic modelling of dispersion in the convective boundary layer with skewed turbulence conditions and a vertical density gradient: Formulation and implementation in the FLEXPART model, Bound.-Lay. Meteorol., 154, 367–390, https://doi.org/10.1007/s10546-014-9976-5, 2015. a, b, c, d, e

Cassiani, M., Stohl, A., Olivié, D., Seland, Ø., Bethke, I., Pisso, I., and Iversen, T.: The offline Lagrangian particle model FLEXPART–NorESM/CAM (v1): model description and comparisons with the online NorESM transport scheme and with the reference FLEXPART model, Geosci. Model Dev., 9, 4029–4048, https://doi.org/10.5194/gmd-9-4029-2016, 2016. a, b, c

Clift, R. and Gauvin, W. H.: Motion of entrained particles in gas streams, Can. J. Chem. Eng., 49, 439–448, https://doi.org/10.1002/cjce.5450490403, 1971. a

Clift, R., Grace, J. R., and Weber, M. E.: Bubbles, drops, and particles, Courier Corporation, Dover Publications, Inc., ISBN 0-486-44580-1, 2005. a

Clifton, O. E., Patton, E. G., Wang, S., Barth, M., Orlando, J., and Schwantes, R. H.: Large eddy simulation for investigating coupled forest canopy and turbulence influences on atmospheric chemistry, J. Adv. Model. Earth Sy., 14, e2022MS003078, https://doi.org/10.1029/2022MS003078, 2022. a, b, c

Dada, L., Angot, H., Beck, I., Baccarini, A., Quéléver, L. L., Boyer, M., Laurila, T., Brasseur, Z., Jozef, G., de Boer, G., Shupe, M. D., Henning, S., Bucci, S., Dütsch, M., Stohl, A., Petäjä, T., Daellenbach, K. R., Jokinen, T., and Schmale, J.: A central arctic extreme aerosol event triggered by a warm air-mass intrusion, Nat. Commun., 13, 5290, https://doi.org/10.1038/s41467-022-32872-2, 2022. a

D'Amours, R., Malo, A., Flesch, T., Wilson, J., Gauthier, J.-P., and Servranckx, R.: The Canadian Meteorological Centre's Atmospheric Transport and Dispersion Modelling Suite, Atmos.-Ocean, 53, 176–199, https://doi.org/10.1080/07055900.2014.1000260, 2015. a

Döös, K., Jönsson, B., and Kjellsson, J.: Evaluation of oceanic and atmospheric trajectory schemes in the TRACMASS trajectory model v6.0, Geosci. Model Dev., 10, 1733–1749, https://doi.org/10.5194/gmd-10-1733-2017, 2017. a

Drakaki, E., Amiridis, V., Tsekeri, A., Gkikas, A., Proestakis, E., Mallios, S., Solomos, S., Spyrou, C., Marinou, E., Ryder, C. L., Bouris, D., and Katsafados, P.: Modeling coarse and giant desert dust particles, Atmos. Chem. Phys., 22, 12727–12748, https://doi.org/10.5194/acp-22-12727-2022, 2022. a

Draxler, R. R. and Hess, G.: An overview of the HYSPLIT_4 modelling system for trajectories, Australian meteorological magazine, 47, 295–308, https://www.researchgate.net/profile/G-Hess/publication/239061109_An_overview_of_the_HYSPLIT _4_modelling_system_for_trajectories/links/ 004635374253416d4e000000/An-overview-of-the-HYSPLIT-4-modelling-system-for-trajectories.pdf (last access: 11 September 2024), 1998. a, b

Eckhardt, S., Cassiani, M., Evangeliou, N., Sollum, E., Pisso, I., and Stohl, A.: Source–receptor matrix calculation for deposited mass with the Lagrangian particle dispersion model FLEXPART v10.2 in backward mode, Geosci. Model Dev., 10, 4605–4618, https://doi.org/10.5194/gmd-10-4605-2017, 2017. a

Eckhardt, S., Pisso, I., Evangeliou, N., Zwaaftink, C. G., Plach, A., McConnell, J. R., Sigl, M., Ruppel, M., Zdanowicz, C., Lim, S., Chellman, N., Opel, T., Meyer, H., Steffensen, J. P., Schwikowski, M., and Stohl, A.: Revised historical Northern Hemisphere black carbon emissions based on inverse modeling of ice core records, Nat. Commun., 14, 271, https://doi.org/10.1038/s41467-022-35660-0, 2023. a

ECMWF – IFS documentation: ECMWF: IFS documentation, https://www.ecmwf.int/sites/default/files/elibrary/2023/81369-ifs-documentation-cy48r1-part-iii-dynamics-and-numerical-procedures.pdf (last access: 11 September 2024), 2023. a

Emanuel, K. A. and Živković-Rothman, M.: Development and evaluation of a convection scheme for use in climate models, J. Atmos. Sci., 56, 1766–1782, https://doi.org/10.1175/1520-0469(1999)056<1766:DAEOAC>2.0.CO;2, 1999. a, b

Evangeliou, N., Grythe, H., Klimont, Z., Heyes, C., Eckhardt, S., Lopez-Aparicio, S., and Stohl, A.: Atmospheric transport is a major pathway of microplastics to remote regions, Nat. Commun., 11, 3381, https://doi.org/10.1038/s41467-020-17201-9, 2020. a

Evangelou, I., Tatsii, D., Bucci, S., and Stohl, A.: Atmospheric Resuspension of Microplastics from Bare Soil Regions, Environ. Sci. Technol., 58, 9741–9749, https://doi.org/10.1021/acs.est.4c01252, 2024. a

Fang, X., Shao, M., Stohl, A., Zhang, Q., Zheng, J., Guo, H., Wang, C., Wang, M., Ou, J., Thompson, R. L., and Prinn, R. G.: Top-down estimates of benzene and toluene emissions in the Pearl River Delta and Hong Kong, China, Atmos. Chem. Phys., 16, 3369–3382, https://doi.org/10.5194/acp-16-3369-2016, 2016. a

Ferber, G. J., Heffter, J. L., Draxler, R. R., Legomarsino, R., and Dietz, R.: Cross-Appalachian tracer experiment (CAPTEX'83), Final report, Tech. rep., National Oceanic and Atmospheric Administration, Silver Spring, MD (USA)., Air Resources Lab, https://www.osti.gov/biblio/5695021 (last access: 11 September 2024), 1986. a, b

Foreback, B.: FLEXPART with support to read and process Enviro- HIRLAM meteorological fields, Zenodo [code], https://doi.org/10.5281/zenodo.8300429, 2023. a

Forster, C., Stohl, A., and Seibert, P.: Parameterization of convective transport in a Lagrangian particle dispersion model and its evaluation, J. Appl. Meteorol. Climatol., 46, 403–422, https://doi.org/10.1175/JAM2470.1, 2007. a

Groot Zwaaftink, C. D., Arnalds, Ó., Dagsson-Waldhauserova, P., Eckhardt, S., Prospero, J. M., and Stohl, A.: Temporal and spatial variability of Icelandic dust emissions and atmospheric transport, Atmos. Chem. Phys., 17, 10865–10878, https://doi.org/10.5194/acp-17-10865-2017, 2017. a

Groot Zwaaftink, C. D., Henne, S., Thompson, R. L., Dlugokencky, E. J., Machida, T., Paris, J.-D., Sasakawa, M., Segers, A., Sweeney, C., and Stohl, A.: Three-dimensional methane distribution simulated with FLEXPART 8-CTM-1.1 constrained with observation data, Geosci. Model Dev., 11, 4469–4487, https://doi.org/10.5194/gmd-11-4469-2018, 2018. a, b, c, d

Groot Zwaaftink, C. D., Aas, W., Eckhardt, S., Evangeliou, N., Hamer, P., Johnsrud, M., Kylling, A., Platt, S. M., Stebel, K., Uggerud, H., and Yttri, K. E.: What caused a record high PM10 episode in northern Europe in October 2020?, Atmos. Chem. Phys., 22, 3789–3810, https://doi.org/10.5194/acp-22-3789-2022, 2022. a, b

Grythe, H., Kristiansen, N. I., Groot Zwaaftink, C. D., Eckhardt, S., Ström, J., Tunved, P., Krejci, R., and Stohl, A.: A new aerosol wet removal scheme for the Lagrangian particle model FLEXPART v10, Geosci. Model Dev., 10, 1447–1466, https://doi.org/10.5194/gmd-10-1447-2017, 2017. a, b, c, d, e, f, g, h, i, j

Hanna, S.: Applications in air pollution modeling, in: Atmospheric Turbulence and Air Pollution Modelling: A Course held in The Hague, 21–25 September, 1981, Springer, 275–310, https://doi.org/10.1007/978-94-010-9112-1_7, 1982. a, b, c, d

Harris, C. R., Millman, K. J., van der Walt, S. J., Gommers, R., Virtanen, P., Cournapeau, D., Wieser, E., Taylor, J., Berg, S., Smith, N. J., Kern, R., Picus, M., Hoyer, S., van Kerkwijk, M. H., Brett, M., Haldane, A., del Río, J. F., Wiebe, M., Peterson, P., Gérard-Marchant, P., Sheppard, K., Reddy, T., Weckesser, W., Abbasi, H., Gohlke, C., and Oliphant, T. E.: Array programming with NumPy, Nature, 585, 357–362, https://doi.org/10.1038/s41586-020-2649-2, 2020. a

Henne, S., Brunner, D., Oney, B., Leuenberger, M., Eugster, W., Bamberger, I., Meinhardt, F., Steinbacher, M., and Emmenegger, L.: Validation of the Swiss methane emission inventory by atmospheric observations and inverse modelling, Atmos. Chem. Phys., 16, 3683–3710, https://doi.org/10.5194/acp-16-3683-2016, 2016. a

Henne, S., Brunner, D., Groot Zwaaftink, C., and Stohl, A.: FLEXPART 8-CTM-1.1: Atmospheric Lagrangian Particle Dispersion Model for global tracer transport, Zenodo [code], https://doi.org/10.5281/zenodo.1249190, 2018. a, b, c

Hersbach, H., Bell, B., Berrisford, P., Hirahara, S., Horányi, A., Muñoz-Sabater, J., Nicolas, J., Peubey, C., Radu, R., Schepers, D., Simmons, A., Soci, C., Abdalla, S., Abellan, X., Balsamo, G., Bechtold, P., Biavati, G., Bidlot, J., Bonavita, M., De Chiara, G., Dahlgren, P., Dee, D., Diamantakis, M., Dragani, R., Flemming, J., Forbes, R., Fuentes, M., Geer, A., Haimberger, L., Healy, S., Hogan, R. J., Hólm, E., Janisková, M., Keeley, S., Laloyaux, P., Lopez, P., Lupu, C., Radnoti, G., de Rosnay, P., Rozum, I., Vamborg, F., Villaume, S., and Thépaut, J.-N.: The ERA5 global reanalysis, Q. J. Roy. Meteo. Soc., 146, 1999–2049, https://doi.org/10.1002/qj.3803, 2020. a

Hertel, O., Christensen, J., Runge, E. H., Asman, W. A., Berkowicz, R., Hovmand, M. F., and Øystein, H.: Development and testing of a new variable scale air pollution model – ACDEP, Atmos. Environ., 29, 1267–1290, https://doi.org/10.1016/1352-2310(95)00067-9, 1995. a, b, c, d, e

Hittmeir, S., Philipp, A., and Seibert, P.: A conservative reconstruction scheme for the interpolation of extensive quantities in the Lagrangian particle dispersion model FLEXPART, Geosci. Model Dev., 11, 2503–2523, https://doi.org/10.5194/gmd-11-2503-2018, 2018. a, b, c, d, e

Hoffmann, L., Baumeister, P. F., Cai, Z., Clemens, J., Griessbach, S., Günther, G., Heng, Y., Liu, M., Haghighi Mood, K., Stein, O., Thomas, N., Vogel, B., Wu, X., and Zou, L.: Massive-Parallel Trajectory Calculations version 2.2 (MPTRAC-2.2): Lagrangian transport simulations on graphics processing units (GPUs), Geosci. Model Dev., 15, 2731–2762, https://doi.org/10.5194/gmd-15-2731-2022, 2022. a, b

Hoyer, S. and Hamman, J.: xarray: N-D labeled arrays and datasets in Python, J. Open Res. Softw., 5, 10, https://doi.org/10.5334/jors.148, 2017. a

Hunter, J. D.: Matplotlib: A 2D graphics environment, Comput. Sci. Eng., 9, 90–95, https://doi.org/10.1109/MCSE.2007.55, 2007. a

Jones, A., Thomson, D., Hort, M., and Devenish, B.: The U.K. Met Office's Next-Generation Atmospheric Dispersion Model, NAME III, Springer, 580–589, ISBN 978-0-387-28255-8, https://doi.org/10.1007/978-0-387-68854-1_62, 2007. a

Katharopoulos, I., Brunner, D., Emmenegger, L., Leuenberger, M., and Henne, S.: Lagrangian particle dispersion models in the Grey Zone of turbulence: Adaptations to FLEXPART-COSMO for simulations at 1 km grid resolution, Bound.-Lay. Meteorol., 185, 129–160, https://doi.org/10.1007/s10546-022-00728-3, 2022. a

Kristiansen, N. I., Stohl, A., Olivié, D. J. L., Croft, B., Søvde, O. A., Klein, H., Christoudias, T., Kunkel, D., Leadbetter, S. J., Lee, Y. H., Zhang, K., Tsigaridis, K., Bergman, T., Evangeliou, N., Wang, H., Ma, P.-L., Easter, R. C., Rasch, P. J., Liu, X., Pitari, G., Di Genova, G., Zhao, S. Y., Balkanski, Y., Bauer, S. E., Faluvegi, G. S., Kokkola, H., Martin, R. V., Pierce, J. R., Schulz, M., Shindell, D., Tost, H., and Zhang, H.: Evaluation of observed and modelled aerosol lifetimes using radioactive tracers of opportunity and an ensemble of 19 global models, Atmos. Chem. Phys., 16, 3525–3561, https://doi.org/10.5194/acp-16-3525-2016, 2016. a, b, c

Kyrö, E.-M., Grönholm, T., Vuollekoski, H., Virkkula, A., Kulmala, M., and Laakso, L.: Snow scavenging of ultrafine particles: field measurements and parameterization, Boreal Environ. Res., 14, 527–538, 2009. a

Laakso, L., Grönholm, T., Rannik, Ü., Kosmale, M., Fiedler, V., Vehkamäki, H., and Kulmala, M.: Ultrafine particle scavenging coefficients calculated from 6 years field measurements, Atmos. Environ., 37, 3605–3613, https://doi.org/10.1016/S1352-2310(03)00326-1, 2003. a

Legras, B., Joseph, B., and Lefevre, F.: Vertical diffusivity in the lower stratosphere from Lagrangian back-trajectory reconstructions of ozone profiles, J. Geophys. Res.-Atmos., 108, https://doi.org/10.1029/2002JD003045, 2003. a, b

Lin, J., Gerbig, C., Wofsy, S., Andrews, A., Daube, B., Davis, K., and Grainger, C.: A near-field tool for simulating the upstream influence of atmospheric observations: The Stochastic Time-Inverted Lagrangian Transport (STILT) model, J. Geophys. Res.-Atmos., 108, https://doi.org/10.1029/2002JD003161, 2003. a

Mackay, D., Shiu, W.-Y., and Lee, S. C.: Handbook of physical-chemical properties and environmental fate for organic chemicals, CRC press, https://doi.org/10.1201/9781420044393, 2006. a, b, c

Martinsson, J., Monteil, G., Sporre, M. K., Kaldal Hansen, A. M., Kristensson, A., Eriksson Stenström, K., Swietlicki, E., and Glasius, M.: Exploring sources of biogenic secondary organic aerosol compounds using chemical analysis and the FLEXPART model, Atmos. Chem. Phys., 17, 11025–11040, https://doi.org/10.5194/acp-17-11025-2017, 2017. a

Maryon, R.: Determining cross-wind variance for low frequency wind meander, Atmos. Environ., 32, 115–121, https://doi.org/10.1016/S1352-2310(97)00325-7, 1998. a

McConnell, J. R., Chellman, N. J., Wensman, S. M., Plach, A., Stanish, C., Santibáñez, P. A., Brugger, S. O., Eckhardt, S., Freitag, J., Kipfstuhl, S., and Stohl, A.: Hemispheric-scale heavy metal pollution from South American and Australian mining and metallurgy during the Common Era, Sci. Total Environ., 912, 169431, https://doi.org/10.1016/j.scitotenv.2023.169431, 2024. a

Met Office: Cartopy: a cartographic python library with a Matplotlib interface, Exeter, Devon, https://scitools.org.uk/cartopy (last access: 11 September 2024), 2010–2015. a

Meyer, D. and Jenny, P.: Conservative velocity interpolation for PDF methods, in: PAMM: Proceedings in Applied Mathematics and Mechanics, 4, 466–467, https://doi.org/10.1002/pamm.200410214, 2004. a, b

Mirza, A. K., Dacre, H. F., and Lo, C. H. B.: A case study analysis of the impact of a new free tropospheric turbulence scheme on the dispersion of an atmospheric tracer, Q. J. Roy. Meteor. Soc., 150, 1907–1925, https://doi.org/10.1002/qj.4681, 2024. a

Moxnes, E. D., Kristiansen, N. I., Stohl, A., Clarisse, L., Durant, A., Weber, K., and Vogel, A.: Separation of ash and sulfur dioxide during the 2011 Grímsvötn eruption, J. Geophys. Res.-Atmos., 119, 7477–7501, https://doi.org/10.1002/2013JD021129, 2014. a

Müller, H. and Pröhl, G.: ECOSYS-87: a dynamic model for assessing radiological consequences of nuclear accidents, Health Phys., 64, 232–252, https://doi.org/10.1097/00004032-199303000-00002, 1993. a

Musser, D. R.: Introspective sorting and selection algorithms, Softw. Pract. Exper., 27, 983–993, https://doi.org/10.1002/(SICI)1097-024X(199708)27:8<983::AID-SPE117>3.0.CO;2-#, 1997. a

Nair, S. K., Apostoaei, A. I., and Hoffman, F. O.: A radioiodine speciation, deposition, and dispersion model with uncertainty propagation for the Oak Ridge dose reconstruction, Health Phys., 78, 394–413, https://doi.org/10.1097/00004032-200004000-00004, 2000. a

Näslund, E. and Thaning, L.: On the settling velocity in a nonstationary atmosphere, Aerosol Sci. Technol., 14, 247–256, https://doi.org/10.1080/02786829108959487, 1991. a, b

Nodop, K., Connolly, R., and Girardi, F.: The field campaigns of the European Tracer Experiment (ETEX): Overview and results, Atmos. Environ., 32, 4095–4108, https://doi.org/10.1016/S1352-2310(98)00190-3, 1998. a

Päsler-Sauer, J.: Description of the atmospheric dispersion model ATSTEP, RODOS (WG2)-TN (99)-11, https://resy5.ites.kit.edu/RODOS/Documents/Public/Handbook/Volume3/4_2_5_ATSTEP.pdf (last access: 11 September 2024), 2000. a, b, c

Peng, D., Zhou, T., Sun, Y., and Lin, A.: Interannual Variation in Moisture Sources for the First Rainy Season in South China Estimated by the FLEXPART Model, J. Climate, 35, 745–761, https://doi.org/10.1175/JCLI-D-21-0289.1, 2022. a

Petterssen, S.: Weather analysis and forecasting: a textbook on synoptic meteorology, McGraw-Hill Book Company, 1940. a

PHAIDRA, 2008: FAIRsharing.org: PHAIDRA – University of Vienna (Phaidra), https://doi.org/10.25504/FAIRsharing.6a56fd, 2008. a

Pisso, I., Sollum, E., Grythe, H., Kristiansen, N. I., Cassiani, M., Eckhardt, S., Arnold, D., Morton, D., Thompson, R. L., Groot Zwaaftink, C. D., Evangeliou, N., Sodemann, H., Haimberger, L., Henne, S., Brunner, D., Burkhart, J. F., Fouilloux, A., Brioude, J., Philipp, A., Seibert, P., and Stohl, A.: The Lagrangian particle dispersion model FLEXPART version 10.4, Geosci. Model Dev., 12, 4955–4997, https://doi.org/10.5194/gmd-12-4955-2019, 2019. a, b, c, d, e, f

Rastigejev, Y., Park, R., Brenner, M. P., and Jacob, D. J.: Resolving intercontinental pollution plumes in global models of atmospheric transport, J. Geophys. Res.-Atmos., 115, https://doi.org/10.1029/2009JD012568, 2010. a

Raynor, G. S., Dietz, R. N., and D'Ottavio, T. W.: Aircraft measurements of tracer gas during the 1983 Cross Appalachian Tracer Experiment (CAPTEX), Tech. rep., Brookhaven National Lab., Upton, NY (USA), https://www.osti.gov/biblio/6609903 (last access: 11 September 2024), 1984. a

Reithmeier, C. and Sausen, R.: ATTILA: atmospheric tracer transport in a Lagrangian model, Tellus B, 54, 278–299, https://doi.org/10.3402/tellusb.v54i3.16666, 2002. a

Ryall, D. and Maryon, R.: Validation of the UK Met. Office’s NAME model against the ETEX dataset, Atmos. Environ., 32, 4265–4276, https://doi.org/10.1016/S1352-2310(98)00177-0, 1998. a, b

Ryder, C. L., Highwood, E. J., Walser, A., Seibert, P., Philipp, A., and Weinzierl, B.: Coarse and giant particles are ubiquitous in Saharan dust export regions and are radiatively significant over the Sahara, Atmos. Chem. Phys., 19, 15353–15376, https://doi.org/10.5194/acp-19-15353-2019, 2019. a

Sahsuvar, L., Helm, P. A., Jantunen, L. M., and Bidleman, T. F.: Henry's law constants for α-, β-, and γ-hexachlorocyclohexanes (HCHs) as a function of temperature and revised estimates of gas exchange in Arctic regions, Atmos. Environ., 37, 983–992, https://doi.org/10.1016/S1352-2310(02)00936-6, 2003. a, b, c

Sander, R.: Compilation of Henry's law constants (version 5.0.0) for water as solvent, Atmos. Chem. Phys., 23, 10901–12440, https://doi.org/10.5194/acp-23-10901-2023, 2023. a, b

Saxby, J., Beckett, F., Cashman, K., Rust, A., and Tennant, E.: The impact of particle shape on fall velocity: Implications for volcanic ash dispersion modelling, J. Volcanol. Geoth. Res., 362, 32–48, https://doi.org/10.1016/j.jvolgeores.2018.08.006, 2018. a

Schicker, I., Radanovics, S., and Seibert, P.: Origin and transport of Mediterranean moisture and air, Atmos. Chem. Phys., 10, 5089–5105, https://doi.org/10.5194/acp-10-5089-2010, 2010. a

Schneising, O., Buchwitz, M., Hachmeister, J., Vanselow, S., Reuter, M., Buschmann, M., Bovensmann, H., and Burrows, J. P.: Advances in retrieving XCH4 and XCO from Sentinel-5 Precursor: improvements in the scientific TROPOMI/WFMD algorithm, Atmos. Meas. Tech., 16, 669–694, https://doi.org/10.5194/amt-16-669-2023, 2023. a

Seibert, P.: Convergence and Accuracy of Numerical Methods for Trajectory Calculations, J. Appl. Meteorol. Climatol., 32, 558–566, https://doi.org/10.1175/1520-0450(1993)032<0558:CAAONM>2.0.CO;2, 1993. a

Seibert, P. and Frank, A.: Source-receptor matrix calculation with a Lagrangian particle dispersion model in backward mode, Atmos. Chem. Phys., 4, 51–63, https://doi.org/10.5194/acp-4-51-2004, 2004. a, b

Seibert, P., Arnold, D., Arnold, N., Gufler, K., Kromp-Kolb, H., Mraz, G., Sholly, S., and Wenisch, A.: Flexrisk – Flexible tools for assessment of nuclear risk in Europe, Final Report, PRELIMINARY VERSION MAY 2013, BOKU-Met Report 23, 126 pp., http://www.boku.ac.at/met/report/BOKU-Met_Report_23_PRELIM_online.pdf (last access: 11 September 2024), 2013. a

Slinn, W.: Predictions for particle deposition to vegetative canopies, Atmos. Environ., 16, 1785–1794, https://doi.org/10.1016/0004-6981(82)90271-2, 1982. a

Stohl, A. and James, P.: A Lagrangian analysis of the atmospheric branch of the global water cycle. Part I: Method description, validation, and demonstration for the August 2002 flooding in central Europe, J. Hydrometeorol., 5, 656–678, https://doi.org/10.1175/1525-7541(2004)005<0656:ALAOTA>2.0.CO;2, 2004. a, b, c

Stohl, A. and Koffi, N. E.: Evaluation of trajectories calculated from ECMWF data against constant volume balloon flights during ETEX, Atmos. Environ., 32, 4151–4156, https://doi.org/10.1016/S1352-2310(98)00185-X, 1998. a, b

Stohl, A. and Seibert, P.: Accuracy of trajectories as determined from the conservation of meteorological tracers, Q. J. Roy. Meteor. Soc., 124, 1465–1484, https://doi.org/10.1002/qj.49712454907, 1998. a

Stohl, A. and Thomson, D. J.: A density correction for Lagrangian particle dispersion models, Bound.-Lay. Meteorol., 90, 155–167, https://doi.org/10.1023/A:1001741110696, 1999. a, b, c

Stohl, A., Hittenberger, M., and Wotawa, G.: Validation of the Lagrangian particle dispersion model FLEXPART against large-scale tracer experiment data, Atmos. Environ., 32, 4245–4264, https://doi.org/10.1016/S1352-2310(98)00184-8, 1998. a, b, c

Stohl, A., Forster, C., Frank, A., Seibert, P., and Wotawa, G.: Technical note: The Lagrangian particle dispersion model FLEXPART version 6.2, Atmos. Chem. Phys., 5, 2461–2474, https://doi.org/10.5194/acp-5-2461-2005, 2005. a, b, c, d

Stohl, A., Andrews, E., Burkhart, J. F., Forster, C., Herber, A., Hoch, S. W., Kowal, D., Lunder, C., Mefford, T., Ogren, J. A., Sharma, S., Spichtinger, N., Stebel, K., Stone, R., Ström, J., Tørseth, K., Wehrli, C., and Yttri, K. E.: Pan-Arctic enhancements of light absorbing aerosol concentrations due to North American boreal forest fires during summer 2004, J. Geophys. Res.-Atmos., 111, https://doi.org/10.1029/2006JD007216, 2006. a

Stohl, A., Prata, A. J., Eckhardt, S., Clarisse, L., Durant, A., Henne, S., Kristiansen, N. I., Minikin, A., Schumann, U., Seibert, P., Stebel, K., Thomas, H. E., Thorsteinsson, T., Tørseth, K., and Weinzierl, B.: Determination of time- and height-resolved volcanic ash emissions and their use for quantitative ash dispersion modeling: the 2010 Eyjafjallajökull eruption, Atmos. Chem. Phys., 11, 4333–4351, https://doi.org/10.5194/acp-11-4333-2011, 2011. a

Stohl, A., Seibert, P., Wotawa, G., Arnold, D., Burkhart, J. F., Eckhardt, S., Tapia, C., Vargas, A., and Yasunari, T. J.: Xenon-133 and caesium-137 releases into the atmosphere from the Fukushima Dai-ichi nuclear power plant: determination of the source term, atmospheric dispersion, and deposition, Atmos. Chem. Phys., 12, 2313–2343, https://doi.org/10.5194/acp-12-2313-2012, 2012. a

Sutherland, W.: LII. The viscosity of gases and molecular force, The London, Edinburgh, and Dublin Philosophical Magazine and Journal of Science, 36, 507–531, https://doi.org/10.1080/14786449308620508, 1893. a

Tatsii, D., Bucci, S., Bhowmick, T., Guettler, J., Bakels, L., Bagheri, G., and Stohl, A.: Shape Matters: Long-Range Transport of Microplastic Fibers in the Atmosphere, Environ. Sci. Technol., 58, 671–682, https://doi.org/10.1021/acs.est.3c08209, 2024. a, b, c, d

Thompson, R. L. and Stohl, A.: FLEXINVERT: an atmospheric Bayesian inversion framework for determining surface fluxes of trace species using an optimized grid, Geosci. Model Dev., 7, 2223–2242, https://doi.org/10.5194/gmd-7-2223-2014, 2014. a

Thomson, D.: Criteria for the selection of stochastic models of particle trajectories in turbulent flows, J. Fluid Mech., 180, 529–556, https://doi.org/10.1017/S0022112087001940, 1987. a, b

Tinarelli, G., Anfossi, D., Trini Castelli, S., Bider, M., and Ferrero, E.: A New High Performance Version of the Lagrangian Particle Dispersion Model Spray, Some Case Studies, Springer US, Boston, MA, 499–507, ISBN 978-1-4615-4153-0, https://doi.org/10.1007/978-1-4615-4153-0_51, 2000. a

Tipka, A., Haimberger, L., and Seibert, P.: Flex_extract v7.1.2 – a software package to retrieve and prepare ECMWF data for use in FLEXPART, Geosci. Model Dev., 13, 5277–5310, https://doi.org/10.5194/gmd-13-5277-2020, 2020. a, b, c

Tunved, P., Ström, J., and Krejci, R.: Arctic aerosol life cycle: linking aerosol size distributions observed between 2000 and 2010 with air mass transport and precipitation at Zeppelin station, Ny-Ålesund, Svalbard, Atmos. Chem. Phys., 13, 3643–3660, https://doi.org/10.5194/acp-13-3643-2013, 2013. a, b

Van Leuven, S., De Meutter, P., Camps, J., Termonia, P., and Delcloo, A.: An optimisation method to improve modelling of wet deposition in atmospheric transport models: applied to FLEXPART v10.4, Geosci. Model Dev., 16, 5323–5338, https://doi.org/10.5194/gmd-16-5323-2023, 2023. a

Verreyken, B., Brioude, J., and Evan, S.: Development of turbulent scheme in the FLEXPART-AROME v1.2.1 Lagrangian particle dispersion model, Geosci. Model Dev., 12, 4245–4259, https://doi.org/10.5194/gmd-12-4245-2019, 2019. a

Virtanen, P., Gommers, R., Oliphant, T. E., Haberland, M., Reddy, T., Cournapeau, D., Burovski, E., Peterson, P., Weckesser, W., Bright, J., van der Walt, S. J., Brett, M., Wilson, J., Millman, K. J., Mayorov, N., Nelson, A. R. J., Jones, E., Kern, R., Larson, E., Carey, C. J., Polat, İ., Feng, Y., Moore, E. W., VanderPlas, J., Laxalde, D., Perktold, J., Cimrman, R., Henriksen, I., Quintero, E. A., Harris, C. R., Archibald, A. M., Ribeiro, A. H., Pedregosa, F., van Mulbregt, P., and SciPy 1.0 Contributors: SciPy 1.0: Fundamental Algorithms for Scientific Computing in Python, Nat. Meth., 17, 261–272, https://doi.org/10.1038/s41592-019-0686-2, 2020. a

Vojta, M., Plach, A., Thompson, R. L., and Stohl, A.: A comprehensive evaluation of the use of Lagrangian particle dispersion models for inverse modeling of greenhouse gas emissions, Geosci. Model Dev., 15, 8295–8323, https://doi.org/10.5194/gmd-15-8295-2022, 2022. a, b

Wang, H., Agrusta, R., and van Hunen, J.: Advantages of a conservative velocity interpolation (CVI) scheme for particle-in-cell methods with application in geodynamic modeling, Tech. Rep. 6, 2015–2023, https://doi.org/10.1002/2015GC005824, 2015. a, b

Wang, X., Zhang, L., and Moran, M. D.: Development of a new semi-empirical parameterization for below-cloud scavenging of size-resolved aerosol particles by both rain and snow, Geosci. Model Dev., 7, 799–819, https://doi.org/10.5194/gmd-7-799-2014, 2014. a

Wesely, M.: Parameterization of surface resistances to gaseous dry deposition in regional-scale numerical models, Atmos. Environ., 23, 1293–1304, https://doi.org/10.1016/0004-6981(89)90153-4, 1989. a, b, c, d, e

Wesely, M. and Hicks, B.: Some factors that affect the deposition rates of sulfur dioxide and similar gases on vegetation, JAPCA J. Air. Waste. Ma., 27, 1110–1116, https://doi.org/10.1080/00022470.1977.10470534, 1977. a

Zhu, C., Kanaya, Y., Takigawa, M., Ikeda, K., Tanimoto, H., Taketani, F., Miyakawa, T., Kobayashi, H., and Pisso, I.: FLEXPART v10.1 simulation of source contributions to Arctic black carbon, Atmos. Chem. Phys., 20, 1641–1656, https://doi.org/10.5194/acp-20-1641-2020, 2020. a

Download
Short summary
Computer models are essential for improving our understanding of how gases and particles move in the atmosphere. We present an update of the atmospheric transport model FLEXPART. FLEXPART 11 is more accurate due to a reduced number of interpolations and a new scheme for wet deposition. It can simulate non-spherical aerosols and includes linear chemical reactions. It is parallelised using OpenMP and includes new user options. A new user manual details how to use FLEXPART 11.