the Creative Commons Attribution 4.0 License.

the Creative Commons Attribution 4.0 License.

# DCMIP2016: the splitting supercell test case

### Christiane Jablonowski

### James Kent

### Peter H. Lauritzen

### Ramachandran Nair

### Kevin A. Reed

### Paul A. Ullrich

### David M. Hall

### Mark A. Taylor

### Don Dazlich

### Ross Heikes

### Celal Konor

### David Randall

### Lucas Harris

### Marco Giorgetta

### Daniel Reinert

### Christian Kühnlein

### Robert Walko

### Vivian Lee

### Abdessamad Qaddouri

### Monique Tanguay

### Hiroaki Miura

### Tomoki Ohno

### Ryuji Yoshida

### Sang-Hun Park

### Joseph B. Klemp

### William C. Skamarock

This paper describes the splitting supercell idealized test case used in the 2016 Dynamical Core Model Intercomparison Project (DCMIP2016). These storms are useful test beds for global atmospheric models because the horizontal scale of convective plumes is O(1 km), emphasizing non-hydrostatic dynamics. The test case simulates a supercell on a reduced-radius sphere with nominal resolutions ranging from 4 to 0.5 km and is based on the work of Klemp et al. (2015). Models are initialized with an atmospheric environment conducive to supercell formation and forced with a small thermal perturbation. A simplified Kessler microphysics scheme is coupled to the dynamical core to represent moist processes. Reference solutions for DCMIP2016 models are presented. Storm evolution is broadly similar between models, although differences in the final solution exist. These differences are hypothesized to result from different numerical discretizations, physics–dynamics coupling, and numerical diffusion. Intramodel solutions generally converge as models approach 0.5 km resolution, although exploratory simulations at 0.25 km imply some dynamical cores require more refinement to fully converge. These results can be used as a reference for future dynamical core evaluation, particularly with the development of non-hydrostatic global models intended to be used in convective-permitting regimes.

- Article
(5569 KB) - Companion paper
- BibTeX
- EndNote

Supercells are strong, long-lived convective cells containing deep, persistent rotating updrafts that operate on spatial scales O(10 km). They can persist for many hours and frequently produce large hail, tornados, damaging straight-line winds, cloud-to-ground lightning, and heavy rain (Browning, 1964; Lemon and Doswell, 1979; Doswell and Burgess, 1993). Therefore, accurate simulation of these features is of great societal interest and critical for atmospheric models.

The supercell test applied in the 2016 Dynamical Core Model Intercomparison Project (DCMIP2016) (Ullrich et al., 2017) permits the study of a non-hydrostatic moist flow field with strong vertical velocities and associated precipitation. This test is based on the work of Klemp and Wilhelmson (1978) and Klemp et al. (2015), and assesses the performance of global numerical models at extremely high spatial resolution. It has recently been used in the evaluation of next-generation weather prediction systems (Ji and Toepfer, 2016).

Previous work regarding the role of model numerics in simulating extreme
weather features has generally focused on limited area domains
(e.g., Gallus and Bresch, 2006; Guimond et al., 2016). While some recent
work has targeted global frameworks and extremes – primarily tropical
cyclones (e.g., Zhao et al., 2012; Reed et al., 2015) – these studies
have almost exclusively employed hydrostatic dynamical cores at grid spacings
approximately 0.25^{∘} and coarser.

The supercell test here emphasizes resolved, non-hydrostatic dynamics. In this regime, the effective grid spacing is very similar to the horizontal scale of convective plumes. Further, the addition of simplified moist physics injects energy near the grid scale in a conditionally unstable atmosphere, which imposes significant stress on model numerics. The supercell test case therefore sheds light on the interplay of the dynamical core and subgrid parameterizations and highlights the impact of both implicit and explicit numerical diffusion on model solutions. It also demonstrates credibility of a global modeling framework to simulate extreme phenomena, essential for future weather and climate simulations.

The test case is defined as follows. The setup employs a non-rotating
reduced-radius sphere with scaling factor *X*=120. Reducing the model's
planetary radius allows for fine horizontal grid spacing and non-hydrostatic
motions to be resolved at relatively low computational cost compared to a
configuration using the actual size of the Earth
(Kuang et al., 2005). Wedi and Smolarkiewicz (2009) provide a detailed
overview of the reduced-radius framework for testing global models. For a
1^{∘} mesh, the grid spacing of the reduced-radius sphere is
approximately $\mathrm{1}{}^{\circ}/X\sim \mathrm{111}\phantom{\rule{0.125em}{0ex}}\mathrm{km}/X\sim \mathrm{111}\phantom{\rule{0.125em}{0ex}}\mathrm{km}/\mathrm{120}\sim \mathrm{1}\phantom{\rule{0.125em}{0ex}}\mathrm{km}$ near the Equator. Klemp et al. (2015) demonstrated
excellent agreement between simulations using this value of *X* and those
completed on a flat, Cartesian plane with equivalent resolution. The model
top (*z*_{t}) is placed at 20 km with uniform vertical grid spacing
(Δ*z*) equal to 500 m, resulting in 40 full vertical levels. No
surface drag is imposed at the lower boundary (free slip condition). Water
vapor (*q*_{v}), cloud water (*q*_{c}), and rainwater
(*q*_{r}) are handled by a simple Kessler microphysics routine
(Kessler, 1969). In particular, the Kessler microphysics used
here is outlined in detail in Appendix C of Klemp et al. (2015) and code
for reproducing this configuration is available via the DCMIP2016 repository
(https://doi.org/10.5281/zenodo.1298671, Ullrich et al., 2018).

All simulations are integrated for 120 min. Outputs of the full
three-dimensional prognostic fields as well as all variables pertaining to
the microphysical routines were stored for post-processing at least every
15 min. Four different horizontal resolutions were specified: 4, 2, 1, and
0.5^{∘}. For the reduced-radius framework, this results in approximate
grid spacings of 4, 2, 1, and 0.5 km, respectively. Note that here we use
“(nominal) resolution” and “grid spacing” interchangeably to refer to the
horizontal length of a single grid cell or distance between grid points. All
relevant constants mentioned here and in the following section are defined in
Table 1.

## 2.1 Mean atmospheric background

The mean atmospheric state is designed such that it consists of large
instability (convective available potential energy (CAPE) of approximately
2200 m^{2} s^{−1}) and strong low-level wind shear, both of which are
strong precursors of supercell formation
(Weisman and Klemp, 1982).

The definition of this test case relies on hydrostatic and cyclostrophic wind
balance, written in terms of Exner pressure *π* and virtual potential
temperature *θ*_{v} as

Defining *u*=*u*_{eq}cos *φ* to maintain solid body rotation,
where *u*_{eq} is the equatorial wind velocity, these equations can be
combined to eliminate *π*, leading to

The wind velocity is analytically defined throughout the domain. Meridional and vertical wind is initially set to zero. The zonal wind is obtained from

The equatorial profile is determined through numerical iteration. Potential temperature at the Equator is specified via

and relative humidity is given by

It is assumed that the saturation mixing ratio is given by

Pressure and temperature at the Equator are obtained by iterating on hydrostatic balance with initial state

and iteration procedure

This iteration procedure generally converges to machine epsilon after approximately 10 iterations. The equatorial moisture profile is then extended through the entire domain:

Once the equatorial profile has been constructed, the virtual potential temperature through the remainder of the domain can be computed by iterating on Eq. (2):

Again, approximately 10 iterations are needed for convergence to machine epsilon. Once virtual potential temperature has been computed throughout the domain, Exner pressure throughout the domain can be obtained from Eq. (1):

and so

Note that, for Eqs. (13)–(14), Smolarkiewicz et al. (2017) also derived an analytic solution for the meridional variation of the initial background state for shallow atmospheres.

## 2.2 Potential temperature perturbation

To initiate convection, a thermal perturbation is introduced into the initial potential temperature field:

where

An additional iterative step is then required to bring the potential temperature perturbation into hydrostatic balance. Without this additional iteration, large vertical velocities will be generated as the flow rapidly adjusts to hydrostatic balance since the test does not possess strong non-hydrostatic characteristics at initialization. Plots showing the initial state of the supercell are shown in Figs. 1 and 2 for reference. Code used by modeling centers during DCMIP2016 for initialization of the supercell test case is archived via Zenodo (https://doi.org/10.5281/zenodo.1298671, Ullrich et al., 2018).

The test case is designed such that the thermal perturbation will induce a convective updraft immediately after initialization. As rainwater is generated by the microphysics, reduced buoyancy and a subsequent downdraft at the Equator in combination with favorable vertical pressure gradients near the peripheral flanks of the storm will cause it to split into two counter-rotating cells that propagate transversely away from the Equator until the end of the test (Rotunno and Klemp, 1982, 1985; Rotunno, 1993; Klemp et al., 2015).

## 2.3 Physical and numerical diffusion

As noted in Klemp et al. (2015), dissipation is an important process near
the grid scale, particularly in simulations investigating convection in
unstable environments such as this. To represent this process and facilitate
solution convergence as resolution is increased for a given model, a
second-order diffusion operator with a constant viscosity (value) is applied
to all momentum equations (*ν*=500 m^{2} s^{−1}) and scalar equations
(*ν*=1500 m^{2} s^{−1}). In the vertical, this diffusion is applied to
the perturbation from the background state only in order to prevent the
initial perturbation from mixing out.

Models that contributed supercell test results during DCMIP2016 are listed in Table 2. They are formally described in Ullrich et al. (2017) and the references therein. Further, specific versions of the code used in DCMIP2016 and access instructions are also listed in Ullrich et al. (2017). Note that not all DCMIP2016 participating groups submitted results for this particular test.

Due to the multitude of differing implicit and explicit diffusion in the
participating models, some groups chose to apply variations in how either
horizontal or vertical diffusion were treated in this test case. Deviations
from the above-specified diffusion are as follows. CSU applied uniform
three-dimensional second-order diffusion with coefficients of
*ν*=1500 m^{2} s^{−1} for *q*_{v} and *θ*_{v},
*ν*=1000 m^{2} s^{−1} for *q*_{c} and *q*_{r}, and
*ν*=500 m^{2} s^{−1} for divergence and relative vorticity. FV^{3}
applied divergence and vorticity damping separately to the velocity fields
along the floating Lagrangian surface. A Smagorinsky diffusion is also
applied to the horizontal wind. ICON applied constant horizontal second-order
diffusion to the horizontal and vertical velocity components
(*ν*=500 m^{2} s^{−1}) as well as the scalar variables
*θ*_{v} and *q*_{v,c,r} (*ν*=1500 m^{2} s^{−1}). No
explicit diffusion was applied in the vertical. NICAM applied a dynamically
defined fourth-order diffusion to all variables in the horizontal with
vertical dissipation being implicitly handled by the model's vertical
discretization.

The following section describes the results of the supercell test case during DCMIP2016, both from a intermodel time evolution perspective and intramodel sensitivity to model resolution and ensuing convergence. Note that there is no analytic solution for the test case, but features specific to supercells should be observed and are subsequently discussed. It is not the intent of this paper to formally explore the precise mechanisms for model spread or define particular solutions as superior but rather to publish an overview set of results from a diverse group of global, non-hydrostatic models to be used for future development endeavors. Future work employing this test case in a more narrow sense can isolate some of the model design choices that impact supercell simulations.

## 3.1 Time evolution of supercell at control resolution

Figure 3 shows the temporal evolution (every 30 min, out
to 120 min test termination) of the supercell for contributing models at the
control resolution of 1 km. The top four panels for each model highlight a
cross-section at 5 km elevation through vertical velocity (*w*), while the
bottom four show a cross-section (at the same elevation) through the
rainwater (*q*_{r}) field produced by the Kessler microphysics. For *w*, red
contours represent rising motion, while blue contours denote sinking air. Note
that the longitudes plotted vary slightly in each of the four time panes to
account for zonal movement. This analysis framework closely follows that
originally outlined in Klemp et al. (2015).

All model solutions show bulk similarities. With respect to vertical
velocity, a single, horseshoe-shaped updraft is noted at 30 min in all
models, although the degree to which the maximum updraft velocities are
centered on the Equator vary. A corresponding downdraft is located
immediately to the east of the region of maximum positive vertical velocity.
This downdraft is single-lobed (e.g., ACME-A) or double-lobed (e.g., GEM) in
all simulations. Separation of the initial updraft occurs by 60 min across
all models, although variance begins to develop in the meridional deviation
from the Equator of the splitting supercell. Models such as NICAM, FV^{3},
OLAM, and ICON all have larger and more distinct north–south spatial
separation, while FVM, GEM, ACME-A, and TEMPEST show only a few degrees of
latitude between updraft cores.

Structural differences also begin to emerge at 60 min. For example, FVM,
GEM, ACME-A, and TEMPEST all exhibit three local maxima in vertical velocity:
two large updrafts mirrored about the Equator with one small maximum still
located over Equator centered near the initial perturbation. Similar behavior
is noted in the *q*_{r} fields. This is in contrast with other models
which lack a third updraft on the equatorial plane. Generally speaking,
*q*_{r} maxima are collocated with the locations of maximum updraft
velocities and thereby conversion from *q*_{v} and *q*_{c} to
*q*_{r} in the Kessler microphysics.

While the aggregate response of a single updraft eventually splitting into
poleward-propagating symmetric storms about the Equator is well matched
between the configurations, notable differences exist, particularly towards
the end of the runs. At 120 min, FVM, GEM, ACME-A, OLAM, and MPAS all show
two discrete supercells approximately 30^{∘} from the Equator. FV^{3}
and TEMPEST both produce longitudinally transverse storms that stretch
towards the Equator in addition to the two main cells. Each of the splitting
supercells splits a second time in ICON, forming, in conjunction with a local
maximum at the Equator, five maxima of vertical velocity (and correspondingly
rainwater). NICAM produces two core supercells (as more clearly evident in
the *q*_{r} field at 120 min) but has noticeable alternating weak
updrafts and downdrafts in the north–south space between the two storm cores.

The relative smoothness of the storms as measured by the vertical velocity
and rainwater fields also varies between models, particularly at later
times. ACME-A, FVM, GEM, OLAM, and MPAS produce updrafts that are relatively
free of additional, small-scale local extrema in the vicinity of the core of
the splitting supercell. Conversely, CSU, FV^{3}, ICON, NICAM, and TEMPEST
all exhibit solutions with additional convective structures, with multiple
updraft maxima versus two coherent cells. This spread is somewhat minimized
when looking at rainwater, implying that the overall dynamical character of
the cells as noted by precipitation generation is more similar, with all
models showing cohesive rainwater maxima O(10 g kg^{−1}).

## 3.2 Resolution sensitivity of the supercell

Figure 4 shows the same cross-section variables as Fig. 3 except across the four specified test resolutions (nominally 4, 2, 1, and 0.5 km, from left to right) at test termination of 120 min. Therefore, the third panel from the left for each model (1 km) should match the fourth panel from the left for each model in Fig. 3.

As resolution increases (left to right), models show increasing horizontal structure in both the vertical velocity and rainwater fields. Updraft velocity generally increases with resolution, particularly going from 4 to 2 km, implying that the supercell is underresolved at 4 km resolution. This is supported by previous mesoscale simulations investigating supercells in other frameworks (Potvin and Flora, 2015; Schwartz et al., 2017), although it should be emphasized that this response is also subject to each numerical scheme's effective resolution (Skamarock, 2004) and that the resolvability of real-world supercells can depend on the size of individual storms.

At the highest resolutions, there is a distinct group of models that exhibit
more small-scale structure, particularly in vertical velocity, at +120 min
at higher resolutions. CSU, GEM, and NICAM appear to have the largest
vertical velocity variability at 0.5 km, while ACME-A, FVM, MPAS, and
TEMPEST appear to produce the smoothest solutions. This result is likely due
to the differences in explicit diffusion treatment as noted before, as well
as differences in the numerical schemes' implicit diffusion, particularly
given the large impact of dissipation on kinetic energy near the grid scale
(Skamarock, 2004; Jablonowski and Williamson, 2011; Guimond et al., 2016; Kühnlein et al., 2019).
Additional focused sensitivity runs varying explicit diffusion operators and
magnitude may be insightful for developers to explore. It is also
hypothesized that differences in the coupling between the dynamical core and
subgrid parameterizations may lead to some of these behaviors
(e.g., Staniforth et al., 2002; Gallus and Bresch, 2006; Malardel, 2010; Thatcher and Jablonowski, 2016; Gross et al., 2018),
although more constrained simulations isolating physics–dynamics coupling in
particular modeling frameworks is a target for future work. As before,
rainwater cross-sections tend to be less spatially variable at 0.5 km than
vertical velocity, although CSU and NICAM both show some additional local
maxima in the field associated with some of the aforementioned *w* maxima.

## 3.3 Convergence of global supercell quantities with resolution

While Fig. 4 highlights the structural convergence with
resolution, more storm-wide measures of supercell intensity are also of
interest. Figure 5 shows the maximum resolved updraft
velocity over the global domain as a function of time for each dynamical core
and each resolution (finer model resolution is denoted by progressively
darker lines). Maximum updraft velocity is chosen as a metric of interest due
to its common use in both observational and modeling studies of supercells.
All models show increasing updraft velocity as a function of resolution,
further confirming that, at 4 km, the supercell is underresolved
dynamically. For the majority of models and integration times, the gap
between 4 and 2 km grid spacing is the largest in magnitude, with subsequent
increases in updraft velocity being smaller as models further decrease
horizontal grid spacing. At 0.5 km, the majority of models are relatively
converged, with FV^{3}, ICON, and MPAS showing curves nearly on top of one
another at these resolutions. Other models show larger differences between
0.5 and 1 km curves, implying that these configurations may not yet be
converged in this bulk sense. Further grid refinement or modifications to the
dissipation schemes are necessary to achieve convergence; this is left to the
individual modeling groups to verify (see Sect. 3.4 for
an example).

The maximum updraft velocity as a function of resolution for particular model
configurations varies quite widely. NICAM produces the weakest supercell,
with velocities around 30 m s^{−1} at 0.5 km, while ACME-A, TEMPEST,
GEM, and CSU all produce supercells that surpass 55 m s^{−1} at some
point during the supercell evolution. Models that have weaker supercells at
0.5 km tend to also have weaker supercells at 4 km (e.g., NICAM), while the
same is true for stronger supercells (e.g., TEMPEST), likely due to
configuration sensitivity. This agrees with the already discussed structural
plots (Fig. 4) which demonstrated model solutions were
generally converging with resolution on an intramodel basis but not
necessarily across models.

Figure 6 shows the same analysis except for
area-integrated precipitation rate for each model and each resolution.
Similar results are noted as above – with most models showing large spread
at the coarsest resolutions but general convergence in precipitation by
0.5 km. All models produce the most precipitation at 120 min with the 4 km
simulation. This is consistent with Klemp et al. (2015), who postulated
this behavior is due to increased spatial extent of available *q*_{r} to
fall out of the column at these grid spacings, even though updraft velocities
are weaker at coarser resolutions. Unlike maximum vertical velocity, the
integrated precipitation rate does not monotonically increase with resolution
for most models. At 120 min, integrated rates at 0.5 km range by
approximately a factor of 3 or 4, from a low of 50–70 ×10^{5} kg s^{−1} (ACME-A, FVM, OLAM) to a high of 170–200 ×10^{5} kg s^{−1} (CSU, FV^{3}), highlighting the sensitivity of final
results that have been already been discussed.

In addition to Figs. 5 and 6, which directly correspond to analysis in Klemp et al. (2015), we also define a storm-integrated kinetic energy (IKE) metric as follows:

where *z*_{t} is the model top, *A*_{e} is the area of the sphere, and
winds (*u*^{′}, *v*^{′}, *w*^{′}) are calculated as perturbations from the initial
model state at the corresponding spatial location (e.g., ${u}^{\prime}={u}^{\prime}(t,\mathit{\varphi},\mathit{\psi},z)=u(t,\mathit{\varphi},\mathit{\psi},z)-u(\mathrm{0},\mathit{\varphi},\mathit{\psi},z)$). Here, local air
density, $\mathit{\rho}(t,\mathit{\varphi},\mathit{\psi},z)$, is computed using a standard atmosphere due
to limitations in available data from some groups.

As a metric, IKE is less sensitive to grid-scale velocities and is also a more holistic measure of storm-integrated intensity. This is shown in Fig. 7. Results are generally analogous to those in Fig. 6. This should be expected since total precipitation within a supercell is tied to the spatial extent and magnitude of the upward velocities that dominate the IKE term. Convergence behavior between 1 and 0.5 km appears similar for each model as noted earlier. The total spread across models at the end of the simulation for the 0.5 km simulations is also similar to that seen in Fig. 6, demonstrating the large range in “converged” solutions across models due to the various design choices discussed earlier.

## 3.4 Sample experiments at 0.25 km grid spacing

While the formal supercell test case definition during DCMIP2016 specified 0.5 km grid spacing as the finest resolution for groups to submit, it is clear that full convergence has not been reached for some of the modeling groups (e.g., Sect. 3.3). To confirm that the solution still converges further, two groups (FVM and TEMPEST) completed an exploratory set of simulations at 0.25 km resolution. Figure 8 shows the structural grid spacing convergence at 120 min for the two models from 2 to 0.25 km. Note that the left three panels for each model in Fig. 8 should match the corresponding three rightmost panels in Fig. 4. Figure 9 shows FVM and TEMPEST IKE results, including the 0.25 km simulations.

For TEMPEST and FVM, results indicate solution differences are markedly smaller between 0.5 and 0.25 km than between 1 and 0.5 km, implying the test is not fully converged at 0.5 km for these models. Therefore, 0.25 km may be a better target for a reference grid spacing going forward.

It is worth noting that the reference solution in Klemp et al. (2015) is indeed converged at 0.5 km, as are some of the models in DCMIP2016. Given this, it is unclear whether the need to go beyond DCMIP2016 protocols for “full” convergence is due to the test case definition itself or, rather, the implementation of the test case in particular models. This is left for subsequent analyses. However, given this result, it is recommended that groups applying this test case in the future continue to push beyond the four resolutions specified here if convergence is not readily apparent in either storm structure or bulk quantities at 0.5 km.

Non-hydrostatic dynamics are required for accurate representation of supercells. The results from this test case show that clear differences and uncertainties exist in storm evolution when comparing identically initialized dynamical cores at similar nominal grid resolutions. Intramodel convergence in bulk, integrated quantities appears to generally occur at approximately 0.5 km grid spacing. However, intermodel differences are quite large even at these resolutions. For example, maximum updraft velocity within a storm between two models may vary by almost a factor of 2 even at the highest resolutions assessed at DCMIP2016.

Structural convergence is weaker than bulk-integrated metrics. Two-dimensional horizontal cross-sections through the supercells at various times show that some models are well converged between 1 and 0.5 km, while results from other models imply that finer resolutions are needed to assess whether convergence will occur with a particular test case formulation and model configuration. Interestingly, in some cases, maximum bulk quantities converge faster than snapshots of cross-sections.

We postulate that these differences and uncertainties likely stem from not only the numerical discretization and grid differences outlined in Ullrich et al. (2017) but also from the form and implementation of filtering mechanisms (either implicit or explicit) specific to each modeling center. The simulation of supercells at these resolutions are particularly sensitive to numerical diffusion since damping of prognostic variables in global models is occurring at or near the scales required for resolvability of the storm. This is different from other DCMIP2016 tests (baroclinic wave and tropical cyclone), which produced dynamics that were less non-hydrostatic in nature and required resolvable scales much coarser than the grid cell level. Further, since DCMIP2016 did not formally specify a particular physics–dynamics coupling strategy, it would not be surprising for particular design choices regarding how the dynamical core is coupled to subgrid parameterizations to also impact results.

Given the lack of an analytic solution, we emphasize that the goal of this paper is not to define particular supercells as optimal answers. Rather, the main intention of this test at DCMIP2016 was to produce a verifiable database for models to use as an initial comparison point when evaluating non-hydrostatic numerics in dynamical cores. Pushing grid spacings to 0.25 km and beyond to formalize convergence would be a useful endeavor in future application of this test, either at the modeling center level or as part of future iterations of DCMIP. Variable-resolution or regionally refined dynamical cores may reduce the burden of such simulations, making them more palatable for researchers with limited computing resources.

We acknowledge that, as groups continue to develop non-hydrostatic modeling techniques, small changes in the treatment of diffusion in the dynamical core will likely lead to changes in their results from DCMIP2016. We recommend modeling centers developing or optimizing non-hydrostatic dynamical cores to perform this test and compare their solutions to the baselines contained in this paper as a check of sanity relative to a large and diverse group of next-generation dynamical cores actively being developed within the atmospheric modeling community.

Information on the availability of source code for the models featured in this paper can be found in Ullrich et al. (2017). For this particular test, the initialization routine, microphysics code, and sample plotting scripts are available at https://doi.org/10.5281/zenodo.1298671 (Ullrich et al., 2018).

CMZ prepared the text and corresponding figures in this paper. PAU assisted with formatting of the test case description in Sect. 2. Data and notations about model-specific configurations were provided by all co-authors representing their modeling groups.

The authors declare that they have no conflict of interest.

DCMIP2016 is sponsored by the National Center for Atmospheric Research
Computational Information Systems Laboratory, the Department of Energy Office
of Science (award no. DE-SC0016015), the National Science Foundation (award
no. 1629819), the National Aeronautics and Space Administration (award no.
NNX16AK51G), the National Oceanic and Atmospheric Administration Great Lakes
Environmental Research Laboratory (award no. NA12OAR4320071), the Office of
Naval Research and CU Boulder Research Computing. This work was made possible
with support from our student and postdoctoral participants:
Sabina Abba Omar, Scott Bachman, Amanda Back, Tobias Bauer,
Vinicius Capistrano, Spencer Clark, Ross Dixon, Christopher Eldred,
Robert Fajber, Jared Ferguson, Emily Foshee, Ariane Frassoni,
Alexander Goldstein, Jorge Guerra, Chasity Henson, Adam Herrington,
Tsung-Lin Hsieh, Dave Lee, Theodore Letcher, Weiwei Li, Laura Mazzaro,
Maximo Menchaca, Jonathan Meyer, Farshid Nazari, John O'Brien,
Bjarke Tobias Olsen, Hossein Parishani, Charles Pelletier, Thomas Rackow,
Kabir Rasouli, Cameron Rencurrel, Koichi Sakaguchi, Gökhan Sever,
James Shaw, Konrad Simon, Abhishekh Srivastava, Nicholas Szapiro,
Kazushi Takemura, Pushp Raj Tiwari, Chii-Yun Tsai, Richard Urata,
Karin van der Wiel, Lei Wang, Eric Wolf, Zheng Wu, Haiyang Yu, Sungduk Yu, and
Jiawei Zhuang. We would also like to thank Rich Loft, Cecilia Banner,
Kathryn Peczkowicz and Rory Kelly (NCAR), Carmen Ho, Perla Dinger, and
Gina Skyberg (UC Davis), and Kristi Hansen (University of Michigan) for
administrative support during the workshop and summer school. The National
Center for Atmospheric Research is sponsored by the National Science
Foundation. Sandia National Laboratories is a multimission laboratory managed
and operated by National Technology and Engineering Solutions of Sandia, LLC,
a wholly owned subsidiary of Honeywell International Inc., for the US
Department of Energy's National Nuclear Security Administration under
contract DE-NA0003525.

Edited by: Simone
Marras

Reviewed by: two anonymous referees

Browning, K. A.: Airflow and Precipitation Trajectories Within Severe Local Storms Which Travel to the Right of the Winds, J. Atmos. Sci., 21, 634–639, https://doi.org/10.1175/1520-0469(1964)021<0634:AAPTWS>2.0.CO;2, 1964. a

Doswell, C. A. and Burgess, D. W.: Tornadoes and toraadic storms: A review of conceptual models, The Tornado: Its Structure, Dynamics, Prediction, and Hazards, Geophysical Monograph Series, American Geophysical Union, 161–172, 1993. a

Gallus, W. A. and Bresch, J. F.: Comparison of Impacts of WRF Dynamic Core, Physics Package, and Initial Conditions on Warm Season Rainfall Forecasts, Mon. Weather Rev., 134, 2632–2641, https://doi.org/10.1175/MWR3198.1, 2006. a, b

Gross, M., Wan, H., Rasch, P. J., Caldwell, P. M., Williamson, D. L., Klocke, D., Jablonowski, C., Thatcher, D. R., Wood, N., Cullen, M., Beare, B., Willett, M., Lemarié, F., Blayo, E., Malardel, S., Termonia, P., Gassmann, A., Lauritzen, P. H., Johansen, H., Zarzycki, C. M., Sakaguchi, K., and Leung, R.: Physics–Dynamics Coupling in Weather, Climate, and Earth System Models: Challenges and Recent Progress, Mon. Weather Rev., 146, 3505–3544, https://doi.org/10.1175/mwr-d-17-0345.1, 2018. a

Guimond, S. R., Reisner, J. M., Marras, S., and Giraldo, F. X.: The Impacts of Dry Dynamic Cores on Asymmetric Hurricane Intensification, J. Atmos. Sci., 73, 4661–4684, https://doi.org/10.1175/JAS-D-16-0055.1, 2016. a, b

Jablonowski, C. and Williamson, D. L.: The pros and cons of diffusion, filters and fixers in atmospheric general circulation models, in: Numerical Techniques for Global Atmospheric Models, Springer, 381–493, 2011. a

Ji, M. and Toepfer, F.: Dynamical Core Evaluation Test Report for NOAA's Next Generation Global Prediction System (NGGPS), Tech. rep., National Oceanic and Atmospheric Administration, available at: https://repository.library.noaa.gov/view/noaa/18653 (last access: 25 February 2019), 2016. a

Kessler, E.: On the Distribution and Continuity of Water Substance in Atmospheric Circulations, American Meteorological Society, Boston, MA, 1–84, https://doi.org/10.1007/978-1-935704-36-2_1, 1969. a

Klemp, J. B. and Wilhelmson, R. B.: The simulation of three-dimensional convective storm dynamics, J. Atmos. Sci., 35, 1070–1096, 1978. a

Klemp, J. B., Skamarock, W. C., and Park, S.-H.: Idealized global nonhydrostatic atmospheric test cases on a reduced-radius sphere, J. Adv. Model. Earth Sy., 7, 1155–1177, https://doi.org/10.1002/2015MS000435, 2015. a, b, c, d, e, f, g, h, i, j

Kuang, Z., Blossey, P. N., and Bretherton, C. S.: A new approach for 3D cloud-resolving simulations of large-scale atmospheric circulation, Geophys. Res. Lett., 32, L02809, https://doi.org/10.1029/2004gl021024, 2005. a

Kühnlein, C., Deconinck, W., Klein, R., Malardel, S., Piotrowski, Z. P., Smolarkiewicz, P. K., Szmelter, J., and Wedi, N. P.: FVM 1.0: a nonhydrostatic finite-volume dynamical core for the IFS, Geosci. Model Dev., 12, 651–676, https://doi.org/10.5194/gmd-12-651-2019, 2019. a

Lemon, L. R. and Doswell, C. A.: Severe Thunderstorm Evolution and Mesocyclone Structure as Related to Tornadogenesis, Mon. Weather Rev., 107, 1184–1197, https://doi.org/10.1175/1520-0493(1979)107<1184:STEAMS>2.0.CO;2, 1979. a

Malardel, S.: Physics–dynamics coupling, in: Proceedings of ECMWF Workshop on Non-hydrostatic Modelling, European Centre for Medium-Range Weather Forecasts, vol. 6777, 2010. a

Potvin, C. K. and Flora, M. L.: Sensitivity of Idealized Supercell Simulations to Horizontal Grid Spacing: Implications for Warn-on-Forecast, Mon. Weather Rev., 143, 2998–3024, https://doi.org/10.1175/MWR-D-14-00416.1, 2015. a

Reed, K. A., Bacmeister, J. T., Rosenbloom, N. A., Wehner, M. F., Bates, S. C., Lauritzen, P. H., Truesdale, J. E., and Hannay, C.: Impact of the dynamical core on the direct simulation of tropical cyclones in a high-resolution global model, Geophys. Res. Lett., 42, 3603–3608, https://doi.org/10.1002/2015GL063974, 2015. a

Rotunno, R.: Supercell thunderstorm modeling and theory, The tornado: Its structure, dynamics, prediction, and hazards, in: Geophysical Monograph Series, edited by: Church, C., Burgess, D., Doswell, C., and Davies-Jone R., 57–73, https://doi.org/10.1029/GM079, 1993. a

Rotunno, R. and Klemp, J.: On the Rotation and Propagation of Simulated Supercell Thunderstorms, J. Atmos. Sci., 42, 271–292, https://doi.org/10.1175/1520-0469(1985)042<0271:OTRAPO>2.0.CO;2, 1985. a

Rotunno, R. and Klemp, J. B.: The Influence of the Shear-Induced Pressure Gradient on Thunderstorm Motion, Mon. Weather Rev., 110, 136–151, https://doi.org/10.1175/1520-0493(1982)110<0136:TIOTSI>2.0.CO;2, 1982. a

Schwartz, C. S., Romine, G. S., Fossell, K. R., Sobash, R. A., and Weisman, M. L.: Toward 1-km Ensemble Forecasts over Large Domains, Mon. Weather Rev., 145, 2943–2969, https://doi.org/10.1175/MWR-D-16-0410.1, 2017. a

Skamarock, W. C.: Evaluating Mesoscale NWP Models Using Kinetic Energy Spectra, Mon. Weather Rev., 132, 3019–3032, https://doi.org/10.1175/MWR2830.1, 2004. a, b

Smolarkiewicz, P. K., Kühnlein, C., and Grabowski, W. W.: A finite-volume module for cloud-resolving simulations of global atmospheric flows, J. Comput. Phys., 341, 208–229, https://doi.org/10.1016/j.jcp.2017.04.008, 2017. a

Staniforth, A., Wood, N., and Côté, J.: Analysis of the numerics of physics–dynamics coupling, Q. J. Roy. Meteor. Soc., 128, 2779–2799, https://doi.org/10.1256/qj.02.25, 2002. a

Thatcher, D. R. and Jablonowski, C.: A moist aquaplanet variant of the Held–Suarez test for atmospheric model dynamical cores, Geosci. Model Dev., 9, 1263–1292, https://doi.org/10.5194/gmd-9-1263-2016, 2016. a

Ullrich, P. A., Jablonowski, C., Kent, J., Lauritzen, P. H., Nair, R., Reed, K. A., Zarzycki, C. M., Hall, D. M., Dazlich, D., Heikes, R., Konor, C., Randall, D., Dubos, T., Meurdesoif, Y., Chen, X., Harris, L., Kühnlein, C., Lee, V., Qaddouri, A., Girard, C., Giorgetta, M., Reinert, D., Klemp, J., Park, S.-H., Skamarock, W., Miura, H., Ohno, T., Yoshida, R., Walko, R., Reinecke, A., and Viner, K.: DCMIP2016: a review of non-hydrostatic dynamical core design and intercomparison of participating models, Geosci. Model Dev., 10, 4477–4509, https://doi.org/10.5194/gmd-10-4477-2017, 2017. a, b, c, d, e

Ullrich, P., Lauritzen, P. H., Reed, K., Jablonowski, C., Zarzycki, C., Kent, J., Nair, R., and Verlet-Banide, A.: ClimateGlobalChange/DCMIP2016: v1.0 (Version v1.0), Zenodo, https://doi.org/10.5281/zenodo.1298671 (last access: 25 February 2019), 2018. a, b, c

Wedi, N. P. and Smolarkiewicz, P. K.: A framework for testing global non-hydrostatic models, Q. J. Roy. Meteor. Soc., 135, 469–484, https://doi.org/10.1002/qj.377, 2009. a

Weisman, M. L. and Klemp, J. B.: The Dependence of Numerically Simulated Convective Storms on Vertical Wind Shear and Buoyancy, Mon. Weather Rev., 110, 504–520, https://doi.org/10.1175/1520-0493(1982)110<0504:TDONSC>2.0.CO;2, 1982. a

Zhao, M., Held, I. M., and Lin, S.-J.: Some Counterintuitive Dependencies of Tropical Cyclone Frequency on Parameters in a GCM, J. Atmos. Sci., 69, 2272–2283, https://doi.org/10.1175/JAS-D-11-0238.1, 2012. a