This work presents a first version of the ICON atmosphere model that works not only on CPUs, but also on GPUs. This GPU-enabled ICON version is benchmarked on two GPU machines and a CPU machine. While the weak scaling is very good on CPUs and GPUs, the strong scaling is poor on GPUs. But the high performance of GPU machines allowed for first simulations of a short period of the quasi-biennial oscillation at very high resolution with explicit convection and gravity wave forcing.