We discuss the question of whether weather forecast models that are based on deep learning and trained on atmospheric data can compete with conventional weather and climate models that are based on physical principles and the basic equations of motion. We discuss the question in the context of global weather forecasts. A toy model for global weather predictions will be presented and used to identify challenges and fundamental design choices for a forecast system based on neural networks.