<p>A standardized methodology for the validation of short-term air quality forecast applications was developed in the framework of FAIRMODE activities. The proposed approach, focusing on specific features to be checked when evaluating a forecasting application, investigates the model capability to detect sudden changes of pollutants concentrations levels, to predict threshold exceedances and to reproduce air quality indices. The proposed formulation relies on the definition of specific forecast Modelling Quality Objective and Performance Criteria, defining the minimum level of quality to be achieved by a forecasting application when it is used for policy purposes. The persistence model, which uses the most recent observed value as predicted value, is used as benchmark for the forecast evaluation. The validation protocol has been applied to several forecasting applications across Europe, using different modelling paradigms and covering a range of geographical contexts and spatial scales. The method is successful, with room for improvement, in highlighting shortcomings and strengths of forecasting applications. This provides a useful basis for using short-term air quality forecast as a supporting tool for correct information to citizens and regulators.</p>