Articles | Volume 16, issue 20
https://doi.org/10.5194/gmd-16-6029-2023
https://doi.org/10.5194/gmd-16-6029-2023
Methods for assessment of models
 | 
27 Oct 2023
Methods for assessment of models |  | 27 Oct 2023

A standardized methodology for the validation of air quality forecast applications (F-MQO): lessons learnt from its application across Europe

Lina Vitali, Kees Cuvelier, Antonio Piersanti, Alexandra Monteiro, Mario Adani, Roberta Amorati, Agnieszka Bartocha, Alessandro D'Ausilio, Paweł Durka, Carla Gama, Giulia Giovannini, Stijn Janssen, Tomasz Przybyła, Michele Stortini, Stijn Vranckx, and Philippe Thunis

Related authors

Copernicus Atmosphere Monitoring Service – Regional Air Quality Production System v1.0
Augustin Colette, Gaëlle Collin, François Besson, Etienne Blot, Vincent Guidard, Frederik Meleux, Adrien Royer, Valentin Petiot, Claire Miller, Oihana Fermond, Alizé Jeant, Mario Adani, Joaquim Arteta, Anna Benedictow, Robert Bergström, Dene Bowdalo, Jorgen Brandt, Gino Briganti, Ana C. Carvalho, Jesper Heile Christensen, Florian Couvidat, Ilia D’Elia, Massimo D’Isidoro, Hugo Denier van der Gon, Gaël Descombes, Enza Di Tomaso, John Douros, Jeronimo Escribano, Henk Eskes, Hilde Fagerli, Yalda Fatahi, Johannes Flemming, Elmar Friese, Lise Frohn, Michael Gauss, Camilla Geels, Guido Guarnieri, Marc Guevara, Antoine Guion, Jonathan Guth, Risto Hänninen, Kaj Hansen, Ulas Im, Ruud Janssen, Marine Jeoffrion, Mathieu Joly, Luke Jones, Oriol Jorba, Evgeni Kadantsev, Michael Kahnert, Jacek W. Kaminski, Rostislav Kouznetsov, Richard Kranenburg, Jeroen Kuenen, Anne Caroline Lange, Joachim Langner, Victor Lannuque, Francesca Macchia, Astrid Manders, Mihaela Mircea, Agnes Nyiri, Miriam Olid, Carlos Pérez García-Pando, Yuliia Palamarchuk, Antonio Piersanti, Blandine Raux, Miha Razinger, Lennard Robertson, Arjo Segers, Martijn Schaap, Pilvi Siljamo, David Simpson, Mikhail Sofiev, Anders Stangel, Joanna Struzewska, Carles Tena, Renske Timmermans, Thanos Tsikerdekis, Svetlana Tsyro, Svyatoslav Tyuryakov, Anthony Ung, Andreas Uppstu, Alvaro Valdebenito, Peter van Velthoven, Lina Vitali, Zhuyun Ye, Vincent-Henri Peuch, and Laurence Rouïl
EGUsphere, https://doi.org/10.5194/egusphere-2024-3744,https://doi.org/10.5194/egusphere-2024-3744, 2024
Short summary
Measured and modelled air quality trends in Italy over the period 2003–2010
Ilaria D'Elia, Gino Briganti, Lina Vitali, Antonio Piersanti, Gaia Righini, Massimo D'Isidoro, Andrea Cappelletti, Mihaela Mircea, Mario Adani, Gabriele Zanini, and Luisella Ciancarella
Atmos. Chem. Phys., 21, 10825–10849, https://doi.org/10.5194/acp-21-10825-2021,https://doi.org/10.5194/acp-21-10825-2021, 2021
Short summary
Evaluation of air quality forecasting system FORAIR_IT over Europe and Italy at high resolution for year 2017
Mario Adani, Guido Guarnieri, Lina Vitali, Luisella Ciancarella, Ilaria D'Elia, Mihaela Mircea, Maurizio Gualtieri, Andrea Cappelletti, Massimo D'Isidoro, Gino Briganti, Antonio Piersanti, Milena Stracquadanio, Gaia Righini, Felicita Russo, Giuseppe Cremona, Maria Gabriella Villani, and Gabriele Zanini
Geosci. Model Dev. Discuss., https://doi.org/10.5194/gmd-2020-54,https://doi.org/10.5194/gmd-2020-54, 2020
Publication in GMD not foreseen
Short summary

Related subject area

Atmospheric sciences
Knowledge-inspired fusion strategies for the inference of PM2.5 values with a neural network
Matthieu Dabrowski, José Mennesson, Jérôme Riedi, Chaabane Djeraba, and Pierre Nabat
Geosci. Model Dev., 18, 3707–3733, https://doi.org/10.5194/gmd-18-3707-2025,https://doi.org/10.5194/gmd-18-3707-2025, 2025
Short summary
Tuning the ICON-A 2.6.4 climate model with machine-learning-based emulators and history matching
Pauline Bonnet, Lorenzo Pastori, Mierk Schwabe, Marco Giorgetta, Fernando Iglesias-Suarez, and Veronika Eyring
Geosci. Model Dev., 18, 3681–3706, https://doi.org/10.5194/gmd-18-3681-2025,https://doi.org/10.5194/gmd-18-3681-2025, 2025
Short summary
A novel method for quantifying the contribution of regional transport to PM2.5 in Beijing (2013–2020): combining machine learning with concentration-weighted trajectory analysis
Kang Hu, Hong Liao, Dantong Liu, Jianbing Jin, Lei Chen, Siyuan Li, Yangzhou Wu, Changhao Wu, Shitong Zhao, Xiaotong Jiang, Ping Tian, Kai Bi, Ye Wang, and Delong Zhao
Geosci. Model Dev., 18, 3623–3634, https://doi.org/10.5194/gmd-18-3623-2025,https://doi.org/10.5194/gmd-18-3623-2025, 2025
Short summary
Quantification of CO2 hotspot emissions from OCO-3 SAM CO2 satellite images using deep learning methods
Joffrey Dumont Le Brazidec, Pierre Vanderbecken, Alban Farchi, Grégoire Broquet, Gerrit Kuhlmann, and Marc Bocquet
Geosci. Model Dev., 18, 3607–3622, https://doi.org/10.5194/gmd-18-3607-2025,https://doi.org/10.5194/gmd-18-3607-2025, 2025
Short summary
Diagnosis of winter precipitation types using the spectral bin model (version 1DSBM-19M): comparison of five methods using ICE-POP 2018 field experiment data
Wonbae Bang, Jacob T. Carlin, Kwonil Kim, Alexander V. Ryzhkov, Guosheng Liu, and GyuWon Lee
Geosci. Model Dev., 18, 3559–3581, https://doi.org/10.5194/gmd-18-3559-2025,https://doi.org/10.5194/gmd-18-3559-2025, 2025
Short summary

Cited articles

Adani, M., Piersanti, A., Ciancarella, L., D'Isidoro, M., Villani, M. G., and Vitali, L.: Preliminary Tests on the Sensitivity of the FORAIR_IT Air Quality Forecasting System to Different Meteorological Drivers, Atmosphere, 11, 574, https://doi.org/10.3390/atmos11060574, 2020. 
Adani, M., D'Isidoro, M., Mircea, M., Guarnieri, G., Vitali, L., D'Elia, I., Ciancarella, L., Gualtieri, M., Briganti, G., Cappelletti, A., Piersanti, A., Stracquadanio, M., Righini, G., Russo, F., Cremona, G., Villani, M. G., and Zanini, G.: Evaluation of air quality forecasting system FORAIR-IT over Europe and Italy at high resolution for year 2017, Atmos. Pollut. Res., 13, 101456, https://doi.org/10.1016/j.apr.2022.101456, 2022. 
Agarwal, S., Sharma, S., R., S., Rahman, M. H., Vranckx, S., Maiheu, B., Blyth, L., Janssen, S., Gargava, P., Shukla, V. K., and Batra, S.: Air quality forecasting using artificial neural networks with real time dynamic error correction in highly polluted regions, Sci. Total Environ., 735, 139454, https://doi.org/10.1016/j.scitotenv.2020.139454, 2020. 
Alfaro, S. C. and Gomes, L.: Modeling mineral aerosol production by wind erosion: Emission intensities and aerosol size distributions in source areas, J. Geophys. Res.-Atmos., 106, 18075–18084, https://doi.org/10.1029/2000JD900339, 2001. 
Bai, L., Wang, J., Ma, X., and Lu, H.: Air Pollution Forecasts: An Overview, Int. J. Environ. Res. Publ. He., 15, 780, https://doi.org/10.3390/ijerph15040780, 2018. 
Download
Short summary
Air quality forecasting models play a key role in fostering short-term measures aimed at reducing human exposure to air pollution. Together with this role comes the need for a thorough assessment of the model performances to build confidence in models’ capabilities, in particular when model applications support policymaking. In this paper, we propose an evaluation methodology and test it on several domains across Europe, highlighting its strengths and room for improvement.
Share