Articles | Volume 18, issue 13
https://doi.org/10.5194/gmd-18-4231-2025
© Author(s) 2025. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
https://doi.org/10.5194/gmd-18-4231-2025
© Author(s) 2025. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
Methods for assessment of models
| 
15 Jul 2025
Methods for assessment of models |
| 15 Jul 2025
| 15 Jul 2025
A new set of indicators for model evaluation complementing FAIRMODE's modelling quality objective (MQO)
Alexander de Meij
MetClim, 21025 Varese, Italy
Cornelis Cuvelier
European Commission, Joint Research Centre (JRC), 21027 Ispra, Italy
retired with Active Senior Agreement
Philippe Thunis
CORRESPONDING AUTHOR
European Commission, Joint Research Centre (JRC), 21027 Ispra, Italy
Enrico Pisoni
European Commission, Joint Research Centre (JRC), 21027 Ispra, Italy
Related authors
Philippe Thunis, Jeroen Kuenen, Enrico Pisoni, Bertrand Bessagnet, Manjola Banja, Lech Gawuc, Karol Szymankiewicz, Diego Guizardi, Monica Crippa, Susana Lopez-Aparicio, Marc Guevara, Alexander De Meij, Sabine Schindlbacher, and Alain Clappier
Geosci. Model Dev., 17, 3631–3643, https://doi.org/10.5194/gmd-17-3631-2024, https://doi.org/10.5194/gmd-17-3631-2024, 2024
Short summary
Short summary
An ensemble emission inventory is created with the aim of monitoring the status and progress made with the development of EU-wide inventories. This emission ensemble serves as a common benchmark for the screening and allows for the comparison of more than two inventories at a time. Because the emission “truth” is unknown, the approach does not tell which inventory is the closest to reality, but it identifies inconsistencies that require special attention.
Alexander de Meij, Cornelis Cuvelier, Philippe Thunis, Enrico Pisoni, and Bertrand Bessagnet
Geosci. Model Dev., 17, 587–606, https://doi.org/10.5194/gmd-17-587-2024, https://doi.org/10.5194/gmd-17-587-2024, 2024
Short summary
Short summary
In our study the robustness of the model responses to emission reductions in the EU is assessed when the emission data are changed. Our findings are particularly important to better understand the uncertainties associated to the emission inventories and how these uncertainties impact the level of accuracy of the resulting air quality modelling, which is a key for designing air quality plans. Also crucial is the choice of indicator to avoid misleading interpretations of the results.
Philippe Thunis, Alain Clappier, Alexander de Meij, Enrico Pisoni, Bertrand Bessagnet, and Leonor Tarrason
Atmos. Chem. Phys., 21, 18195–18212, https://doi.org/10.5194/acp-21-18195-2021, https://doi.org/10.5194/acp-21-18195-2021, 2021
Short summary
Short summary
Air pollution's origin in cities is still a point of discussion, and approaches to assess the city's responsibility for its pollution are not harmonized and thus not comparable, resulting in sometimes contradicting interpretations. We show that methodological choices can easily lead to differences of a factor of 2 in terms of responsibility outcome and stress that methodological choices and assumptions most often lead to a systematic and important underestimation of the city's responsibility.
Philippe Thunis, Alain Clappier, Matthias Beekmann, Jean Philippe Putaud, Cornelis Cuvelier, Jessie Madrazo, and Alexander de Meij
Atmos. Chem. Phys., 21, 9309–9327, https://doi.org/10.5194/acp-21-9309-2021, https://doi.org/10.5194/acp-21-9309-2021, 2021
Short summary
Short summary
Modelling simulations are used to identify the most efficient emission reduction strategies to reduce PM2.5 concentration levels in northern Italy. Results show contrasting chemical regimes and important non-linearities during wintertime, with the striking result that PM2.5 levels may increase when NOx reductions are applied in NOx-rich areas – a process that may have contributed to the absence of significant PM2.5 decrease during the COVID-19 lockdowns in many European cities.
Manjola Banja, Monica Crippa, Diego Guizzardi, Marilena Muntean, Federico Pagani, and Enrico Pisoni
Earth Syst. Sci. Data Discuss., https://doi.org/10.5194/essd-2025-385, https://doi.org/10.5194/essd-2025-385, 2025
Preprint under review for ESSD
Short summary
Short summary
Global efforts to decrease emissions rely on inventories that differ widely in scope and methodology. Alongside national inventories, independent databases provide yearly globally consistent emission inventories. Comparing independent inventories with countries submissions provides clear and consistent track of the real progress. Improvement of emissions inventories, reporting timelines, and statistical systems are essential to ensure reliable and comparable data.
Diego Guizzardi, Monica Crippa, Tim Butler, Terry Keating, Rosa Wu, Jacek W. Kamiński, Jeroen Kuenen, Junichi Kurokawa, Satoru Chatani, Tazuko Morikawa, George Pouliot, Jacinthe Racine, Michael D. Moran, Zbigniew Klimont, Patrick M. Manseau, Rabab Mashayekhi, Barron H. Henderson, Steven J. Smith, Rachel Hoesly, Marilena Muntean, Manjola Banja, Edwin Schaaf, Federico Pagani, Jung-Hun Woo, Jinseok Kim, Enrico Pisoni, Junhua Zhang, David Niemi, Mourad Sassi, Annie Duhamel, Tabish Ansari, Kristen Foley, Guannan Geng, Yifei Chen, and Qiang Zhang
Earth Syst. Sci. Data Discuss., https://doi.org/10.5194/essd-2024-601, https://doi.org/10.5194/essd-2024-601, 2025
Preprint under review for ESSD
Short summary
Short summary
The global air pollution emission mosaic HTAP_v3.1 is the state-of-the-art database for addressing the evolution of a set of policy-relevant air pollutants over the past 2 decades. The inventory is made by the harmonization and blending of seven regional inventories, gapfilled using the most recent release of EDGAR (EDGARv8). By incorporating the best available local information, the HTAP_v3.1 mosaic inventory can be used for policy-relevant studies at both regional and global levels.
Monica Crippa, Diego Guizzardi, Federico Pagani, Marcello Schiavina, Michele Melchiorri, Enrico Pisoni, Francesco Graziosi, Marilena Muntean, Joachim Maes, Lewis Dijkstra, Martin Van Damme, Lieven Clarisse, and Pierre Coheur
Earth Syst. Sci. Data, 16, 2811–2830, https://doi.org/10.5194/essd-16-2811-2024, https://doi.org/10.5194/essd-16-2811-2024, 2024
Short summary
Short summary
Knowing where emissions occur is essential for planning effective emission reduction measures and atmospheric modelling. Disaggregating national emissions over high-resolution grids requires spatial proxies that contain information on the location of different emission sources. This work incorporates state-of-the-art spatial information to improve the spatial representation of global emissions with the Emissions Database for Global Atmospheric Research (EDGAR).
Philippe Thunis, Jeroen Kuenen, Enrico Pisoni, Bertrand Bessagnet, Manjola Banja, Lech Gawuc, Karol Szymankiewicz, Diego Guizardi, Monica Crippa, Susana Lopez-Aparicio, Marc Guevara, Alexander De Meij, Sabine Schindlbacher, and Alain Clappier
Geosci. Model Dev., 17, 3631–3643, https://doi.org/10.5194/gmd-17-3631-2024, https://doi.org/10.5194/gmd-17-3631-2024, 2024
Short summary
Short summary
An ensemble emission inventory is created with the aim of monitoring the status and progress made with the development of EU-wide inventories. This emission ensemble serves as a common benchmark for the screening and allows for the comparison of more than two inventories at a time. Because the emission “truth” is unknown, the approach does not tell which inventory is the closest to reality, but it identifies inconsistencies that require special attention.
Alexander de Meij, Cornelis Cuvelier, Philippe Thunis, Enrico Pisoni, and Bertrand Bessagnet
Geosci. Model Dev., 17, 587–606, https://doi.org/10.5194/gmd-17-587-2024, https://doi.org/10.5194/gmd-17-587-2024, 2024
Short summary
Short summary
In our study the robustness of the model responses to emission reductions in the EU is assessed when the emission data are changed. Our findings are particularly important to better understand the uncertainties associated to the emission inventories and how these uncertainties impact the level of accuracy of the resulting air quality modelling, which is a key for designing air quality plans. Also crucial is the choice of indicator to avoid misleading interpretations of the results.
Lina Vitali, Kees Cuvelier, Antonio Piersanti, Alexandra Monteiro, Mario Adani, Roberta Amorati, Agnieszka Bartocha, Alessandro D'Ausilio, Paweł Durka, Carla Gama, Giulia Giovannini, Stijn Janssen, Tomasz Przybyła, Michele Stortini, Stijn Vranckx, and Philippe Thunis
Geosci. Model Dev., 16, 6029–6047, https://doi.org/10.5194/gmd-16-6029-2023, https://doi.org/10.5194/gmd-16-6029-2023, 2023
Short summary
Short summary
Air quality forecasting models play a key role in fostering short-term measures aimed at reducing human exposure to air pollution. Together with this role comes the need for a thorough assessment of the model performances to build confidence in models’ capabilities, in particular when model applications support policymaking. In this paper, we propose an evaluation methodology and test it on several domains across Europe, highlighting its strengths and room for improvement.
Jean-Philippe Putaud, Enrico Pisoni, Alexander Mangold, Christoph Hueglin, Jean Sciare, Michael Pikridas, Chrysanthos Savvides, Jakub Ondracek, Saliou Mbengue, Alfred Wiedensohler, Kay Weinhold, Maik Merkel, Laurent Poulain, Dominik van Pinxteren, Hartmut Herrmann, Andreas Massling, Claus Nordstroem, Andrés Alastuey, Cristina Reche, Noemí Pérez, Sonia Castillo, Mar Sorribas, Jose Antonio Adame, Tuukka Petaja, Katrianne Lehtipalo, Jarkko Niemi, Véronique Riffault, Joel F. de Brito, Augustin Colette, Olivier Favez, Jean-Eudes Petit, Valérie Gros, Maria I. Gini, Stergios Vratolis, Konstantinos Eleftheriadis, Evangelia Diapouli, Hugo Denier van der Gon, Karl Espen Yttri, and Wenche Aas
Atmos. Chem. Phys., 23, 10145–10161, https://doi.org/10.5194/acp-23-10145-2023, https://doi.org/10.5194/acp-23-10145-2023, 2023
Short summary
Short summary
Many European people are still exposed to levels of air pollution that can affect their health. COVID-19 lockdowns in 2020 were used to assess the impact of the reduction in human mobility on air pollution across Europe by comparing measurement data with values that would be expected if no lockdown had occurred. We show that lockdown measures did not lead to consistent decreases in the concentrations of fine particulate matter suspended in the air, and we investigate why.
Monica Crippa, Diego Guizzardi, Tim Butler, Terry Keating, Rosa Wu, Jacek Kaminski, Jeroen Kuenen, Junichi Kurokawa, Satoru Chatani, Tazuko Morikawa, George Pouliot, Jacinthe Racine, Michael D. Moran, Zbigniew Klimont, Patrick M. Manseau, Rabab Mashayekhi, Barron H. Henderson, Steven J. Smith, Harrison Suchyta, Marilena Muntean, Efisio Solazzo, Manjola Banja, Edwin Schaaf, Federico Pagani, Jung-Hun Woo, Jinseok Kim, Fabio Monforti-Ferrario, Enrico Pisoni, Junhua Zhang, David Niemi, Mourad Sassi, Tabish Ansari, and Kristen Foley
Earth Syst. Sci. Data, 15, 2667–2694, https://doi.org/10.5194/essd-15-2667-2023, https://doi.org/10.5194/essd-15-2667-2023, 2023
Short summary
Short summary
This study responds to the global and regional atmospheric modelling community's need for a mosaic of air pollutant emissions with global coverage, long time series, spatially distributed data at a high time resolution, and a high sectoral resolution in order to enhance the understanding of transboundary air pollution. The mosaic approach to integrating official regional emission inventories with a global inventory based on a consistent methodology ensures policy-relevant results.
Philippe Thunis, Alain Clappier, Enrico Pisoni, Bertrand Bessagnet, Jeroen Kuenen, Marc Guevara, and Susana Lopez-Aparicio
Geosci. Model Dev., 15, 5271–5286, https://doi.org/10.5194/gmd-15-5271-2022, https://doi.org/10.5194/gmd-15-5271-2022, 2022
Short summary
Short summary
In this work, we propose a screening method to improve the quality of emission inventories, which are responsible for large uncertainties in air-quality modeling. The first step of screening consists of keeping only emission contributions that are relevant enough. In a second step, the method identifies large differences that provide evidence of methodological divergence or errors. We used the approach to compare two versions of the CAMS-REG European-scale inventory over 150 European cities.
Svetlana Tsyro, Wenche Aas, Augustin Colette, Camilla Andersson, Bertrand Bessagnet, Giancarlo Ciarelli, Florian Couvidat, Kees Cuvelier, Astrid Manders, Kathleen Mar, Mihaela Mircea, Noelia Otero, Maria-Teresa Pay, Valentin Raffort, Yelva Roustan, Mark R. Theobald, Marta G. Vivanco, Hilde Fagerli, Peter Wind, Gino Briganti, Andrea Cappelletti, Massimo D'Isidoro, and Mario Adani
Atmos. Chem. Phys., 22, 7207–7257, https://doi.org/10.5194/acp-22-7207-2022, https://doi.org/10.5194/acp-22-7207-2022, 2022
Short summary
Short summary
Particulate matter (PM) air pollution causes adverse health effects. In Europe, the emissions caused by anthropogenic activities have been reduced in the last decades. To assess the efficiency of emission reductions in improving air quality, we have studied the evolution of PM pollution in Europe. Simulations with six air quality models and observational data indicate a decrease in PM concentrations by 10 % to 30 % across Europe from 2000 to 2010, which is mainly a result of emission reductions.
Philippe Thunis, Alain Clappier, Alexander de Meij, Enrico Pisoni, Bertrand Bessagnet, and Leonor Tarrason
Atmos. Chem. Phys., 21, 18195–18212, https://doi.org/10.5194/acp-21-18195-2021, https://doi.org/10.5194/acp-21-18195-2021, 2021
Short summary
Short summary
Air pollution's origin in cities is still a point of discussion, and approaches to assess the city's responsibility for its pollution are not harmonized and thus not comparable, resulting in sometimes contradicting interpretations. We show that methodological choices can easily lead to differences of a factor of 2 in terms of responsibility outcome and stress that methodological choices and assumptions most often lead to a systematic and important underestimation of the city's responsibility.
Philippe Thunis, Alain Clappier, Matthias Beekmann, Jean Philippe Putaud, Cornelis Cuvelier, Jessie Madrazo, and Alexander de Meij
Atmos. Chem. Phys., 21, 9309–9327, https://doi.org/10.5194/acp-21-9309-2021, https://doi.org/10.5194/acp-21-9309-2021, 2021
Short summary
Short summary
Modelling simulations are used to identify the most efficient emission reduction strategies to reduce PM2.5 concentration levels in northern Italy. Results show contrasting chemical regimes and important non-linearities during wintertime, with the striking result that PM2.5 levels may increase when NOx reductions are applied in NOx-rich areas – a process that may have contributed to the absence of significant PM2.5 decrease during the COVID-19 lockdowns in many European cities.
Jean-Philippe Putaud, Luca Pozzoli, Enrico Pisoni, Sebastiao Martins Dos Santos, Friedrich Lagler, Guido Lanzani, Umberto Dal Santo, and Augustin Colette
Atmos. Chem. Phys., 21, 7597–7609, https://doi.org/10.5194/acp-21-7597-2021, https://doi.org/10.5194/acp-21-7597-2021, 2021
Short summary
Short summary
To determine the impact of the COVID lockdown on air quality in northern Italy, measurements of atmospheric pollutants (NO2, PM10, O3, NO, SO2 ) were compared to the output of a model ignoring the lockdown. We found that NO2 decreased on average by −30 % to −40 %. Unlike NO2, PM10 was not significantly affected due to the compensation of decreased emissions from traffic by increased emissions from domestic heating and/or by changes in atmospheric chemistry enhancing secondary aerosol formation.
Bart Degraeuwe, Enrico Pisoni, and Philippe Thunis
Geosci. Model Dev., 13, 5725–5736, https://doi.org/10.5194/gmd-13-5725-2020, https://doi.org/10.5194/gmd-13-5725-2020, 2020
Short summary
Short summary
To make decisions on how to improve air quality, it is useful to identify the main sources of pollution for an area of interest. Often these sources of pollution are identified with complex models that, even if accurate, are time consuming and complex. In this work we use another approach, simplified models, to accomplish the same task. The results, computed with two different set of simplified models, show the main sources of pollution for selected cities, and the associated uncertainties.
Cited articles
Ambient Air Quality Directive: Directive (EU) 2024/2881 of the European Parliament and of the Council of 23 October 2024 on ambient air quality and cleaner air for Europe (recast), https://eur-lex.europa.eu/eli/dir/2024/2881/oj (last access: 11 July 2025), 2024.
Boylan, J. W. and Russell, A. G.: PM and light extinction model performance metrics, goals, and criteria for three-dimensional air quality models, Atmos. Environ., 40, 4946–4959, https://doi.org/10.1016/j.atmosenv.2005.09.087, 2006.
Clappier, A., Thunis, P., Beekmann, M., Putaud, J. P., and De Meij, A.: Impact of SOx, NOx and NH3 emission reductions on PM2.5 concentrations across Europe: Hints for future measure development, Environ. Int., 156, 106699, https://doi.org/10.1016/j.envint.2021.106699, 2021.
Colette, A., Andersson, C., Manders, A., Mar, K., Mircea, M., Pay, M.-T., Raffort, V., Tsyro, S., Cuvelier, C., Adani, M., Bessagnet, B., Bergström, R., Briganti, G., Butler, T., Cappelletti, A., Couvidat, F., D'Isidoro, M., Doumbia, T., Fagerli, H., Granier, C., Heyes, C., Klimont, Z., Ojha, N., Otero, N., Schaap, M., Sindelarova, K., Stegehuis, A. I., Roustan, Y., Vautard, R., van Meijgaard, E., Vivanco, M. G., and Wind, P.: EURODELTA-Trends, a multi-model experiment of air quality hindcast in Europe over 1990–2010, Geosci. Model Dev., 10, 3255–3276, https://doi.org/10.5194/gmd-10-3255-2017, 2017.
CAMS – Copernicus Atmospheric Monitoring Service: Regional Production, Updated documentation covering all Regional operational systems and the ENSEMBLE, Following U3 upgrade, November 2020, https://confluence.ecmwf.int/display/CKB/CAMS+Regional:+European+air+quality+reanalyses+data+documentation (last access: 10 July 2025), 2020.
Copernicus Atmosphere Monitoring Service (CAMS): CAMS European air quality reanalyses, Copernicus Atmosphere Monitoring Service (CAMS) Atmosphere Data Store [data set], https://doi.org/10.24381/7cc0465a, 2021.
Cuvelier, C., Thunis, P., Pisoni, E., and De Meij, A.,: Source code and data to: “A new set of indicators for model evaluation complementing to FAIRMODE's MQO”, Zenodo [code and data set], https://doi.org/10.5281/zenodo.14870503, 2025.
De Meij, A., Wagner, S., Gobron, N., Thunis, P., Cuvelier, C., Dentener, F., and Schaap, M.: Model evaluation and scale issues in chemical and optical aerosol properties over the greater Milan area (Italy), for June 2001, Atmos. Res., 85, 243–267, 2007.
De Meij, A., Gzella, A., Cuvelier, C., Thunis, P., Bessagnet, B., Vinuesa, J. F., Menut, L., and Kelder, H. M.: The impact of MM5 and WRF meteorology over complex terrain on CHIMERE model calculations, Atmos. Chem. Phys., 9, 6611–6632, https://doi.org/10.5194/acp-9-6611-2009, 2009.
De Meij, A., Cuvelier, C., Thunis, P., Pisoni, E., and Bessagnet, B.: Sensitivity of air quality model responses to emission changes: comparison of results based on four EU inventories through FAIRMODE benchmarking methodology, Geosci. Model Dev., 17, 587–606, https://doi.org/10.5194/gmd-17-587-2024, 2024.
Emery, C., Liu, Z., Russell, A. G., Odman, M. T., Yarwood, G., and Kumar, N.: Recommendations on statistics and benchmarks to assess photochemical model performance, JAPCA J. Air. Waste Manage., 67, 582–598, https://doi.org/10.1080/10962247.2016.1265027, 2017.
EPA: Guideline for regulatory application of the Urban Airshed Model (No. PB-92-108760/XAB), Environmental Protection Agency, Research Triangle Park, NC, USA, 1991.
Gilliam, R. C., Hogrefe, C., Godowitch, J. M., Napelenok, S., Mathur, R., and Rao, S. T.: Impact of Inherent Meteorology Uncertainty on Air Quality Model Predictions, J. Geophys. Res.-Atmos., 120, 12259–12280, 2015.
Huang, L., Zhu, Y., Zhai, H., Xue, S., Zhu, T., Shao, Y., Liu, Z., Emery, C., Yarwood, G., Wang, Y., Fu, J., Zhang, K., and Li, L.: Recommendations on benchmarks for numerical air quality model applications in China – Part 1: PM2.5 and chemical species, Atmos. Chem. Phys., 21, 2725–2743, https://doi.org/10.5194/acp-21-2725-2021, 2021.
Janssen, S. and Thunis, P.: FAIRMODE Guidance Document on Modelling Quality Objectives and Benchmarking (version 3.3), EUR 31068 EN, Publications Office of the European Union, Luxembourg, ISBN 978-92-76-52425-0, https://doi.org/10.2760/41988, 2022.
Kushta, J., Georgiou, G. K., Proestos, Y., Christoudias, T., Thunis, P., Savvides, C., Papadopoulos, C., and Lelieveld, J.: Evaluation of EU air quality standards through modeling and the FAIRMODE benchmarking methodology, Air Qual. Atmos. Health, 12, 73–86, https://doi.org/10.1007/s11869-018-0631-z, 2019.
Marécal, V., Peuch, V.-H., Andersson, C., Andersson, S., Arteta, J., Beekmann, M., Benedictow, A., Bergström, R., Bessagnet, B., Cansado, A., Chéroux, F., Colette, A., Coman, A., Curier, R. L., Denier van der Gon, H. A. C., Drouin, A., Elbern, H., Emili, E., Engelen, R. J., Eskes, H. J., Foret, G., Friese, E., Gauss, M., Giannaros, C., Guth, J., Joly, M., Jaumouillé, E., Josse, B., Kadygrov, N., Kaiser, J. W., Krajsek, K., Kuenen, J., Kumar, U., Liora, N., Lopez, E., Malherbe, L., Martinez, I., Melas, D., Meleux, F., Menut, L., Moinat, P., Morales, T., Parmentier, J., Piacentini, A., Plu, M., Poupkou, A., Queguiner, S., Robertson, L., Rouïl, L., Schaap, M., Segers, A., Sofiev, M., Tarasson, L., Thomas, M., Timmermans, R., Valdebenito, Á., van Velthoven, P., van Versendaal, R., Vira, J., and Ung, A.: A regional air quality forecasting system over Europe: the MACC-II daily ensemble production, Geosci. Model Dev., 8, 2777–2813, https://doi.org/10.5194/gmd-8-2777-2015, 2015.
NV5 Geospatial Solutions Inc.: IDL® 8.8.3, https://www.nv5geospatialsoftware.com/docs/idl-install.html, last access: 7 July 2025.
Textor, C., Schulz, M., Guibert, S., Kinne, S., Balkanski, Y., Bauer, S., Berntsen, T., Berglen, T., Boucher, O., Chin, M., Dentener, F., Diehl, T., Easter, R., Feichter, H., Fillmore, D., Ghan, S., Ginoux, P., Gong, S., Grini, A., Hendricks, J., Horowitz, L., Huang, P., Isaksen, I., Iversen, I., Kloster, S., Koch, D., Kirkevåg, A., Kristjansson, J. E., Krol, M., Lauer, A., Lamarque, J. F., Liu, X., Montanaro, V., Myhre, G., Penner, J., Pitari, G., Reddy, S., Seland, Ø., Stier, P., Takemura, T., and Tie, X.: Analysis and quantification of the diversities of aerosol life cycles within AeroCom, Atmos. Chem. Phys., 6, 1777–1813, https://doi.org/10.5194/acp-6-1777-2006, 2006.
Thunis, P., Crippa, M., Cuvelier, C., Guizzardi, D., De Meij, A., Oreggioni, G., and Pisoni, E.: Sensitivity of air quality modelling to different emission inventories: A case study over Europe, Atm. Environ. X, 10, 100111, https://doi.org/10.1016/j.aeaoa.2021.100111, 2021a.
Thunis, P., Clappier, A., Beekmann, M., Putaud, J. P., Cuvelier, C., Madrazo, J., and De Meij, A.: Non-linear response of PM2.5 to changes in NOx and NH3 emissions in the Po basin (Italy): consequences for air quality plans, Atmos. Chem. Phys., 21, 9309–9327, https://doi.org/10.5194/acp-21-9309-2021, 2021b.
Thunis, P., Crippa, M., Cuvelier, C., Guizzardi, D., De Meij, A., Oreggioni, G., and Pisoni, E.: Sensitivity of air quality modelling to different emission inventories: A case study over Europe, Atmos. Environ. X, 10, 100111, https://doi.org/10.1016/j.aeaoa.2021.100111, 2021c.
Van Loon, M., Vautard, R., Schaap, M., Bergström, R., Bessagnet, B., Brandt, J., and Krol, M. C.: Evaluation of long-term ozone simulations from seven regional air quality models and their ensemble, Atmos Environ., 41, 2083–2097, 2007.
Vautard, R., Van Loon, M., Schaap, M., Bergström, R., Bessagnet, B., Brandt, J., Builtjes, P. J. H., Christensen, J. H., Cuvelier, K., Graf, A., Jonson, J. E., Krol, M., Langner, J., Roberts, P., Rouil, L., Stern, R., Tarrasón, L., Thunis, P., Vignati, E., White, L., and Wind, P.: Is regional air quality model diversity representative of uncertainty for ozone simulation?, Geophys. Res. Lett., 33, L24818, https://doi.org/10.1029/2006GL027610, 2006.
Wang, L., Wei, Z., Wei, W., Fu, J. S., Meng, C., and Ma, S.: Source apportionment of PM2.5 in top polluted cities in Hebei, China using the CMAQ model, Atmos. Environ., 122, 723–736, https://doi.org/10.1016/j.atmosenv.2015.10.041, 2015.
Short summary
We assess relevance and utility indicators by evaluating nine Copernicus Atmospheric Monitoring Service models in calculated air pollutant values. For NO2, the results highlight difficulties at traffic stations. For PM2.5 and PM10 the bias and winter–summer gradients reveal issues. O3 evaluation shows that seasonal gradients are useful. Overall, the indicators reveal model limitations, yet there is a need to reconsider the strictness of some indicators for certain pollutants.
We assess relevance and utility indicators by evaluating nine Copernicus Atmospheric Monitoring...
