Articles | Volume 18, issue 13
https://doi.org/10.5194/gmd-18-4231-2025
https://doi.org/10.5194/gmd-18-4231-2025
Methods for assessment of models
 | 
15 Jul 2025
Methods for assessment of models |  | 15 Jul 2025

A new set of indicators for model evaluation complementing FAIRMODE's modelling quality objective (MQO)

Alexander de Meij, Cornelis Cuvelier, Philippe Thunis, and Enrico Pisoni

Related authors

Emission ensemble approach to improve the development of multi-scale emission inventories
Philippe Thunis, Jeroen Kuenen, Enrico Pisoni, Bertrand Bessagnet, Manjola Banja, Lech Gawuc, Karol Szymankiewicz, Diego Guizardi, Monica Crippa, Susana Lopez-Aparicio, Marc Guevara, Alexander De Meij, Sabine Schindlbacher, and Alain Clappier
Geosci. Model Dev., 17, 3631–3643, https://doi.org/10.5194/gmd-17-3631-2024,https://doi.org/10.5194/gmd-17-3631-2024, 2024
Short summary
Sensitivity of air quality model responses to emission changes: comparison of results based on four EU inventories through FAIRMODE benchmarking methodology
Alexander de Meij, Cornelis Cuvelier, Philippe Thunis, Enrico Pisoni, and Bertrand Bessagnet
Geosci. Model Dev., 17, 587–606, https://doi.org/10.5194/gmd-17-587-2024,https://doi.org/10.5194/gmd-17-587-2024, 2024
Short summary
Why is the city's responsibility for its air pollution often underestimated? A focus on PM2.5
Philippe Thunis, Alain Clappier, Alexander de Meij, Enrico Pisoni, Bertrand Bessagnet, and Leonor Tarrason
Atmos. Chem. Phys., 21, 18195–18212, https://doi.org/10.5194/acp-21-18195-2021,https://doi.org/10.5194/acp-21-18195-2021, 2021
Short summary
Non-linear response of PM2.5 to changes in NOx and NH3 emissions in the Po basin (Italy): consequences for air quality plans
Philippe Thunis, Alain Clappier, Matthias Beekmann, Jean Philippe Putaud, Cornelis Cuvelier, Jessie Madrazo, and Alexander de Meij
Atmos. Chem. Phys., 21, 9309–9327, https://doi.org/10.5194/acp-21-9309-2021,https://doi.org/10.5194/acp-21-9309-2021, 2021
Short summary
Sensitivity of air quality modelling to different emission inventories: a case study over Europe
Philippe Thunis, Monica Crippa, Cornelis Cuvelier, Diego Guizzardi, Alexander De Meij, Gabriel Oreggioni, and Enrico Pisoni
Earth Syst. Sci. Data Discuss., https://doi.org/10.5194/essd-2020-144,https://doi.org/10.5194/essd-2020-144, 2020
Preprint withdrawn
Short summary

Related subject area

Atmospheric sciences
Impact of multiple radar wind profiler data assimilation on convective-scale short-term rainfall forecasts: OSSE studies over the Beijing–Tianjin–Hebei region
Juan Zhao, Jianping Guo, and Xiaohui Zheng
Geosci. Model Dev., 18, 4075–4101, https://doi.org/10.5194/gmd-18-4075-2025,https://doi.org/10.5194/gmd-18-4075-2025, 2025
Short summary
New submodel for emissions from Explosive Volcanic ERuptions (EVER v1.1) within the Modular Earth Submodel System (MESSy, version 2.55.1)
Matthias Kohl, Christoph Brühl, Jennifer Schallock, Holger Tost, Patrick Jöckel, Adrian Jost, Steffen Beirle, Michael Höpfner, and Andrea Pozzer
Geosci. Model Dev., 18, 3985–4007, https://doi.org/10.5194/gmd-18-3985-2025,https://doi.org/10.5194/gmd-18-3985-2025, 2025
Short summary
Quantifying the oscillatory evolution of simulated boundary-layer cloud fields using Gaussian process regression
Gunho Loren Oh and Philip H. Austin
Geosci. Model Dev., 18, 3921–3940, https://doi.org/10.5194/gmd-18-3921-2025,https://doi.org/10.5194/gmd-18-3921-2025, 2025
Short summary
Numerical investigations on the modelling of ultrafine particles in SSH-aerosol-v1.3a: size resolution and redistribution
Oscar Jacquot and Karine Sartelet
Geosci. Model Dev., 18, 3965–3984, https://doi.org/10.5194/gmd-18-3965-2025,https://doi.org/10.5194/gmd-18-3965-2025, 2025
Short summary
The third Met Office Unified Model–JULES Regional Atmosphere and Land Configuration, RAL3
Mike Bush, David L. A. Flack, Huw W. Lewis, Sylvia I. Bohnenstengel, Chris J. Short, Charmaine Franklin, Adrian P. Lock, Martin Best, Paul Field, Anne McCabe, Kwinten Van Weverberg, Segolene Berthou, Ian Boutle, Jennifer K. Brooke, Seb Cole, Shaun Cooper, Gareth Dow, John Edwards, Anke Finnenkoetter, Kalli Furtado, Kate Halladay, Kirsty Hanley, Margaret A. Hendry, Adrian Hill, Aravindakshan Jayakumar, Richard W. Jones, Humphrey Lean, Joshua C. K. Lee, Andy Malcolm, Marion Mittermaier, Saji Mohandas, Stuart Moore, Cyril Morcrette, Rachel North, Aurore Porson, Susan Rennie, Nigel Roberts, Belinda Roux, Claudio Sanchez, Chun-Hsu Su, Simon Tucker, Simon Vosper, David Walters, James Warner, Stuart Webster, Mark Weeks, Jonathan Wilkinson, Michael Whitall, Keith D. Williams, and Hugh Zhang
Geosci. Model Dev., 18, 3819–3855, https://doi.org/10.5194/gmd-18-3819-2025,https://doi.org/10.5194/gmd-18-3819-2025, 2025
Short summary

Cited articles

Ambient Air Quality Directive: Directive (EU) 2024/2881 of the European Parliament and of the Council of 23 October 2024 on ambient air quality and cleaner air for Europe (recast), https://eur-lex.europa.eu/eli/dir/2024/2881/oj (last access: 11 July 2025), 2024. 
Boylan, J. W. and Russell, A. G.: PM and light extinction model performance metrics, goals, and criteria for three-dimensional air quality models, Atmos. Environ., 40, 4946–4959, https://doi.org/10.1016/j.atmosenv.2005.09.087, 2006. 
Clappier, A., Thunis, P., Beekmann, M., Putaud, J. P., and De Meij, A.: Impact of SOx, NOx and NH3 emission reductions on PM2.5 concentrations across Europe: Hints for future measure development, Environ. Int., 156, 106699, https://doi.org/10.1016/j.envint.2021.106699, 2021. 
CAMS – Copernicus Atmospheric Monitoring Service: Regional Production, Updated documentation covering all Regional operational systems and the ENSEMBLE, Following U3 upgrade, November 2020, https://confluence.ecmwf.int/display/CKB/CAMS+Regional:+European+air+quality+reanalyses+data+documentation (last access: 10 July 2025), 2020. 
Download
Short summary
We assess relevance and utility indicators by evaluating nine Copernicus Atmospheric Monitoring Service models in calculated air pollutant values. For NO2, the results highlight difficulties at traffic stations. For PM2.5 and PM10 the bias and winter–summer gradients reveal issues. O3 evaluation shows that seasonal gradients are useful. Overall, the indicators reveal model limitations, yet there is a need to reconsider the strictness of some indicators for certain pollutants.
Share