Articles | Volume 16, issue 20
https://doi.org/10.5194/gmd-16-6029-2023
© Author(s) 2023. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
https://doi.org/10.5194/gmd-16-6029-2023
© Author(s) 2023. This work is distributed under
the Creative Commons Attribution 4.0 License.
the Creative Commons Attribution 4.0 License.
Methods for assessment of models
| 
27 Oct 2023
Methods for assessment of models |
| 27 Oct 2023
| 27 Oct 2023
A standardized methodology for the validation of air quality forecast applications (F-MQO): lessons learnt from its application across Europe
Lina Vitali
National Agency for New Technologies, Energy and Sustainable Economic Development (ENEA), Department for Sustainability, Bologna, Italy
Kees Cuvelier
European Commission – Joint Research Centre (JRC), Ispra, Italy
retired
Antonio Piersanti
National Agency for New Technologies, Energy and Sustainable Economic Development (ENEA), Department for Sustainability, Bologna, Italy
Alexandra Monteiro
CESAM, Department of Environment, University of Aveiro, Aveiro, Portugal
Mario Adani
National Agency for New Technologies, Energy and Sustainable Economic Development (ENEA), Department for Sustainability, Bologna, Italy
Roberta Amorati
Regional Agency for Prevention, Environment and Energy (ARPAE) of the Emilia-Romagna region, Bologna, Italy
Agnieszka Bartocha
ATMOTERM, Opole, Poland
Alessandro D'Ausilio
Flemish Institute for Technological Research (VITO), Mol, Belgium
Paweł Durka
Institute of Environmental Protection (IEP) – National Research Institute, Warsaw, Poland
Carla Gama
CESAM, Department of Environment, University of Aveiro, Aveiro, Portugal
Giulia Giovannini
Regional Agency for Prevention, Environment and Energy (ARPAE) of the Emilia-Romagna region, Bologna, Italy
Stijn Janssen
Flemish Institute for Technological Research (VITO), Mol, Belgium
Tomasz Przybyła
ATMOTERM, Opole, Poland
Michele Stortini
Regional Agency for Prevention, Environment and Energy (ARPAE) of the Emilia-Romagna region, Bologna, Italy
Stijn Vranckx
Flemish Institute for Technological Research (VITO), Mol, Belgium
Philippe Thunis
CORRESPONDING AUTHOR
European Commission – Joint Research Centre (JRC), Ispra, Italy
Related authors
Augustin Colette, Gaëlle Collin, François Besson, Etienne Blot, Vincent Guidard, Frederik Meleux, Adrien Royer, Valentin Petiot, Claire Miller, Oihana Fermond, Alizé Jeant, Mario Adani, Joaquim Arteta, Anna Benedictow, Robert Bergström, Dene Bowdalo, Jorgen Brandt, Gino Briganti, Ana C. Carvalho, Jesper Heile Christensen, Florian Couvidat, Ilia D’Elia, Massimo D’Isidoro, Hugo Denier van der Gon, Gaël Descombes, Enza Di Tomaso, John Douros, Jeronimo Escribano, Henk Eskes, Hilde Fagerli, Yalda Fatahi, Johannes Flemming, Elmar Friese, Lise Frohn, Michael Gauss, Camilla Geels, Guido Guarnieri, Marc Guevara, Antoine Guion, Jonathan Guth, Risto Hänninen, Kaj Hansen, Ulas Im, Ruud Janssen, Marine Jeoffrion, Mathieu Joly, Luke Jones, Oriol Jorba, Evgeni Kadantsev, Michael Kahnert, Jacek W. Kaminski, Rostislav Kouznetsov, Richard Kranenburg, Jeroen Kuenen, Anne Caroline Lange, Joachim Langner, Victor Lannuque, Francesca Macchia, Astrid Manders, Mihaela Mircea, Agnes Nyiri, Miriam Olid, Carlos Pérez García-Pando, Yuliia Palamarchuk, Antonio Piersanti, Blandine Raux, Miha Razinger, Lennard Robertson, Arjo Segers, Martijn Schaap, Pilvi Siljamo, David Simpson, Mikhail Sofiev, Anders Stangel, Joanna Struzewska, Carles Tena, Renske Timmermans, Thanos Tsikerdekis, Svetlana Tsyro, Svyatoslav Tyuryakov, Anthony Ung, Andreas Uppstu, Alvaro Valdebenito, Peter van Velthoven, Lina Vitali, Zhuyun Ye, Vincent-Henri Peuch, and Laurence Rouïl
EGUsphere, https://doi.org/10.5194/egusphere-2024-3744, https://doi.org/10.5194/egusphere-2024-3744, 2024
Short summary
Short summary
The Copernicus Atmosphere Monitoring Service – Regional Production delivers daily forecasts, analyses, and reanalyses of air quality in Europe. The Service relies on a distributed modelling production by eleven leading European modelling teams following stringent requirements with an operational design which has no equivalent in the world. All the products are full, free, open and quality assured and disseminated with a high level of reliability.
Ilaria D'Elia, Gino Briganti, Lina Vitali, Antonio Piersanti, Gaia Righini, Massimo D'Isidoro, Andrea Cappelletti, Mihaela Mircea, Mario Adani, Gabriele Zanini, and Luisella Ciancarella
Atmos. Chem. Phys., 21, 10825–10849, https://doi.org/10.5194/acp-21-10825-2021, https://doi.org/10.5194/acp-21-10825-2021, 2021
Short summary
Short summary
We present an analysis of modelled trends of PM10, NO2, and O3 airborne concentrations over the Italian territory in 2003–2010. Our analysis shows a general downward simulated trend for all pollutants, with good agreement between observed and modelled values and the model widening both coverage and significance of air concentration trends. Due to the complex atmospheric dynamics, emission reductions do not always result in decreasing concentrations, especially for secondary pollutants.
Mario Adani, Guido Guarnieri, Lina Vitali, Luisella Ciancarella, Ilaria D'Elia, Mihaela Mircea, Maurizio Gualtieri, Andrea Cappelletti, Massimo D'Isidoro, Gino Briganti, Antonio Piersanti, Milena Stracquadanio, Gaia Righini, Felicita Russo, Giuseppe Cremona, Maria Gabriella Villani, and Gabriele Zanini
Geosci. Model Dev. Discuss., https://doi.org/10.5194/gmd-2020-54, https://doi.org/10.5194/gmd-2020-54, 2020
Publication in GMD not foreseen
Short summary
Short summary
The National Air Quality forecasting system FORAIR_IT may be considered a state of the art model, and as far as we know it is the first forecasting system at high spatial resolution proposed at Italian National level. FORAIR_IT may be a useful tool that the policy makers might use in order to apply extraordinary procedure to prevent/mitigate high levels of air pollution. Moreover general population might take advantage of FORAIR_IT to get used to the complexity of air quality issues.
Marc Guevara, Augustin Colette, Antoine Guion, Valentin Petiot, Mario Adani, Joaquim Arteta, Anna Benedictow, Robert Bergström, Andrea Bolignano, Paula Camps, Ana C. Carvalho, Jesper Heile Christensen, Florian Couvidat, Ilia D’Elia, Hugo Denier van der Gon, Gaël Descombes, John Douros, Hilde Fagerli, Yalda Fatahi, Elmar Friese, Lise Frohn, Michael Gauss, Camilla Geels, Risto Hänninen, Kaj Hansen, Oriol Jorba, Jacek W. Kaminski, Rostislav Kouznetsov, Richard Kranenburg, Jeroen Kuenen, Victor Lannuque, Frédérik Meleux, Agnes Nyíri, Yuliia Palamarchuk, Carlos Pérez García-Pando, Lennard Robertson, Felicita Russo, Arjo Segers, Mikhail Sofiev, Joanna Struzewska, Renske Timmermans, Andreas Uppstu, Alvaro Valdebenito, and Zhuyun Ye
EGUsphere, https://doi.org/10.5194/egusphere-2025-1287, https://doi.org/10.5194/egusphere-2025-1287, 2025
This preprint is open for discussion and under review for Atmospheric Chemistry and Physics (ACP).
Short summary
Short summary
Air quality models require hourly emissions to accurately represent dispersion and physico-chemical processes in the atmosphere. Since emission inventories are typically provided at the annual level, emissions are downscaled to a refined temporal resolution using temporal profiles. This study quantifies the impact of using new anthropogenic temporal profiles on the performance of an European air quality multi-model ensemble. Overall, the findings indicate an improvement of the modelling results.
Alexander de Meij, Cornelis Cuvelier, Philippe Thunis, and Enrico Pisoni
EGUsphere, https://doi.org/10.5194/egusphere-2024-3690, https://doi.org/10.5194/egusphere-2024-3690, 2025
Short summary
Short summary
We assess the relevance and utility indicators developed within FAIRMODE by evaluating 9 CAMS models in calculated air pollutant values. For NO2, the results highlight difficulties at traffic stations. For PM2.5 and PM10 the bias and Winter-Summer gradients reveal issues. O3 evaluation shows that e.g. seasonal gradients are useful. Overall, the indicators provide valuable insights into model limitations, yet there is a need to reconsider the strictness of some indicators for certain pollutants.
Augustin Colette, Gaëlle Collin, François Besson, Etienne Blot, Vincent Guidard, Frederik Meleux, Adrien Royer, Valentin Petiot, Claire Miller, Oihana Fermond, Alizé Jeant, Mario Adani, Joaquim Arteta, Anna Benedictow, Robert Bergström, Dene Bowdalo, Jorgen Brandt, Gino Briganti, Ana C. Carvalho, Jesper Heile Christensen, Florian Couvidat, Ilia D’Elia, Massimo D’Isidoro, Hugo Denier van der Gon, Gaël Descombes, Enza Di Tomaso, John Douros, Jeronimo Escribano, Henk Eskes, Hilde Fagerli, Yalda Fatahi, Johannes Flemming, Elmar Friese, Lise Frohn, Michael Gauss, Camilla Geels, Guido Guarnieri, Marc Guevara, Antoine Guion, Jonathan Guth, Risto Hänninen, Kaj Hansen, Ulas Im, Ruud Janssen, Marine Jeoffrion, Mathieu Joly, Luke Jones, Oriol Jorba, Evgeni Kadantsev, Michael Kahnert, Jacek W. Kaminski, Rostislav Kouznetsov, Richard Kranenburg, Jeroen Kuenen, Anne Caroline Lange, Joachim Langner, Victor Lannuque, Francesca Macchia, Astrid Manders, Mihaela Mircea, Agnes Nyiri, Miriam Olid, Carlos Pérez García-Pando, Yuliia Palamarchuk, Antonio Piersanti, Blandine Raux, Miha Razinger, Lennard Robertson, Arjo Segers, Martijn Schaap, Pilvi Siljamo, David Simpson, Mikhail Sofiev, Anders Stangel, Joanna Struzewska, Carles Tena, Renske Timmermans, Thanos Tsikerdekis, Svetlana Tsyro, Svyatoslav Tyuryakov, Anthony Ung, Andreas Uppstu, Alvaro Valdebenito, Peter van Velthoven, Lina Vitali, Zhuyun Ye, Vincent-Henri Peuch, and Laurence Rouïl
EGUsphere, https://doi.org/10.5194/egusphere-2024-3744, https://doi.org/10.5194/egusphere-2024-3744, 2024
Short summary
Short summary
The Copernicus Atmosphere Monitoring Service – Regional Production delivers daily forecasts, analyses, and reanalyses of air quality in Europe. The Service relies on a distributed modelling production by eleven leading European modelling teams following stringent requirements with an operational design which has no equivalent in the world. All the products are full, free, open and quality assured and disseminated with a high level of reliability.
Giorgio Veratti, Alessandro Bigi, Michele Stortini, Sergio Teggi, and Grazia Ghermandi
Atmos. Chem. Phys., 24, 10475–10512, https://doi.org/10.5194/acp-24-10475-2024, https://doi.org/10.5194/acp-24-10475-2024, 2024
Short summary
Short summary
In a study of two consecutive winter seasons, we used measurements and modelling tools to identify the levels and sources of black carbon pollution in a medium-sized urban area of the Po Valley, Italy. Our findings show that biomass burning and traffic-related emissions (especially from Euro 4 diesel cars) significantly contribute to BC concentrations. This research offers crucial insights for policymakers and urban planners aiming to improve air quality in cities.
Philippe Thunis, Jeroen Kuenen, Enrico Pisoni, Bertrand Bessagnet, Manjola Banja, Lech Gawuc, Karol Szymankiewicz, Diego Guizardi, Monica Crippa, Susana Lopez-Aparicio, Marc Guevara, Alexander De Meij, Sabine Schindlbacher, and Alain Clappier
Geosci. Model Dev., 17, 3631–3643, https://doi.org/10.5194/gmd-17-3631-2024, https://doi.org/10.5194/gmd-17-3631-2024, 2024
Short summary
Short summary
An ensemble emission inventory is created with the aim of monitoring the status and progress made with the development of EU-wide inventories. This emission ensemble serves as a common benchmark for the screening and allows for the comparison of more than two inventories at a time. Because the emission “truth” is unknown, the approach does not tell which inventory is the closest to reality, but it identifies inconsistencies that require special attention.
Eduardo Torre-Pascual, Gotzon Gangoiti, Ana Rodríguez-García, Estibaliz Sáez de Cámara, Joana Ferreira, Carla Gama, María Carmen Gómez, Iñaki Zuazo, Jose Antonio García, and Maite de Blas
Atmos. Chem. Phys., 24, 4305–4329, https://doi.org/10.5194/acp-24-4305-2024, https://doi.org/10.5194/acp-24-4305-2024, 2024
Short summary
Short summary
We present an analysis of an intense air pollution episode of tropospheric ozone (O3) along the Atlantic coast of the Iberian Peninsula, incorporating both measured and simulated parameters. Our study extends beyond surface-level factors to include altitude-related parameters. These episodes stem from upper-atmosphere O3 accumulation in preceding days, transported to surface layers, causing rapid O3 concentration increase.
Alexander de Meij, Cornelis Cuvelier, Philippe Thunis, Enrico Pisoni, and Bertrand Bessagnet
Geosci. Model Dev., 17, 587–606, https://doi.org/10.5194/gmd-17-587-2024, https://doi.org/10.5194/gmd-17-587-2024, 2024
Short summary
Short summary
In our study the robustness of the model responses to emission reductions in the EU is assessed when the emission data are changed. Our findings are particularly important to better understand the uncertainties associated to the emission inventories and how these uncertainties impact the level of accuracy of the resulting air quality modelling, which is a key for designing air quality plans. Also crucial is the choice of indicator to avoid misleading interpretations of the results.
Philippe Thunis, Alain Clappier, Enrico Pisoni, Bertrand Bessagnet, Jeroen Kuenen, Marc Guevara, and Susana Lopez-Aparicio
Geosci. Model Dev., 15, 5271–5286, https://doi.org/10.5194/gmd-15-5271-2022, https://doi.org/10.5194/gmd-15-5271-2022, 2022
Short summary
Short summary
In this work, we propose a screening method to improve the quality of emission inventories, which are responsible for large uncertainties in air-quality modeling. The first step of screening consists of keeping only emission contributions that are relevant enough. In a second step, the method identifies large differences that provide evidence of methodological divergence or errors. We used the approach to compare two versions of the CAMS-REG European-scale inventory over 150 European cities.
Svetlana Tsyro, Wenche Aas, Augustin Colette, Camilla Andersson, Bertrand Bessagnet, Giancarlo Ciarelli, Florian Couvidat, Kees Cuvelier, Astrid Manders, Kathleen Mar, Mihaela Mircea, Noelia Otero, Maria-Teresa Pay, Valentin Raffort, Yelva Roustan, Mark R. Theobald, Marta G. Vivanco, Hilde Fagerli, Peter Wind, Gino Briganti, Andrea Cappelletti, Massimo D'Isidoro, and Mario Adani
Atmos. Chem. Phys., 22, 7207–7257, https://doi.org/10.5194/acp-22-7207-2022, https://doi.org/10.5194/acp-22-7207-2022, 2022
Short summary
Short summary
Particulate matter (PM) air pollution causes adverse health effects. In Europe, the emissions caused by anthropogenic activities have been reduced in the last decades. To assess the efficiency of emission reductions in improving air quality, we have studied the evolution of PM pollution in Europe. Simulations with six air quality models and observational data indicate a decrease in PM concentrations by 10 % to 30 % across Europe from 2000 to 2010, which is mainly a result of emission reductions.
Philippe Thunis, Alain Clappier, Alexander de Meij, Enrico Pisoni, Bertrand Bessagnet, and Leonor Tarrason
Atmos. Chem. Phys., 21, 18195–18212, https://doi.org/10.5194/acp-21-18195-2021, https://doi.org/10.5194/acp-21-18195-2021, 2021
Short summary
Short summary
Air pollution's origin in cities is still a point of discussion, and approaches to assess the city's responsibility for its pollution are not harmonized and thus not comparable, resulting in sometimes contradicting interpretations. We show that methodological choices can easily lead to differences of a factor of 2 in terms of responsibility outcome and stress that methodological choices and assumptions most often lead to a systematic and important underestimation of the city's responsibility.
Ilaria D'Elia, Gino Briganti, Lina Vitali, Antonio Piersanti, Gaia Righini, Massimo D'Isidoro, Andrea Cappelletti, Mihaela Mircea, Mario Adani, Gabriele Zanini, and Luisella Ciancarella
Atmos. Chem. Phys., 21, 10825–10849, https://doi.org/10.5194/acp-21-10825-2021, https://doi.org/10.5194/acp-21-10825-2021, 2021
Short summary
Short summary
We present an analysis of modelled trends of PM10, NO2, and O3 airborne concentrations over the Italian territory in 2003–2010. Our analysis shows a general downward simulated trend for all pollutants, with good agreement between observed and modelled values and the model widening both coverage and significance of air concentration trends. Due to the complex atmospheric dynamics, emission reductions do not always result in decreasing concentrations, especially for secondary pollutants.
Philippe Thunis, Alain Clappier, Matthias Beekmann, Jean Philippe Putaud, Cornelis Cuvelier, Jessie Madrazo, and Alexander de Meij
Atmos. Chem. Phys., 21, 9309–9327, https://doi.org/10.5194/acp-21-9309-2021, https://doi.org/10.5194/acp-21-9309-2021, 2021
Short summary
Short summary
Modelling simulations are used to identify the most efficient emission reduction strategies to reduce PM2.5 concentration levels in northern Italy. Results show contrasting chemical regimes and important non-linearities during wintertime, with the striking result that PM2.5 levels may increase when NOx reductions are applied in NOx-rich areas – a process that may have contributed to the absence of significant PM2.5 decrease during the COVID-19 lockdowns in many European cities.
Jérôme Barré, Hervé Petetin, Augustin Colette, Marc Guevara, Vincent-Henri Peuch, Laurence Rouil, Richard Engelen, Antje Inness, Johannes Flemming, Carlos Pérez García-Pando, Dene Bowdalo, Frederik Meleux, Camilla Geels, Jesper H. Christensen, Michael Gauss, Anna Benedictow, Svetlana Tsyro, Elmar Friese, Joanna Struzewska, Jacek W. Kaminski, John Douros, Renske Timmermans, Lennart Robertson, Mario Adani, Oriol Jorba, Mathieu Joly, and Rostislav Kouznetsov
Atmos. Chem. Phys., 21, 7373–7394, https://doi.org/10.5194/acp-21-7373-2021, https://doi.org/10.5194/acp-21-7373-2021, 2021
Short summary
Short summary
This study provides a comprehensive assessment of air quality changes across the main European urban areas induced by the COVID-19 lockdown using satellite observations, surface site measurements, and the forecasting system from the Copernicus Atmospheric Monitoring Service (CAMS). We demonstrate the importance of accounting for weather and seasonal variability when calculating such estimates.
Bart Degraeuwe, Enrico Pisoni, and Philippe Thunis
Geosci. Model Dev., 13, 5725–5736, https://doi.org/10.5194/gmd-13-5725-2020, https://doi.org/10.5194/gmd-13-5725-2020, 2020
Short summary
Short summary
To make decisions on how to improve air quality, it is useful to identify the main sources of pollution for an area of interest. Often these sources of pollution are identified with complex models that, even if accurate, are time consuming and complex. In this work we use another approach, simplified models, to accomplish the same task. The results, computed with two different set of simplified models, show the main sources of pollution for selected cities, and the associated uncertainties.
Philippe Thunis, Monica Crippa, Cornelis Cuvelier, Diego Guizzardi, Alexander De Meij, Gabriel Oreggioni, and Enrico Pisoni
Earth Syst. Sci. Data Discuss., https://doi.org/10.5194/essd-2020-144, https://doi.org/10.5194/essd-2020-144, 2020
Preprint withdrawn
Short summary
Short summary
A comparison of emissions inventories for air quality modelling, in Europe, is presented. Among these inventories, EDGAR v5.0 for air pollutants is introduced and validated, through a simulation with the EMEP model.
Mario Adani, Guido Guarnieri, Lina Vitali, Luisella Ciancarella, Ilaria D'Elia, Mihaela Mircea, Maurizio Gualtieri, Andrea Cappelletti, Massimo D'Isidoro, Gino Briganti, Antonio Piersanti, Milena Stracquadanio, Gaia Righini, Felicita Russo, Giuseppe Cremona, Maria Gabriella Villani, and Gabriele Zanini
Geosci. Model Dev. Discuss., https://doi.org/10.5194/gmd-2020-54, https://doi.org/10.5194/gmd-2020-54, 2020
Publication in GMD not foreseen
Short summary
Short summary
The National Air Quality forecasting system FORAIR_IT may be considered a state of the art model, and as far as we know it is the first forecasting system at high spatial resolution proposed at Italian National level. FORAIR_IT may be a useful tool that the policy makers might use in order to apply extraordinary procedure to prevent/mitigate high levels of air pollution. Moreover general population might take advantage of FORAIR_IT to get used to the complexity of air quality issues.
Giancarlo Ciarelli, Mark R. Theobald, Marta G. Vivanco, Matthias Beekmann, Wenche Aas, Camilla Andersson, Robert Bergström, Astrid Manders-Groot, Florian Couvidat, Mihaela Mircea, Svetlana Tsyro, Hilde Fagerli, Kathleen Mar, Valentin Raffort, Yelva Roustan, Maria-Teresa Pay, Martijn Schaap, Richard Kranenburg, Mario Adani, Gino Briganti, Andrea Cappelletti, Massimo D'Isidoro, Cornelis Cuvelier, Arineh Cholakian, Bertrand Bessagnet, Peter Wind, and Augustin Colette
Geosci. Model Dev., 12, 4923–4954, https://doi.org/10.5194/gmd-12-4923-2019, https://doi.org/10.5194/gmd-12-4923-2019, 2019
Short summary
Short summary
The novel multi-model EURODELTA-Trends exercise provided 21 years of continuous PM components and their gas-phase precursor concentrations over Europe from the year 1990. The models’ capabilities to reproduce PM components and gas-phase PM precursor trends over the 1990–2010 period is the key focus of this study. The models were able to reproduce the observed trends relatively well, indicating a possible shift in the thermodynamic equilibrium between gas and particle phases.
Mark R. Theobald, Marta G. Vivanco, Wenche Aas, Camilla Andersson, Giancarlo Ciarelli, Florian Couvidat, Kees Cuvelier, Astrid Manders, Mihaela Mircea, Maria-Teresa Pay, Svetlana Tsyro, Mario Adani, Robert Bergström, Bertrand Bessagnet, Gino Briganti, Andrea Cappelletti, Massimo D'Isidoro, Hilde Fagerli, Kathleen Mar, Noelia Otero, Valentin Raffort, Yelva Roustan, Martijn Schaap, Peter Wind, and Augustin Colette
Atmos. Chem. Phys., 19, 379–405, https://doi.org/10.5194/acp-19-379-2019, https://doi.org/10.5194/acp-19-379-2019, 2019
Short summary
Short summary
Model estimates of the mean European wet deposition of nitrogen and sulfur for 1990 to 2010 were within 40 % of the observed values. As a result of systematic biases, the models were better at estimating relative trends for the periods 1990–2000 and 2000–2010 than the absolute trends. Although the predominantly decreasing trends were mostly due to emission reductions, they were partially offset by other factors (e.g. changes in precipitation) during the first period, but not the second.
Noelia Otero, Jana Sillmann, Kathleen A. Mar, Henning W. Rust, Sverre Solberg, Camilla Andersson, Magnuz Engardt, Robert Bergström, Bertrand Bessagnet, Augustin Colette, Florian Couvidat, Cournelius Cuvelier, Svetlana Tsyro, Hilde Fagerli, Martijn Schaap, Astrid Manders, Mihaela Mircea, Gino Briganti, Andrea Cappelletti, Mario Adani, Massimo D'Isidoro, María-Teresa Pay, Mark Theobald, Marta G. Vivanco, Peter Wind, Narendra Ojha, Valentin Raffort, and Tim Butler
Atmos. Chem. Phys., 18, 12269–12288, https://doi.org/10.5194/acp-18-12269-2018, https://doi.org/10.5194/acp-18-12269-2018, 2018
Short summary
Short summary
This paper evaluates the capability of air-quality models to capture the observed relationship between surface ozone concentrations and meteorology over Europe. The air-quality models tended to overestimate the influence of maximum temperature and surface solar radiation. None of the air-quality models captured the strength of the observed relationship between ozone and relative humidity appropriately, underestimating the effect of relative humidity, a key factor in the ozone removal processes.
Marta G. Vivanco, Mark R. Theobald, Héctor García-Gómez, Juan Luis Garrido, Marje Prank, Wenche Aas, Mario Adani, Ummugulsum Alyuz, Camilla Andersson, Roberto Bellasio, Bertrand Bessagnet, Roberto Bianconi, Johannes Bieser, Jørgen Brandt, Gino Briganti, Andrea Cappelletti, Gabriele Curci, Jesper H. Christensen, Augustin Colette, Florian Couvidat, Cornelis Cuvelier, Massimo D'Isidoro, Johannes Flemming, Andrea Fraser, Camilla Geels, Kaj M. Hansen, Christian Hogrefe, Ulas Im, Oriol Jorba, Nutthida Kitwiroon, Astrid Manders, Mihaela Mircea, Noelia Otero, Maria-Teresa Pay, Luca Pozzoli, Efisio Solazzo, Svetlana Tsyro, Alper Unal, Peter Wind, and Stefano Galmarini
Atmos. Chem. Phys., 18, 10199–10218, https://doi.org/10.5194/acp-18-10199-2018, https://doi.org/10.5194/acp-18-10199-2018, 2018
Short summary
Short summary
European wet and dry atmospheric deposition of N and S estimated by 14 air quality models was found to vary substantially. An ensemble of models meeting acceptability criteria was used to estimate the exceedances of the critical loads for N in habitats within the Natura 2000 network, as well as their lower and upper limits. Scenarios with 20 % emission reductions in different regions of the world showed that European emissions are responsible for most of the N and S deposition in Europe.
Alain Clappier, Claudio A. Belis, Denise Pernigotti, and Philippe Thunis
Geosci. Model Dev., 10, 4245–4256, https://doi.org/10.5194/gmd-10-4245-2017, https://doi.org/10.5194/gmd-10-4245-2017, 2017
Short summary
Short summary
This work demonstrates that when the relationship between emissions and concentrations is nonlinear, sensitivity approaches, generally used for air quality planning, are not suitable to retrieve source contributions and source apportionment methods are not appropriate to evaluate the impact of abatement strategies on air quality. A simple theoretical example is used highlighting differences and potential implications for policy.
Augustin Colette, Camilla Andersson, Astrid Manders, Kathleen Mar, Mihaela Mircea, Maria-Teresa Pay, Valentin Raffort, Svetlana Tsyro, Cornelius Cuvelier, Mario Adani, Bertrand Bessagnet, Robert Bergström, Gino Briganti, Tim Butler, Andrea Cappelletti, Florian Couvidat, Massimo D'Isidoro, Thierno Doumbia, Hilde Fagerli, Claire Granier, Chris Heyes, Zig Klimont, Narendra Ojha, Noelia Otero, Martijn Schaap, Katarina Sindelarova, Annemiek I. Stegehuis, Yelva Roustan, Robert Vautard, Erik van Meijgaard, Marta Garcia Vivanco, and Peter Wind
Geosci. Model Dev., 10, 3255–3276, https://doi.org/10.5194/gmd-10-3255-2017, https://doi.org/10.5194/gmd-10-3255-2017, 2017
Short summary
Short summary
The EURODELTA-Trends numerical experiment has been designed to assess the capability of chemistry-transport models to capture the evolution of surface air quality over the 1990–2010 period in Europe. It also includes sensitivity experiments in order to analyse the relative contribution of (i) emission changes, (ii) meteorological variability, and (iii) boundary conditions to air quality trends. The article is a detailed presentation of the experiment design and participating models.
Bertrand Bessagnet, Guido Pirovano, Mihaela Mircea, Cornelius Cuvelier, Armin Aulinger, Giuseppe Calori, Giancarlo Ciarelli, Astrid Manders, Rainer Stern, Svetlana Tsyro, Marta García Vivanco, Philippe Thunis, Maria-Teresa Pay, Augustin Colette, Florian Couvidat, Frédérik Meleux, Laurence Rouïl, Anthony Ung, Sebnem Aksoyoglu, José María Baldasano, Johannes Bieser, Gino Briganti, Andrea Cappelletti, Massimo D'Isidoro, Sandro Finardi, Richard Kranenburg, Camillo Silibello, Claudio Carnevale, Wenche Aas, Jean-Charles Dupont, Hilde Fagerli, Lucia Gonzalez, Laurent Menut, André S. H. Prévôt, Pete Roberts, and Les White
Atmos. Chem. Phys., 16, 12667–12701, https://doi.org/10.5194/acp-16-12667-2016, https://doi.org/10.5194/acp-16-12667-2016, 2016
Short summary
Short summary
The EURODELTA III exercise allows a very comprehensive intercomparison and evaluation of air quality models' performance. On average, the models provide a rather good picture of the particulate matter (PM) concentrations over Europe even if the highest concentrations are underestimated. The meteorology is responsible for model discrepancies, while the lack of emissions, particularly in winter, is mentioned as the main reason for the underestimations of PM.
G. Kiesewetter, J. Borken-Kleefeld, W. Schöpp, C. Heyes, P. Thunis, B. Bessagnet, E. Terrenoire, H. Fagerli, A. Nyiri, and M. Amann
Atmos. Chem. Phys., 15, 1539–1553, https://doi.org/10.5194/acp-15-1539-2015, https://doi.org/10.5194/acp-15-1539-2015, 2015
Short summary
Short summary
We describe the multi-stage approach applied in the GAINS model to assess compliance with PM10 limit values at more than 1850 individual air quality monitoring stations in Europe. We analyse source contributions to ambient concentrations and the implications of future policy choices on air quality for 2030. While current legislation does not solve compliance issues, problems are largely eliminated by EU-wide adoption of the best available emission control technology.
E. Terrenoire, B. Bessagnet, L. Rouïl, F. Tognet, G. Pirovano, L. Létinois, M. Beauchamp, A. Colette, P. Thunis, M. Amann, and L. Menut
Geosci. Model Dev., 8, 21–42, https://doi.org/10.5194/gmd-8-21-2015, https://doi.org/10.5194/gmd-8-21-2015, 2015
Short summary
Short summary
The model reproduces the temporal variability of NO2, O3, PM10, PM2.5 better at rural than urban background stations.
The fractional biases show that the model performs slightly better at RB sites than at UB sites for NO2, O3 and PM10.
At UB sites, CHIMERE reproduces PM2.5 better than PM10.
This is primarily the result of an underestimation of coarse particulate matter (PM) associated with uncertainties on SOA chemistry and their precursor emissions, dust and sea salt.
D. Lauwaet, P. Viaene, E. Brisson, N.P.M. van Lipzig, T. van Noije, A. Strunk, S. Van Looy, N. Veldeman, L. Blyth, K. De Ridder, and S. Janssen
Atmos. Chem. Phys., 14, 5893–5904, https://doi.org/10.5194/acp-14-5893-2014, https://doi.org/10.5194/acp-14-5893-2014, 2014
G. Kiesewetter, J. Borken-Kleefeld, W. Schöpp, C. Heyes, P. Thunis, B. Bessagnet, E. Terrenoire, A. Gsella, and M. Amann
Atmos. Chem. Phys., 14, 813–829, https://doi.org/10.5194/acp-14-813-2014, https://doi.org/10.5194/acp-14-813-2014, 2014
Related subject area
Atmospheric sciences
Evaluation of dust emission and land surface schemes in predicting a mega Asian dust storm over South Korea using WRF-Chem
Sensitivity studies of a four-dimensional local ensemble transform Kalman filter coupled with WRF-Chem version 3.9.1 for improving particulate matter simulation accuracy
A Bayesian method for predicting background radiation at environmental monitoring stations in local-scale networks
Inclusion of the ECMWF ecRad radiation scheme (v1.5.0) in the MAR (v3.14), regional evaluation for Belgium, and assessment of surface shortwave spectral fluxes at Uccle
Development of a fast radiative transfer model for ground-based microwave radiometers (ARMS-gb v1.0): validation and comparison to RTTOV-gb
Indian Institute of Tropical Meteorology (IITM) High-Resolution Global Forecast Model version 1: an attempt to resolve monsoon prediction deadlock
Cell-tracking-based framework for assessing nowcasting model skill in reproducing growth and decay of convective rainfall
NeuralMie (v1.0): an aerosol optics emulator
Simulation performance of planetary boundary layer schemes in WRF v4.3.1 for near-surface wind over the western Sichuan Basin: a single-site assessment
FootNet v1.0: development of a machine learning emulator of atmospheric transport
Updates and evaluation of NOAA's online-coupled air quality model version 7 (AQMv7) within the Unified Forecast System
Quantifying the analysis uncertainty for nowcasting application
Improving the ensemble square root filter (EnSRF) in the Community Inversion Framework: a case study with ICON-ART 2024.01
The MESSy DWARF (based on MESSy v2.55.2)
An enhanced emission module for the PALM model system 23.10 with application for PM10 emission from urban domestic heating
Identifying lightning processes in ERA5 soundings with deep learning
Sensitivity of predicted ultrafine particle size distributions in Europe to different nucleation rate parameterizations using PMCAMx-UF v2.2
Explaining neural networks for detection of tropical cyclones and atmospheric rivers in gridded atmospheric simulation data
PALACE v1.0: Paranal Airglow Line And Continuum Emission model
Accurate space-based NOx emission estimates with the flux divergence approach require fine-scale model information on local oxidation chemistry and profile shapes
Exploring a high-level programming model for the NWP domain using ECMWF microphysics schemes
Quantifying uncertainties in satellite NO2 superobservations for data assimilation and model evaluation
ML-AMPSIT: Machine Learning-based Automated Multi-method Parameter Sensitivity and Importance analysis Tool
Coupling the urban canopy model TEB (SURFEXv9.0) with the radiation model SPARTACUS-Urbanv0.6.1 for more realistic urban radiative exchange calculation
Forecasting contrail climate forcing for flight planning and air traffic management applications: the CocipGrid model in pycontrails 0.51.0
Simulation of the heat mitigation potential of unsealing measures in cities by parameterizing grass grid pavers for urban microclimate modelling with ENVI-met (V5)
AI-NAOS: an AI-based nonspherical aerosol optical scheme for the chemical weather model GRAPES_Meso5.1/CUACE
Orbital-Radar v1.0.0: a tool to transform suborbital radar observations to synthetic EarthCARE cloud radar data
The Modular and Integrated Data Assimilation System at Environment and Climate Change Canada (MIDAS v3.9.1)
A new set of indicators for model evaluation complementing to FAIRMODE’s MQO
Modeling of polycyclic aromatic hydrocarbons (PAHs) from global to regional scales: model development (IAP-AACM_PAH v1.0) and investigation of health risks in 2013 and 2018 in China
LIMA (v2.0): A full two-moment cloud microphysical scheme for the mesoscale non-hydrostatic model Meso-NH v5-6
SLUCM+BEM (v1.0): a simple parameterisation for dynamic anthropogenic heat and electricity consumption in WRF-Urban (v4.3.2)
NAQPMS-PDAF v2.0: a novel hybrid nonlinear data assimilation system for improved simulation of PM2.5 chemical components
Source-specific bias correction of US background and anthropogenic ozone modeled in CMAQ
Observational operator for fair model evaluation with ground NO2 measurements
Valid time shifting ensemble Kalman filter (VTS-EnKF) for dust storm forecasting
The third Met Office Unified Model-JULES Regional Atmosphere and Land Configuration, RAL3
An updated parameterization of the unstable atmospheric surface layer in the Weather Research and Forecasting (WRF) modeling system
The impact of cloud microphysics and ice nucleation on Southern Ocean clouds assessed with single-column modeling and instrument simulators
An updated aerosol simulation in the Community Earth System Model (v2.1.3): dust and marine aerosol emissions and secondary organic aerosol formation
Exploring ship track spreading rates with a physics-informed Langevin particle parameterization
Do data-driven models beat numerical models in forecasting weather extremes? A comparison of IFS HRES, Pangu-Weather, and GraphCast
Development of the MPAS-CMAQ coupled system (V1.0) for multiscale global air quality modeling
UA-ICON with NWP physics package (version: ua-icon-2.1): mean state and variability of the middle atmosphere
Assessment of object-based indices to identify convective organization
Diagnosis of winter precipitation types using Spectral Bin Model (SBM): Comparison of five methods using ICE-POP 2018 field experiment data
The Global Forest Fire Emissions Prediction System version 1.0
Impact of Multiple Radar Wind Profilers Data Assimilation on Convective Scale Short-Term Rainfall Forecasts: OSSE Studies over the Beijing-Tianjin-Hebei region
NEIVAv1.0: Next-generation Emissions InVentory expansion of Akagi et al. (2011) version 1.0
Ji Won Yoon, Seungyeon Lee, Ebony Lee, and Seon Ki Park
Geosci. Model Dev., 18, 2303–2328, https://doi.org/10.5194/gmd-18-2303-2025, https://doi.org/10.5194/gmd-18-2303-2025, 2025
Short summary
Short summary
This study evaluates the Weather Research and Forecasting Model (WRF) coupled with Chemistry (WRF-Chem) to predict a mega Asian dust storm (ADS) over South Korea on 28–29 March 2021. We assessed combinations of five dust emission and four land surface schemes by analyzing meteorological and air quality variables. The best scheme combination reduced the root mean square error (RMSE) for particulate matter 10 (PM10) by up to 29.6 %, demonstrating the highest performance.
Jianyu Lin, Tie Dai, Lifang Sheng, Weihang Zhang, Shangfei Hai, and Yawen Kong
Geosci. Model Dev., 18, 2231–2248, https://doi.org/10.5194/gmd-18-2231-2025, https://doi.org/10.5194/gmd-18-2231-2025, 2025
Short summary
Short summary
The effectiveness of this assimilation system and its sensitivity to the ensemble member size and length of the assimilation window are investigated. This study advances our understanding of the selection of basic parameters in the four-dimensional local ensemble transform Kalman filter assimilation system and the performance of ensemble simulation in a particulate-matter-polluted environment.
Jens Peter Karolus Wenceslaus Frankemölle, Johan Camps, Pieter De Meutter, and Johan Meyers
Geosci. Model Dev., 18, 1989–2003, https://doi.org/10.5194/gmd-18-1989-2025, https://doi.org/10.5194/gmd-18-1989-2025, 2025
Short summary
Short summary
To detect anomalous radioactivity in the environment, it is paramount that we understand the natural background level. In this work, we propose a statistical model to describe the most likely background level and the associated uncertainty in a network of dose rate detectors. We train, verify, and validate the model using real environmental data. Using the model, we show that we can correctly predict the background level in a subset of the detector network during a known
anomalous event.
Jean-François Grailet, Robin J. Hogan, Nicolas Ghilain, David Bolsée, Xavier Fettweis, and Marilaure Grégoire
Geosci. Model Dev., 18, 1965–1988, https://doi.org/10.5194/gmd-18-1965-2025, https://doi.org/10.5194/gmd-18-1965-2025, 2025
Short summary
Short summary
The MAR (Modèle Régional Atmosphérique) is a regional climate model used for weather forecasting and studying the climate over various regions. This paper presents an update of MAR thanks to which it can precisely decompose solar radiation, in particular in the UV (ultraviolet) and photosynthesis ranges, both being critical to human health and ecosystems. As a first application of this new capability, this paper presents a method for predicting UV indices with MAR.
Yi-Ning Shi, Jun Yang, Wei Han, Lujie Han, Jiajia Mao, Wanlin Kan, and Fuzhong Weng
Geosci. Model Dev., 18, 1947–1964, https://doi.org/10.5194/gmd-18-1947-2025, https://doi.org/10.5194/gmd-18-1947-2025, 2025
Short summary
Short summary
Direct assimilation of observations from ground-based microwave radiometers (GMRs) holds significant potential for improving forecast accuracy. Radiative transfer models (RTMs) play a crucial role in direct data assimilation. In this study, we introduce a new RTM, the Advanced Radiative Transfer Modeling System – Ground-Based (ARMS-gb), designed to simulate brightness temperatures observed by GMRs along with their Jacobians. Several enhancements have been incorporated to achieve higher accuracy.
R. Phani Murali Krishna, Siddharth Kumar, A. Gopinathan Prajeesh, Peter Bechtold, Nils Wedi, Kumar Roy, Malay Ganai, B. Revanth Reddy, Snehlata Tirkey, Tanmoy Goswami, Radhika Kanase, Sahadat Sarkar, Medha Deshpande, and Parthasarathi Mukhopadhyay
Geosci. Model Dev., 18, 1879–1894, https://doi.org/10.5194/gmd-18-1879-2025, https://doi.org/10.5194/gmd-18-1879-2025, 2025
Short summary
Short summary
The High-Resolution Global Forecast Model (HGFM) is an advanced iteration of the operational Global Forecast System (GFS) model. HGFM can produce forecasts at a spatial scale of ~6 km in tropics. It demonstrates improved accuracy in short- to medium-range weather prediction over the Indian region, with notable success in predicting extreme events. Further, the model will be entrusted to operational forecasting agencies after validation and testing.
Jenna Ritvanen, Seppo Pulkkinen, Dmitri Moisseev, and Daniele Nerini
Geosci. Model Dev., 18, 1851–1878, https://doi.org/10.5194/gmd-18-1851-2025, https://doi.org/10.5194/gmd-18-1851-2025, 2025
Short summary
Short summary
Nowcasting models struggle with the rapid evolution of heavy rain, and common verification methods are unable to describe how accurately the models predict the growth and decay of heavy rain. We propose a framework to assess model performance. In the framework, convective cells are identified and tracked in the forecasts and observations, and the model skill is then evaluated by comparing differences between forecast and observed cells. We demonstrate the framework with four open-source models.
Andrew Geiss and Po-Lun Ma
Geosci. Model Dev., 18, 1809–1827, https://doi.org/10.5194/gmd-18-1809-2025, https://doi.org/10.5194/gmd-18-1809-2025, 2025
Short summary
Short summary
Particles in the Earth's atmosphere strongly impact the planet's energy budget, and atmosphere simulations require accurate representation of their interaction with light. This work introduces two approaches to represent light scattering by small particles. The first is a scattering simulator based on Mie theory implemented in Python. The second is a neural network emulator that is more accurate than existing methods and is fast enough to be used in climate and weather simulations.
Qin Wang, Bo Zeng, Gong Chen, and Yaoting Li
Geosci. Model Dev., 18, 1769–1784, https://doi.org/10.5194/gmd-18-1769-2025, https://doi.org/10.5194/gmd-18-1769-2025, 2025
Short summary
Short summary
This study evaluates the performance of four planetary boundary layer (PBL) schemes in near-surface wind fields over the Sichuan Basin, China. Using 112 sensitivity experiments with the Weather Research and Forecasting (WRF) model and focusing on 28 wind events, it is found that wind direction was less sensitive to the PBL schemes. The quasi-normal scale elimination (QNSE) scheme captured temporal variations best, while the Mellor–Yamada–Janjić (MYJ) scheme had the least error in wind speed.
Tai-Long He, Nikhil Dadheech, Tammy M. Thompson, and Alexander J. Turner
Geosci. Model Dev., 18, 1661–1671, https://doi.org/10.5194/gmd-18-1661-2025, https://doi.org/10.5194/gmd-18-1661-2025, 2025
Short summary
Short summary
It is computationally expensive to infer greenhouse gas (GHG) emissions using atmospheric observations. This is partly due to the detailed model used to represent atmospheric transport. We demonstrate how a machine learning (ML) model can be used to simulate high-resolution atmospheric transport. This type of ML model will help estimate GHG emissions using dense observations, which are becoming increasingly common with the proliferation of urban monitoring networks and geostationary satellites.
Wei Li, Beiming Tang, Patrick C. Campbell, Youhua Tang, Barry Baker, Zachary Moon, Daniel Tong, Jianping Huang, Kai Wang, Ivanka Stajner, and Raffaele Montuoro
Geosci. Model Dev., 18, 1635–1660, https://doi.org/10.5194/gmd-18-1635-2025, https://doi.org/10.5194/gmd-18-1635-2025, 2025
Short summary
Short summary
The study describes the updates of NOAA's current UFS-AQMv7 air quality forecast model by incorporating the latest scientific and structural changes in CMAQv5.4. An evaluation during the summer of 2023 shows that the updated model overall improves the simulation of MDA8 O3 by reducing the bias by 8%–12% in the contiguous US. PM2.5 predictions have mixed results due to wildfire, highlighting the need for future refinements.
Yanwei Zhu, Aitor Atencia, Markus Dabernig, and Yong Wang
Geosci. Model Dev., 18, 1545–1559, https://doi.org/10.5194/gmd-18-1545-2025, https://doi.org/10.5194/gmd-18-1545-2025, 2025
Short summary
Short summary
Most works have delved into convective weather nowcasting, and only a few works have discussed the nowcasting uncertainty for variables at the surface level. Hence, we proposed a method to estimate uncertainty. Generating appropriate noises associated with the characteristic of the error in analysis can simulate the uncertainty of nowcasting. This method can contribute to the estimation of near–surface analysis uncertainty in both nowcasting applications and ensemble nowcasting development.
Joël Thanwerdas, Antoine Berchet, Lionel Constantin, Aki Tsuruta, Michael Steiner, Friedemann Reum, Stephan Henne, and Dominik Brunner
Geosci. Model Dev., 18, 1505–1544, https://doi.org/10.5194/gmd-18-1505-2025, https://doi.org/10.5194/gmd-18-1505-2025, 2025
Short summary
Short summary
The Community Inversion Framework (CIF) brings together methods for estimating greenhouse gas fluxes from atmospheric observations. The initial ensemble method implemented in CIF was found to be incomplete and could hardly be compared to other ensemble methods employed in the inversion community. In this paper, we present and evaluate a new implementation of the ensemble mode, building upon the initial developments.
Astrid Kerkweg, Timo Kirfel, Duong H. Do, Sabine Griessbach, Patrick Jöckel, and Domenico Taraborrelli
Geosci. Model Dev., 18, 1265–1286, https://doi.org/10.5194/gmd-18-1265-2025, https://doi.org/10.5194/gmd-18-1265-2025, 2025
Short summary
Short summary
Normally, the Modular Earth Submodel System (MESSy) is linked to complete dynamic models to create chemical climate models. However, the modular concept of MESSy and the newly developed DWARF component presented here make it possible to create simplified models that contain only one or a few process descriptions. This is very useful for technical optimisation, such as porting to GPUs, and can be used to create less complex models, such as a chemical box model.
Edward C. Chan, Ilona J. Jäkel, Basit Khan, Martijn Schaap, Timothy M. Butler, Renate Forkel, and Sabine Banzhaf
Geosci. Model Dev., 18, 1119–1139, https://doi.org/10.5194/gmd-18-1119-2025, https://doi.org/10.5194/gmd-18-1119-2025, 2025
Short summary
Short summary
An enhanced emission module has been developed for the PALM model system, improving flexibility and scalability of emission source representation across different sectors. A model for parametrized domestic emissions has also been included, for which an idealized model run is conducted for particulate matter (PM10). The results show that, in addition to individual sources and diurnal variations in energy consumption, vertical transport and urban topology play a role in concentration distribution.
Gregor Ehrensperger, Thorsten Simon, Georg J. Mayr, and Tobias Hell
Geosci. Model Dev., 18, 1141–1153, https://doi.org/10.5194/gmd-18-1141-2025, https://doi.org/10.5194/gmd-18-1141-2025, 2025
Short summary
Short summary
As lightning is a brief and localized event, it is not explicitly resolved in atmospheric models. Instead, expert-based auxiliary descriptions are used to assess it. This study explores how AI can improve our understanding of lightning without relying on traditional expert knowledge. We reveal that AI independently identified the key factors known to experts as essential for lightning in the Alps region. This shows how knowledge discovery could be sped up in areas with limited expert knowledge.
David Patoulias, Kalliopi Florou, and Spyros N. Pandis
Geosci. Model Dev., 18, 1103–1118, https://doi.org/10.5194/gmd-18-1103-2025, https://doi.org/10.5194/gmd-18-1103-2025, 2025
Short summary
Short summary
The effect of the assumed atmospheric nucleation mechanism on particle number concentrations and size distribution was investigated. Two quite different mechanisms involving sulfuric acid and ammonia or a biogenic organic vapor gave quite similar results which were consistent with measurements at 26 measurement stations across Europe. The number of larger particles that serve as cloud condensation nuclei showed little sensitivity to the assumed nucleation mechanism.
Tim Radke, Susanne Fuchs, Christian Wilms, Iuliia Polkova, and Marc Rautenhaus
Geosci. Model Dev., 18, 1017–1039, https://doi.org/10.5194/gmd-18-1017-2025, https://doi.org/10.5194/gmd-18-1017-2025, 2025
Short summary
Short summary
In our study, we built upon previous work to investigate the patterns artificial intelligence (AI) learns to detect atmospheric features like tropical cyclones (TCs) and atmospheric rivers (ARs). As primary objective, we adopt a method to explain the AI used and investigate the plausibility of learned patterns. We find that plausible patterns are learned for both TCs and ARs. Hence, the chosen method is very useful for gaining confidence in the AI-based detection of atmospheric features.
Stefan Noll, Carsten Schmidt, Patrick Hannawald, Wolfgang Kausch, and Stefan Kimeswenger
EGUsphere, https://doi.org/10.5194/egusphere-2024-3512, https://doi.org/10.5194/egusphere-2024-3512, 2025
Short summary
Short summary
Non-thermal emission from chemical reactions in the Earth's middle und upper atmosphere strongly contributes to the brightness of the night sky below about 2.3 µm. The new Paranal Airglow Line and Continuum Emission model calculates the emission spectrum and its variability with an unprecedented accuracy. Relying on a large spectroscopic data set from astronomical spectrographs and theoretical molecular/atomic data, it is valuable for airglow research and astronomical observatories.
Felipe Cifuentes, Henk Eskes, Enrico Dammers, Charlotte Bryan, and Folkert Boersma
Geosci. Model Dev., 18, 621–649, https://doi.org/10.5194/gmd-18-621-2025, https://doi.org/10.5194/gmd-18-621-2025, 2025
Short summary
Short summary
We tested the capability of the flux divergence approach (FDA) to reproduce known NOx emissions using synthetic NO2 satellite column retrievals from high-resolution model simulations. The FDA accurately reproduced NOx emissions when column observations were limited to the boundary layer and when the variability of the NO2 lifetime, the NOx : NO2 ratio, and NO2 profile shapes were correctly modeled. This introduces strong model dependency, reducing the simplicity of the original FDA formulation.
Stefano Ubbiali, Christian Kühnlein, Christoph Schär, Linda Schlemmer, Thomas C. Schulthess, Michael Staneker, and Heini Wernli
Geosci. Model Dev., 18, 529–546, https://doi.org/10.5194/gmd-18-529-2025, https://doi.org/10.5194/gmd-18-529-2025, 2025
Short summary
Short summary
We explore a high-level programming model for porting numerical weather prediction (NWP) model codes to graphics processing units (GPUs). We present a Python rewrite with the domain-specific library GT4Py (GridTools for Python) of two renowned cloud microphysics schemes and the associated tangent-linear and adjoint algorithms. We find excellent portability, competitive GPU performance, robust execution on diverse computing architectures, and enhanced code maintainability and user productivity.
Pieter Rijsdijk, Henk Eskes, Arlene Dingemans, K. Folkert Boersma, Takashi Sekiya, Kazuyuki Miyazaki, and Sander Houweling
Geosci. Model Dev., 18, 483–509, https://doi.org/10.5194/gmd-18-483-2025, https://doi.org/10.5194/gmd-18-483-2025, 2025
Short summary
Short summary
Clustering high-resolution satellite observations into superobservations improves model validation and data assimilation applications. In our paper, we derive quantitative uncertainties for satellite NO2 column observations based on knowledge of the retrievals, including a detailed analysis of spatial error correlations and representativity errors. The superobservations and uncertainty estimates are tested in a global chemical data assimilation system and are found to improve the forecasts.
Dario Di Santo, Cenlin He, Fei Chen, and Lorenzo Giovannini
Geosci. Model Dev., 18, 433–459, https://doi.org/10.5194/gmd-18-433-2025, https://doi.org/10.5194/gmd-18-433-2025, 2025
Short summary
Short summary
This paper presents the Machine Learning-based Automated Multi-method Parameter Sensitivity and Importance analysis Tool (ML-AMPSIT), a computationally efficient tool that uses machine learning algorithms for sensitivity analysis in atmospheric models. It is tested with the Weather Research and Forecasting (WRF) model coupled with the Noah-Multiparameterization (Noah-MP) land surface model to investigate sea breeze circulation sensitivity to vegetation-related parameters.
Robert Schoetter, Robin James Hogan, Cyril Caliot, and Valéry Masson
Geosci. Model Dev., 18, 405–431, https://doi.org/10.5194/gmd-18-405-2025, https://doi.org/10.5194/gmd-18-405-2025, 2025
Short summary
Short summary
Radiation is relevant to the atmospheric impact on people and infrastructure in cities as it can influence the urban heat island, building energy consumption, and human thermal comfort. A new urban radiation model, assuming a more realistic form of urban morphology, is coupled to the urban climate model Town Energy Balance (TEB). The new TEB is evaluated with a reference radiation model for a variety of urban morphologies, and an improvement in the simulated radiative observables is found.
Zebediah Engberg, Roger Teoh, Tristan Abbott, Thomas Dean, Marc E. J. Stettler, and Marc L. Shapiro
Geosci. Model Dev., 18, 253–286, https://doi.org/10.5194/gmd-18-253-2025, https://doi.org/10.5194/gmd-18-253-2025, 2025
Short summary
Short summary
Contrails forming in some atmospheric conditions may persist and become strongly warming cirrus, while in other conditions may be neutral or cooling. We develop a contrail forecast model to predict contrail climate forcing for any arbitrary point in space and time and explore integration into flight planning and air traffic management. This approach enables contrail interventions to target high-probability high-climate-impact regions and reduce unintended consequences of contrail management.
Nils Eingrüber, Alina Domm, Wolfgang Korres, and Karl Schneider
Geosci. Model Dev., 18, 141–160, https://doi.org/10.5194/gmd-18-141-2025, https://doi.org/10.5194/gmd-18-141-2025, 2025
Short summary
Short summary
Climate change adaptation measures like unsealings can reduce urban heat stress. As grass grid pavers have never been parameterized for microclimate model simulations with ENVI-met, a new parameterization was developed based on field measurements. To analyse the cooling potential, scenario analyses were performed for a densely developed area in Cologne. Statistically significant average cooling effects of up to −11.1 K were found for surface temperature and up to −2.9 K for 1 m air temperature.
Xuan Wang, Lei Bi, Hong Wang, Yaqiang Wang, Wei Han, Xueshun Shen, and Xiaoye Zhang
Geosci. Model Dev., 18, 117–139, https://doi.org/10.5194/gmd-18-117-2025, https://doi.org/10.5194/gmd-18-117-2025, 2025
Short summary
Short summary
The Artificial-Intelligence-based Nonspherical Aerosol Optical Scheme (AI-NAOS) was developed to improve the estimation of the aerosol direct radiation effect and was coupled online with a chemical weather model. The AI-NAOS scheme considers black carbon as fractal aggregates and soil dust as super-spheroids, encapsulated with hygroscopic aerosols. Real-case simulations emphasize the necessity of accurately representing nonspherical and inhomogeneous aerosols in chemical weather models.
Lukas Pfitzenmaier, Pavlos Kollias, Nils Risse, Imke Schirmacher, Bernat Puigdomenech Treserras, and Katia Lamer
Geosci. Model Dev., 18, 101–115, https://doi.org/10.5194/gmd-18-101-2025, https://doi.org/10.5194/gmd-18-101-2025, 2025
Short summary
Short summary
The Python tool Orbital-Radar transfers suborbital radar data (ground-based, airborne, and forward-simulated numerical weather prediction model) into synthetic spaceborne cloud profiling radar data, mimicking platform-specific instrument characteristics, e.g. EarthCARE or CloudSat. The tool's novelty lies in simulating characteristic errors and instrument noise. Thus, existing data sets are transferred into synthetic observations and can be used for satellite calibration–validation studies.
Mark Buehner, Jean-Francois Caron, Ervig Lapalme, Alain Caya, Ping Du, Yves Rochon, Sergey Skachko, Maziar Bani Shahabadi, Sylvain Heilliette, Martin Deshaies-Jacques, Weiguang Chang, and Michael Sitwell
Geosci. Model Dev., 18, 1–18, https://doi.org/10.5194/gmd-18-1-2025, https://doi.org/10.5194/gmd-18-1-2025, 2025
Short summary
Short summary
The Modular and Integrated Data Assimilation System (MIDAS) software is described. The flexible design of MIDAS enables both deterministic and ensemble prediction applications for the atmosphere and several other Earth system components. It is currently used for all main operational weather prediction systems in Canada and also for sea ice and sea surface temperature analysis. The use of MIDAS for multiple Earth system components will facilitate future research on coupled data assimilation.
Alexander de Meij, Cornelis Cuvelier, Philippe Thunis, and Enrico Pisoni
EGUsphere, https://doi.org/10.5194/egusphere-2024-3690, https://doi.org/10.5194/egusphere-2024-3690, 2025
Short summary
Short summary
We assess the relevance and utility indicators developed within FAIRMODE by evaluating 9 CAMS models in calculated air pollutant values. For NO2, the results highlight difficulties at traffic stations. For PM2.5 and PM10 the bias and Winter-Summer gradients reveal issues. O3 evaluation shows that e.g. seasonal gradients are useful. Overall, the indicators provide valuable insights into model limitations, yet there is a need to reconsider the strictness of some indicators for certain pollutants.
Zichen Wu, Xueshun Chen, Zifa Wang, Huansheng Chen, Zhe Wang, Qing Mu, Lin Wu, Wending Wang, Xiao Tang, Jie Li, Ying Li, Qizhong Wu, Yang Wang, Zhiyin Zou, and Zijian Jiang
Geosci. Model Dev., 17, 8885–8907, https://doi.org/10.5194/gmd-17-8885-2024, https://doi.org/10.5194/gmd-17-8885-2024, 2024
Short summary
Short summary
We developed a model to simulate polycyclic aromatic hydrocarbons (PAHs) from global to regional scales. The model can reproduce PAH distribution well. The concentration of BaP (indicator species for PAHs) could exceed the target values of 1 ng m-3 over some areas (e.g., in central Europe, India, and eastern China). The change in BaP is lower than that in PM2.5 from 2013 to 2018. China still faces significant potential health risks posed by BaP although the Action Plan has been implemented.
Marie Taufour, Jean-Pierre Pinty, Christelle Barthe, Benoît Vié, and Chien Wang
Geosci. Model Dev., 17, 8773–8798, https://doi.org/10.5194/gmd-17-8773-2024, https://doi.org/10.5194/gmd-17-8773-2024, 2024
Short summary
Short summary
We have developed a complete two-moment version of the LIMA (Liquid Ice Multiple Aerosols) microphysics scheme. We have focused on collection processes, where the hydrometeor number transfer is often estimated in proportion to the mass transfer. The impact of these parameterizations on a convective system and the prospects for more realistic estimates of secondary parameters (reflectivity, hydrometeor size) are shown in a first test on an idealized case.
Yuya Takane, Yukihiro Kikegawa, Ko Nakajima, and Hiroyuki Kusaka
Geosci. Model Dev., 17, 8639–8664, https://doi.org/10.5194/gmd-17-8639-2024, https://doi.org/10.5194/gmd-17-8639-2024, 2024
Short summary
Short summary
A new parameterisation for dynamic anthropogenic heat and electricity consumption is described. The model reproduced the temporal variation in and spatial distributions of electricity consumption and temperature well in summer and winter. The partial air conditioning was the most critical factor, significantly affecting the value of anthropogenic heat emission.
Hongyi Li, Ting Yang, Lars Nerger, Dawei Zhang, Di Zhang, Guigang Tang, Haibo Wang, Yele Sun, Pingqing Fu, Hang Su, and Zifa Wang
Geosci. Model Dev., 17, 8495–8519, https://doi.org/10.5194/gmd-17-8495-2024, https://doi.org/10.5194/gmd-17-8495-2024, 2024
Short summary
Short summary
To accurately characterize the spatiotemporal distribution of particulate matter <2.5 µm chemical components, we developed the Nested Air Quality Prediction Model System with the Parallel Data Assimilation Framework (NAQPMS-PDAF) v2.0 for chemical components with non-Gaussian and nonlinear properties. NAQPMS-PDAF v2.0 has better computing efficiency, excels when used with a small ensemble size, and can significantly improve the simulation performance of chemical components.
T. Nash Skipper, Christian Hogrefe, Barron H. Henderson, Rohit Mathur, Kristen M. Foley, and Armistead G. Russell
Geosci. Model Dev., 17, 8373–8397, https://doi.org/10.5194/gmd-17-8373-2024, https://doi.org/10.5194/gmd-17-8373-2024, 2024
Short summary
Short summary
Chemical transport model simulations are combined with ozone observations to estimate the bias in ozone attributable to US anthropogenic sources and individual sources of US background ozone: natural sources, non-US anthropogenic sources, and stratospheric ozone. Results indicate a positive bias correlated with US anthropogenic emissions during summer in the eastern US and a negative bias correlated with stratospheric ozone during spring.
Li Fang, Jianbing Jin, Arjo Segers, Ke Li, Ji Xia, Wei Han, Baojie Li, Hai Xiang Lin, Lei Zhu, Song Liu, and Hong Liao
Geosci. Model Dev., 17, 8267–8282, https://doi.org/10.5194/gmd-17-8267-2024, https://doi.org/10.5194/gmd-17-8267-2024, 2024
Short summary
Short summary
Model evaluations against ground observations are usually unfair. The former simulates mean status over coarse grids and the latter the surrounding atmosphere. To solve this, we proposed the new land-use-based representative (LUBR) operator that considers intra-grid variance. The LUBR operator is validated to provide insights that align with satellite measurements. The results highlight the importance of considering fine-scale urban–rural differences when comparing models and observation.
Mijie Pang, Jianbing Jin, Arjo Segers, Huiya Jiang, Wei Han, Batjargal Buyantogtokh, Ji Xia, Li Fang, Jiandong Li, Hai Xiang Lin, and Hong Liao
Geosci. Model Dev., 17, 8223–8242, https://doi.org/10.5194/gmd-17-8223-2024, https://doi.org/10.5194/gmd-17-8223-2024, 2024
Short summary
Short summary
The ensemble Kalman filter (EnKF) improves dust storm forecasts but faces challenges with position errors. The valid time shifting EnKF (VTS-EnKF) addresses this by adjusting for position errors, enhancing accuracy in forecasting dust storms, as proven in tests on 2021 events, even with smaller ensembles and time intervals.
Mike Bush, David L. A. Flack, Huw W. Lewis, Sylvia I. Bohnenstengel, Chris J. Short, Charmaine Franklin, Adrian P. Lock, Martin Best, Paul Field, Anne McCabe, Kwinten Van Weverberg, Segolene Berthou, Ian Boutle, Jennifer K. Brooke, Seb Cole, Shaun Cooper, Gareth Dow, John Edwards, Anke Finnenkoetter, Kalli Furtado, Kate Halladay, Kirsty Hanley, Margaret A. Hendry, Adrian Hill, Aravindakshan Jayakumar, Richard W. Jones, Humphrey Lean, Joshua C. K. Lee, Andy Malcolm, Marion Mittermaier, Saji Mohandas, Stuart Moore, Cyril Morcrette, Rachel North, Aurore Porson, Susan Rennie, Nigel Roberts, Belinda Roux, Claudio Sanchez, Chun-Hsu Su, Simon Tucker, Simon Vosper, David Walters, James Warner, Stuart Webster, Mark Weeks, Jonathan Wilkinson, Michael Whitall, Keith D. Williams, and Hugh Zhang
Geosci. Model Dev. Discuss., https://doi.org/10.5194/gmd-2024-201, https://doi.org/10.5194/gmd-2024-201, 2024
Revised manuscript accepted for GMD
Short summary
Short summary
RAL configurations define settings for the Unified Model atmosphere and Joint UK Land Environment Simulator. The third version of the Regional Atmosphere and Land (RAL3) science configuration for kilometre and sub-km scale modelling represents a major advance compared to previous versions (RAL2) by delivering a common science definition for applications in tropical and mid-latitude regions. RAL3 has more realistic precipitation distributions and improved representation of clouds and visibility.
Prabhakar Namdev, Maithili Sharan, Piyush Srivastava, and Saroj Kanta Mishra
Geosci. Model Dev., 17, 8093–8114, https://doi.org/10.5194/gmd-17-8093-2024, https://doi.org/10.5194/gmd-17-8093-2024, 2024
Short summary
Short summary
Inadequate representation of surface–atmosphere interaction processes is a major source of uncertainty in numerical weather prediction models. Here, an effort has been made to improve the Weather Research and Forecasting (WRF) model version 4.2.2 by introducing a unique theoretical framework under convective conditions. In addition, to enhance the potential applicability of the WRF modeling system, various commonly used similarity functions under convective conditions have also been installed.
Andrew Gettelman, Richard Forbes, Roger Marchand, Chih-Chieh Chen, and Mark Fielding
Geosci. Model Dev., 17, 8069–8092, https://doi.org/10.5194/gmd-17-8069-2024, https://doi.org/10.5194/gmd-17-8069-2024, 2024
Short summary
Short summary
Supercooled liquid clouds (liquid clouds colder than 0°C) are common at higher latitudes (especially over the Southern Ocean) and are critical for constraining climate projections. We compare a single-column version of a weather model to observations with two different cloud schemes and find that both the dynamical environment and atmospheric aerosols are important for reproducing observations.
Yujuan Wang, Peng Zhang, Jie Li, Yaman Liu, Yanxu Zhang, Jiawei Li, and Zhiwei Han
Geosci. Model Dev., 17, 7995–8021, https://doi.org/10.5194/gmd-17-7995-2024, https://doi.org/10.5194/gmd-17-7995-2024, 2024
Short summary
Short summary
This study updates the CESM's aerosol schemes, focusing on dust, marine aerosol emissions, and secondary organic aerosol (SOA) . Dust emission modifications make deflation areas more continuous, improving results in North America and the sub-Arctic. Humidity correction to sea-salt emissions has a minor effect. Introducing marine organic aerosol emissions, coupled with ocean biogeochemical processes, and adding aqueous reactions for SOA formation advance the CESM's aerosol modelling results.
Lucas A. McMichael, Michael J. Schmidt, Robert Wood, Peter N. Blossey, and Lekha Patel
Geosci. Model Dev., 17, 7867–7888, https://doi.org/10.5194/gmd-17-7867-2024, https://doi.org/10.5194/gmd-17-7867-2024, 2024
Short summary
Short summary
Marine cloud brightening (MCB) is a climate intervention technique to potentially cool the climate. Climate models used to gauge regional climate impacts associated with MCB often assume large areas of the ocean are uniformly perturbed. However, a more realistic representation of MCB application would require information about how an injected particle plume spreads. This work aims to develop such a plume-spreading model.
Leonardo Olivetti and Gabriele Messori
Geosci. Model Dev., 17, 7915–7962, https://doi.org/10.5194/gmd-17-7915-2024, https://doi.org/10.5194/gmd-17-7915-2024, 2024
Short summary
Short summary
Data-driven models are becoming a viable alternative to physics-based models for weather forecasting up to 15 d into the future. However, it is unclear whether they are as reliable as physics-based models when forecasting weather extremes. We evaluate their performance in forecasting near-surface cold, hot, and windy extremes globally. We find that data-driven models can compete with physics-based models and that the choice of the best model mainly depends on the region and type of extreme.
David C. Wong, Jeff Willison, Jonathan E. Pleim, Golam Sarwar, James Beidler, Russ Bullock, Jerold A. Herwehe, Rob Gilliam, Daiwen Kang, Christian Hogrefe, George Pouliot, and Hosein Foroutan
Geosci. Model Dev., 17, 7855–7866, https://doi.org/10.5194/gmd-17-7855-2024, https://doi.org/10.5194/gmd-17-7855-2024, 2024
Short summary
Short summary
This work describe how we linked the meteorological Model for Prediction Across Scales – Atmosphere (MPAS-A) with the Community Multiscale Air Quality (CMAQ) air quality model to form a coupled modelling system. This could be used to study air quality or climate and air quality interaction at a global scale. This new model scales well in high-performance computing environments and performs well with respect to ground surface networks in terms of ozone and PM2.5.
Markus Kunze, Christoph Zülicke, Tarique Adnan Siddiqui, Claudia Christine Stephan, Yosuke Yamazaki, Claudia Stolle, Sebastian Borchert, and Hauke Schmidt
Geosci. Model Dev. Discuss., https://doi.org/10.5194/gmd-2024-191, https://doi.org/10.5194/gmd-2024-191, 2024
Revised manuscript accepted for GMD
Short summary
Short summary
We present the Icosahedral Nonhydrostatic (ICON) general circulation model with upper atmosphere extension with the physics package for numerical weather prediction (UA-ICON(NWP)). The parameters for the gravity wave parameterizations were optimized, and realistic modelling of the thermal and dynamic state of the mesopause regions was achieved. UA-ICON(NWP) now shows a realistic frequency of major sudden stratospheric warmings and well-represented solar tides in temperature.
Giulio Mandorli and Claudia J. Stubenrauch
Geosci. Model Dev., 17, 7795–7813, https://doi.org/10.5194/gmd-17-7795-2024, https://doi.org/10.5194/gmd-17-7795-2024, 2024
Short summary
Short summary
In recent years, several studies focused their attention on the disposition of convection. Lots of methods, called indices, have been developed to quantify the amount of convection clustering. These indices are evaluated in this study by defining criteria that must be satisfied and then evaluating the indices against these standards. None of the indices meet all criteria, with some only partially meeting them.
Wonbae Bang, Jacob Carlin, Kwonil Kim, Alexander Ryzhkov, Guosheng Liu, and Gyuwon Lee
Geosci. Model Dev. Discuss., https://doi.org/10.5194/gmd-2024-179, https://doi.org/10.5194/gmd-2024-179, 2024
Revised manuscript accepted for GMD
Short summary
Short summary
Microphysics model-based diagnosis such as the spectral bin model (SBM) recently has been attempted to diagnose winter precipitation types. In this study, the accuracy of SBM-based precipitation type diagnosis is compared with other traditional methods. SBM have relatively higher accuracy about snow and wetsnow events whereas lower accuracy about rain event. When microphysics scheme in the SBM was optimized for the corresponding region, accuracy about rain events was improved.
Kerry Anderson, Jack Chen, Peter Englefield, Debora Griffin, Paul A. Makar, and Dan Thompson
Geosci. Model Dev., 17, 7713–7749, https://doi.org/10.5194/gmd-17-7713-2024, https://doi.org/10.5194/gmd-17-7713-2024, 2024
Short summary
Short summary
The Global Forest Fire Emissions Prediction System (GFFEPS) is a model that predicts smoke and carbon emissions from wildland fires. The model calculates emissions from the ground up based on satellite-detected fires, modelled weather and fire characteristics. Unlike other global models, GFFEPS uses daily weather conditions to capture changing burning conditions on a day-to-day basis. GFFEPS produced lower carbon emissions due to the changing weather not captured by the other models.
Juan Zhao, Jianping Guo, and Xiaohui Zheng
Geosci. Model Dev. Discuss., https://doi.org/10.5194/gmd-2024-194, https://doi.org/10.5194/gmd-2024-194, 2024
Revised manuscript accepted for GMD
Short summary
Short summary
A series of observing system simulation experiments are conducted to assess the impact of multiple radar wind profiler (RWP) networks on convective scale numerical weather prediction. Results from three southwest-type heavy rainfall cases in the Beijing-Tianjin-Hebei region suggest the added forecast skill of ridge and foothill networks associated with the Taihang Mountains over the existing RWP network. This research provides valuable guidance for designing optimal RWP networks in the region.
Samiha Binte Shahid, Forrest G. Lacey, Christine Wiedinmyer, Robert J. Yokelson, and Kelley C. Barsanti
Geosci. Model Dev., 17, 7679–7711, https://doi.org/10.5194/gmd-17-7679-2024, https://doi.org/10.5194/gmd-17-7679-2024, 2024
Short summary
Short summary
The Next-generation Emissions InVentory expansion of Akagi (NEIVA) v.1.0 is a comprehensive biomass burning emissions database that allows integration of new data and flexible querying. Data are stored in connected datasets, including recommended averages of ~1500 constituents for 14 globally relevant fire types. Individual compounds were mapped to common model species to allow better attribution of emissions in modeling studies that predict the effects of fires on air quality and climate.
Cited articles
Adani, M., Piersanti, A., Ciancarella, L., D'Isidoro, M., Villani, M. G., and Vitali, L.: Preliminary Tests on the Sensitivity of the FORAIR_IT Air Quality Forecasting System to Different Meteorological Drivers, Atmosphere, 11, 574, https://doi.org/10.3390/atmos11060574, 2020.
Adani, M., D'Isidoro, M., Mircea, M., Guarnieri, G., Vitali, L., D'Elia, I., Ciancarella, L., Gualtieri, M., Briganti, G., Cappelletti, A., Piersanti, A., Stracquadanio, M., Righini, G., Russo, F., Cremona, G., Villani, M. G., and Zanini, G.: Evaluation of air quality forecasting system FORAIR-IT over Europe and Italy at high resolution for year 2017, Atmos. Pollut. Res., 13, 101456, https://doi.org/10.1016/j.apr.2022.101456, 2022.
Agarwal, S., Sharma, S., R., S., Rahman, M. H., Vranckx, S., Maiheu, B., Blyth, L., Janssen, S., Gargava, P., Shukla, V. K., and Batra, S.: Air quality forecasting using artificial neural networks with real time dynamic error correction in highly polluted regions, Sci. Total Environ., 735, 139454, https://doi.org/10.1016/j.scitotenv.2020.139454, 2020.
Alfaro, S. C. and Gomes, L.: Modeling mineral aerosol production by wind erosion: Emission intensities and aerosol size distributions in source areas, J. Geophys. Res.-Atmos., 106, 18075–18084, https://doi.org/10.1029/2000JD900339, 2001.
Bai, L., Wang, J., Ma, X., and Lu, H.: Air Pollution Forecasts: An Overview, Int. J. Environ. Res. Publ. He., 15, 780, https://doi.org/10.3390/ijerph15040780, 2018.
Baklanov, A. and Zhang, Y.: Advances in air quality modeling and forecasting, Glob. Transit., 2, 261–270, https://doi.org/10.1016/j.glt.2020.11.001, 2020.
Baklanov, A., Schlünzen, K., Suppan, P., Baldasano, J., Brunner, D., Aksoyoglu, S., Carmichael, G., Douros, J., Flemming, J., Forkel, R., Galmarini, S., Gauss, M., Grell, G., Hirtl, M., Joffre, S., Jorba, O., Kaas, E., Kaasik, M., Kallos, G., Kong, X., Korsholm, U., Kurganskiy, A., Kushta, J., Lohmann, U., Mahura, A., Manders-Groot, A., Maurizi, A., Moussiopoulos, N., Rao, S. T., Savage, N., Seigneur, C., Sokhi, R. S., Solazzo, E., Solomos, S., Sørensen, B., Tsegas, G., Vignati, E., Vogel, B., and Zhang, Y.: Online coupled regional meteorology chemistry models in Europe: current status and prospects, Atmos. Chem. Phys., 14, 317–398, https://doi.org/10.5194/acp-14-317-2014, 2014.
Baldauf, M., Seifert, A., Förstner, J., Majewski, D., Raschendorfer, M., and Reinhardt, T.: Operational Convective-Scale Numerical Weather Prediction with the COSMO Model: Description and Sensitivities, Mon. Weather Rev., 139, 3887–3905, https://doi.org/10.1175/MWR-D-10-05013.1, 2011.
Borrego, C., Monteiro, A., Ferreira, J., Miranda, A. I., Costa, A. M., Carvalho, A. C., and Lopes, M.: Procedures for estimation of modelling uncertainty in air quality assessment, Environ. Int., 34, 613–620, https://doi.org/10.1016/j.envint.2007.12.005, 2008.
Boylan, J. W. and Russell, A. G.: PM and light extinction model performance metrics, goals, and criteria for three-dimensional air quality models, Atmos. Environ., 40, 4946–4959, https://doi.org/10.1016/j.atmosenv.2005.09.087, 2006.
Cabaneros, S. M., Calautit, J. K., and Hughes, B. R.: A review of artificial neural network models for ambient air pollution prediction, Environ. Model. Softw., 119, 285–304, https://doi.org/10.1016/j.envsoft.2019.06.014, 2019.
Carnevale, C., Finzi, G., Pederzoli, A., Pisoni, E., Thunis, P., Turrini, E., and Volta, M.: A methodology for the evaluation of re-analyzed PM10 concentration fields: a case study over the PO Valley, Air Qual. Atmos. Health, 8, 533–544, https://doi.org/10.1007/s11869-014-0307-2, 2015.
Chang, J. C. and Hanna, S. R.: Air quality model performance evaluation, Meteorol. Atmos. Phys., 87, 167–196, https://doi.org/10.1007/s00703-003-0070-7, 2004.
Chemel, C., Sokhi, R. S., Yu, Y., Hayman, G. D., Vincent, K. J., Dore, A. J., Tang, Y. S., Prain, H. D., and Fisher, B. E. A.: Evaluation of a CMAQ simulation at high resolution over the UK for the calendar year 2003, Atmos. Environ., 44, 2927–2939, https://doi.org/10.1016/j.atmosenv.2010.03.029, 2010.
D'Elia, I., Briganti, G., Vitali, L., Piersanti, A., Righini, G., D'Isidoro, M., Cappelletti, A., Mircea, M., Adani, M., Zanini, G., and Ciancarella, L.: Measured and modelled air quality trends in Italy over the period 2003–2010, Atmos. Chem. Phys., 21, 10825–10849, https://doi.org/10.5194/acp-21-10825-2021, 2021.
Dennis, R., Fox, T., Fuentes, M., Gilliland, A., Hanna, S., Hogrefe, C., Irwin, J., Rao, S. T., Scheffe, R., Schere, K., Steyn, D., and Venkatram, A.: A framework for evaluating regional-scale numerical photochemical modeling systems, Environ. Fluid Mech., 10, 471–489, https://doi.org/10.1007/s10652-009-9163-2, 2010.
Doms, G. and Baldauf, M.: A Description of the Non Hydrostatic Regional COSMO-Model. Part I: Dynamics and Numeric. User Guide Documentation, http://www.cosmo-model.org (last access: 20 October 2023), 2018.
Eder, B., Kang, D., Rao, S. T., Mathur, R., Yu, S., Otte, T., Schere, K., Wayland, R., Jackson, S., Davidson, P., McQueen, J., and Bridgers, G.: Using National Air Quality Forecast Guidance to Develop Local Air Quality Index Forecasts, B. Am. Meteorol. Soc., 91, 313–326, https://doi.org/10.1175/2009BAMS2734.1, 2010.
Emery, C., Liu, Z., Russell, A. G., Odman, M. T., Yarwood, G., and Kumar, N.: Recommendations on statistics and benchmarks to assess photochemical model performance, J. Air Waste Manag. Assoc., 67, 582–598, https://doi.org/10.1080/10962247.2016.1265027, 2017.
EPA: Guidelines for Developing an Air Quality (Ozone and PM2.5) Forecasting Program, EPA-456/R-03-002 June 2003, 2003.
European Union: Directive 2004/107/EC of the European Parliament and of the Council of 15 December 2004 relating to arsenic, cadmium, mercury, nickel and polycyclic aromatic hydrocarbons in ambient air, 2004.
European Union: Directive 2008/50/EC of the European Parliament and of the Council of 21 May 2008 on ambient air quality and cleaner air for Europe, OJ L, 152, 2008.
European Union: Proposal for a DIRECTIVE OF THE EUROPEAN PARLIAMENT AND OF THE COUNCIL on ambient air quality and cleaner air for Europe (recast), 2022.
Georgieva, E., Syrakov, D., Prodanova, M., Etropolska, I., and Slavov, K.: Evaluating the performance of WRF-CMAQ air quality modelling system in Bulgaria by means of the DELTA tool, Int. J. Environ. Pollut., 57, 272–284, https://doi.org/10.1504/IJEP.2015.074512, 2015.
Ginoux, P., Chin, M., Tegen, I., Prospero, J. M., Holben, B., Dubovik, O., and Lin, S.-J.: Sources and distributions of dust aerosols simulated with the GOCART model, J. Geophys. Res.-Atmos., 106, 20255–20273, https://doi.org/10.1029/2000JD000053, 2001.
Guenther, A., Karl, T., Harley, P., Wiedinmyer, C., Palmer, P. I., and Geron, C.: Estimates of global terrestrial isoprene emissions using MEGAN (Model of Emissions of Gases and Aerosols from Nature), Atmos. Chem. Phys., 6, 3181–3210, https://doi.org/10.5194/acp-6-3181-2006, 2006.
Hanna, S. R. and Chang, J.: Setting Acceptance Criteria for Air Quality Models, in: Air Pollution Modeling and its Application XXI, Dordrecht, 479–484, https://doi.org/10.1007/978-94-007-1359-8_80, 2012.
Hintze, J. L. and Nelson, R. D.: Violin Plots: A Box Plot-Density Trace Synergism, Am. Stat., 52, 181–184, https://doi.org/10.1080/00031305.1998.10480559, 1998.
Hooyberghs, J., Mensink, C., Dumont, G., Fierens, F., and Brasseur, O.: A neural network forecast for daily average PM10 concentrations in Belgium, Atmos. Environ., 39, 3279–3289, https://doi.org/10.1016/j.atmosenv.2005.01.050, 2005.
Janssen, S. and Thunis, P.: FAIRMODE Guidance Document on Modelling Quality Objectives and Benchmarking (version 3.3), EUR 31068 EN, Publications Office of the European Union, Luxembourg, 2022, JRC129254, ISBN 978-92-76-52425-0, https://doi.org/10.2760/41988, 2022.
Janssen, S., Dumont, G., Fierens, F., and Mensink, C.: Spatial interpolation of air pollution measurements using CORINE land cover data, Atmos. Environ., 42, 4884–4903, https://doi.org/10.1016/j.atmosenv.2008.02.043, 2008.
Kang, D., Eder, B. K., Stein, A. F., Grell, G. A., Peckham, S. E., and McHenry, J.: The New England Air Quality Forecasting Pilot Program: Development of an Evaluation Protocol and Performance Benchmark, J. Air Waste Manag. Assoc., 55, 1782–1796, https://doi.org/10.1080/10473289.2005.10464775, 2005.
Kingma, D. P. and Ba, J.: Adam: A Method for Stochastic Optimization, arXiv preprint arXiv:1412.6980, https://doi.org/10.48550/arXiv.1412.6980, 2014.
Knaff, J. A. and Landsea, C. W.: An El Niño–Southern Oscillation Climatology and Persistence (CLIPER) Forecasting Scheme, Weather Forecast., 12, 633–652, https://doi.org/10.1175/1520-0434(1997)012<0633:AENOSO>2.0.CO;2, 1997.
Kukkonen, J., Olsson, T., Schultz, D. M., Baklanov, A., Klein, T., Miranda, A. I., Monteiro, A., Hirtl, M., Tarvainen, V., Boy, M., Peuch, V.-H., Poupkou, A., Kioutsioukis, I., Finardi, S., Sofiev, M., Sokhi, R., Lehtinen, K. E. J., Karatzas, K., San José, R., Astitha, M., Kallos, G., Schaap, M., Reimer, E., Jakobs, H., and Eben, K.: A review of operational, regional-scale, chemical weather forecasting models in Europe, Atmos. Chem. Phys., 12, 1–87, https://doi.org/10.5194/acp-12-1-2012, 2012.
Kushta, J., Georgiou, G. K., Proestos, Y., Christoudias, T., Thunis, P., Savvides, C., Papadopoulos, C., and Lelieveld, J.: Evaluation of EU air quality standards through modeling and the FAIRMODE benchmarking methodology, Air Qual. Atmos. Health, 12, 73–86, https://doi.org/10.1007/s11869-018-0631-z, 2019.
Mailler, S., Menut, L., Khvorostyanov, D., Valari, M., Couvidat, F., Siour, G., Turquety, S., Briant, R., Tuccella, P., Bessagnet, B., Colette, A., Létinois, L., Markakis, K., and Meleux, F.: CHIMERE-2017: from urban to hemispheric chemistry-transport modeling, Geosci. Model Dev., 10, 2397–2423, https://doi.org/10.5194/gmd-10-2397-2017, 2017.
Marécal, V., Peuch, V.-H., Andersson, C., Andersson, S., Arteta, J., Beekmann, M., Benedictow, A., Bergström, R., Bessagnet, B., Cansado, A., Chéroux, F., Colette, A., Coman, A., Curier, R. L., Denier van der Gon, H. A. C., Drouin, A., Elbern, H., Emili, E., Engelen, R. J., Eskes, H. J., Foret, G., Friese, E., Gauss, M., Giannaros, C., Guth, J., Joly, M., Jaumouillé, E., Josse, B., Kadygrov, N., Kaiser, J. W., Krajsek, K., Kuenen, J., Kumar, U., Liora, N., Lopez, E., Malherbe, L., Martinez, I., Melas, D., Meleux, F., Menut, L., Moinat, P., Morales, T., Parmentier, J., Piacentini, A., Plu, M., Poupkou, A., Queguiner, S., Robertson, L., Rouïl, L., Schaap, M., Segers, A., Sofiev, M., Tarasson, L., Thomas, M., Timmermans, R., Valdebenito, Á., van Velthoven, P., van Versendaal, R., Vira, J., and Ung, A.: A regional air quality forecasting system over Europe: the MACC-II daily ensemble production, Geosci. Model Dev., 8, 2777–2813, https://doi.org/10.5194/gmd-8-2777-2015, 2015.
Marongiu, A., Angelino, E., Moretti, M., Malvestiti, G., and Fossati, G.: Atmospheric Emission Sources in the Po-Basin from the LIFE-IP PREPAIR Project, Open J. Air Pollut., 11, 70–83, https://doi.org/10.4236/ojap.2022.113006, 2022.
Masood, A. and Ahmad, K.: A review on emerging artificial intelligence (AI) techniques for air pollution forecasting: Fundamentals, application and performance, J. Clean. Prod., 322, 129072, https://doi.org/10.1016/j.jclepro.2021.129072, 2021.
Menut, L., Bessagnet, B., Khvorostyanov, D., Beekmann, M., Blond, N., Colette, A., Coll, I., Curci, G., Foret, G., Hodzic, A., Mailler, S., Meleux, F., Monge, J.-L., Pison, I., Siour, G., Turquety, S., Valari, M., Vautard, R., and Vivanco, M. G.: CHIMERE 2013: a model for regional atmospheric composition modelling, Geosci. Model Dev., 6, 981–1028, https://doi.org/10.5194/gmd-6-981-2013, 2013.
Mircea, M., Ciancarella, L., Briganti, G., Calori, G., Cappelletti, A., Cionni, I., Costa, M., Cremona, G., D'Isidoro, M., Finardi, S., Pace, G., Piersanti, A., Righini, G., Silibello, C., Vitali, L., and Zanini, G.: Assessment of the AMS-MINNI system capabilities to simulate air quality over Italy for the calendar year 2005, Atmos. Environ., 84, 178–188, https://doi.org/10.1016/j.atmosenv.2013.11.006, 2014.
Mittermaier, M. P.: The Potential Impact of Using Persistence as a Reference Forecast on Perceived Forecast Skill, Weather Forecast., 23, 1022–1031, https://doi.org/10.1175/2008WAF2007037.1, 2008.
Monteiro, A., Lopes, M., Miranda, A. I., Borrego, C., and Robert Vautard: Air pollution forecast in Portugal: a demand from the new air quality framework directive, Int. J. Environ. Pollut., 25, 4–15, https://doi.org/10.1504/IJEP.2005.007650, 2005.
Monteiro, A., Miranda, A. I., Borrego, C., and Vautard, R.: Air quality assessment for Portugal, Sci. Total Environ., 373, 22–31, https://doi.org/10.1016/j.scitotenv.2006.10.014, 2007a.
Monteiro, A., Miranda, A. I., Borrego, C., Vautard, R., Ferreira, J., and Perez, A. T.: Long-term assessment of particulate matter using CHIMERE model, Atmos. Environ., 41, 7726–7738, https://doi.org/10.1016/j.atmosenv.2007.06.008, 2007b.
Monteiro, A., Durka, P., Flandorfer, C., Georgieva, E., Guerreiro, C., Kushta, J., Malherbe, L., Maiheu, B., Miranda, A. I., Santos, G., Stocker, J., Trimpeneers, E., Tognet, F., Stortini, M., Wesseling, J., Janssen, S., and Thunis, P.: Strengths and weaknesses of the FAIRMODE benchmarking methodology for the evaluation of air quality models, Air Qual. Atmos. Health, 11, 373–383, https://doi.org/10.1007/s11869-018-0554-8, 2018.
Olesen, H. R.: Toward the Establishment of a Common Framework for Model Evaluation, in: Air Pollution Modeling and Its Application XI, edited by: Gryning, S.-E. and Schiermeier, F. A., Springer US, Boston, MA, 519–528, https://doi.org/10.1007/978-1-4615-5841-5_54, 1996.
Pernigotti, D., Gerboles, M., Belis, C. A., and Thunis, P.: Model quality objectives based on measurement uncertainty. Part II: NO2 and PM10, Atmos. Environ., 79, 869–878, https://doi.org/10.1016/j.atmosenv.2013.07.045, 2013.
Raffaelli, K., Deserti, M., Stortini, M., Amorati, R., Vasconi, M., and Giovannini, G.: Improving Air Quality in the Po Valley, Italy: Some Results by the LIFE-IP-PREPAIR Project, Atmosphere, 11, 429, https://doi.org/10.3390/atmos11040429, 2020.
Rahman, M. H., Agarwal, S., Sharma, S., Suresh, R., Kundu, S., Vranckx, S., Maiheu, B., Blyth, L., Janssen, S., Jorge, S., Gargava, P., Shukla, V. K., and Batra, S.: High-Resolution Mapping of Air Pollution in Delhi Using Detrended Kriging Model, Environ. Model. Assess., 28, 39–54, https://doi.org/10.1007/s10666-022-09842-5, 2023.
Russell, A. and Dennis, R.: NARSTO critical review of photochemical models and modeling, Atmos. Environ., 34, 2283–2324, https://doi.org/10.1016/S1352-2310(99)00468-9, 2000.
Ryan, W. F.: The air quality forecast rote: Recent changes and future challenges, J. Air Waste Manag. Assoc., 66, 576–596, https://doi.org/10.1080/10962247.2016.1151469, 2016.
Seigneur, C., Pun, B., Pai, P., Louis, J.-F., Solomon, P., Emery, C., Morris, R., Zahniser, M., Worsnop, D., Koutrakis, P., White, W., and Tombach, I.: Guidance for the Performance Evaluation of Three-Dimensional Air Quality Modeling Systems for Particulate Matter and Visibility, J. Air Waste Manag. Assoc., 50, 588–599, https://doi.org/10.1080/10473289.2000.10464036, 2000.
Skamarock, C., Klemp, B., Dudhia, J., Gill, O., Barker, D., Duda, G., Huang, X., Wang, W., and Powers, G.: A Description of the Advanced Research WRF Version 3. NCAR Tech. Note NCAR/TN-475+STR, https://doi.org/10.5065/D68S4MVH, 2008.
Sokhi, R. S., Moussiopoulos, N., Baklanov, A., Bartzis, J., Coll, I., Finardi, S., Friedrich, R., Geels, C., Grönholm, T., Halenka, T., Ketzel, M., Maragkidou, A., Matthias, V., Moldanova, J., Ntziachristos, L., Schäfer, K., Suppan, P., Tsegas, G., Carmichael, G., Franco, V., Hanna, S., Jalkanen, J.-P., Velders, G. J. M., and Kukkonen, J.: Advances in air quality research – current and emerging challenges, Atmos. Chem. Phys., 22, 4615–4703, https://doi.org/10.5194/acp-22-4615-2022, 2022.
Stortini, M., Arvani, B., and Deserti, M.: Operational Forecast and Daily Assessment of the Air Quality in Italy: A Copernicus-CAMS Downstream Service, Atmosphere, 11, 447, https://doi.org/10.3390/atmos11050447, 2020.
Szopa, S., Foret, G., Menut, L., and Cozic, A.: Impact of large scale circulation on European summer surface ozone and consequences for modelling forecast, Atmos. Environ., 43, 1189–1195, https://doi.org/10.1016/j.atmosenv.2008.10.039, 2009.
Tesche, T. W., Lurmann, F. R., Roth, P. M., Georgopoulos, P., and Seinfeld, J. H.: Improvement of procedures for evaluating photochemical models, Final report, Radian Corp., Sacramento, CA (USA), 1990.
Thunis, P. and Vitali, L.: Supporting data and tool, for the paper “A standardized methodology for the validation of air quality forecast applications (F-MQO): Lessons learnt from its application across Europe” (Version v2), Zenodo [data set], https://doi.org/10.5281/zenodo.7949868, 2023.
Thunis, P., Georgieva, E., and Pederzoli, A.: A tool to evaluate air quality model performances in regulatory applications, Environ. Model. Softw., 38, 220–230, https://doi.org/10.1016/j.envsoft.2012.06.005, 2012a.
Thunis, P., Pederzoli, A., and Pernigotti, D.: Performance criteria to evaluate air quality modeling applications, Atmos. Environ., 59, 476–482, https://doi.org/10.1016/j.atmosenv.2012.05.043, 2012b.
Thunis, P., Pernigotti, D., and Gerboles, M.: Model quality objectives based on measurement uncertainty. Part I: Ozone, Atmos. Environ., 79, 861–868, https://doi.org/10.1016/j.atmosenv.2013.05.018, 2013.
Zhang, B., Rong, Y., Yong, R., Qin, D., Li, M., Zou, G., and Pan, J.: Deep learning for air pollutant concentration prediction: A review, Atmos. Environ., 290, 119347, https://doi.org/10.1016/j.atmosenv.2022.119347, 2022.
Zhang, Y., Bocquet, M., Mallet, V., Seigneur, C., and Baklanov, A.: Real-time air quality forecasting, part I: History, techniques, and current status, Atmos. Environ., 60, 632–655, https://doi.org/10.1016/j.atmosenv.2012.06.031, 2012.
Short summary
Air quality forecasting models play a key role in fostering short-term measures aimed at reducing human exposure to air pollution. Together with this role comes the need for a thorough assessment of the model performances to build confidence in models’ capabilities, in particular when model applications support policymaking. In this paper, we propose an evaluation methodology and test it on several domains across Europe, highlighting its strengths and room for improvement.
Air quality forecasting models play a key role in fostering short-term measures aimed at...
