Preprints
https://doi.org/10.5194/gmd-2022-218
https://doi.org/10.5194/gmd-2022-218
Submitted as: methods for assessment of models
 | 
12 Dec 2022
Submitted as: methods for assessment of models |  | 12 Dec 2022
Status: a revised version of this preprint was accepted for the journal GMD and is expected to appear here in due course.

A Standardised Validation Framework for Ocean Physics Models: Application to the Northwest European Shelf

David Byrne, Jeff Polton, Enda O'Dea, and Joanne Williams

Abstract. Validation is one of the most important stages of a model's development. By comparing outputs to observations, we can estimate how well the model is able to simulate reality, which is the ultimate aim of many models. During development, validation may be iterated upon to improve the model simulation and compare to similar existing models or perhaps previous versions of the same configuration. As models become more complex, data storage requirements increase and analyses improve, scientific communities must be able to develop standardised validation workflows for efficient and accurate analyses with an ultimate goal of a complete, automated validation.

We set out our process and principles used to construct a standardised and partially automated validation system. This is discussed alongside five principles which are fundamental for our system: system scaleability, independence from data source, reproducible workflows, expandable code base and objective scoring. We also describe the current version of our own validation workflow and discuss how it adheres to the above principles. We use the COAsT Python package as a framework within which to build our analyses. COAsT provides a set of standardised oceanographic data objects ideal for representing both modelled and observed data. We use the package to compare two model configurations of the Northwest European Shelf to observations from tide gauge and profiles.

David Byrne et al.

Status: closed

Comment types: AC – author | RC – referee | CC – community | EC – editor | CEC – chief editor | : Report abuse
  • RC1: 'Comment on gmd-2022-218', Anonymous Referee #1, 26 Jan 2023
  • RC2: 'Comment on gmd-2022-218', Anonymous Referee #2, 12 Feb 2023
  • AC1: 'Responses to reviewers', David Byrne, 06 Apr 2023

Status: closed

Comment types: AC – author | RC – referee | CC – community | EC – editor | CEC – chief editor | : Report abuse
  • RC1: 'Comment on gmd-2022-218', Anonymous Referee #1, 26 Jan 2023
  • RC2: 'Comment on gmd-2022-218', Anonymous Referee #2, 12 Feb 2023
  • AC1: 'Responses to reviewers', David Byrne, 06 Apr 2023

David Byrne et al.

David Byrne et al.

Viewed

Total article views: 374 (including HTML, PDF, and XML)
HTML PDF XML Total BibTeX EndNote
286 76 12 374 3 3
  • HTML: 286
  • PDF: 76
  • XML: 12
  • Total: 374
  • BibTeX: 3
  • EndNote: 3
Views and downloads (calculated since 12 Dec 2022)
Cumulative views and downloads (calculated since 12 Dec 2022)

Viewed (geographical distribution)

Total article views: 356 (including HTML, PDF, and XML) Thereof 356 with geography defined and 0 with unknown origin.
Country # Views %
  • 1
1
 
 
 
 
Latest update: 06 Jun 2023
Download
Short summary
When models designed to simulate the ocean are developed, the validation step is one of the most important parts of the process. The purpose of validation is to assess how accurate a model is. This is most commonly done by comparing output from a model observations. In this paper we introduce and demonstrate the use of the COAsT Python package to standardise the validation process for physical ocean models alongside a set of five fundamental principles for standardised validation.