Preprints
https://doi.org/10.5194/gmd-2021-132
https://doi.org/10.5194/gmd-2021-132
Submitted as: model description paper
 | 
02 Jun 2021
Submitted as: model description paper |  | 02 Jun 2021
Status: this preprint was under review for the journal GMD but the revision was not accepted.

Sensitivity analysis of a data-driven model of ocean temperature

Rachel Furner, Peter Haynes, Dave Munday, Brooks Paige, Daniel C. Jones, and Emily Shuckburgh

Abstract. There has been much recent interest in developing data-driven models for weather and climate predictions. These have shown reasonable success in modelling atmospheric dynamics over short time scales, however there are open questions regarding the sensitivity and robustness of these models. Using model interpretation techniques to better understand how data-driven models are making predictions is critical to developing trust in these alternative prediction systems. We develop a simple regression model of ocean temperature evolution, Ocean Temperature Regressor v1.0, and investigate its sensitivity to improve understanding of whether data-driven models are capable of learning the complex underlying dynamics of the systems being modelled.

We investigate model sensitivity in a variety of ways and find that Ocean Temperature Regressor v1.0 behaves in ways which are, for the most part, in line with our knowledge of the ocean system being modelled. Specifically we see that the regressor heavily bases its forecasts on, and is dependent on, variables which we know are key to the physical dynamics inherent in the system, such as the currents and density. By contrast, inputs to the regressor which have limited direct dynamic impact, such as location, are not heavily used by the regressor. We also find that the regression model requires non-linear interactions between inputs in order to show any meaningful predictive skill – in line with out knowledge of the highly nonlinear dynamics of the ocean. Further sensitivity analysis is carried out to interpret that the ways in which certain variables are used by the regression model. Results here are again mostly in line with our physical knowledge of the system, for example, we see that information about the vertical profile of the water column reduces errors in areas associated with convective activity, and information about the currents is used by the regressor to reduce errors in regions dominated by advective processes.

Our results show that even a simple regression model is capable of “learning” much of the physical dynamics inherent in the ocean system being modelled, which gives promise for the sensitivity and generalisability of data-driven models more generally.

Rachel Furner, Peter Haynes, Dave Munday, Brooks Paige, Daniel C. Jones, and Emily Shuckburgh

Status: closed

Comment types: AC – author | RC – referee | CC – community | EC – editor | CEC – chief editor | : Report abuse
  • CC1: 'Comment on gmd-2021-132', Paul PUKITE, 06 Jun 2021
    • AC1: 'Reply on CC1', Rachel Furner, 21 Jun 2021
    • AC2: 'Reply on CEC1', Rachel Furner, 02 Jul 2021
  • CEC1: 'Comment on gmd-2021-132', Juan Antonio Añel, 30 Jun 2021
    • AC2: 'Reply on CEC1', Rachel Furner, 02 Jul 2021
  • RC1: 'Comment on gmd-2021-132', Anonymous Referee #1, 30 Jun 2021
  • RC2: 'Comment on gmd-2021-132', Anonymous Referee #2, 02 Jul 2021

Status: closed

Comment types: AC – author | RC – referee | CC – community | EC – editor | CEC – chief editor | : Report abuse
  • CC1: 'Comment on gmd-2021-132', Paul PUKITE, 06 Jun 2021
    • AC1: 'Reply on CC1', Rachel Furner, 21 Jun 2021
    • AC2: 'Reply on CEC1', Rachel Furner, 02 Jul 2021
  • CEC1: 'Comment on gmd-2021-132', Juan Antonio Añel, 30 Jun 2021
    • AC2: 'Reply on CEC1', Rachel Furner, 02 Jul 2021
  • RC1: 'Comment on gmd-2021-132', Anonymous Referee #1, 30 Jun 2021
  • RC2: 'Comment on gmd-2021-132', Anonymous Referee #2, 02 Jul 2021
Rachel Furner, Peter Haynes, Dave Munday, Brooks Paige, Daniel C. Jones, and Emily Shuckburgh
Rachel Furner, Peter Haynes, Dave Munday, Brooks Paige, Daniel C. Jones, and Emily Shuckburgh

Viewed

Total article views: 1,863 (including HTML, PDF, and XML)
HTML PDF XML Total BibTeX EndNote
1,308 504 51 1,863 21 18
  • HTML: 1,308
  • PDF: 504
  • XML: 51
  • Total: 1,863
  • BibTeX: 21
  • EndNote: 18
Views and downloads (calculated since 02 Jun 2021)
Cumulative views and downloads (calculated since 02 Jun 2021)

Viewed (geographical distribution)

Total article views: 1,667 (including HTML, PDF, and XML) Thereof 1,667 with geography defined and 0 with unknown origin.
Country # Views %
  • 1
1
 
 
 
 
Latest update: 18 Mar 2024
Download
Short summary
Traditional weather & climate models are built from physics-based equations, while data-driven models are built from patterns found in datasets using Machine Learning or statistics. There is growing interest in using data-driven models for weather & climate prediction, but confidence in their use depends on understanding the patterns they're finding. We look at this with a simple regression model of ocean temperature and see the patterns found by the regression model are similar to the physics.