icenet-ai / icenet

The icenet library is a pip installable python package containing the commands and code you need to produce forecasts
MIT License
21 stars 7 forks source link

Operational forecasts are not comparable #52

Open JimCircadian opened 2 years ago

JimCircadian commented 2 years ago

Not sure I had a ticket for this, but fundamentally the ERA5 and operational forecast data seem to produce vastly different, unacceptable (in the latter case) forecasts. This really shouldn't be the case to the level at which it happens, so tracking the issue herein...

JimCircadian commented 2 years ago

A really very likely culprit is, surprise surprise, the solar radiation parameters. I did do a rudimentary fix for these at some point but seem to have knackered it in the collection of the source data somehow. Comparison between training (reanalysis/observed SIC) data and operational forecast data highlights this well:

image

There is also the issue of the SIC forecast provided from the ECMWF model, which is the operational version of the SEAS @tom-andersson (I've CC'd you as you might find this interesting 😄 ) used in assessing the previous IceNet, and the SST differences. I'll add all these to evaluate these difference in the operationally forecasted data into the tasklist for this issue, and for at the moment we can continue running through ERA5 for predictions alongside operational forecasted data.