new nwp data

[peterdudfield]

Describe the bug

New nwp data must be slightly different as it is causing this bug

https://eu-west-1.console.aws.amazon.com/cloudwatch/home?region=eu-west-1#logsV2:log-groups/log-group/$252Faws$252Fecs$252Fforecast$252F/log-events/streaming$252Fforecast$252Fa17bd8c180194cb68f201eb478de6805

Something here - https://github.com/openclimatefix/nowcasting_dataset/blob/main/nowcasting_dataset/data_sources/data_source.py#L447 is going wrong

Expected behavior

not to error

Additional context

• new nwp-consumer has just been deployed
• osgb is used here
• Could be something used to be an int, and now its a float, or something like that

[peterdudfield]

@devsjc if you get a chance, do you mind looking at this today?

[peterdudfield]

It could be something we can fix in nowcasting_datast but I'm just confused how this has happened. It could also be a package update that has caused this

[peterdudfield]

THis might be fixed with 1.3.24 (or the latest one), @devsjc do you mind deploying in on terraform cloud, then seeing if it works on airflow, not it normally only works between xx:05 and xx:35

[devsjc]

Sure! Here's the terraform run link...

[devsjc]

Still failing, with a different error now:

RuntimeError: Example is wrong shape! x_center_osgb=274767.28508405434

See Cloudwatch logs