search

openclimatefix / dagster-dags

Dags for running jobs on Leonardo
2 stars 0 forks source link

ECMWF UK 84 Hr Horizon Extend #92

Closed devsjc closed 3 months ago

devsjc commented 6 months ago

Alongside the Ensemble Archive #96 and the Extended Horizon UKV Archive #97, larger-horizon ECMWF UK data is also required for the longer range NIA forecast. The desired max horizon is 84 hours.

[Part of NIA work package 6]

devsjc commented 5 months ago

2024-03-20

Launched backfill from 2017-2024 with all new variables. For now, old data is in uk-old. Tunnel to dagster and see http://localhost:3003/overview/backfills/qklifbnk

devsjc commented 5 months ago

2024-04-19

10% of the way there. Currenty mostly being usurped by the 7 day india download (https://github.com/openclimatefix/nwp-consumer/issues/138).

devsjc commented 5 months ago

2024-04-24

25% of the way there. ~ 1000 / 4000 downloaded.

devsjc commented 5 months ago

2024-04-29

Same as above - still being superceded by the india 7 day backfill.

devsjc commented 4 months ago

2024-05-14

50% of the way there. ~2000 init times downloaded, randomly distributed across the archive.

devsjc commented 4 months ago

2024-05-20

65% of the way there.

devsjc commented 3 months ago

2024-06-01

Complete.