ECMWF Whole India Archive

openclimatefix / dagster-dags

Dags for running jobs on Leonardo

1 stars 0 forks source link

ECMWF Whole India Archive #99

Open devsjc opened 2 months ago

devsjc commented 2 months ago

For Adani an ECMWF archive of data from north india is required. This will match the steps/parameters/horizon of the northwest india archive, but differ in area. The exact grid bounds are to be determined.

devsjc commented 2 months ago

@jacobbieker is there a specific lat/long area bound you know we might want for this archive?

jacobbieker commented 2 months ago

Not sure with the extended one, I would go with like 4 or 5 degrees further in every direction from the bounding box around the sites, if that makes sense?

devsjc commented 1 month ago

After conversation with @peterdudfield and Dan, we have decided to make this archive a 55hr horizon archive of the entirety of India. India's bounding box is 68w, 7s, 97e, 35n, so with a buffer of 100km this becomes 67w, 97e, 6s, 35n.

devsjc commented 1 month ago

This requires two tasks:

[x] Update the ECMWF module of the consumer for india with the newly defined area: see https://github.com/openclimatefix/nwp-consumer/pull/149
[x] Add a new asset collection to dagster for the archive and bump the consumer version: see https://github.com/openclimatefix/dagster-dags/issues/99

devsjc commented 1 month ago

Created test week-long backfill for first week of 2024 at http://localhost:3003/overview/backfills/kqtarwyx. As usual ensure dagster is port forwarded on port 3003.