openmethane / openmethane-prior

Method to calculate a gridded, prior emissions estimate for methane across Australia
Apache License 2.0
4 stars 0 forks source link

Evaluate impact of updates to CDS #19

Closed aethr closed 1 month ago

aethr commented 5 months ago

The motivation

The team behind Copernicus/CDS has announced they are making substantial changes to the service in an attempt to modernise their infrastructure: https://forum.ecmwf.int/t/a-new-cds-soon-to-be-launched-expect-some-disruptions/1607/50

They haven't released (or I couldn't find) any details on how these changes will impacts APIs / downstream consumers. This issue can simply serve as a reminder / TODO to check back periodically to see if changes will be required.

The team has stated:

the current Climate and Atmosphere Data Stores will continue to operate until complete shutdown on 1st September 2024.

So we will need to understand before September what, if any, changes will be required on our side.

The proposed solution

Watch and wait until details have been released about impacts to downstream consumers.

Additional context

https://forum.ecmwf.int/t/a-new-cds-soon-to-be-launched-expect-some-disruptions/1607

mikapfl commented 1 month ago

It seems we need to move to ads-beta because their stable system stops working on 2024-09-26:

2024-09-04T13:09:40.725000: 2024-09-04 11:09:40,725 INFO Welcome to the ADS.
2024-09-04T13:09:40.725000: As per our announcements on the Forum, this instance of ADS will be decommissioned on 26 September 2024 and will no longer be accessible from this date onwards.
2024-09-04T13:09:40.725000: Please update your cdsapi package to a version >=0.7.0, create an account on ADS-Beta and update your .cdsapirc file. We strongly recommend users to check our Guidelines at https://confluence.ecmwf.int/x/uINmFw
2024-09-04T13:09:40.725000: 2024-09-04 11:09:40,725 WARNING Move urgently to ads-beta
aethr commented 1 month ago

The ADS/CDS team now provides a migration guide to the new system: https://confluence.ecmwf.int/display/CKB/Please+read%3A+CDS+and+ADS+migrating+to+new+infrastructure%3A+Common+Data+Store+%28CDS%29+Engine

Steps to migrate openmethane-prior to the new ADS system: