search

planet-os / notebooks

A collection of Planet OS Jupyter notebooks.
MIT License
113 stars 54 forks source link

AWS s3 ERA5 deprecation #25

Open mickwelli opened 8 months ago

mickwelli commented 8 months ago

It seems ECMWF ERA5 Reanalysis has been deprecated on AWS S3 , which is a shame. Wondering if anyone here has insights on alternative public bucket options? Thanks!

aluhamaa commented 8 months ago

It seems ECMWF ERA5 Reanalysis has been deprecated on AWS S3 , which is a shame. Wondering if anyone here has insights on alternative public bucket options? Thanks!

@mickwelli Hi, just noticed as well. As a developer of the original version (but moved to another company two years ago), I could take over the maintenance, but it requires some planning and will not happen overnight.

mickwelli commented 8 months ago

It seems ECMWF ERA5 Reanalysis has been deprecated on AWS S3 , which is a shame. Wondering if anyone here has insights on alternative public bucket options? Thanks!

@mickwelli Hi, just noticed as well. As a developer of the original version (but moved to another company two years ago), I could take over the maintenance, but it requires some planning and will not happen overnight.

Hi @aluhamaa, thanks for your response. It's possible that myself or colleagues could assist. We have some dependent functions that we'd like to maintain e.g. load_era5(). Please get in contact if we may be of assistance.

aluhamaa commented 8 months ago

Thanks, @mickwelli I'll try to contact AWS and let you know here. If I continue, it would be a fully open solution with all contributions welcome.

Gonzalo1985 commented 7 months ago

Hello, Sorry I think I opened other issue about the same problem. We have a R package for management of ERA5 data from AWS. It would be a shame to lose this. If there is a possibility of helping on this issue please let me know. Thank you!

aluhamaa commented 7 months ago

@Gonzalo1985 @mickwelli I've got a response from AWS, they have several interested persons already and they will continue providing the dataset. No details about when and if there will be any changes in formats, etc.

Gonzalo1985 commented 7 months ago

Thank you very much @aluhamaa. I hope we can get it soon.

mickwelli commented 6 months ago

Hi again folks. We've managed to re-route our load_era5() function to google, but have left the AWS option open when access is reinstated. Sharing in case it's useful for others https://github.com/digitalearthafrica/deafrica-sandbox-notebooks/pull/491

Gonzalo1985 commented 6 months ago

Ok, thanks @mickwelli! We know something new about the data availability on AWS?

mickwelli commented 6 months ago

Ok, thanks @mickwelli! We know something new about the data availability on AWS?

Only the above, which indicates they are working on it.