Open-EO / openeo-earthengine-driver

openEO back-end driver for Google Earth Engine.
Apache License 2.0
22 stars 7 forks source link

Implement file storage on Google Cloud #11

Open m-mohr opened 6 years ago

m-mohr commented 6 years ago

Currently, the driver has its own file storage, but GEE uses Google Cloud Storage. We should try to find a way to connect to the Google Cloud Storage and not use our proprietary implementation as this limits us in importing and exporting files before/after data processing. I'll probably need some help from the GEE engineers to figure out the details. We are already connected to a GCS bucket using the package "@google-cloud/storage", which is used to download the dataset catalogue. Maybe we can re-use that library.

edzer commented 6 years ago

More in general, effective clouds use some kind of special storage; aws e.g. S3. I believe S3 is also found in non-aws clouds.