Try streaming tiffs to s3 - Githubissues

Open-EO / openeo-geotrellis-extensions

Java/Scala extensions for Geotrellis, for use with OpenEO GeoPySpark backend.

Apache License 2.0

5 stars 4 forks source link

Try streaming tiffs to s3 #347

Open EmileSonneveld opened 2 weeks ago

EmileSonneveld commented 2 weeks ago

This has been tried here: https://github.com/Open-EO/openeo-geotrellis-extensions/issues/199 But was disabled: https://github.com/Open-EO/openeo-geotrellis-extensions/commit/01b67c85f27ff59fde22872a53a13306b79eb6f9#diff-eb0b0fb3836fe17a6e2feaf1496210faf468bfd995d245163cf3876af89626a9L229

We can try again for tiffs with some extra precaution.

EmileSonneveld commented 1 week ago

@pvbouwel Would this add TRY_SWIFT_STREAMING to the environment variables on the executors? https://git.vito.be/projects/TPT/repos/os_creodias_openeo_k8s/browse/kube_resources/applications/openeo/values_cdse-dev.yaml#23