Optimization of UDF dependency management - Githubissues

Open-EO / openeo-geopyspark-driver

OpenEO driver for GeoPySpark (Geotrellis)

Apache License 2.0

25 stars 4 forks source link

Optimization of UDF dependency management #788

Open soxofaan opened 3 weeks ago

soxofaan commented 3 weeks ago

spin-off from https://github.com/Open-EO/openeo-geopyspark-driver/issues/237 (automatic UDF depdendency handling)

further optimization options:

don't (re)install dependencies that are already in the default env, e.g. reinstalling numpy is not always necessary
use uv as pip replacement and leverage it's aggressive caching mechanisms for installation speed
config for deny-listing certain dependencies?