DataBiosphere / dsub

Open-source command-line tool to run batch computing tasks and workflows on backend services such as Google Cloud.
Apache License 2.0
265 stars 44 forks source link

installation of Cloud SDK not working on newer Ubuntu (e.g. 18.04) #127

Closed jwhitney31337 closed 6 years ago

jwhitney31337 commented 6 years ago

On recent Ubuntu versions, the easy_install scripts are no longer installed as part of package python-setuptools This means that the procedure dsub uses to install the SDK (when gsutil is not already present on my docker image) breaks: in the error log I see a "command not found" message for easy_install.

One way to fix this would be to substitute:

apt-get install python-pip

for

easy_install -U pip

in dsub/providers/google.py

This seems a little bloated due to the number of dependencies but appears to work both for 14.04 and 18.04. There might be a better way but this is at least simple.

mbookman commented 6 years ago

With the deprecation of Pipelines v1alpha2 and the google provider, we have no plans to implement this. Pull requests would still be accepted.

jwhitney31337 commented 6 years ago

Ah! TIL I could just use --provider google-v2 and problem solved!