galaxyproject / ephemeris

Library for managing Galaxy plugins - tools, index data, and workflows.
https://ephemeris.readthedocs.org/
Other
27 stars 38 forks source link

Parallellized tool installation. #174

Open rhpvorderman opened 3 years ago

rhpvorderman commented 3 years ago

Well, I think this should be possible. I just spend quite some time installing new tools, it is quite tedious. This will require some refactoring however, and shed-tools testing is not up to scratch yet.

One of the enormous advantages of doing this is that tool installation will also be much faster in the testing, which will save a lot of time.

bgruening commented 3 years ago

Conda does not support parallel installation, left? For containers that might work with some work in Galaxy.

rhpvorderman commented 3 years ago

Ah. https://github.com/conda/conda/issues/5997 Okay. Well, still it is possible, but then the package cache cannot be shared. But that would require some work in galaxy. And arguably a one-hour wait is not that bad in the grand scheme of things. (As opposed to the waiting we do on the CI for ephemeris. That is quite bad.)