galaxyproject / idc

Simon's Data Club - Reference data for Galaxy servers
MIT License
9 stars 7 forks source link

Outstanding items for improving the automation #22

Open natefoo opened 1 year ago

natefoo commented 1 year ago

Leftover issues and more from #21.

I commented out a couple of tasks that I expanded upon in #30.

natefoo commented 1 year ago

Running the importer in Docker (and all the double setup that goes along with it) is not really necessary, it's mainly a holdover from usegalaxy-tools so we can mount $OVERLAYFS_MOUNT as /cvmfs/$REPO. But we can use the namespace techniques used by https://github.com/cvmfs/cvmfsexec to do this without docker, which should be much quicker/simpler.

Rather than this, I think we can remove one entire step and part of the complexity (and a point of failure encountered in #26) by simply importing directly on the CVMFS server, which has a sizable spool volume.