search

bgruening / galaxy-ipython

:microscope::books: IPython Integration into Galaxy
MIT License
31 stars 14 forks source link

Allow for launching docker on remote hosts #4

Closed hexylena closed 8 years ago

hexylena commented 10 years ago

A few possibilities:

This of course raises the issue of having to keep port mappings somewhere, so this may add a dependency, for this configuration option, of having a database available somewhere to talk to.

(01:33:00 PM) Unode_: if you can somehow channel that via the current job handling system would be perfect I'd say
(01:33:07 PM) erasche: we then randomly test to find an open one, and launch docker with that port
(01:33:11 PM) erasche: on a remote host...that's tougher.
(01:33:23 PM) erasche: hmmm @ via current job handling system.
(01:33:27 PM) erasche: I can see the argument for it
(01:33:33 PM) erasche: but the integration would be ... interesting.
(01:33:42 PM) erasche: Hmmm. I'll have to think on that.
(01:33:51 PM) erasche: I'll add it to our bug for remote hosts
(01:33:52 PM) Unode_: no, I mean the request to start a new docker. That would go via job handler, with all it's queues and rules on where the job should run.
(01:34:03 PM) erasche: yes.
(01:34:15 PM) guerler_ [~guerler@z65-182-50-175.ips.direcpath.com] entered the room.
(01:34:23 PM) erasche: i.e., it'd just submit a job as the user to the queue
(01:34:30 PM) erasche: and whenever it got executed it'd load up a galaxy instance.
(01:34:30 PM) Unode_: yup
(01:34:33 PM) erasche: docker/ipy*
(01:34:35 PM) erasche: not galaxy
(01:34:55 PM) erasche: I can't tell whether the sys admin in me is terrified or really excited at that idea
(01:34:57 PM) erasche: haha
(01:35:01 PM) Unode_: :D
(01:35:25 PM) Unode_: The crazy part is to then connect from the frontend to the docker machine.
(01:35:51 PM) erasche: yeah.....
(01:36:01 PM) erasche: the apache magic we do would get a fair bit more complicated
(01:36:21 PM) Unode_: I don't even know how that would work...
(01:36:21 PM) erasche: I think I remembere that you can read from a csv file in apache....we could write a list of host/port mapping...oh gods what am I doing
hexylena commented 10 years ago

http://httpd.apache.org/docs/current/rewrite/rewritemap.html

We can append to a "database" of docker host + docker port (or maybe run them all on the same port?) within the main mako template. Whenever our docker images kill themselves, they'll call up a separate mako template, the sole purpose of which is to remove that specific entry from the "database". It will need to wait on a 200 OK (and possibly specific content in the page) to kill itself, or keep sending the request.

hexylena commented 8 years ago

Closed since this is now possible through docker.