Method for running async (notebook tasks)

[vsoch]

I'm testing https://django-q.readthedocs.io/en/latest/install.html and want to leave the link here for myself - right now I have a basic setup with a small "cluster" and i'm going to try and have the flow be:

• snakface
• user logs in to notebook with token on the command line
• presented with table of tasks (or empty, with button to create)
• mapping of snakemake command line util to a form
• form submit starts an async task.

This will of course need to have a callback that can somehow update the table. Likely I'll do refreshing the page first, but later can try Django Channels to (maybe) use sockets.

[vsoch]

Channels docs if/when I need it https://channels.readthedocs.io/en/stable/topics/consumers.html

[vsoch]

Update - we have a thread runner, and now just need to use some kind of strategy to dynamically update the run interface.

[vsoch]

Okay, the run interface is being updated with Django Channels. For a single notebook, in memory is fine. If we scale to a production thing (for other deployments) we need to add a docker compose file with redis.