search

kbaseattic / assembly

An extensible framework for genome assembly.
MIT License
12 stars 14 forks source link

[Worker] Isolate computation engine from Arast queueing/db dependencies. #10

Open sebhtml opened 10 years ago

sebhtml commented 10 years ago

Issue by sebhtml Thursday May 15, 2014 at 22:19 GMT Originally opened as https://github.com/kbase/assembly/issues/7

https://bitbucket.org/levinas/assembly-rast/issue/5/worker-isolate-computation-engine-from

Christopher Bun created an issue 2013-08-28

Allow a worker pipeline process to be explicitly invoked using minimal dependencies on connections back to the control server (rabbitmq, mongodb).

Ex: the ability to run an Arast workflow on external supercomputing resources, dealing with esoteric queueing restrictions, data transfer, and operating system flavors.

sebhtml commented 10 years ago

In this design, I suppose there would be the following concepts:

work work queue worker work outcome