joocer / cronicl

cronicl: data pipelines.
Apache License 2.0
0 stars 0 forks source link

Use queing to communicate between stages #9

Closed joocer closed 4 years ago

joocer commented 4 years ago

rather than have a synchronous control flow, have each step pick up and drop off to a queue, this is a step toward enabling stages to run in different threads, processes or containers