joocer / cronicl

cronicl: data pipelines.
Apache License 2.0
0 stars 0 forks source link

Allow multiple pipelines run in one process #32

Closed joocer closed 3 years ago

joocer commented 4 years ago

Pipelines need a unique name/id

A pipeline manager needs to hold multiple pipelines

Reply queue, and every queue, needs to be named according to the pipeline id

Pipelines may need a trigger, such as a file watcher or a timer, to start the pipeline