search

snowplow-archive / factotum

A system to programmatically run data pipelines
http://snowplowanalytics.com/blog/2016/04/09/introducing-factotum-data-pipeline-runner/
220 stars 12 forks source link

Offer a state machine mode? #105

Open alexanderdean opened 7 years ago

alexanderdean commented 7 years ago

Just an idea at this stage - a FSM is a particular flavor of DAG; could we implement an FSM behavior for Factotum?

This could end up being an open-source / multi-cloud version of AWS Step Functions:

https://docs.aws.amazon.com/step-functions/latest/dg/amazon-states-language-states.html

ninjabear commented 7 years ago

I like this idea but it would ostensibly mean breaking the non-turing complete rule. We could revisit that rule though