Simpleflow is a Python library that provides abstractions to write programs in the distributed dataflow paradigm. It coordinates the execution of distributed tasks with Amazon SWF.
It relies on futures to describe the dependencies between tasks. A Future
object
models the asynchronous execution of a computation that may end. It tries to mimic
the interface of the Python concurrent.futures library.
Future
abstraction to define dependencies between tasks.simpleflow --local
command).simpleflow
command. simpleflow --help
for more information
about the commands it supports.You can read more in the Features section of the documentation.
Please read and even run the demo
script to have a quick glance of
simpleflow
commands. To run the demo
you will need to start decider
and activity worker processes.
Start a decider with:
$ PYTHONPATH=$PWD simpleflow decider.start --domain TestDomain --task-list test examples.basic.BasicWorkflow
Start an activity worker with:
$ simpleflow worker.start --domain TestDomain --task-list quickstart
Then execute ./extras/demo
.
Read the main documentation at https://botify-labs.github.io/simpleflow/.