search

daskos / epos

Write DAG Workflows like epic poems via Mesos, Marathon, Chronos, Spark, Dask
4 stars 1 forks source link

Create custom pickler to use explicitly #17

Open kszucs opened 7 years ago

kszucs commented 7 years ago

https://github.com/lensacom/epos/blob/master/epos/context.py#L108

When satyr sends back the result in a queue, it uses cp.dumps and forwards context to the scheduler!