search

daskos / epos

Write DAG Workflows like epic poems via Mesos, Marathon, Chronos, Spark, Dask
4 stars 1 forks source link

Auto ship current module with via spark driver #6

Open kszucs opened 8 years ago

kszucs commented 8 years ago

Programatically call setuptools bdist_egg, and attach to the current spark context.