Marathon, Chronos, Parquet, Cassandra Support - Githubissues

daskos / epos

Write DAG Workflows like epic poems via Mesos, Marathon, Chronos, Spark, Dask

4 stars 1 forks source link

Marathon, Chronos, Parquet, Cassandra Support #3

Closed kszucs closed 8 years ago

kszucs commented 8 years ago

[x] System tests covering mesos(chronos/marathon) deployments,
[x] System tests covering HDFS, Cassandra, Zookeeper integrations
[x] Long running process support via marathon decorator.
[x] DAG scheduling support via chronos decorator.
[x] Odo implementations:

SparkDataFrame -> Parquet / HDFS(Parquet)
Parquet / HDFS(Parquet) -> SparkDataFrame
SparkDataFrame -> Cassandra
Cassandra -> SparkDataFrame