Odo Parquet Format - Githubissues

daskos / epos

Write DAG Workflows like epic poems via Mesos, Marathon, Chronos, Spark, Dask

4 stars 1 forks source link

Odo Parquet Format #2

Closed kszucs closed 8 years ago

kszucs commented 8 years ago

To support the following operations:

[x] odo(spark_dataframe, 'hdfs://path/to/output.parquet')
[x] ~~odo(pandas_dataframe, 'hdfs://path/to/output.parquet')~~
[x] odo('hdfs://path/to/input.parquet', sqlContext) # spark dataframe
[x] ~~odo('hdfs://path/to/input.parquet', pd.DataFrame) # pandas dataframe~~

related odo issue https://github.com/blaze/odo/issues/31

kszucs commented 8 years ago

https://github.com/lensacom/epos/pull/3