benchflow / data-transformers

Spark scripts utilised to transform data to the BenchFlow internal formats
Other
0 stars 0 forks source link

Update pyspark cassandra to use Cassandra 3.0 when available #16

Closed Cerfoglg closed 8 years ago

Cerfoglg commented 8 years ago

As it stands, Cassandra 3.0 is not supported by the pyspark cassandra connector. Cassandra 3.0 would be ideal to use, thanks to its new features like materialized views, so once support for Cassandra 3.0 is added to pyspark cassandra it would be good to implement it.

An issue has already been opened by a different user on their Github: https://github.com/TargetHolding/pyspark-cassandra/issues/69

VincenzoFerme commented 8 years ago

@Cerfoglg it seems that a new version supporting Cassandra 3 will be published soon: https://github.com/TargetHolding/pyspark-cassandra/issues/69#issuecomment-196227139

Cerfoglg commented 8 years ago

@VincenzoFerme This issue needs closing, we now have support for Cassandra 3.0