Bump up Spark version - Githubissues

spotify / spark-bigquery

Google BigQuery support for Spark, SQL, and DataFrames

Apache License 2.0

155 stars 52 forks source link

Closed yawaramin closed 8 years ago

yawaramin commented 8 years ago

Bump up Spark to version 2.0.0. There are no actual source changes, but since Spark changed DataFrame from a class to a type alias, client code (including this project) is binary incompatible with Spark 2. Also bump spark-avro.
Bump up project version to 0.1.4-SNAPSHOT

nevillelyh commented 8 years ago

Hi, sorry for the late response. Is this backwards compatible with clusters running 1.6?

yawaramin commented 8 years ago

Hi, no worries. It is source-compatible but not binary compatible because of the change in the DataFrame type between 1.6 and 2.0.

yawaramin commented 8 years ago

Just realised bumping to 0.1.4 wouldn't be following semantic versioning. I've bumped to 0.2.0.