search

spotify / spark-bigquery

Google BigQuery support for Spark, SQL, and DataFrames
Apache License 2.0
155 stars 52 forks source link

remove dependency on databricks avro #31

Closed samelamin closed 7 years ago

samelamin commented 7 years ago

@jonas @nevillelyh Happy new year folks, sorry for the late pr I was away for a few weeks on xmas break

FYI this is the initial attempt on removing the dependency on databricks avro as discussed here

this pr is not ready to merge, its just my initial attempt with adding a bit if tests to see if this is a path/architecture I should continue down

We are only saving the dataframe for now, if you can agree with this route I can work on adding the "select/read from bq" functionality

samelamin commented 7 years ago

@ravwojdyla I think this is the pr you meant to change