search

spotify / spark-bigquery

Google BigQuery support for Spark, SQL, and DataFrames
Apache License 2.0
155 stars 52 forks source link

Update Schema with jobs #27

Open samelamin opened 7 years ago

samelamin commented 7 years ago

Hey guys

I want to update the schema with each write, but seems like setting the job configuration to ALLOW_FIELD_ADDITION doesnt work

I even tried setting writeDisposition as WRITE_APPEND but as far as I can tell, its set as this by default

Any ideas? See here