spotify / spark-bigquery

Google BigQuery support for Spark, SQL, and DataFrames
Apache License 2.0
155 stars 52 forks source link

Configuration parameter for Staging dataset id #63

Closed pcejrowski closed 6 years ago

pcejrowski commented 6 years ago

Adding configuration parameter bq.staging_dataset.id which allows to choose staging Dataset ID which stores results of SELECT ... statements.

Currently existing prefix + location doesn't allow to specify the full bucket name.

pcejrowski commented 6 years ago

@nevillelyh Do you have any plans for releasing the newest version?