spotify / spark-bigquery

Google BigQuery support for Spark, SQL, and DataFrames
Apache License 2.0
155 stars 52 forks source link

Support configurable query job priority #53

Closed martinstuder closed 6 years ago

martinstuder commented 6 years ago

Query jobs are currently submitted with a priority that is dependent on whether the job is submitted from an interactive context or not. If a job is submitted from the Scala REPL, it is submitted as an interactive BigQuery job, otherwise as a BigQuery batch job. See

Rather than pre-determining the query job priority, it would be nice if it could be configured from the outside - possibly keeping the current logic as a default.