Add ABORT_DETACHED_QUERY parameter in session prologue query

snowflakedb / spark-snowflake

Snowflake Data Source for Apache Spark.

http://www.snowflake.net

Apache License 2.0

211 stars 98 forks source link

Add ABORT_DETACHED_QUERY parameter in session prologue query #558

Closed urosstan-db closed 3 months ago

urosstan-db commented 3 months ago

When customer use async mode for query execution (async mode on JDBC driver) and he has ABORT_DETACHED_QUERY parameters set to true, then long running queries (longer than 5 minutes) being cancelled.

For more details, please take a look on https://docs.snowflake.com/en/sql-reference/parameters#abort-detached-query.

The current fix is to set session parameter to override user/account level parameter setting, while we still want to allow customer to pass desired value to options of spark read.

sfc-gh-bli commented 3 months ago

@urosstan-db thank you for your contribution. We modified this PR and filed a new PR. That one has been merged. https://github.com/snowflakedb/spark-snowflake/pull/562