SNOW-1012110 Skip Retry after Application Closed

snowflakedb / spark-snowflake

Snowflake Data Source for Apache Spark.

http://www.snowflake.net

Apache License 2.0

211 stars 98 forks source link

SNOW-1012110 Skip Retry after Application Closed #544

Closed sfc-gh-bli closed 7 months ago

sfc-gh-bli commented 7 months ago

Spark triggers onApplicationEnd listener earlier than stops tasks. Spark connector cancels all running queries in this listener. Therefore, spark will rerun those canceled queries in the retry. This PR introduces a new checker, to skip those retries after application closed.