Spark triggers onApplicationEnd listener earlier than stops tasks. Spark connector cancels all running queries in this listener. Therefore, spark will rerun those canceled queries in the retry.
This PR introduces a new checker, to skip those retries after application closed.
Spark triggers
onApplicationEnd
listener earlier than stops tasks. Spark connector cancels all running queries in this listener. Therefore, spark will rerun those canceled queries in the retry. This PR introduces a new checker, to skip those retries after application closed.