org.apache.spark.SparkException: Job aborted due to stage failure: Task 0 in stage 9582.0 failed 4 times, most recent failure: Lost task 0.3 in stage 9582.0 (TID 136905) (10.138.1.6 executor 14): net.snowflake.client.jdbc.SnowflakeSQLException: JDBC driver internal error: The actual read row count 1230892 is not equal to the expected row count 1114384 for partition ID:0. Related query ID is 01ae613e-0202-bf2e-0000-ab7920c9be4e
T
he pipeline is using spark jdbc driver 3.13.14 (via dbx run time 11.2) and latest spark-snowflake 2.11.0 release.
When checking the query id in snowflake's query history, the query is in success status
Any help is appreciated.
Seeing this intermittent error
org.apache.spark.SparkException: Job aborted due to stage failure: Task 0 in stage 9582.0 failed 4 times, most recent failure: Lost task 0.3 in stage 9582.0 (TID 136905) (10.138.1.6 executor 14): net.snowflake.client.jdbc.SnowflakeSQLException: JDBC driver internal error: The actual read row count 1230892 is not equal to the expected row count 1114384 for partition ID:0. Related query ID is 01ae613e-0202-bf2e-0000-ab7920c9be4e T he pipeline is using spark jdbc driver 3.13.14 (via dbx run time 11.2) and latest spark-snowflake 2.11.0 release.
When checking the query id in snowflake's query history, the query is in success status Any help is appreciated.