search

snowflakedb / spark-snowflake

Snowflake Data Source for Apache Spark.
http://www.snowflake.net
Apache License 2.0
202 stars 97 forks source link

EXPLAIN command executes query on Snowflake side #567

Open urosstan-db opened 4 weeks ago

urosstan-db commented 4 weeks ago

Query execution is done in getRDD method of SnowflakeRelation and because of that, snowflake strategy during planning executes query on snowflake side and that can take a lot of time for bigger queries.

It helps a little bit data is not fetched, but still, some query executions can take a lot of time.

urosstan-db commented 4 weeks ago

https://github.com/snowflakedb/spark-snowflake/pull/535 This PR seems to solve this issue also.