snowflakedb / spark-snowflake

Snowflake Data Source for Apache Spark.
http://www.snowflake.net
Apache License 2.0
217 stars 99 forks source link

Support for snowflake-jdbc-thin #577

Open jtjeferreira opened 3 months ago

jtjeferreira commented 3 months ago

I am trying to use snowflake-jdbc-thin instead of the fat jar snowflake-jdbc. After excluding the snowflake-jdbc and using snowflake-jdbc-thin, I got the error:

[info]   Cause: java.lang.ClassNotFoundException: net.snowflake.client.jdbc.internal.fasterxml.jackson.databind.ObjectMapper
[info]   at java.base/java.net.URLClassLoader.findClass(URLClassLoader.java:476)
[info]   at sbt.internal.ManagedClassLoader.findClass(ManagedClassLoader.java:102)
[info]   at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:594)
[info]   at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:527)
[info]   at net.snowflake.spark.snowflake.Utils$.<clinit>(Utils.scala:86)
[info]   at net.snowflake.spark.snowflake.DefaultSource.shortName(DefaultSource.scala:40)
[info]   at org.apache.spark.sql.execution.datasources.DataSource$.$anonfun$lookupDataSource$2(DataSource.scala:657)
[info]   at org.apache.spark.sql.execution.datasources.DataSource$.$anonfun$lookupDataSource$2$adapted(DataSource.scala:657)

which makes sense because net.snowflake.client.jdbc.internal.fasterxml.jackson.databind.ObjectMapper only exists in the fat jar.

Any plans to support snowflake-jdbc-thin?