search

zero-one-group / geni

A Clojure dataframe library that runs on Spark
Apache License 2.0
286 stars 28 forks source link

spark connect and databricks connect support? #345

Open indraniel opened 1 year ago

indraniel commented 1 year ago

Will geni support Spark 3.5's remote connections to clusters via spark connect and databricks connect ?

behrica commented 1 week ago

I got databricks connect working on Clojure. But I did not manage to have the spark connect jar and the spark jars working in the same VM.

Even by carefully checking the versions. -> I din not get Geni and databricks cnnect working together.