databrickslabs / splunk-integration

Databricks Add-on for Splunk
https://splunkbase.splunk.com/app/5416/
Other
26 stars 18 forks source link

Splunk DB connect fails to connect to Databricks #50

Open mflpopescu opened 7 months ago

mflpopescu commented 7 months ago

Following guide Splunk DB Connect Guide for Databricks but when creating a connection to Databricks and trying to test it in Data Lab >> SQL Explorer, I'm getting error "Cannot get schemas"

image

This is the combo used (tried others as well but the error thrown is always the same) DB connect: 3.12.2 JDBC driver: 2.6 JAVA: JRE 11

Connection fails with the following errors in splunk/var/log/splunk/splunk_app_db_connect_server.log

ERROR c.s.d.s.a.s.d.impl.DatabaseMetadataServiceImpl - Unable to get schemas metadata
[...]
.ErrorPropagationThriftHandler:runSafely:ErrorPropagationThriftHandler.scala:119], errorCode:0, errorMessage:Configuration CONNECTION_TYPE is not available.).
sudonitt018 commented 4 months ago

hi, were you able to resolve the error? I am also facing the exact same error.

DC connect: 3.15.0 JDBC Driver: 2.6.34 JAVA: OpenJDK 11

mflpopescu commented 4 months ago

@sudonitt018 you'll need to make the connection using the cluster JDBC endpoint (it won't work with the warehouse endpoint)

sudonitt018 commented 4 months ago

@mflpopescu , thanks for the response, what is the format of that? Where can we find it?

mflpopescu commented 4 months ago

@sudonitt018 In the guide linked in the original post, see section "JDBC URL Settings"

steyler-db commented 4 months ago

Hello @mflpopescu why SQL warehouse doesn't work ? @sudonitt018 you'll need to make the connection using the cluster JDBC endpoint (it won't work with the warehouse endpoint) If I use the Splunk Add on it works, but the SQL warehouse needs to be always turned on, why this is needed, this will be a lot of cost, can this be more likely to splunk db connect to launch the cluster when it connects to databricks SQL warehouse?