search

Azure / azure-databricks-client

Client library for Azure Databricks
MIT License
69 stars 59 forks source link

Please add databricks sql client #133

Open innai30 opened 1 year ago

memoryz commented 1 year ago

Which API are you referring to? Can you also describe how you plan to use that API?

innai30 commented 1 year ago

Databricks sql: https://docs.databricks.com/api/workspace/dashboards/list and Unity Catalog: https://docs.databricks.com/api/workspace/catalogs/list I want to be able to create/delete/update schema/table/view from C# code.

memoryz commented 1 year ago

Databricks sql: https://docs.databricks.com/api/workspace/dashboards/list and Unity Catalog: https://docs.databricks.com/api/workspace/catalogs/list I want to be able to create/delete/update schema/table/view from C# code.

Thanks for the links. I'll take a look.

amirjalali1 commented 1 year ago

@memoryz is there any chance to have .net driver as well? I've attempted to connect to Databricks SQL using the ODBC driver on Mac M1. However, due to the limitations with 64-bit compatibility on the M1, it's been challenging. The only alternative I've found is using Colima, but it hasn't been an optimal solution.

memoryz commented 1 year ago

To give an update on this: I'm looking into Unity Catalog API but having trouble testing it because I don't have permission to enable unity catalog at tenant level in my organization, and I'm trying to hunt down the Databricks account administrators. This will take some time.

jvmlet commented 1 year ago

We have implemented sql query history api, would you be interested in PR ?

memoryz commented 1 year ago

We have implemented sql query history api, would you be interested in PR ?

Yes of course! Community contribution is very much appreciated!

jtgooding42 commented 8 months ago

We have built a low and mid layer for the SQL API, I haven't submitted it because it requires a change in the base classes that feels like a hack, but the last release it looked like someone was heading in the right direction with config overrides for headers, is that work complete? The SQL API requires a different header and auth than the standard calls. The low level happy to share, the mid layer is probably unique to us and might not actually belong in the base classes.

memoryz commented 5 months ago

Recently the community contributed a few APIs under the SQL API and Unity Catalog API. Do these satisfy your needs?

185

159