databricks / dbt-databricks

A dbt adapter for Databricks.
https://databricks.com
Apache License 2.0
226 stars 119 forks source link

Question: is it possible to run a SQL model via all-purpose compute cluster? #852

Closed csimplestring closed 13 hours ago

csimplestring commented 14 hours ago

Hello, is it possible to run a SQL model via all-purpose compute cluster?

The reason why I want to use a cluster to run SQL model is: in the SQL mode, we are using some python UDFs, which the sql warehouse does not support such a feature.

benc-db commented 13 hours ago

Yes, all-purpose cluster is supported for all dbt-databricks operations.