search

databrickslabs / dlt-meta

Metadata driven Databricks Delta Live Tables framework for bronze/silver pipelines
https://databrickslabs.github.io/dlt-meta/
Other
148 stars 66 forks source link

provide SQL Query support #88

Open ravi-databricks opened 1 month ago

ravi-databricks commented 1 month ago

Introduce sql query string sqlstmt via onboarding which can have joins to other static tables. This way after readStream we can do spark.sql(sqlstmt) This can also open gold layer possibilities