search

databrickslabs / dlt-meta

Metadata driven Databricks Delta Live Tables framework for bronze/silver pipelines
https://databrickslabs.github.io/dlt-meta/
Other
156 stars 71 forks source link

provide SQL Query support #88

Open ravi-databricks opened 3 months ago

ravi-databricks commented 3 months ago

Introduce sql query string sqlstmt via onboarding which can have joins to other static tables. This way after readStream we can do spark.sql(sqlstmt) This can also open gold layer possibilities