Add non-Delta as Sink - Githubissues

databrickslabs / dlt-meta

This is metadata driven DLT based framework for bronze/silver pipelines

Other

125 stars 54 forks source link

Open ravi-databricks opened 2 months ago

ravi-databricks commented 2 months ago

Support non delta as sink using metadata approach.

In metadata if sink is non delta use Structure streaming approach with foreachbatch
Use DAB to deploy non-DLT pipelines to databricks workspace