search

databrickslabs / dlt-meta

Metadata driven Databricks Delta Live Tables framework for bronze/silver pipelines
https://databrickslabs.github.io/dlt-meta/
Other
156 stars 71 forks source link

Mismatched Keys: Update read_dlt_delta() with key "source_database" instead of "database" #33

Closed rtdtwo closed 7 months ago

rtdtwo commented 10 months ago

Issue:

When the bronze_dataflow_spec dataframe is created in onboard_dataflowspec.py, the database is included with key source_database in the sourceDetails field. However, in pipeline_readers.py > read_dlt_delta(), it is accessed with key database instead.

Fix:

Change the key to source_database in pipeline_readers.py > read_dlt_delta().

CLAassistant commented 10 months ago

CLA assistant check
All committers have signed the CLA.

ravi-databricks commented 10 months ago

Please fix Unit Tests

prabhat-ratnala commented 7 months ago

Can this be resolved please?

ravi-databricks commented 7 months ago

merged this for v0.0.7 release.

ravi-databricks commented 7 months ago

@prabhat-ratnala this is fixed in release v.0.0.7