slidoapp / dbt-superset-lineage

Make dbt docs and Apache Superset talk to one another
MIT License
134 stars 18 forks source link

update: Replace `catalog.json` with `manifest.json` #4

Closed one-data-cookie closed 2 years ago

one-data-cookie commented 2 years ago

As generating docs through dbt docs generate often takes a while, it is less economical to use catalog.json than manifest.json that gets created with every compile (dbt compile or as a part of dbt run or dbt docs generate). This could be done because we don't need information about the current state of database, only what's documented in dbt, because we can only create refs to these tables anyway.

Tested by running the code – resulted in the same output as the code on main.

one-data-cookie commented 2 years ago

Terrific, cheers! 👑