search

dbt-labs / dbt-codegen

Macros that generate dbt code
https://hub.getdbt.com/dbt-labs/codegen/latest/
Apache License 2.0
484 stars 106 forks source link

Support for external tables (databricks) #62

Closed lassebenni closed 1 year ago

lassebenni commented 2 years ago

Hi, I really like this package! Unfortunately it doesn't seem to support creating a source from external tables (e.g. Databricks Lakehouse).

I looked at the generate_source.sql` code, which calls dbt_utils.get_relations_by_pattern to create a list of tables. Unfortunately that only seems to work for relational databases(?). We are using the dbt-external-tables package to create our external (hive) tables, but it requires manually putting in all the source information and this package would be very helpful.

Do you think it would be a lot of work to make it work for external tables?

Olaktal commented 2 years ago

+1 for Redshift Spectrum external tables 🙏

github-actions[bot] commented 1 year ago

This issue has been marked as Stale because it has been open for 180 days with no activity. If you would like the issue to remain open, please comment on the issue or else it will be closed in 7 days.

github-actions[bot] commented 1 year ago

Although we are closing this issue as stale, it's not gone forever. Issues can be reopened if there is renewed community interest. Just add a comment to notify the maintainers.

bencmbrook commented 1 year ago

Commenting to reopen... this would be so valuable (+1 on Redshift Spectrum)

RobertDCI commented 1 year ago

+1 for databricks. This would be great