search

dbt-labs / dbt-audit-helper

Useful macros when performing data audits
https://hub.getdbt.com/dbt-labs/audit_helper/latest/
Apache License 2.0
329 stars 40 forks source link

BigQuery compare_queries should materialize temporary tables for large queries #74

Closed graciegoheen closed 1 year ago

graciegoheen commented 1 year ago

Describe the feature

A clear and concise description of what you want to happen.

Right now, when you use compare_queries in BQ you may hit BQ limits for view definition. The work around is to materialize those queries as tables, then use the compare_relations macro.

Instead, compare_queries should materialize the queries as temporary tables in BQ, perform the comparison, then drop the tables.

Describe alternatives you've considered

A clear and concise description of any alternative solutions or features you've considered.

Additional context

Is this feature database-specific? Which database(s) is/are relevant? Please include any other relevant context here.

This is specific to BigQuery.

Who will this benefit?

What kind of use case will this feature be useful for? Please be specific and provide examples, this will help us prioritize properly.

Are you interested in contributing this feature?

github-actions[bot] commented 1 year ago

This issue has been marked as Stale because it has been open for 180 days with no activity. If you would like the issue to remain open, please comment on the issue or else it will be closed in 7 days.

github-actions[bot] commented 1 year ago

Although we are closing this issue as stale, it's not gone forever. Issues can be reopened if there is renewed community interest. Just add a comment to notify the maintainers.