search

dbt-labs / dbt-external-tables

dbt macros to stage external sources
https://hub.getdbt.com/dbt-labs/dbt_external_tables/latest/
Apache License 2.0
286 stars 115 forks source link

enable concurrent tests on same target warehouse #271

Open dataders opened 3 months ago

dataders commented 3 months ago

even though matrix testing is available. it can't run concurrently because ostensibly two tests against the same DWH would collide: e.g. testing dbt-redshift==1.6.0 and dbt-redshift==1.70. Neither can two PRs run CI against the same warehouse concurrently

This is because the schema is hardcoded. It should instead by dynamic with perhaps generated GHA-run-id-related.

However this requires also doing #171 and #272

https://github.com/dbt-labs/dbt-external-tables/blob/383ee3cedefd15102dfb7427fb5f1e061ad41e4f/integration_tests/ci/sample.profiles.yml#L20