search

dbt-labs / dbt-bigquery

dbt-bigquery contains all of the code required to make dbt operate on a BigQuery database.
https://github.com/dbt-labs/dbt-bigquery
Apache License 2.0
223 stars 157 forks source link

[dbt-bigquery] Microbatch Strategy #1354

Closed MichelleArk closed 2 months ago

MichelleArk commented 2 months ago

As part of https://github.com/dbt-labs/dbt-core/issues/10624, dbt-bigquery needs to implement a microbatch incremental strategy.

In bigquery, this will use the insert_overwrite mechanism while additionally (ideally) setting the partitions value statically under the hood.

The base tests from dbt-adapters 1.6 should also be inherited and included as part of this work.