Microbatch Strategy

[MichelleArk]

resolves #1354 docs dbt-labs/docs.getdbt.com/#

Problem

As part of https://github.com/dbt-labs/dbt-core/issues/10624, dbt-bigquery needs to implement a microbatch incremental strategy.

Solution

• Ensuring partition_by is set + has the same granularity as batch_size
• Calling insert_overwrite, which will use dynamic partition if partitions not set
• Follow up: static microbatch for perf improvement: https://discourse.getdbt.com/t/benchmarking-incremental-strategies-on-bigquery/981 🚀

Checklist

• [x] I have read the contributing guide and understand what's expected of me
• [x] I have run this code in development and it appears to resolve the stated issue
• [x] This PR includes tests, or tests are not required/relevant for this PR
• [x] This PR has no interface changes (e.g. macros, cli, logs, json artifacts, config files, adapter interface, etc) or this PR has already received feedback and approval from Product or DX

[github-actions[bot]]

Thank you for your pull request! We could not find a changelog entry for this change. For details on how to document a change, see the dbt-bigquery contributing guide.

[github-actions[bot]]

Thank you for your pull request! We could not find a changelog entry for this change. For details on how to document a change, see the dbt-bigquery contributing guide.