Support for non-incremental materialized views in BQ

[kevin-meyers]

Community Note

• Please vote on this issue by adding a 👍 reaction to the original issue to help the community and maintainers prioritize this request
• Please do not leave "+1" or "me too" comments, they generate extra noise for issue followers and do not help prioritize the request
• If you are interested in working on this issue or have submitted a pull request, please leave a comment. If the issue is assigned to the "modular-magician" user, it is either in the process of being autogenerated, or is planned to be autogenerated soon. If the issue is assigned to a user, that user is claiming responsibility for the issue. If the issue is assigned to "hashibot", a community member has claimed the issue already.

Description

Non-incremental is a materialized view option available via api or directly in the OPTIONS clause of sql. It enables materialized view support for many more situations, including our current need for a left join: https://cloud.google.com/bigquery/docs/materialized-views-create#non-incremental

From my cursory search, it looks like this could be as simple as adding the flag and a few lines to expandMaterializedView and flattenMaterializedView.

New or Affected Resource(s)

• google_bigquery_table

Potential Terraform Configuration

-- copied option values from example listed at link above
resource "google_bigquery_table" "test" {
  dataset_id          = google_bigquery_dataset.test.dataset_id
  table_id            = "test"
  materialized_view {
    query = "SELECT ..."
    refresh_interval_ms = "3600000"
    enable_refresh = true
    -- NEW BELOW
    allow_non_incremental_definition = true
    max_staleness = "INTERVAL '4' HOUR"
  }
}

• b/293782461

[sachinpro]

This should be fixed by the #8725.