abcxyz / github-metrics-aggregator

Apache License 2.0
11 stars 3 forks source link

big query optimization: new table that is partitioned and clustered #136

Closed pdewilde closed 9 months ago

pdewilde commented 9 months ago

This should make a new BigQuery table that is also subscribed to the existing topic, creating a dual write scenario.

The new table also uses JSON as the type for the payload. It can be fed from a string in BigQuery so it should "just work"