PeerDB-io / peerdb

Fast, Simple and a cost effective tool to replicate data from Postgres to Data Warehouses, Queues and Storage
https://peerdb.io
Other
2.17k stars 88 forks source link

BigQuery: check if pkeys can be used for clustering #2002

Closed Amogh-Bharadwaj closed 1 month ago

Amogh-Bharadwaj commented 1 month ago

When clustering the tables in SetupNormalize for BigQuery we must account for: https://cloud.google.com/bigquery/docs/clustered-tables#cluster_column_types