search

pingcap-inc / tidb2dw

Replicate data changes from TiDB to Data Warehouses in real-time
MIT License
13 stars 7 forks source link

fix(cdc): BigQuery only accept base64 for binary field #86

Closed wd0517 closed 9 months ago

wd0517 commented 9 months ago

refer: https://cloud.google.com/bigquery/docs/loading-data-cloud-storage-csv#data_types

Dumpling already supports defining CSV dialect to output binary as base64/hex. This PR will configure CDC to do the same thing.

wd0517 commented 9 months ago

@Lloyd-Pottiger PTAL