man8pr commented 6 months ago

What this PR changes/adds

Added:

extensions/common/gcp/gcp-core/.../bigquery : common classes including BQ DataAddress, service client, and theBigQuery DataAddress Validator Extension to register DataAddress validators
extensions/control-plane/provision/provision-bigquery : BQ provisioner for generating access token for data plane sink, including the BigQuery Provision Extension to register the provisioner

Why it does that

The PR adds first basic version of the BigQuery extension to exchange data to and from BigQuery tables.

Also included small license fix for GCS and Secret Manager extensions
To be added in following PR:
- BigQuery data plane
Limitations for this version:
- provisioner requires destination table to exist, doesn't create new table if it doesn't
- data is committed to the destination table only if no error occurred during the data transmission
- no transmission retry in case of error
- results are fetched via pages (size is fixed, 4 rows), max. size for serialized page data is 16 KiB

paullatzelsperger commented 6 months ago

@man8pr the DEPENDENCIES file is messed up. I suggest you just regenerate it, then we can merge this PR

man8pr commented 6 months ago

I will clean up the dependencies mess and open again the PR