Buffered writer for exactly once sink

GoogleCloudDataproc / flink-bigquery-connector

BigQuery integration to Apache Flink's Table API

Apache License 2.0

15 stars 11 forks source link

Buffered writer for exactly once sink #156

Closed jayehwhyehentee closed 1 week ago

jayehwhyehentee commented 2 weeks ago

Create writer used by exactly once sink, following the two-phase commit protocol. This writer uses BQ's buffered stream for appending data to the table.

Note to reviewers: this PR is bloated by tests

/gcbrun

jayehwhyehentee commented 2 weeks ago

@clmccart kindly review this PR