Adds more config options to the connector.

GoogleCloudDataproc / flink-bigquery-connector

BigQuery integration to Apache Flink's Table API

Apache License 2.0

15 stars 11 forks source link

Adds more config options to the connector. #144

Closed prashastia closed 2 months ago

prashastia commented 2 months ago

sinkParallelism - Integer value indicating the parallelism of the sink job

/gcbrun

prashastia commented 2 months ago

/gcbrun

jayehwhyehentee commented 2 months ago

@prashastia when is the parallelism from your config used to set sink's actual runtime parallelism?

prashastia commented 2 months ago

@prashastia when is the parallelism from your config used to set sink's actual runtime parallelism?

Set under getSinkRuntimeProvider, SinkV2Provider() sets the sink's actual runtime parallelism. getSinkRuntimeProvider() is executed at Runtime when .executeInsert() or similar method is executed.