StarRocks / starrocks-connector-for-apache-spark

Apache License 2.0
36 stars 53 forks source link

[Feature] Support to trigger flush according to the number of buffered rows #78

Closed banmoy closed 1 year ago

banmoy commented 1 year ago

What type of PR is this:

Which issues of this PR fixes :

Fixes #

Problem Summary(Required) :

This PR adds a new option starrocks.write.buffer.rows to control how to trigger flush according the number of buffered rows in a table. If the number of rows reaches the limitation, send these data to StarRocks. This PR is based on https://github.com/StarRocks/starrocks-connector-for-apache-flink/pull/267

Checklist: