StarRocks / starrocks-connector-for-apache-flink

Apache License 2.0
195 stars 156 forks source link

[Enhancement] Support to retry for normal stream load #246

Closed banmoy closed 1 year ago

banmoy commented 1 year ago

What type of PR is this:

Which issues of this PR fixes :

Fixes #

Problem Summary(Required) :

Support to retry for normal stream load if it failed. Currently the retry for transaction stream load is not supported. The advantage of transaction load is to save memory usage. It splits data into batches, and release the memory for each batch after sending it to StarRocks. If support to retry, need to buffer all data in memory before the last batch success, and the memory usage will not be reduced. this will lose the advantage of transaction stream load

Checklist: