Rewrite snapshot source consumer semantic for flink - Githubissues

tidb-incubator / TiBigData

TiDB connectors for Flink/Hive/Presto

Apache License 2.0

211 stars 57 forks source link

Rewrite snapshot source consumer semantic for flink #239

Closed humengyu2012 closed 1 year ago

humengyu2012 commented 1 year ago

What is the purpose of the change

Rewrite snapshot source consumer semantic for flink

Brief change log

Encode current row to generate new split when checkpoint in flink.

Verifying this change

This change added tests and can be verified as follows:

Previous tests;
Add some new tests in io.tidb.bigdata.tidb.codec.TiDBEncodeHelperTest.

Does this pull request potentially affect one of the following parts:

Dependencies (does it add or upgrade a dependency): no
The public API: no
The runtime per-record code paths (performance sensitive): yes

Documentation

Does this pull request introduce a new feature? yes
If yes, how is the feature documented? docs

humengyu2012 commented 1 year ago

run-all-tests

humengyu2012 commented 1 year ago

/run-all-tests

humengyu2012 commented 1 year ago

/run-all-tests

humengyu2012 commented 1 year ago

https://github.com/tidb-incubator/TiBigData/pull/240