[connector] Fluss Connector support batch source.

alibaba / fluss

Fluss is a streaming storage built for real-time analytics.

https://alibaba.github.io/fluss-docs

Apache License 2.0

701 stars 155 forks source link

Open loserwang1024 opened 1 day ago

loserwang1024 commented 1 day ago

Fix https://github.com/alibaba/fluss/issues/40, Support batch read table without datalake enabled.

For primary table, batch read will apply cdc log which includes [+I, -U, +U, -D] to snapshot data, and then emit to downstream,
For Log table, batch read will read a segment of log which only include +I and then emit to downstream directly.

CLAassistant commented 1 day ago

All committers have signed the CLA.