apache / doris-flink-connector

Flink Connector for Apache Doris
https://doris.apache.org/
Apache License 2.0
309 stars 219 forks source link

[Enhancement] How can I set the startup_mode to synchronize from the specified timestamp? #468

Open Hub-Wling opened 1 month ago

Hub-Wling commented 1 month ago

Search before asking

Description

I have a very large table and for some reason the synchronous redo log is overwritten, so i missing the kafka offset; the situation is that I can manually fix the data myself and I don t want to sync the historical data; So how can I start syncing the data from the specified time point?

Solution

No response

Are you willing to submit PR?

Code of Conduct

JNSimba commented 3 weeks ago

You can refer to here https://nightlies.apache.org/flink/flink-docs-master/docs/connectors/datastream/kafka/#starting-offset