Closed zhoujinsong closed 2 months ago
This issue has been automatically marked as stale because it has been open for 180 days with no activity. It will be closed in next 14 days if no further activity occurs. To permanently prevent this issue from being considered stale, add the label 'not-stale', but commenting on the issue is preferred when possible.
Description
Support switch from Changestore to Logstore automatically for flink source
Use case/motivation
Arctic use Changestore and Logstore to store CDC messages. Logstore use MQ(eg: Kafka) to distribute real-time cdc message. Changestore use iceberg table to store cdc message for analyse and provide near real-time incremental pull. In really use case, Logstore store message for several days and Changestore store message for a longer time. Flink source should support to read Changestore for early CDC messages and switch to Logstore when catch it up.
Describe the solution
Subtasks
Related issues
No response
Are you willing to submit a PR?
Code of Conduct