streaming: make ingestion job start by restoring a backup, and then picking up from a stream

cockroachdb / cockroach

CockroachDB — the cloud native, distributed SQL database designed for high availability, effortless scale, and control over data placement.

https://www.cockroachlabs.com

Other

30.18k stars 3.82k forks source link

streaming: make ingestion job start by restoring a backup, and then picking up from a stream #57414

Open pbardea opened 3 years ago

pbardea commented 3 years ago

When creating an ingestion job, the user should be able to specify a backup file to restore from and then start consuming a stream from the timestamp at which it restored. This enables users to have a way to catch up on the initial set of data, and then continuously keep up to date with the source.

Jira issue: CRDB-3548

Epic CRDB-14841

kenliu commented 3 years ago

test comment, please ignore

github-actions[bot] commented 8 months ago

We have marked this issue as stale because it has been inactive for 18 months. If this issue is still relevant, removing the stale label or adding a comment will keep it active. Otherwise, we'll close it in 10 days to keep the issue queue tidy. Thank you for your contribution to CockroachDB!