risingwavelabs / risingwave

Best-in-class stream processing, analytics, and management. Perform continuous analytics, or build event-driven applications, real-time ETL pipelines, and feature stores in minutes. Unified streaming and batch. PostgreSQL compatible.
https://go.risingwave.com/slack
Apache License 2.0
6.8k stars 563 forks source link

Support background index #15603

Open kwannoel opened 6 months ago

kwannoel commented 6 months ago

An interesting usecase for background ddl is that we can use it for transient errors.

Typically in foreground ddl, if there's some transient error, the entire stream job will fail.

But with background ddl, since the stream job is persisted, after recovery it can continue execution.

Mentioned by @zwang28

kwannoel commented 3 months ago

Waiting for sql backend recovery tests. https://github.com/risingwavelabs/risingwave/issues/12802