Memory used during recovery surges

risingwavelabs / risingwave

SQL engine for event-driven workloads. Perform streaming analytics, or build event-driven applications, real-time ETL pipelines, and feature stores in minutes. Unified streaming and batch processing. PostgreSQL compatible.

https://www.risingwave.com/slack

Apache License 2.0

6.71k stars 550 forks source link

Memory used during recovery surges #16676

Open kwannoel opened 3 months ago

kwannoel commented 3 months ago

Describe the bug

During recovery, memory consumption increases greatly, and meta goes in a oom crash loop.

Error message/log

No response

To Reproduce

No response

Expected behavior

No response

How did you deploy RisingWave?

No response

The version of RisingWave

No response

Additional context

No response

kwannoel commented 3 months ago

Root cause: https://github.com/risingwavelabs/risingwave/issues/16742