risingwavelabs / risingwave

Best-in-class stream processing, analytics, and management. Perform continuous analytics, or build event-driven applications, real-time ETL pipelines, and feature stores in minutes. Unified streaming and batch. PostgreSQL compatible.
https://go.risingwave.com/slack
Apache License 2.0
7.06k stars 581 forks source link

feat: support backfill_rate_limit for source backfill #19445

Closed xxchan closed 2 days ago

xxchan commented 3 days ago

I hereby agree to the terms of the RisingWave Labs, Inc. Contributor License Agreement.

What's changed and what's your intention?

fix #19297

This is a missing feature. We support source_rate_limit for shared source executor, but cannot rate limit source backfill before this PR.

Checklist

Documentation

Release note

If this PR includes changes that directly affect users or other significant modifications relevant to the community, kindly draft a release note to provide a concise summary of these changes. Please prioritize highlighting the impact these changes will have on users.

xxchan commented 3 days ago

This stack of pull requests is managed by Graphite. Learn more about stacking.

tabVersion commented 3 days ago

Please also leave some doc on how to use the source_rate_limit and backfill_rate_limit from the user's perspective. It is really confusing.

xxchan commented 3 days ago

https://github.com/risingwavelabs/risingwave-docs-new/pull/62

xxchan commented 2 days ago

Merge activity