FEAT: Producer side rate limiting

flipkart-incubator / varadhi

Apache License 2.0

26 stars 4 forks source link

FEAT: Producer side rate limiting #173

Open anuj-flipkart opened 3 weeks ago

anuj-flipkart commented 3 weeks ago

Sub Task:

Implementation
Simulation to test rate limiting behaviour

iosdev747 commented 2 weeks ago

POC code is ready and metrics are added (OTEL)
Some skewness simulations are done

Remaining

Production readiness code in progress and under review
Address corner cases and remaining todos in the PR

iosdev747 commented 5 days ago

Tried probabilistic approach which performs ways better in case where skewness is changing a lot. But it performs slightly worse in normal cases (continuous breach of quota and not much change in skewness)

iosdev747 commented 9 hours ago

Added unit tests for rate limiting module.