ixti / sidekiq-throttled

Concurrency and rate-limit throttling for Sidekiq
MIT License
713 stars 77 forks source link

Dynamic Throttling depending on usage #187

Open farojos opened 7 months ago

farojos commented 7 months ago

My goal is to allow at least 100 jobs per account with a maximum of 600 concurrent jobs in a minute. However, I would like this to be dynamic based on the usage of the queue.

For instance, if there is high usage of the queue (e.g., 300 jobs in a minute), I would like the system to automatically decrease the maximum jobs per account to 20. Similarly, if there are 500 jobs in a minute, the system should decrease the maximum jobs per account to 10.

Could this be possible? Any guidance or suggestions would be greatly appreciated.