Feat/dynamic queue with concurrency - Githubissues

hibiken / asynq

Simple, reliable, and efficient distributed task queue in Go

MIT License

10.03k stars 716 forks source link

Feat/dynamic queue with concurrency #973

Open pcmid opened 2 days ago

pcmid commented 2 days ago

Implemented #250, based on #879, cc @kanzihuang, with support for dynamically adding queues and controlling concurrency levels.

Not fully verified, but it works perfectly for my use case: a distributed spider with concurrency control.

Known issues:

[ ] We need a global lock to protect the server’s restart operation.
[ ] When the server is running, setting the queue concurrency does not take effect.