celery / ceps

Celery Enhancement Proposals
27 stars 15 forks source link

AMQP, prefetch limit 1 #5

Open carlhoerberg opened 6 years ago

carlhoerberg commented 6 years ago

Default to worker_prefetch_multiplier = 1 Most celery workers doesn't have a throughput that justifies a large prefetch amount, and second, you use AMQP global prefetch instead of consumer level prefetch, which is A LOT heavier for the server: https://www.rabbitmq.com/consumer-prefetch.html