search

mitodl / odl-video-service

building blocks for a basic video service for ODL
BSD 3-Clause "New" or "Revised" License
4 stars 1 forks source link

Replace Redis with RabbitMQ as celery backend #170

Open giocalitri opened 7 years ago

giocalitri commented 7 years ago

This will allow an easy deployment for EC2 and we will not have to deal with external services that might cause crashes of our application in case of maximum number of connections.

pdpinch commented 7 years ago

Is this necessary for #54 ?

giocalitri commented 7 years ago

No, this is because this app uses way more connections to redis than other applications and we can easily run out of them if we scale the number of celery workers. I talked with Tobias and he told me that we have reliable formulas to deploy our own RabbitMQ cluster. Then I spoke with Nathan and we agreed that RabbitMQ is a better choice as broker in the long term for Celery.