We now throw an exception when we think the queue is full. This means we let Sidekiq take care of retrying jobs and automatically backing off.
So when there's been a big queue backlog it takes ages to catch up because Sidekiq has backed right off on most jobs. Meanwhile the server is there just tapping its finger waiting for more jobs.
We now throw an exception when we think the queue is full. This means we let Sidekiq take care of retrying jobs and automatically backing off.
So when there's been a big queue backlog it takes ages to catch up because Sidekiq has backed right off on most jobs. Meanwhile the server is there just tapping its finger waiting for more jobs.