search

OpenAddressesUK / ernest

Open Addresses' "Ingester" software component
http://openaddressesuk.org/docs/
MIT License
1 stars 0 forks source link

Add queuing #3

Closed pezholio closed 10 years ago

pezholio commented 10 years ago

We need to post off API requests to a queue, to avoid too much load on the server. Does Heroku have a queuing system?

Floppy commented 10 years ago

Is this just an in-app queue, or the general job queue? If just in-app, I think we can probably just use delayed job. Heroku can handle a background worker, though it will cost us some cash to have another process.

pezholio commented 10 years ago

Yeah, good call. Do we not get a worker dyno too on the free tier though?

Floppy commented 10 years ago

No, that takes us out of it.

pezholio commented 10 years ago

Hmmmm... DelayedJob looks like a faff to set up sans Rails. Could use Resque combined with RedisToGo free tier?

Floppy commented 10 years ago

That would also work.

pezholio commented 10 years ago

Also, we could have resque running on another app (similar to how we work with services maanger), which means we don't need to worry about going over the free tier!

pezholio commented 10 years ago

Wait, no. That's bullshit. Ignore me