search

dpinney / omf

The Open Modeling Framework for smart grid cost-benefit analysis.
https://omf.coop
GNU General Public License v2.0
112 stars 60 forks source link

*20 Add a queued status to the cluster worker. #84

Closed dpinney closed 10 years ago

dpinney commented 11 years ago

Right now, we can't terminate queued jobs if there are more than 10 jobs in the queue. It's an issues with the SQS APIs.

So instead, when we run, put the job in the queue and set DB analysis status to queued. When we take it off the queue, switch it to running on the DB and run it locally. When we terminate a queued job in this model, keep reading the job queue until we find that job and take it off.

Think about how the DB and queue could get out of sync...

dpinney commented 10 years ago

NAI on account of decommissioning the cluster.