MorrisJobke
commented
8 years ago - followup to #1
- this is an API endpoint that exposes exactly 1 pending task from the queue
- this should be used by a worker
- once the worker has finished the task, it should upload the performance metrics to the weasel API and update the queue task with a link to this new data (to allow for checking for updates)
- a task with such an link to the data should then be treated as a already solved task and will not be delivered to workers anymore
- a task could have following states:
- waiting for process
- delivered to worker (with a TTL to fallback to "waiting for process" to circumvent crashed workers and queue the task again)
- finished with a link to the metrics to allow polling for results by the process that queued the task - check out http://farazdagi.com/blog/2014/rest-long-running-jobs/