moby / swarmkit

A toolkit for orchestrating distributed systems at any scale. It includes primitives for node discovery, raft-based consensus, task scheduling and more.
Apache License 2.0
3.38k stars 616 forks source link

Job priorities, eviction and pre-emption #309

Open aluzzardi opened 8 years ago

aluzzardi commented 8 years ago

Right now, every Job has the same priority and if no candidate node is available the Task stays in PENDING state.

An alternative would be to provide a priority to every Job.

When no node is available to schedule a task, the scheduler would try to evict one or more lower priority task to make room for it.

Since eviction might be costly, Jobs could hint they are Preemptive - therefore informing the scheduler that it's okay to evict them to make room for someone else.

aluzzardi commented 8 years ago

Tentatively moving to 1.13. This may not be what we end up doing but it's still relevant

ziliangpeng commented 6 years ago

Is this issue still active? What's the plan?

machisuji commented 3 years ago

I need this badly. I don't think it's possible right now with swarmkit which will likely force me to use kubernetes (which does support preemption) instead.