search

galaxyproject / cloudman

Easily create and manage compute clusters on any Cloud.
https://galaxyproject.org/cloudman/
37 stars 23 forks source link

Improve node draining #116

Closed nuwang closed 4 years ago

nuwang commented 4 years ago

Make sure that any jobs scheduled on a node are complete before attempting to drain it. This works by:

  1. First cordoning the node, so no new jobs are scheduled on it
  2. Waiting for running job pods on that node to complete (will wait for upto an hour)
  3. Draining the node
  4. Deleting the node
coveralls commented 4 years ago

Coverage Status

Coverage decreased (-0.08%) to 93.446% when pulling 7fbd6deb538b3f2d2c309b280f47f463b98637ff on improve_node_draining into 60ed1b5ea27aa8212257007567b68379a046628e on master.