intel / vck

Volume Controller for Kubernetes
https://ai.intel.com/kubernetes-volume-controller-kvc-data-management-tailored-for-machine-learning-workloads-in-kubernetes/
Apache License 2.0
67 stars 17 forks source link

Replace NodeAffinity with Labels #6

Closed elsonrodriguez closed 6 years ago

elsonrodriguez commented 6 years ago

Currently the mechanism used to keep track of what data is where is a nodeAffinity. This causes a few problems:

  1. If a node in the list goes away, or a node is added, the list must be reconciled
  2. Pods spawned by templates will not get the updated list, causing uneven distribution of pods.

A better approach to this is to manage affinity by tagging nodes with labels reflecting the kvc volumes. This way pods can always be matched to the data with a freshly reconciled node list.