openshift / instaslice-operator

InstaSlice Operator facilitates slicing of accelerators using stable APIs
Apache License 2.0
15 stars 12 forks source link

Discuss daemonset state removal #196

Open asm582 opened 4 weeks ago

asm582 commented 4 weeks ago

In the current system, the daemon set sets states in instance allocation to created (when mig slice is created on GPU with configmap added to pod namespaces) and deleted (when mig slice is deleted from the GPU with configmap deleted from the namespace). The controller can listen to config map events and move allocation to ungated when a config map create event occurs or remove allocation when a config map delete event occurs. This approach reduces the ping-pong for changing allocation status by two controllers for a pod.

harche commented 4 weeks ago

The events in k8s are not guaranteed to arrive in sequence. So in a rapidly starting and stopping, the deleted event may arrive before created one.