search

unity-sds / unity-sps-prototype

Apache License 2.0
2 stars 7 forks source link

[New Feature]: Refactor the HySDS workers as a Kubernetes DaemonSet #170

Closed LucaCinquini closed 1 year ago

LucaCinquini commented 1 year ago

Checked for duplicates No duplicates exist.

Alternatives considered An alternative approach is to bring the HySDS workers outside of the Kubernetes cluster into independent AWS ASGs, but this approach will take longer and will be possibly implemented in the future.

Describe the feature request Currently the HySDS Verdi workers are implemented as a Pod. Transform them instead into a K8s DaemonSet such that K8s will automatically create a Verdi pod for every Node in the system. Additionally, constraints can be established such that the Verdi worker is never created on the same node that hosts Mozart, GRQ or Metrics.

LucaCinquini commented 1 year ago

In case it is useful, this is an example of how a DaemonSet for CWS workers is implemented for M2020 Pixl/Sherloc: https://github.jpl.nasa.gov/iSDS/CWS_Docker/blob/master/kubernetes/cws-worker-daemonset.yaml

LucaCinquini commented 1 year ago

Drew implemented, Luca tested.