unity-sds / unity-sps-prototype

Apache License 2.0
2 stars 7 forks source link

[New Feature]: Scale the number of worker nodes in the Kubernetes cluster #171

Closed LucaCinquini closed 1 year ago

LucaCinquini commented 1 year ago

Describe the feature request

Provide a concrete implementation to the SPS API pre-warm request. For now, the implementation could directly call the K8s functionality to scale the number of replicas in a DaemonSet - see examples here: https://www.containiq.com/post/kubectl-scale

Later, we need to decouple the details of the specific Kubernetes implementation - perhaps implementing a registration model where a specific ADES implementation registers itself with a WPS-T front-end, and then under a scaling request the WPS-T method invokes ADES specific functionality.

LucaCinquini commented 1 year ago

Drew updated the SPS API to increase/decrease the number of nodes of a U-SPS cluster. Works great including reporting errors when trying to set the number of nodes outside of the allowed range.