search

NVIDIA / k8s-nim-operator

An Operator for deployment and maintenance of NVIDIA NIMs and NeMo microservices in a Kubernetes environment.
https://docs.nvidia.com/nim-operator/latest
Apache License 2.0
58 stars 14 forks source link

CRD nimcache miss #179

Closed iming0319 closed 1 month ago

iming0319 commented 1 month ago

file: deployments/helm/k8s-nim-operator/crds/apps.nvidia.com_nimcaches.yaml spec.resources Resources defines the minimum resources required for the caching job to run(cpu, memory, gpu). it missed a property "gpus" now GPUs CANNOT specifies the number of GPUs to assign to the caching job.

reference link: https://github.com/NVIDIA/k8s-nim-operator/blob/f678cd641c423c06425afe3f7647bd28213f4690/deployments/helm/k8s-nim-operator/crds/apps.nvidia.com_nimcaches.yaml#L70

shivamerla commented 1 month ago

@iming0319 we don't need to assign GPUs for caching job? Can you provide the use case?

iming0319 commented 1 month ago

I think this is because of the version gap. I'll study the new CRD