search

SeldonIO / seldon-core

An MLOps framework to package, deploy, monitor and manage thousands of production machine learning models
https://www.seldon.io/tech/products/core/
Other
4.4k stars 832 forks source link

The CustomResourceDefinition "servers.mlops.seldon.io" is invalid: metadata.annotations: Too long: must have at most 262144 bytes #4708

Open eerhil opened 1 year ago

eerhil commented 1 year ago

Describe the bug

When applying seldon-v2-crds.yaml, I get the following error:

kubectl apply -f https://raw.githubusercontent.com/SeldonIO/seldon-core/v2.2.0/k8s/yaml/seldon-v2-crds.yaml 

customresourcedefinition.apiextensions.k8s.io/experiments.mlops.seldon.io unchanged
customresourcedefinition.apiextensions.k8s.io/models.mlops.seldon.io unchanged
customresourcedefinition.apiextensions.k8s.io/pipelines.mlops.seldon.io unchanged
customresourcedefinition.apiextensions.k8s.io/serverconfigs.mlops.seldon.io unchanged
The CustomResourceDefinition "servers.mlops.seldon.io" is invalid: metadata.annotations: Too long: must have at most 262144 bytes

To reproduce

  1. $ kubectl apply -f https://raw.githubusercontent.com/SeldonIO/seldon-core/v2.2.0/k8s/yaml/seldon-v2-crds.yaml

Expected behaviour

Apply would be successful

Environment

Kubernetes (AKS)

eerhil commented 1 year ago

I managed to overcome this by adding a flag --server-side=true . However, we are using Kustomize. Any ideas how to solve this on that side?

ukclivecox commented 1 year ago

Seems there is a long discussion here with suggestion but unclear if this is ideal.