Open amacharya opened 6 months ago
That docs is not up to date. Try with this yaml
apiVersion: "serving.kserve.io/v1beta1"
kind: "InferenceService"
metadata:
name: "sklearn-iris-example"
spec:
predictor:
minReplicas: 1
sklearn:
protocolVersion: v1
resources:
limits:
cpu: 100m
memory: 512Mi
requests:
cpu: 100m
memory: 512Mi
We are planning to deprecate trained models
. So I don't recommend using it.
I've run into the same issue today, though the reason being that the MutiatingWebhookConfiguration for the /mutate-pod
endpoint provided in the v0.12.0 manifests ignores all namespaces with the control-plane
label set. Seems sensible, but I wanted everything needed for Kserve to be in a singular namespace, including the deployed inference services. Therefore either patch the Webhook config to specifically allow the kserve namespace (though i cant recommend it for prod, im just doing this on a test cluster in which i have only access to one namespace) or move the inference service to another namespace.
In general it would be cool if that would be mentioned somewhere, cuz in tightly controlled environments it can happen that everything is in the same namespace.
I've run into the same issue today, though the reason being that the MutiatingWebhookConfiguration for the
/mutate-pod
endpoint provided in the v0.12.0 manifests ignores all namespaces with thecontrol-plane
label set. Seems sensible, but I wanted everything needed for Kserve to be in a singular namespace, including the deployed inference services. Therefore either patch the Webhook config to specifically allow the kserve namespace (though i cant recommend it for prod, im just doing this on a test cluster in which i have only access to one namespace) or move the inference service to another namespace.In general it would be cool if that would be mentioned somewhere, cuz in tightly controlled environments it can happen that everything is in the same namespace.
@DerTiedemann - You can follow this - https://kserve.github.io/website/0.11/get_started/
I was able to unblock myself, and it worked for me.
I've also struggled with that the webhook completely ignoring any pods that are running in the system namespace (`server) without error.
I recommend creating an explicit error instead of ignoring the webhook but still creating the deployment for the iscv runtime. IMO, the error should already happen in the validation webhook of the isvc
itself that it does not allow to be deployed in the system namespace.
/kind bug
What steps did you take and what happened: [A clear and concise description of what the bug is.]
Ref - https://kserve.github.io/website/master/admin/kubernetes_deployment/
kind - kubernetes v1.25 Istio - v1.16.0 Cert Manager - v1.14.2 kserve v0.11.0 (deployed kserve without knative)
on my kind k8s cluster.
ref - https://github.com/kserve/kserve/tree/master/docs/samples/multimodelserving/sklearn
What did you expect to happen:
Any help would be appreciated.
What's the InferenceService yaml: [To help us debug please run
kubectl get isvc $name -n $namespace -oyaml
and paste the output]Anything else you would like to add: [Miscellaneous information that will assist in solving the issue.]
Environment: kind - kubernetes v1.25
kubectl version
):/etc/os-release
):Similar issue ref - https://github.com/kserve/kserve/issues/3082
cc @terrytangyuan @sivanantha321