SeldonIO / seldon-core

An MLOps framework to package, deploy, monitor and manage thousands of production machine learning models
https://www.seldon.io/tech/products/core/
Other
4.33k stars 827 forks source link

Cannot create new SeldonDeployment after seldon-core automatic update from 1.5 to 1.6 #3005

Closed FrancescoFanchin closed 3 years ago

FrancescoFanchin commented 3 years ago

Describe the bug

After seldon-core automatic update, from 1.5 to 1.6, we are not able to create a new SeldonDeployment from yaml file. The following error message appears: "Error "failed calling webhook "v1.mseldondeployment.kb.io": Post https://seldon-webhook-service.xxxxxxxxxxxxxxxx/mutate-machinelearning-seldon-io-v1-seldondeployment?timeout=30s: x509: certificate signed by unknown authority (possibly because of "crypto/rsa: verification error" while trying to verify candidate authority certificate "Seldon")" for field "undefined".

To reproduce

  1. Go to Seldon Operator
  2. Create Seldon Deployment
  3. Insert a yaml template that is expected to work (e.g. default mock classifier)

Expected behaviour

Seldon Operator should create a new SeldonDeployment.

Environment

Openshift 4 on Azure

ukclivecox commented 3 years ago

Are you running on Openshift and installed via the Marketplace?

For now - can you simply delete the MWC and check this solve this.

FrancescoFanchin commented 3 years ago

Seldon is running on Openshift and was installed via Operatorhub, but not the Marketplace one. We deleted the MWC and it worked, many thanks!