SeldonIO / seldon-core

An MLOps framework to package, deploy, monitor and manage thousands of production machine learning models
https://www.seldon.io/tech/products/core/
Other
4.39k stars 833 forks source link

feat(cli): cli as k8s deployment for debugging #6090

Open sakoush opened 4 days ago

sakoush commented 4 days ago

What this PR does / why we need it:

This PR creates a docker image seldonio/seldon-cli with Seldon CLI prepackaged in it. Users can then deploy this image in Kubernetes alongside Core 2 installation in the same namespace.

This PR also factors out kafka config code into a top level component so that it can be used by the cli and especially in a Kubernetes deployment where it can have access to seldon-kafka ConfigMap for consumer config.

We have disabled also Seldon CLI control plane operations (e.g. load and unload) by default as they can cause inconsistencies in Kubernetes installation. They can be re-enabled with the flag --force.

Docs have been also adjust and perhaps it would be a good entrypoint to review the changes of this PR. Link to rendered docs here.

Which issue(s) this PR fixes:

Fixes Infra-1269 (internal)

Special notes for your reviewer: