SeldonIO / seldon-core

An MLOps framework to package, deploy, monitor and manage thousands of production machine learning models
https://www.seldon.io/tech/products/core/
Other
4.37k stars 831 forks source link

How to set type of K8s Service created by SeldonDeployment #5299

Open tomaszstachera opened 8 months ago

tomaszstachera commented 8 months ago

Describe the bug

I don't know how to change Service type created by SeldonDeployment.

To reproduce

apiVersion: machinelearning.seldon.io/v1
kind: SeldonDeployment
metadata:
  name: multi
  namespace: tomasz
spec:
  predictors:
  - graph:
      implementation: TRITON_SERVER
      logger:
        mode: all
      modelUri: pvc://ts-seldon-4-volume/triton/multi
      name: multi
      type: MODEL
      endpoint:
        type: NodePort
    componentSpecs:
    - spec:
        containers:
        - name: multi
        tolerations:
          - key: SystemResources
            value: reservedFor
            effect: NoSchedule
    explainer:
      endpoint:
        type: NodePort
    name: default
    replicas: 1
    labels:
      sidecar.istio.io/inject: "true"
  protocol: v2

Expected behaviour

I would like to have NodePort service.

vidya4499 commented 2 weeks ago

want to work on this issue @tomaszstachera is this issue still exists