Create a V2 version of "Manipulate Kubernetes Resources as Part of a Pipeline"

hbelmiro commented 3 weeks ago

          @hbelmiro We also need to create a V2 version of ["Manipulate Kubernetes Resources as Part of a Pipeline"](https://www.kubeflow.org/docs/components/pipelines/v1/sdk/manipulate-resources/).

Its quite different in V2 as it uses the kfp[kubernetes] library:

I also note that there seem to be a few significant features missing (namely the ability to manipulate arbitrary resources, like the old v1 ResourceOp):

We could suggest people use a Python component with the kubernetes python library, but that should be a decision for the @kubeflow/pipelines leads.

Originally posted by @thesuperzapper in https://github.com/kubeflow/website/issues/3750#issuecomment-2148396967

hbelmiro commented 2 weeks ago

/area pipelines

Mohit-Verma-1688 commented 6 days ago

Is it possible to create a resource from yaml in the Kubeflowv2 version ? I checked the links but I am not able to understand how to achieve below code in KFPV2. Thank you in advance.

deploy_step = dsl.ResourceOp(
        name="seldondeploy",
        k8s_resource=seldon_config,
        attribute_outputs={"name": "{.metadata.name}"})

hbelmiro commented 6 days ago

@Mohit-Verma-1688 you can ask that in our Slack.

hbelmiro commented 6 days ago

@thesuperzapper, it seems like we already have a v2 page for this. https://www.kubeflow.org/docs/components/pipelines/user-guides/core-functions/platform-specific-features/

Mohit-Verma-1688 commented 5 days ago

@hbelmiro I am sorry but I am not able to find an example to load a k8s yaml file. I am very new to Kubeflow and still trying to understand. My end goal is to use seldon deployment step in the pipeline and deploy the seldon crd yaml from KFP pipeline as mentioned in below example for v1.

https://github.com/SeldonIO/seldon-core/tree/8eb787a536b4a9470eed6230b9def4e844fceab8/examples/kubeflow

hbelmiro commented 5 days ago

@Mohit-Verma-1688 This is not the right place to ask and discussing this here pollutes this issue. As I said before, can you please ask in our Slack?

kubeflow / website

Create a V2 version of "Manipulate Kubernetes Resources as Part of a Pipeline" #3752