kubeflow / kfp-tekton

Kubeflow Pipelines on Tekton
https://developer.ibm.com/blogs/kubeflow-pipelines-with-tekton-and-watson/
Apache License 2.0
171 stars 121 forks source link

Nested pipelines #1338

Open omriel1 opened 11 months ago

omriel1 commented 11 months ago

/kind question

Question: Hi! Is there any way to create nested pipelines or nested components in KFP-Tekton V1?

I'm looking for similar functionality like as the one introduced in KFP V2 (pipelines-as-components) but in KFP-Tekton V1.

Thank you in advance

Tomcli commented 11 months ago

Hi @OmriLevyTau, in KFP v1, nested pipelines are simply embedded the pipeline into another pipeline. It doesn't create a subdag like in KFP V2. This applies to both Argo and Tekton backend.

For KFP-Tekton v1 nested pipelines, you can check out this example. https://github.com/kubeflow/kfp-tekton/blob/master/sdk/python/tests/compiler/testdata/compose.py

For KFP-Tekton v2 nested pipelines, you can use the example pipelines-as-components and run it on top of the KFP-Tekton v2 release.

omriel1 commented 11 months ago

Thank you! I appreciate the detailed answer!