kubeflow / pipelines

Machine Learning Pipelines for Kubeflow
https://www.kubeflow.org/docs/components/pipelines/
Apache License 2.0
3.53k stars 1.59k forks source link

[sdk] Can't use ParallelFor on output of task with set_display_name #10371

Closed LotemAm closed 4 months ago

LotemAm commented 6 months ago

Environment

Steps to reproduce

Taking the following sample: https://github.com/kubeflow/pipelines/blob/master/components/contrib/datasets/HuggingFace/_samples/sample.pipeline.py and adding .set_display_name('Test') to load_dataset_op task, after this task succeeds, the loop fails to start with error:

KFP driver: driver.DAG(...) failed: failed to resolve inputs: resolving input parameter pipelinechannel--load-dataset-using-huggingface-splits with spec task_output_parameter:{producer_task:"load-dataset-using-huggingface" output_parameter_key:"splits"}: cannot find producer task "load-dataset-using-huggingface"

Expected result

Loop tasks start running

Materials and Reference


Impacted by this bug? Give it a 👍.

github-actions[bot] commented 4 months ago

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

github-actions[bot] commented 4 months ago

This issue has been automatically closed because it has not had recent activity. Please comment "/reopen" to reopen it.