search

kubeflow / pipelines

Machine Learning Pipelines for Kubeflow
https://www.kubeflow.org/docs/components/pipelines/
Apache License 2.0
3.55k stars 1.6k forks source link

Organize Pipelines samples and tutorials in an ordered curriculum #2490

Closed Ark-kun closed 5 months ago

Ark-kun commented 4 years ago

I think we should have some organization in the samples. Currently samples are like the "Index" of a technical book - they're organized alphabetically. There is no order, no curriculum. There is no distinction between notebooks and python files. Niche topics come before fundamental topics. Etc.

There should be a place where the users see clearly structured tutorials:

Pipelines 101 - Creating pipeline from existing components
Pipelines 102 - Creating pipeline that access GCP resources
Pipelines 103 - Creating components from python functions
Pipelines 104 - Passing data for python components
Pipelines 105 - Creating components from container images
Pipelines 106 - Creating components from command-line programs
Pipelines 107 - Creating components from Airflow operators

Pipelines 201 - Control structures: Conditionals
Pipelines 202 - Control structures: ParallelFor loops
Pipelines 203 - Control structures: Recursive loops
Pipelines 204 - Code generation
Pipelines 205 - Execution options: Retries
Pipelines 206 - Control structures: Exit handlers

Pipelines 301 - Execution options: Kubernetes container options
Pipelines 302 - Execution options: Kubernetes pod options
Pipelines 303 - Pipeline packages - create, submit, upload
Pipelines 304 - Kubeflow Pipelines server API client
Pipelines 305 - Creating Kubernetes objects as part of pipeline
Ark-kun commented 4 years ago

Some initial tutorials: https://github.com/Ark-kun/kfp_samples/tree/ae1a5b6/2019-10%20Kubeflow%20summit

stale[bot] commented 4 years ago

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

stale[bot] commented 4 years ago

This issue has been automatically closed because it has not had recent activity. Please comment "/reopen" to reopen it.

rimolive commented 5 months ago

Closing this issue. No activity for more than a year.

/close

google-oss-prow[bot] commented 5 months ago

@rimolive: Closing this issue.

In response to [this](https://github.com/kubeflow/pipelines/issues/2490#issuecomment-2016818785): >Closing this issue. No activity for more than a year. > >/close Instructions for interacting with me using PR comments are available [here](https://git.k8s.io/community/contributors/guide/pull-requests.md). If you have questions or suggestions related to my behavior, please file an issue against the [kubernetes/test-infra](https://github.com/kubernetes/test-infra/issues/new?title=Prow%20issue:) repository.