kubeflow / pipelines

Machine Learning Pipelines for Kubeflow
https://www.kubeflow.org/docs/components/pipelines/
Apache License 2.0
3.61k stars 1.63k forks source link

ContainerBuilder support for non-GCR registries #1700

Closed gaoning777 closed 1 year ago

gaoning777 commented 5 years ago

Currently, the ContainerBuilder only supports the GCR. Expose the secret configurations for other content registries: https://github.com/GoogleContainerTools/kaniko#pushing-to-different-registries

sarahmaddox commented 5 years ago

@gaoning777 Can we close this issue, after the merge of the above PRs? We have a note in the docs that we can remove when this issue and https://github.com/kubeflow/pipelines/issues/337 are closed.

gaoning777 commented 5 years ago

Unfortunately, the container builder does not support other registries other than the GCR, yet.

gaoning777 commented 4 years ago

/unassign @gaoning777 /assign @numerology

HassanOuda commented 4 years ago

Any updates on this? What are the implications for container builder not supporting non-GCR registries? We cannot push our images to our own registries?

Trezorro commented 4 years ago

I'm trying to evaluate the proposition of using KubeFlow for my company's future ML training workflows. We want to use our local kubernetes cluster, to maintain data security, but this issue has me puzzled on whether we will be forced to set up our experiments via GCP instead.

Can anyone shed a light on this for a novice user?

sallamander commented 4 years ago

I'd like to echo what @Trezorro asked.. is it possible to use kubeflow and kubeflow pipelines with registries other than GCR? From the docs it sounds like it is possible, but I can't find a clear cut example (in the docs or elsewhere online) that spells out how to do this. Has anybody been able to pull an image from Amazon's ECR, or a private docker hub registry, and run a Kubeflow pipeline on it?

jarednielsen commented 4 years ago

Same here - has anyone pulled an image from Amazon ECR or Docker Hub? The tight linking to GCP would be a deal-breaker.

stale[bot] commented 4 years ago

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

Bobgy commented 4 years ago

To answer above questions, the container builder doesn't block any usage. You can use dockerfile to build component base images too.

stale[bot] commented 3 years ago

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

Bobgy commented 3 years ago

/lifecycle frozen