kubeflow / pipelines

Machine Learning Pipelines for Kubeflow
https://www.kubeflow.org/docs/components/pipelines/
Apache License 2.0
3.55k stars 1.6k forks source link

[backend] <Cannot get MLMD objects from Metadata store. Cannot find context>(version 1.8.0 and 1.10.0) #11086

Open ZDowney926 opened 1 month ago

ZDowney926 commented 1 month ago

Environment

Steps to reproduce

Here is a pipeline issue, I try in KubeFlow both v1.8.0 and v1.10.0 ,it both have same issue. I have read relevant issue, and try lots of method, it doesn't work. It seems like MLMD problem?( I don't know is it about database?) I followed the example to build a simple pipeline, here is the code. image

The pipeline.yaml show: image image image

Then, I put the yaml file to pipleline image

I create run of pipeline, then I get the result of this "Cannot get MLMD objects from Metadata store.", if click Details, it shows image image


Impacted by this bug? Give it a 👍.

rimolive commented 1 month ago

https://github.com/kubeflow/manifests/tree/v1.10-branch is still under development. I recommend use https://github.com/kubeflow/manifests/tree/v1.9-branch or the v1.9.0 tag.

ESKYoung commented 1 month ago

I'm encountering the same issue, but from installing only Kubeflow Pipelines as detailed here. Will investigate the full installation.

nparkstar commented 1 week ago

I have the same problem.

nparkstar commented 1 week ago

I solved my issue at last. I did fresh install on the new machine, and the problem has not appear anymore.

But I think the following instruction is wrong. "Install individual components" of https://github.com/kubeflow/manifests/tree/v1.9.0.

I cannot connect to the central dashboard after installing kubeflow according to the above instruction.

I succeeded after installing using bellow command.

while ! kustomize build example | kubectl apply -f -; do echo "Retrying to apply resources"; sleep 10; done

Thanks,