SAME-Project / same-project

https://sameproject.ml/
Apache License 2.0
20 stars 8 forks source link

BLOCKING FEATURE: Adding instructions/requiring external mounted storage #125

Open aronchick opened 2 years ago

aronchick commented 2 years ago

In continuing to try to get Kubeflow v1 and v2 working, the ephemeral storage support is REALLY spotty. Lots of weird, hard to track down bugs. My proposal - we have instructions how to add a storage bucket and mount that storage bucket into kubeflow on all the major clouds, and then use that storage rather than relying on the ephemeral storage provided. I don't think this is insanely challenging, and will eliminate a large class of bugs (I suspect).

Thoughts? cc @lukemarsden @Bubblyworld

lukemarsden commented 2 years ago

Yes. Consider using minio proxy to unify the access on our side

On Sat, 7 May 2022, 01:31 David Aronchick, @.***> wrote:

In continuing to try to get Kubeflow v1 and v2 working, the ephemeral storage support is REALLY spotty. Lots of weird, hard to track down bugs. My proposal - we have instructions how to add a storage bucket and mount that storage bucket into kubeflow on all the major clouds, and then use that storage rather than relying on the ephemeral storage provided. I don't think this is insanely challenging, and will eliminate a large class of bugs (I suspect).

Thoughts? cc @lukemarsden https://github.com/lukemarsden @Bubblyworld https://github.com/Bubblyworld

— Reply to this email directly, view it on GitHub https://github.com/SAME-Project/same-project/issues/125, or unsubscribe https://github.com/notifications/unsubscribe-auth/AACATUUAQYGVUKWDWSQ5I33VIW2UZANCNFSM5VJSHUAQ . You are receiving this because you were mentioned.Message ID: @.***>