search

SAME-Project / same-project

https://sameproject.ml/
Apache License 2.0
20 stars 8 forks source link

Pachyderm: Add support for uploading context to PFS #184

Closed bbonenfant closed 2 years ago

bbonenfant commented 2 years ago

This adds support for uploading the SAME context to PFS rather than storing it in a tarball and encoding it within the pipeline spec. An added bonus to this is that it considerably simplifies the "micro_entrypoint".

lukemarsden commented 2 years ago

Merging since the test failures seem to be related to a misconfigured long running kubeflow cluster, which is hopefully unrelated to this change!