search

pachyderm / examples

A curated list of examples that use Pachyderm to accomplish various tasks.
62 stars 16 forks source link

Breast cancer detection example is broken with CRIO #7

Open RaananHadar opened 3 years ago

RaananHadar commented 3 years ago

I've deployed Pachyderm on AKS. Latest version of AKS don't seem to use the docker daemon anymore so deployment now works with --no-expose-docker-socket.

I've tried doing the breast cancer example right now and I saw that since it uses relative paths in the pipeline spec it doesn't work anymore.

I'm in the process of making this work, so hopefully I'll get a PR for this. But I wanted to get you a heads up for this as this is probably a general issue which affects all the other examples. To my understanding, the simplest solution is to provide the "working_dir" in the pipeline spec.

dgeorg42 commented 3 years ago

Thanks for bring this to our attention, Raanan! We have an effort underway to improve our documentation, which includes updating the included examples and tutorials. k8s deprecating the Docker runtime is definitely a thorn in our side right now. :). https://kubernetes.io/blog/2020/12/02/dont-panic-kubernetes-and-docker/

RaananHadar commented 3 years ago

Thanks. Its a minor issue, just wanted to let you know.

This issue can be solved in 2 ways:

  1. Changing the pipeline spec.
  2. Changing thr docker image.

I think the latter is a better option as it keeps a cleaner pipeline spec. However i did not see a Dockerfile in the repo, so its hard for me to solve this on my own.