fairing job backend: Papermill not installed in remote pod

aws-samples / eks-kubeflow-workshop

Kubeflow workshop on EKS. Mainly focus on AWS integration examples. Please go check kubeflow website http://kubeflow.org for other examples

Apache License 2.0

97 stars 55 forks source link

fairing job backend: Papermill not installed in remote pod #7

Closed otterley closed 4 years ago

otterley commented 4 years ago

Failed to launch fairing-job-s8kv5-9m4g7, reason: ContainerCannotRun, message: OCI runtime create failed: container_linux.go:348: starting container process caused "exec: \"papermill\": executable file not found in $PATH": unknown

Jeffwan commented 4 years ago

Looks like container build process ignore the requirements we pass to fairing. I will have a check

Jeffwan commented 4 years ago

I was using requirement-example.txt for testing purpose to avoid override other configs. This can be fixed by changing requirement to requirements.txt Otherwise, pip can not recognize the file.

%%writefile requirements.txt
papermill
jupyter

job = TrainJob("train.ipynb", input_files=["requirements.txt"], base_docker_image=BASE_IMAGE, docker_registry=DOCKER_REGISTRY, backend=KubeflowAWSBackend())
job.submit()