mlbench / mlbench-core

MLBench Framework Core Python Library
https://mlbench.github.io
Apache License 2.0
16 stars 10 forks source link

Halt when deploying the cluster with kind #423

Open nariaki3551 opened 2 years ago

nariaki3551 commented 2 years ago

Hi, I'm trying to use mlbench with Kubernetes-in-Docker (KIND). I've installed several libraries and mlbench-core==3.0.0 as described in the documentation, then I executed following command

$ mlbench create-cluster kind 3 my-cluster -k 1.19

, where k is kubectl version I installed.

However, it appears that the execution has halted; there was no change from the standard output below after 24 hours of execution.

Failed to import tensorflow.
Creating registry kind-registry
Creating cluster my-cluster-3
Deploying chart

I got the same error using kubectl whose version 1.15, which is the default kubectl version for mlbench. (It seems to be halting in mlbench-core/mlbench_core/cli/utils.py::deploy_chart)

What should I do to solve this?

Environments

OS: Ubuntu 20.04.3 LTS (GNU/Linux 5.11.0-34-generic x86_64) Python 3.9.12 mlbench, version 3.0.0 $ kubectl version Client Version: version.Info{Major:"1", Minor:"19", GitVersion:"v1.19.1", GitCommit:"206bcadf021e76c27513500ca24182692aabd17e", GitTreeState:"clean", BuildDate:"2020-09-09T11:26:42Z", GoVersion:"go1.15", Compiler:"gc", Platform:"linux/amd64"} Server Version: version.Info{Major:"1", Minor:"19", GitVersion:"v1.19.1", GitCommit:"206bcadf021e76c27513500ca24182692aabd17e", GitTreeState:"clean", BuildDate:"2020-09-14T07:30:52Z", GoVersion:"go1.15", Compiler:"gc", Platform:"linux/amd64"} $ helm version
version.BuildInfo{Version:"v3.9.0", GitCommit:"7ceeda6c585217a19a1131663d8cd1f7d641b2a7", GitTreeState:"clean", GoVersion:"go1.18.2"}

Building procedure

# freetype
apt-get install libfreetype6-dev

# cython
pip install --upgrade pip
pip install wheel
pip install cython

# mlbench-core v3.00
pip install mlbench-core==3.0.0

# kubectl v1.19.1-00
apt-get install kubectl=1.19.1-00

# helm
apt-get install helm

# kind v0.9.0 (download release binary)
wget https://github.com/kubernetes-sigs/kind/releases/download/v0.9.0/kind-linux-amd64
mv kind-linux-amd64 /some-dir-in-your-PATH/kind