vhive-serverless / vHive

vHive: Open-source framework for serverless experimentation
MIT License
265 stars 84 forks source link

Error in creating one node cluster. Attaching the log files. #953

Closed Prithvi-Velicheti closed 4 months ago

Prithvi-Velicheti commented 4 months ago

Describe the bug ERROR: 12:19:44 system.go:85: Executing shell command: sudo kubeadm init --ignore-preflight-errors=all --cri-socket unix:///etc/vhive-cri/vhive-cri.sock --pod-network-cidr=192.168.0.0/16 --kubernetes-version 1.29.1 ERROR: 12:19:44 system.go:86: Stderr from shell: [WARNING FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml]: /etc/kubernetes/manifests/kube-apiserver.yaml already exists [WARNING FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml]: /etc/kubernetes/manifests/kube-controller-manager.yaml already exists [WARNING FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml]: /etc/kubernetes/manifests/kube-scheduler.yaml already exists [WARNING FileAvailable--etc-kubernetes-manifests-etcd.yaml]: /etc/kubernetes/manifests/etcd.yaml already exists [WARNING CRI]: container runtime is not running: output: time="2024-03-06T12:17:47+01:00" level=fatal msg="validate service connection: validate CRI v1 runtime API for endpoint \"unix:///etc/vhive-cri/vhive-cri.sock\": rpc error: code = Unimplemented desc = unknown service runtime.v1.RuntimeService" , error: exit status 1 [WARNING ImagePull]: failed to pull image registry.k8s.io/kube-apiserver:v1.29.1: output: time="2024-03-06T12:17:47+01:00" level=fatal msg="validate service connection: validate CRI v1 image API for endpoint \"unix:///etc/vhive-cri/vhive-cri.sock\": rpc error: code = Unimplemented desc = unknown service runtime.v1.ImageService" , error: exit status 1 [WARNING ImagePull]: failed to pull image registry.k8s.io/kube-controller-manager:v1.29.1: output: time="2024-03-06T12:17:48+01:00" level=fatal msg="validate service connection: validate CRI v1 image API for endpoint \"unix:///etc/vhive-cri/vhive-cri.sock\": rpc error: code = Unimplemented desc = unknown service runtime.v1.ImageService" , error: exit status 1 [WARNING ImagePull]: failed to pull image registry.k8s.io/kube-scheduler:v1.29.1: output: time="2024-03-06T12:17:48+01:00" level=fatal msg="validate service connection: validate CRI v1 image API for endpoint \"unix:///etc/vhive-cri/vhive-cri.sock\": rpc error: code = Unimplemented desc = unknown service runtime.v1.ImageService" , error: exit status 1 [WARNING ImagePull]: failed to pull image registry.k8s.io/kube-proxy:v1.29.1: output: time="2024-03-06T12:17:48+01:00" level=fatal msg="validate service connection: validate CRI v1 image API for endpoint \"unix:///etc/vhive-cri/vhive-cri.sock\": rpc error: code = Unimplemented desc = unknown service runtime.v1.ImageService" , error: exit status 1 [WARNING ImagePull]: failed to pull image registry.k8s.io/coredns/coredns:v1.11.1: output: time="2024-03-06T12:17:48+01:00" level=fatal msg="validate service connection: validate CRI v1 image API for endpoint \"unix:///etc/vhive-cri/vhive-cri.sock\": rpc error: code = Unimplemented desc = unknown service runtime.v1.ImageService" , error: exit status 1 [WARNING ImagePull]: failed to pull image registry.k8s.io/pause:3.9: output: time="2024-03-06T12:17:48+01:00" level=fatal msg="validate service connection: validate CRI v1 image API for endpoint \"unix:///etc/vhive-cri/vhive-cri.sock\": rpc error: code = Unimplemented desc = unknown service runtime.v1.ImageService" , error: exit status 1 [WARNING ImagePull]: failed to pull image registry.k8s.io/etcd:3.5.10-0: output: time="2024-03-06T12:17:48+01:00" level=fatal msg="validate service connection: validate CRI v1 image API for endpoint \"unix:///etc/vhive-cri/vhive-cri.sock\": rpc error: code = Unimplemented desc = unknown service runtime.v1.ImageService" , error: exit status 1 error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster To see the stack trace of this error execute with --v=5 or higher ERROR: 12:19:44 logs.go:64: [exit 1] -> [WARNING FileAvailable--etc-kubernetes-manifests-kube-apiserver.yaml]: /etc/kubernetes/manifests/kube-apiserver.yaml already exists [WARNING FileAvailable--etc-kubernetes-manifests-kube-controller-manager.yaml]: /etc/kubernetes/manifests/kube-controller-manager.yaml already exists [WARNING FileAvailable--etc-kubernetes-manifests-kube-scheduler.yaml]: /etc/kubernetes/manifests/kube-scheduler.yaml already exists [WARNING FileAvailable--etc-kubernetes-manifests-etcd.yaml]: /etc/kubernetes/manifests/etcd.yaml already exists [WARNING CRI]: container runtime is not running: output: time="2024-03-06T12:17:47+01:00" level=fatal msg="validate service connection: validate CRI v1 runtime API for endpoint \"unix:///etc/vhive-cri/vhive-cri.sock\": rpc error: code = Unimplemented desc = unknown service runtime.v1.RuntimeService" , error: exit status 1 [WARNING ImagePull]: failed to pull image registry.k8s.io/kube-apiserver:v1.29.1: output: time="2024-03-06T12:17:47+01:00" level=fatal msg="validate service connection: validate CRI v1 image API for endpoint \"unix:///etc/vhive-cri/vhive-cri.sock\": rpc error: code = Unimplemented desc = unknown service runtime.v1.ImageService" , error: exit status 1 [WARNING ImagePull]: failed to pull image registry.k8s.io/kube-controller-manager:v1.29.1: output: time="2024-03-06T12:17:48+01:00" level=fatal msg="validate service connection: validate CRI v1 image API for endpoint \"unix:///etc/vhive-cri/vhive-cri.sock\": rpc error: code = Unimplemented desc = unknown service runtime.v1.ImageService" , error: exit status 1 [WARNING ImagePull]: failed to pull image registry.k8s.io/kube-scheduler:v1.29.1: output: time="2024-03-06T12:17:48+01:00" level=fatal msg="validate service connection: validate CRI v1 image API for endpoint \"unix:///etc/vhive-cri/vhive-cri.sock\": rpc error: code = Unimplemented desc = unknown service runtime.v1.ImageService" , error: exit status 1 [WARNING ImagePull]: failed to pull image registry.k8s.io/kube-proxy:v1.29.1: output: time="2024-03-06T12:17:48+01:00" level=fatal msg="validate service connection: validate CRI v1 image API for endpoint \"unix:///etc/vhive-cri/vhive-cri.sock\": rpc error: code = Unimplemented desc = unknown service runtime.v1.ImageService" , error: exit status 1 [WARNING ImagePull]: failed to pull image registry.k8s.io/coredns/coredns:v1.11.1: output: time="2024-03-06T12:17:48+01:00" level=fatal msg="validate service connection: validate CRI v1 image API for endpoint \"unix:///etc/vhive-cri/vhive-cri.sock\": rpc error: code = Unimplemented desc = unknown service runtime.v1.ImageService" , error: exit status 1 [WARNING ImagePull]: failed to pull image registry.k8s.io/pause:3.9: output: time="2024-03-06T12:17:48+01:00" level=fatal msg="validate service connection: validate CRI v1 image API for endpoint \"unix:///etc/vhive-cri/vhive-cri.sock\": rpc error: code = Unimplemented desc = unknown service runtime.v1.ImageService" , error: exit status 1 [WARNING ImagePull]: failed to pull image registry.k8s.io/etcd:3.5.10-0: output: time="2024-03-06T12:17:48+01:00" level=fatal msg="validate service connection: validate CRI v1 image API for endpoint \"unix:///etc/vhive-cri/vhive-cri.sock\": rpc error: code = Unimplemented desc = unknown service runtime.v1.ImageService" , error: exit status 1 error execution phase wait-control-plane: couldn't initialize a Kubernetes cluster To see the stack trace of this error execute with --v=5 or higher ERROR: 12:19:44 logs.go:64: Failed to create cluster! ERROR: 12:19:44 logs.go:64: Faild subcommand: create_one_node_cluster!

To Reproduce create_one_node_cluster_logs.zip ./setup_tool create_one_node_cluster firecracker

Prithvi-Velicheti commented 4 months ago

it looks like kubelet service is not functioning properly?

Prithvi-Velicheti commented 4 months ago

issue is not with vhive, its about kube and containerd compatibility.