Orange-OpenSource / towards5gs-helm

Helm charts for deploying 5G network services on Kubernetes
Other
167 stars 130 forks source link

Problem deploying free5gc on cluster #18

Closed MrBurawski closed 2 years ago

MrBurawski commented 2 years ago

Hello, I am using the cluster which consists of two laptops connected via the network. I deploy the free5gc charts from the cluster control-plane (all preliminary requirements seem to be fullfilled). However, while all other pods are doployed on the master node, the amf, upf and smf are not initializing on the worker nodes, as on screenshot image

When describing a pod i get the following message: OutputPodDescribe.txt

Where it seems, that all the time when adding interfaces, there is some missing link which doesn't allow Multus CNI to create the container: Warning FailedCreatePodSandBox 111s (x184 over 11m) kubelet (combined from similar events): Failed to create pod sandbox: rpc error: code = Unknown desc = failed to create pod network sandbox k8s_free5gc-free5gc-smf-smf-68fbcd7db9-dbj8l_5gtest_358cfc0f-40a2-4d02-92e8-d380eb6326bb_0(3ecb690e00ac792823ee8b02226e323a001e05ca8126275b76757a4b1fb171a6): error adding pod 5gtest_free5gc-free5gc-smf-smf-68fbcd7db9-dbj8l to CNI network "multus-cni-network": [5gtest/free5gc-free5gc-smf-smf-68fbcd7db9-dbj8l:n4network-smf]: error adding container to network "n4network-smf": Link not found

What could be the problem here? (Master node is untainted and allows pods scheduling, node103 is on the same laptop with master node and node193 is on the another laptop). Should i expect to have all the pods deployed on the single node? Maybe I should try deploying them specifically from the worker nodes? Thank You in advance.

Here is node description: NodesDescribe.txt

MrBurawski commented 2 years ago

Only master node allows access to the kubectl and therefore to the helm charts. Should i try creating persistent volume on the worker node?

fhgrings commented 2 years ago

@MrBurawski Did you create the eth1 interface? It look like UPF error when configuring eth1 tunneling, I guess.

navarrothiago commented 2 years ago

@MrBurawski this problem happened with me when I didn't configure properly the interfaces in SMF. Run ip a on your node and check the physical interfaces that you want to set the global.n4network.masterIf variable. Other possibility is that your Multus CNI was not configured properly, because all the components that have a secondary interface (SMF, UPF and AMF) were not initialized in your setup.

MrBurawski commented 2 years ago

Thanks for everyone who replied. The problem was indeed with the missing configuration of the ip address of a eth0 interface on one of the nodes. In addition, i have also renamed the network interfaces to eth0 and eth1. I will attach the screenshots of the netplan yaml configuration, which is working for my cluster. (sudo nano /etc/netplan/00-installer-config.yaml). Control-plane: image

Worker node 1: image

Worker node 2: unknown

Therefore, i am closing the issue