Experimented for some time around VXLAN in VXLAN on Amit's env, currently shut down
Managed to get two OVN clusters up and running in Kind to experiment further
Following the change of direction (one peering IP per {service, VPC}), I went back to experimenting with the Hedgehog Fabric. Currently trying to set up two kube-ovn clusters and have them talk together.
Current workflow
```bash
# Host
rm -rf ~/.hhfab
hhfab init -p vlab --fabric-mode collapsed-core
hhfab build
hhfab vlab up --restrict-servers=false
# Host (2)
hhfab vlab setup-vpcs
# control-1
kubectl fabric vpc peer --vpc vpc-01 --vpc vpc-02
# Host (2)
hhfab vlab ssh --vm server-01 sudo ip route add 10.0.2.0/24 dev bond0.1001 via 10.0.1.1 src 10.0.1.10 proto static metric 1024
hhfab vlab ssh --vm server-02 sudo ip route add 10.0.1.0/24 dev bond0.1002 via 10.0.2.1 src 10.0.2.10 proto static metric 1024
# server-01
curl -sfL https://get.k3s.io | sh -s - --flannel-backend=none --disable-network-policy --disable=traefik --write-kubeconfig-mode 644 --write-kubeconfig ~/.kube/config
sudo mount --bind /opt/bin /usr/local/bin
wget https://raw.githubusercontent.com/kubeovn/kube-ovn/release-1.12/dist/images/install.sh
sed -i 's/^POD_CIDR=".*"/POD_CIDR="10.42.0.0\/24"/' install.sh
sed -i 's/^POD_GATEWAY=".*"/POD_GATEWAY="10.42.0.1"/' install.sh
sed -i 's/^SVC_CIDR=".*"/SVC_CIDR="10.43.0.0\/16"/' install.sh
ENABLE_IC=true bash ./install.sh
# kube-ovn installation doesn't complete, server-01 VM network connection and apiserver connection on server-01 become unstable.
# Bonus command for copy-paste:
wget https://github.com/derailed/k9s/releases/download/v0.32.5/k9s_Linux_amd64.tar.gz && tar xf k9s_Linux_amd64.tar.gz
```
Status 2024-10-22: Still in progress :roll_eyes:
Current workflow
```bash # Host rm -rf ~/.hhfab hhfab init -p vlab --fabric-mode collapsed-core hhfab build hhfab vlab up --restrict-servers=false # Host (2) hhfab vlab setup-vpcs # control-1 kubectl fabric vpc peer --vpc vpc-01 --vpc vpc-02 # Host (2) hhfab vlab ssh --vm server-01 sudo ip route add 10.0.2.0/24 dev bond0.1001 via 10.0.1.1 src 10.0.1.10 proto static metric 1024 hhfab vlab ssh --vm server-02 sudo ip route add 10.0.1.0/24 dev bond0.1002 via 10.0.2.1 src 10.0.2.10 proto static metric 1024 # server-01 curl -sfL https://get.k3s.io | sh -s - --flannel-backend=none --disable-network-policy --disable=traefik --write-kubeconfig-mode 644 --write-kubeconfig ~/.kube/config sudo mount --bind /opt/bin /usr/local/bin wget https://raw.githubusercontent.com/kubeovn/kube-ovn/release-1.12/dist/images/install.sh sed -i 's/^POD_CIDR=".*"/POD_CIDR="10.42.0.0\/24"/' install.sh sed -i 's/^POD_GATEWAY=".*"/POD_GATEWAY="10.42.0.1"/' install.sh sed -i 's/^SVC_CIDR=".*"/SVC_CIDR="10.43.0.0\/16"/' install.sh ENABLE_IC=true bash ./install.sh # kube-ovn installation doesn't complete, server-01 VM network connection and apiserver connection on server-01 become unstable. # Bonus command for copy-paste: wget https://github.com/derailed/k9s/releases/download/v0.32.5/k9s_Linux_amd64.tar.gz && tar xf k9s_Linux_amd64.tar.gz ```