loxilb-io / kube-loxilb

Implementation of kubernetes service load-balancer spec for loxilb
Apache License 2.0
89 stars 26 forks source link

In-cluster mode with Cilium? #158

Closed stevefan1999-personal closed 2 weeks ago

stevefan1999-personal commented 3 months ago

Load balancing doesn't seems to work in my case where I have Cilium installed, nor it was documented, is it supported?

UltraInstinct14 commented 3 months ago

Due to both cilium and loxilb using their own eBPF implementations, loxilb (in-cluster mode) and cilium might be incompatible. And I believe nobody has given a serious enough try.

Nonetheless, I will give it a try and report more details.

UltraInstinct14 commented 3 months ago

Update - It is possible to run loxilb(in-cluster mode) and cilium provided you run loxilb pod with multus. There is guide of running loxilb(external mode) with cilium. In this guide, loxilb runs as a docker in the same pod and uses mac-vlan interface to get packets to itself before cilium gets hands on it.

In the same way, loxilb pod in-cluster can use multus to get a secondary interface hooked to it and get things working. There was a blog which used a similar concept although not with cilium. Will try to write a README for this when time permits.

TrekkieCoder commented 2 weeks ago

Updated guide here