digitalocean / k8s-staticroute-operator

Create static routes for your k8s nodes using CRDs.
52 stars 11 forks source link

Indeterministic behavior while switching gateways #23

Open Tang8330 opened 1 year ago

Tang8330 commented 1 year ago

As per title.

I have this set up such that any AWS or GCP resources will go through my egress gateway.

However, I would like to have some redundancies by having 2 gateways such that I can swap one out, reboot, etc...and achieve HA.

When I switch gateways, the mapping does not change and when running describe static route, it shows that none of the routes are ready.

Checking events is also extremely extremely slow / verging on not being able due to how many events there are.

For context, the number of CIDR ranges I am trying to load is ~2k (list from GCP and AWS). I have increased the memory limit for my staticRoute operator from 150Mi to 512Mi.

Any help would be appreciated.

Tang8330 commented 1 year ago

One thing I also noticed -- when changing the gateway and then running describe kubectl describe staticroute NAME.

The K8 resource status still points to the old gateway.

nabillarahmanizhafira commented 1 month ago

Hi is there any update on this? 😓