search

antrea-io / antrea

Kubernetes networking based on Open vSwitch
https://antrea.io
Apache License 2.0
1.62k stars 346 forks source link

Document Egress Subnet Support in VPC #6365

Open rajnkamr opened 1 month ago

rajnkamr commented 1 month ago

Antrea supports adding subnet other than Node's network, From Antrea v1.15, IPs can be allocated from a subnet different from the Node IPs. In VPC scenario, need to document behavior as in VPC , Egress ip from subnet other than node's subnet have to be assigned as secondary ip on primary interface. In VPC, HA case, Usually k8 operator (as in general case without VPC) can be implemented to configure the Egress IP as the secondary IP of the primary network interface of the Egress Node instance. However for subnet other than node's subnet an additional gateway must also exist to facilitate Egress traffic. Document following scenarios 1.Configure Egress Subnet other than node's subnet in VPC 2.Handle HA case in VPC with Egress subnet other than node's network. 3.Egress gateway configuration wrt VPC. 4.Configuring multiple subnets

tnqn commented 1 month ago

I don't know which VPC it refers to and whether it is really supported. The working VPC I'm aware of is only AWS and it's already documented: https://github.com/antrea-io/antrea/blob/main/docs/egress.md#egress-on-cloud

rajnkamr commented 1 month ago

Specially We would need to elaborate cases related to using externalippool crd in egress in vpc, currently secondary interface addition in aws is documented ,although it is explanatory for static ip case, however when using externalippool crd (different from nodes's subnet/same as node's subnet) , as secondary interface in aws is configured manually as given here might not work!, also for HA case for externalippools , we might like to enhance the doc wrt mentioned points in subject.

Also it might be useful to create a task for automating HA case while using antrea with Kubernetes Operator which watches the Egress API.