search

sassoftware / viya4-iac-k8s

This project contains Terraform scripts to provision cloud infrastructure resources, when using vSphere, and Ansible to apply the needed elements of a Kubernetes cluster that are required to deploy SAS Viya platform product offerings.
Apache License 2.0
23 stars 15 forks source link

Pod connectivity issue #125

Open henriquedanc opened 1 month ago

henriquedanc commented 1 month ago

Terraform Version Details

I'm creating a bare-metal environment on Ubuntu 22.04. I ran the IaC setup and install, and it finished successfully. However, I initially noticed that DNS resolution is not working for pods (all but pods running on the first control plane node, where core-dns is also running).

This is from a (helper) pod running in the first control plane node, where core-dns is also running:

image

This is from the helper pod running in all other nodes:

image

I then tried to reach the core-dns IP from the nodes. I can reach it from the node where it's running:

image

But I cannot reach it from any other nodes:

image

Terraform Variable File Details

No response

Ansible Variable File Details

ansible-vars-suppressed.yaml.txt inventory-suppressed.txt

Steps to Reproduce

Expected Behavior

Pod networking should work. Pods should be able to talk with each other.

Actual Behavior

Pod networking is broken. Pods cannot talk with each other.

Additional Context

I have this environment available if that would make troubleshooting easier.

References

No response

Code of Conduct

henriquedanc commented 1 month ago

Below is another test bypassing the service IP and trying a Pod IP directly. It fails if the client pod is not in the same node as the server pod:

image

And below is the same test from the hosts. The left one (that succeeds) is the host the server pod is running on. The right one is what I get from any other node.

image

jarpat commented 1 month ago

Hey @henriquedanc are you still running into this issue? Also, am I correct in assuming you are a SAS Employee?

henriquedanc commented 1 month ago

Hi @jarpat . Yes. And Yes :-)

dhoucgitter commented 1 month ago

Hi @henriquedanc, if you are comfortable doing so, please add your SAS company email address to your GitHub profile information so that we can more easily communicate with you, thanks.