Open bradsmin opened 1 year ago
Thanks for opening your first issue here! Be sure to follow the issue template!
@bradsmin As you described , it looks not like a DNS issue, but firewall issue
Further troubleshooting shows from inside system vm, only able to ping management server IP but no connection with any active ports of management server like ssh port , management ports like 8250 etc
is systemvm able to ping google DNS (8.8.8.8) ?
can you share the agent.properties on kvm host , xml dump of systemvm and output of some ovs commands ?
Yes, can ping 8.8.8.8 from inside systemvm but not able to ping google.com
ping 8.8.8.8 PING 8.8.8.8 (8.8.8.8): 56 data bytes 64 bytes from 8.8.8.8: icmp_seq=0 ttl=60 time=1.033 ms 64 bytes from 8.8.8.8: icmp_seq=1 ttl=60 time=0.966 ms
ping google.com ping: unknown host
agent.properties content
libvirt.vif.driver=com.cloud.hypervisor.kvm.resource.OvsVifDriver cluster=1 openvswitch.dpdk.enabled=true pod=1 resource=com.cloud.hypervisor.kvm.resource.LibvirtComputingResource private.network.device=cloudbr0 domr.scripts.dir=scripts/network/domr/kvm openvswitch.dpdk.ovs.path=/var/run/openvswitch guest.network.device=cloudbr0 keystore.passphrase= key exists , just for safety removed it here hypervisor.type=kvm port=8250 zone=1 public.network.device=cloudbr0 local.storage.uuid= ID exists, just for safety removed it here host=HOSTIP@static guid= guid exists , just for safety removed it here LibvirtComputingResource.id=1 network.bridge.type=openvswitch workers=5 iscsi.session.cleanup.enabled=false vm.migrate.wait=3600
xml dump attached as file . Only removed IPs, VNC infos, ids, and mac address values. xmldump.txt
Output of command ovs-vsctl show
Bridge cloud0 Port vnet0 Interface vnet0 Port vnet3 Interface vnet3 Port cloud0 Interface cloud0 type: internal Bridge cloudbr0 datapath_type: netdev Port vnet4 Interface vnet4 Port vnet1 Interface vnet1 Port cloudbr0 Interface cloudbr0 type: internal Port eno2 Interface eno2 type: dpdk options: {dpdk-devargs="id"} Port vnet5 Interface vnet5 Port vnet2 Interface vnet2 ovs_version: "2.17.3"
@bradsmin can you test openvswitch without dpdk ?
Yes, already done that. With out dpdk, openvswitch and cloudstack is working fine on a fresh install.
I have been experiencing the same issue. In my case (I am using linux bridge), I am able to make guest DNS working by disabling UFW on my Ubuntu KVM hosts. However, I haven't figured out a way to make UFW and guest DNS working together for better security.
@bradsmin have you defined the internal dns which isn't on your management network? This is because ssvm agent puts a routing rule to route traffic to the internal zone dns via its management/private network nic.
@bradsmin can you review the comments and advise? Have you also tried @li-liwen 's workaround to disable ufw (or firewalld).
Yes, internal dns defined ( provided google dns ) at the time of configuration. Also tried to disable ufw firewall at KVM host. But issue still exists.
ISSUE TYPE
COMPONENT NAME
CLOUDSTACK VERSION
CONFIGURATION
Zone with default Advanced networking with Isolation method as VLAN Zone has only one "Physical Network 1" with all traffic types Guest, Management, Public, Storage passing through it KVM Management Server and KVM Host are same. Its a testing environment OpenVswitch and DPDK enabled and created bridge interface using OpenVswitch commands Primany and Secondary with NFS mount points
OS / ENVIRONMENT
Ubuntu 22.04.2 LTS Codename: jammy
SUMMARY
The System VMs Agent state is not Up
STEPS TO REPRODUCE
EXPECTED RESULTS
ACTUAL RESULTS