vmware / container-service-extension

Container Service for VMware vCloud Director
https://vmware.github.io/container-service-extension
Other
77 stars 52 forks source link

Unable to start cse #1300

Open rvvliet78 opened 2 years ago

rvvliet78 commented 2 years ago

Describe the bug

We've deployed cse but are unable to connect to mqtt, VCD does connect properly. This is the error we get when starting cse:

cse.sh[6461]: Exception in MessageConsumer thread. About to stop thread due to : WebSocket handshake error, connection not upgraded

Reproduction steps

Followed the cse 3.1.2 greenfield install docs

Expected behavior

Not to het this error

Additional context

No response

rocknes commented 2 years ago

Can you please try to set verify_ssl under mqtt section to False in CSE config file and restart the CSE server?

I believe this is related to TLS being enabled on the machine which is running VCD.

rvvliet78 commented 2 years ago

This is already set to false.

rocknes commented 2 years ago

It is hard to say what is going on here, CSE uses paho library for mqtt connections and the errors you are noticing are originating from the library directly. Most of he time it is a configuration issue. Is the MQTT service running on vcd machine. Can you please check that? If it is running and you are still unable to connect, I guess then we will have start sniffing packets between CSE and VCD to figure the issue.

rvvliet78 commented 2 years ago

Just an update form our side, we found that pointing the CSE service directly to a backend node "fixes" the problem. So it seems with a Loadbalancer between the CSE and VCD makes that it doesn't work. We however have no other issues with the load balancer and we can fully access the VCD API from the CSE server, which makes me believe that there are extra configuration settings needed on the Loadbalancer, is there any documentation on this?