cloudfoundry-incubator / kubecf

Cloud Foundry on Kubernetes
Apache License 2.0
115 stars 62 forks source link

Multiple environment setup of kubecf with single/multi-operator not working #1710

Open divyaaswath opened 3 years ago

divyaaswath commented 3 years ago

Describe the bug I am trying to get multi-environment setup for kubecf (eirini enabled). Having trouble with the setup. Trying to achieve multi-env setup with a single quarks operator and 2 pods do not seem to move past CrashLoopBackOff state.

cf-apps-dns pod is in CrashLoopBackOff state and below is its logs:

Listen: listen tcp :53: bind: permission denied

database-0 pod is stuck in CrashLoopBackOff state and below is the logs:

chown: changing ownership of '/var/lib/mysql/public_key.pem': Operation not permitted
chown: changing ownership of '/var/lib/mysql': Operation not permitted
chown: changing ownership of '/var/log/mysqld.log': Operation not permitted

Tried the multi-operator multi-environment setup as well and although installation is successful, we cannot do a cf-push in the first environment. Noticed that some pods although are all up have errors in them. cf-apps-dns pod has the below error:

[INFO] plugin/reload: Running configuration MD5 = 61f83ad89ee44c5a0857c1575d2ed928
CoreDNS-1.7.0
linux/amd64, go1.15.2,
[ERROR] plugin/errors: 2 622515394376455650.4712288795810336393. HINFO: read udp 172.30.239.155:57813->172.21.93.216:53: read: connection refused
[ERROR] plugin/errors: 2 622515394376455650.4712288795810336393. HINFO: read udp 172.30.239.155:52441->172.21.93.216:53: read: connection refused
[ERROR] plugin/errors: 2 622515394376455650.4712288795810336393. HINFO: read udp 172.30.239.155:53313->172.21.93.216:53: read: connection refused

To Reproduce Followed instructions given on: https://quarks.suse.dev/docs/quarks-operator/install/#multiple-namespaces for quarks install. Tried both single operator option and multi-operator option while installing kubecf Expected behavior Multi-environment kubecf install should be successful and a cf-push of any application should be possible in these multiple environments

Environment

Additional context Tried to install 2 environments - dev and test via both single and multi-operator options and both have failed.