Open czeslavo opened 10 months ago
czeslavo
commented
10 months ago It was only partially mitigated in https://github.com/Kong/kubernetes-ingress-controller/pull/5029 where we've changed those logs level to debug (as that was the expected level for them).
Despite that, it would be good to reproduce the issue and find the root cause.
parkjeongryul
commented
3 months ago We found the same issue. And I'm not sure if it was caused by this issue, but the ingress controller would no longer reconcile.
It was resolved after manually restarting the ingress controller. The client IPs in the logs were not present at the time.
I think we should look into this issue further.
[clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:50:13+09:00" level=error msg="already created client for \"https://172.24.61.5:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.61.5:8444/status\": dial tcp 172.24.61.5:8444: connect: connection refused" logger=setup.readiness-checker |
-- | --
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:50:13+09:00" level=error msg="already created client for \"https://172.24.70.34:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.70.34:8444/status\": dial tcp 172.24.70.34:8444: connect: connection refused" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:50:13+09:00" level=error msg="already created client for \"https://172.24.83.228:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.83.228:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:50:12+09:00" level=error msg="already created client for \"https://172.24.92.68:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.92.68:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:50:11+09:00" level=error msg="already created client for \"https://172.24.65.36:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.65.36:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:50:10+09:00" level=error msg="already created client for \"https://172.24.81.86:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.81.86:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:50:09+09:00" level=error msg="already created client for \"https://172.24.81.245:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.81.245:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:50:08+09:00" level=error msg="already created client for \"https://172.24.82.41:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.82.41:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:50:07+09:00" level=error msg="already created client for \"https://172.24.85.158:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.85.158:8444/status\": dial tcp 172.24.85.158:8444: connect: connection refused" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:50:07+09:00" level=error msg="already created client for \"https://172.24.61.226:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.61.226:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:50:06+09:00" level=error msg="already created client for \"https://172.24.83.84:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.83.84:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-9dlsn/ingress-controller] time="2024-05-24T11:50:06+09:00" level=error msg="already created client for \"https://172.24.61.226:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.61.226:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:50:05+09:00" level=error msg="already created client for \"https://172.24.90.230:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.90.230:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-9dlsn/ingress-controller] time="2024-05-24T11:50:05+09:00" level=error msg="already created client for \"https://172.24.102.39:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.102.39:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:50:04+09:00" level=error msg="already created client for \"https://172.24.87.249:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.87.249:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:50:03+09:00" level=error msg="already created client for \"https://172.24.102.39:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.102.39:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-vhkj5/ingress-controller] time="2024-05-24T11:50:02+09:00" level=error msg="failed to fill-in defaults for plugin: request-transformer" url="https://172.24.15.86:8444" |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:50:02+09:00" level=error msg="already created client for \"https://172.24.74.201:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.74.201:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-9dlsn/ingress-controller] time="2024-05-24T11:49:54+09:00" level=error msg="already created client for \"https://172.24.72.20:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.72.20:8444/status\": EOF" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-9dlsn/ingress-controller] time="2024-05-24T11:49:54+09:00" level=error msg="already created client for \"https://172.24.62.243:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.62.243:8444/status\": dial tcp 172.24.62.243:8444: connect: connection refused" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-9dlsn/ingress-controller] time="2024-05-24T11:49:54+09:00" level=error msg="already created client for \"https://172.24.65.36:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.65.36:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-9dlsn/ingress-controller] time="2024-05-24T11:49:53+09:00" level=error msg="already created client for \"https://172.24.60.7:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.60.7:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-9dlsn/ingress-controller] time="2024-05-24T11:49:52+09:00" level=error msg="already created client for \"https://172.24.107.98:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.107.98:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:49:51+09:00" level=error msg="already created client for \"https://172.24.98.226:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.98.226:8444/status\": dial tcp 172.24.98.226:8444: connect: connection refused" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:49:51+09:00" level=error msg="already created client for \"https://172.24.78.197:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.78.197:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-9dlsn/ingress-controller] time="2024-05-24T11:49:51+09:00" level=error msg="already created client for \"https://172.24.78.197:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.78.197:8444/status\": dial tcp 172.24.78.197:8444: i/o timeout" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:49:50+09:00" level=error msg="already created client for \"https://172.24.68.222:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.68.222:8444/status\": dial tcp 172.24.68.222:8444: connect: connection refused" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:49:50+09:00" level=error msg="already created client for \"https://172.24.107.98:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.107.98:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-9dlsn/ingress-controller] time="2024-05-24T11:49:50+09:00" level=error msg="already created client for \"https://172.24.85.158:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.85.158:8444/status\": dial tcp 172.24.85.158:8444: connect: connection refused" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-9dlsn/ingress-controller] time="2024-05-24T11:49:50+09:00" level=error msg="already created client for \"https://172.24.90.47:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.90.47:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:49:49+09:00" level=error msg="already created client for \"https://172.24.108.59:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.108.59:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:49:48+09:00" level=error msg="already created client for \"https://172.24.62.243:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.62.243:8444/status\": dial tcp 172.24.62.243:8444: connect: connection refused" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:49:48+09:00" level=error msg="already created client for \"https://172.24.94.146:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.94.146:8444/status\": EOF" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:49:48+09:00" level=error msg="already created client for \"https://172.24.75.47:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.75.47:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:49:47+09:00" level=error msg="already created client for \"https://172.24.100.9:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.100.9:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:49:46+09:00" level=error msg="already created client for \"https://172.24.69.52:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.69.52:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:49:45+09:00" level=error msg="already created client for \"https://172.24.59.97:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.59.97:8444/status\": dial tcp 172.24.59.97:8444: connect: connection refused" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:49:45+09:00" level=error msg="already created client for \"https://172.24.90.47:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.90.47:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:49:44+09:00" level=error msg="already created client for \"https://172.24.71.160:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.71.160:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:49:43+09:00" level=error msg="already created client for \"https://172.24.72.20:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.72.20:8444/status\": EOF" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:49:43+09:00" level=error msg="already created client for \"https://172.24.60.7:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.60.7:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:49:42+09:00" level=error msg="already created client for \"https://172.24.65.36:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.65.36:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:49:41+09:00" level=error msg="already created client for \"https://172.24.81.86:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.81.86:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:49:40+09:00" level=error msg="already created client for \"https://172.24.82.41:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.82.41:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:49:39+09:00" level=error msg="already created client for \"https://172.24.85.158:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.85.158:8444/status\": dial tcp 172.24.85.158:8444: connect: connection refused" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:49:39+09:00" level=error msg="already created client for \"https://172.24.81.245:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.81.245:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-9dlsn/ingress-controller] time="2024-05-24T11:49:39+09:00" level=error msg="already created client for \"https://172.24.61.226:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.61.226:8444/status\": dial tcp 172.24.61.226:8444: i/o timeout" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:49:38+09:00" level=error msg="already created client for \"https://172.24.83.84:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.83.84:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-9dlsn/ingress-controller] time="2024-05-24T11:49:38+09:00" level=error msg="already created client for \"https://172.24.102.39:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.102.39:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:49:37+09:00" level=error msg="already created client for \"https://172.24.61.226:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.61.226:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:49:36+09:00" level=error msg="already created client for \"https://172.24.90.230:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.90.230:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:49:35+09:00" level=error msg="already created client for \"https://172.24.87.249:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.87.249:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:49:34+09:00" level=error msg="already created client for \"https://172.24.74.201:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.74.201:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:49:33+09:00" level=error msg="already created client for \"https://172.24.102.39:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.102.39:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-vhkj5/ingress-controller] time="2024-05-24T11:49:32+09:00" level=error msg="failed to fill-in defaults for plugin: request-termination" url="https://172.24.15.86:8444" |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:49:32+09:00" level=error msg="already created client for \"https://172.24.70.34:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.70.34:8444/status\": dial tcp 172.24.70.34:8444: connect: connection refused" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:49:32+09:00" level=error msg="already created client for \"https://172.24.61.5:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.61.5:8444/status\": dial tcp 172.24.61.5:8444: connect: connection refused" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:49:32+09:00" level=error msg="already created client for \"https://172.24.92.68:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.92.68:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:49:31+09:00" level=error msg="already created client for \"https://172.24.83.228:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.83.228:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-9dlsn/ingress-controller] time="2024-05-24T11:49:27+09:00" level=error msg="already created client for \"https://172.24.90.47:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.90.47:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-9dlsn/ingress-controller] time="2024-05-24T11:49:26+09:00" level=error msg="already created client for \"https://172.24.60.7:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.60.7:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-9dlsn/ingress-controller] time="2024-05-24T11:49:25+09:00" level=error msg="already created client for \"https://172.24.107.98:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.107.98:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-9dlsn/ingress-controller] time="2024-05-24T11:49:24+09:00" level=error msg="already created client for \"https://172.24.78.197:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.78.197:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-9dlsn/ingress-controller] time="2024-05-24T11:49:23+09:00" level=error msg="already created client for \"https://172.24.85.158:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.85.158:8444/status\": dial tcp 172.24.85.158:8444: connect: connection refused" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-9dlsn/ingress-controller] time="2024-05-24T11:49:22+09:00" level=error msg="already created client for \"https://172.24.72.20:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.72.20:8444/status\": EOF" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-9dlsn/ingress-controller] time="2024-05-24T11:49:22+09:00" level=error msg="already created client for \"https://172.24.62.243:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.62.243:8444/status\": dial tcp 172.24.62.243:8444: connect: connection refused" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-9dlsn/ingress-controller] time="2024-05-24T11:49:22+09:00" level=error msg="already created client for \"https://172.24.65.36:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.65.36:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:49:20+09:00" level=error msg="already created client for \"https://172.24.90.47:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.90.47:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:49:19+09:00" level=error msg="already created client for \"https://172.24.71.160:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.71.160:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:49:18+09:00" level=error msg="already created client for \"https://172.24.59.97:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.59.97:8444/status\": dial tcp 172.24.59.97:8444: connect: connection refused" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:49:18+09:00" level=error msg="already created client for \"https://172.24.72.20:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.72.20:8444/status\": EOF" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:49:18+09:00" level=error msg="already created client for \"https://172.24.60.7:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.60.7:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:49:17+09:00" level=error msg="already created client for \"https://172.24.98.226:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.98.226:8444/status\": dial tcp 172.24.98.226:8444: connect: connection refused" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:49:17+09:00" level=error msg="already created client for \"https://172.24.68.222:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.68.222:8444/status\": dial tcp 172.24.68.222:8444: connect: connection refused" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:49:17+09:00" level=error msg="already created client for \"https://172.24.78.197:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.78.197:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:49:16+09:00" level=error msg="already created client for \"https://172.24.107.98:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.107.98:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:49:15+09:00" level=error msg="already created client for \"https://172.24.108.59:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.108.59:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:49:14+09:00" level=error msg="already created client for \"https://172.24.62.243:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.62.243:8444/status\": dial tcp 172.24.62.243:8444: connect: connection refused" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:49:14+09:00" level=error msg="already created client for \"https://172.24.94.146:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.94.146:8444/status\": EOF" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:49:14+09:00" level=error msg="already created client for \"https://172.24.100.9:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.100.9:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:49:13+09:00" level=error msg="already created client for \"https://172.24.69.52:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.69.52:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:49:12+09:00" level=error msg="already created client for \"https://172.24.75.47:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.75.47:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-9dlsn/ingress-controller] time="2024-05-24T11:49:11+09:00" level=error msg="already created client for \"https://172.24.102.39:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.102.39:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:49:11+09:00" level=error msg="already created client for \"https://172.24.83.84:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.83.84:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-9dlsn/ingress-controller] time="2024-05-24T11:49:10+09:00" level=error msg="already created client for \"https://172.24.61.226:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.61.226:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:49:10+09:00" level=error msg="already created client for \"https://172.24.61.226:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.61.226:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:49:09+09:00" level=error msg="already created client for \"https://172.24.87.249:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.87.249:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:49:08+09:00" level=error msg="already created client for \"https://172.24.74.201:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.74.201:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:49:07+09:00" level=error msg="already created client for \"https://172.24.102.39:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.102.39:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:49:06+09:00" level=error msg="already created client for \"https://172.24.90.230:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.90.230:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:49:05+09:00" level=error msg="already created client for \"https://172.24.70.34:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.70.34:8444/status\": dial tcp 172.24.70.34:8444: connect: connection refused" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:49:05+09:00" level=error msg="already created client for \"https://172.24.61.5:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.61.5:8444/status\": dial tcp 172.24.61.5:8444: connect: connection refused" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:49:05+09:00" level=error msg="already created client for \"https://172.24.92.68:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.92.68:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:49:04+09:00" level=error msg="already created client for \"https://172.24.83.228:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.83.228:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:49:03+09:00" level=error msg="already created client for \"https://172.24.65.36:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.65.36:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-vhkj5/ingress-controller] time="2024-05-24T11:49:02+09:00" level=error msg="failed to fill-in defaults for plugin: jwt" url="https://172.24.15.86:8444" |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:49:02+09:00" level=error msg="already created client for \"https://172.24.81.86:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.81.86:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:49:01+09:00" level=error msg="already created client for \"https://172.24.85.158:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.85.158:8444/status\": dial tcp 172.24.85.158:8444: connect: connection refused" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:49:01+09:00" level=error msg="already created client for \"https://172.24.82.41:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.82.41:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:49:00+09:00" level=error msg="already created client for \"https://172.24.81.245:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.81.245:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-9dlsn/ingress-controller] time="2024-05-24T11:48:59+09:00" level=error msg="already created client for \"https://172.24.72.20:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.72.20:8444/status\": EOF" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-9dlsn/ingress-controller] time="2024-05-24T11:48:59+09:00" level=error msg="already created client for \"https://172.24.62.243:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.62.243:8444/status\": dial tcp 172.24.62.243:8444: connect: connection refused" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-9dlsn/ingress-controller] time="2024-05-24T11:48:59+09:00" level=error msg="already created client for \"https://172.24.65.36:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.65.36:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-9dlsn/ingress-controller] time="2024-05-24T11:48:58+09:00" level=error msg="already created client for \"https://172.24.78.197:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.78.197:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-9dlsn/ingress-controller] time="2024-05-24T11:48:57+09:00" level=error msg="already created client for \"https://172.24.85.158:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.85.158:8444/status\": dial tcp 172.24.85.158:8444: connect: connection refused" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-9dlsn/ingress-controller] time="2024-05-24T11:48:57+09:00" level=error msg="already created client for \"https://172.24.90.47:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.90.47:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-9dlsn/ingress-controller] time="2024-05-24T11:48:56+09:00" level=error msg="already created client for \"https://172.24.60.7:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.60.7:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-9dlsn/ingress-controller] time="2024-05-24T11:48:55+09:00" level=error msg="already created client for \"https://172.24.107.98:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.107.98:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:48:49+09:00" level=error msg="already created client for \"https://172.24.60.7:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.60.7:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:48:48+09:00" level=error msg="already created client for \"https://172.24.98.226:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.98.226:8444/status\": dial tcp 172.24.98.226:8444: connect: connection refused" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:48:48+09:00" level=error msg="already created client for \"https://172.24.68.222:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.68.222:8444/status\": dial tcp 172.24.68.222:8444: connect: connection refused" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:48:48+09:00" level=error msg="already created client for \"https://172.24.78.197:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.78.197:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:48:47+09:00" level=error msg="already created client for \"https://172.24.107.98:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.107.98:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:48:46+09:00" level=error msg="already created client for \"https://172.24.62.243:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.62.243:8444/status\": dial tcp 172.24.62.243:8444: connect: connection refused" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:48:46+09:00" level=error msg="already created client for \"https://172.24.108.59:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.108.59:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:48:45+09:00" level=error msg="already created client for \"https://172.24.75.47:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.75.47:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-9dlsn/ingress-controller] time="2024-05-24T11:48:44+09:00" level=error msg="already created client for \"https://172.24.61.226:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.61.226:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:48:44+09:00" level=error msg="already created client for \"https://172.24.94.146:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.94.146:8444/status\": EOF" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:48:44+09:00" level=error msg="already created client for \"https://172.24.69.52:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.69.52:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-9dlsn/ingress-controller] time="2024-05-24T11:48:43+09:00" level=error msg="already created client for \"https://172.24.102.39:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.102.39:8444/status\": dial tcp 172.24.102.39:8444: i/o timeout" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:48:43+09:00" level=error msg="already created client for \"https://172.24.100.9:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.100.9:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:48:42+09:00" level=error msg="already created client for \"https://172.24.59.97:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.59.97:8444/status\": dial tcp 172.24.59.97:8444: connect: connection refused" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:48:42+09:00" level=error msg="already created client for \"https://172.24.71.160:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.71.160:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:48:41+09:00" level=error msg="already created client for \"https://172.24.90.47:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.90.47:8444/status\": dial tcp 172.24.90.47:8444: i/o timeout" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:48:40+09:00" level=error msg="already created client for \"https://172.24.72.20:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.72.20:8444/status\": EOF" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:48:40+09:00" level=error msg="already created client for \"https://172.24.92.68:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.92.68:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:48:39+09:00" level=error msg="already created client for \"https://172.24.83.228:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.83.228:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:48:38+09:00" level=error msg="already created client for \"https://172.24.81.86:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.81.86:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:48:37+09:00" level=error msg="already created client for \"https://172.24.65.36:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.65.36:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:48:36+09:00" level=error msg="already created client for \"https://172.24.82.41:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.82.41:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:48:35+09:00" level=error msg="already created client for \"https://172.24.81.245:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.81.245:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:48:34+09:00" level=error msg="already created client for \"https://172.24.85.158:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.85.158:8444/status\": dial tcp 172.24.85.158:8444: connect: connection refused" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:48:34+09:00" level=error msg="already created client for \"https://172.24.83.84:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.83.84:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:48:33+09:00" level=error msg="already created client for \"https://172.24.61.226:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.61.226:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-9dlsn/ingress-controller] time="2024-05-24T11:48:32+09:00" level=error msg="already created client for \"https://172.24.72.20:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.72.20:8444/status\": EOF" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-9dlsn/ingress-controller] time="2024-05-24T11:48:32+09:00" level=error msg="already created client for \"https://172.24.62.243:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.62.243:8444/status\": dial tcp 172.24.62.243:8444: connect: connection refused" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-9dlsn/ingress-controller] time="2024-05-24T11:48:32+09:00" level=error msg="already created client for \"https://172.24.65.36:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.65.36:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-vhkj5/ingress-controller] time="2024-05-24T11:48:32+09:00" level=error msg="failed to fill-in defaults for plugin: jwt" url="https://172.24.15.86:8444" |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:48:32+09:00" level=error msg="already created client for \"https://172.24.74.201:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.74.201:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-9dlsn/ingress-controller] time="2024-05-24T11:48:31+09:00" level=error msg="already created client for \"https://172.24.78.197:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.78.197:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:48:31+09:00" level=error msg="already created client for \"https://172.24.102.39:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.102.39:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-9dlsn/ingress-controller] time="2024-05-24T11:48:30+09:00" level=error msg="already created client for \"https://172.24.85.158:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.85.158:8444/status\": dial tcp 172.24.85.158:8444: connect: connection refused" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-9dlsn/ingress-controller] time="2024-05-24T11:48:30+09:00" level=error msg="already created client for \"https://172.24.90.47:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.90.47:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:48:30+09:00" level=error msg="already created client for \"https://172.24.90.230:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.90.230:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-9dlsn/ingress-controller] time="2024-05-24T11:48:29+09:00" level=error msg="already created client for \"https://172.24.60.7:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.60.7:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:48:29+09:00" level=error msg="already created client for \"https://172.24.87.249:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.87.249:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-9dlsn/ingress-controller] time="2024-05-24T11:48:28+09:00" level=error msg="already created client for \"https://172.24.107.98:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.107.98:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:48:28+09:00" level=error msg="already created client for \"https://172.24.70.34:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.70.34:8444/status\": dial tcp 172.24.70.34:8444: connect: connection refused" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:48:28+09:00" level=error msg="already created client for \"https://172.24.61.5:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.61.5:8444/status\": dial tcp 172.24.61.5:8444: connect: connection refused" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:48:18+09:00" level=error msg="already created client for \"https://172.24.94.146:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.94.146:8444/status\": EOF" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:48:18+09:00" level=error msg="already created client for \"https://172.24.69.52:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.69.52:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-9dlsn/ingress-controller] time="2024-05-24T11:48:17+09:00" level=error msg="already created client for \"https://172.24.102.39:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.102.39:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:48:17+09:00" level=error msg="already created client for \"https://172.24.100.9:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.100.9:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-9dlsn/ingress-controller] time="2024-05-24T11:48:16+09:00" level=error msg="already created client for \"https://172.24.61.226:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.61.226:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:48:16+09:00" level=error msg="already created client for \"https://172.24.75.47:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.75.47:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:48:15+09:00" level=error msg="already created client for \"https://172.24.59.97:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.59.97:8444/status\": dial tcp 172.24.59.97:8444: connect: connection refused" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:48:15+09:00" level=error msg="already created client for \"https://172.24.71.160:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.71.160:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:48:14+09:00" level=error msg="already created client for \"https://172.24.90.47:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.90.47:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:48:13+09:00" level=error msg="already created client for \"https://172.24.72.20:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.72.20:8444/status\": EOF" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:48:13+09:00" level=error msg="already created client for \"https://172.24.60.7:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.60.7:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:48:12+09:00" level=error msg="already created client for \"https://172.24.98.226:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.98.226:8444/status\": dial tcp 172.24.98.226:8444: connect: connection refused" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:48:12+09:00" level=error msg="already created client for \"https://172.24.68.222:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.68.222:8444/status\": dial tcp 172.24.68.222:8444: connect: connection refused" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:48:12+09:00" level=error msg="already created client for \"https://172.24.78.197:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.78.197:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:48:11+09:00" level=error msg="already created client for \"https://172.24.108.59:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.108.59:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:48:10+09:00" level=error msg="already created client for \"https://172.24.62.243:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.62.243:8444/status\": dial tcp 172.24.62.243:8444: connect: connection refused" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:48:10+09:00" level=error msg="already created client for \"https://172.24.107.98:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.107.98:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:48:09+09:00" level=error msg="already created client for \"https://172.24.81.86:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.81.86:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:48:08+09:00" level=error msg="already created client for \"https://172.24.65.36:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.65.36:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:48:07+09:00" level=error msg="already created client for \"https://172.24.82.41:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.82.41:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:48:06+09:00" level=error msg="already created client for \"https://172.24.81.245:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.81.245:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-9dlsn/ingress-controller] time="2024-05-24T11:48:05+09:00" level=error msg="already created client for \"https://172.24.62.243:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.62.243:8444/status\": dial tcp 172.24.62.243:8444: connect: connection refused" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-9dlsn/ingress-controller] time="2024-05-24T11:48:05+09:00" level=error msg="already created client for \"https://172.24.65.36:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.65.36:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:48:05+09:00" level=error msg="already created client for \"https://172.24.85.158:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.85.158:8444/status\": dial tcp 172.24.85.158:8444: connect: connection refused" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:48:05+09:00" level=error msg="already created client for \"https://172.24.83.84:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.83.84:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-9dlsn/ingress-controller] time="2024-05-24T11:48:04+09:00" level=error msg="already created client for \"https://172.24.72.20:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.72.20:8444/status\": EOF" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-9dlsn/ingress-controller] time="2024-05-24T11:48:04+09:00" level=error msg="already created client for \"https://172.24.85.158:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.85.158:8444/status\": dial tcp 172.24.85.158:8444: connect: connection refused" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-9dlsn/ingress-controller] time="2024-05-24T11:48:04+09:00" level=error msg="already created client for \"https://172.24.90.47:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.90.47:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:48:04+09:00" level=error msg="already created client for \"https://172.24.61.226:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.61.226:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-9dlsn/ingress-controller] time="2024-05-24T11:48:03+09:00" level=error msg="already created client for \"https://172.24.60.7:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.60.7:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:48:03+09:00" level=error msg="already created client for \"https://172.24.102.39:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.102.39:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-9dlsn/ingress-controller] time="2024-05-24T11:48:02+09:00" level=error msg="already created client for \"https://172.24.107.98:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.107.98:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-vhkj5/ingress-controller] time="2024-05-24T11:48:02+09:00" level=error msg="failed to fill-in defaults for plugin: jwt" url="https://172.24.15.86:8444" |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:48:02+09:00" level=error msg="already created client for \"https://172.24.87.249:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.87.249:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-9dlsn/ingress-controller] time="2024-05-24T11:48:01+09:00" level=error msg="already created client for \"https://172.24.78.197:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.78.197:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:48:01+09:00" level=error msg="already created client for \"https://172.24.90.230:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.90.230:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:48:00+09:00" level=error msg="already created client for \"https://172.24.74.201:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.74.201:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:47:59+09:00" level=error msg="already created client for \"https://172.24.61.5:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.61.5:8444/status\": dial tcp 172.24.61.5:8444: connect: connection refused" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:47:59+09:00" level=error msg="already created client for \"https://172.24.70.34:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.70.34:8444/status\": dial tcp 172.24.70.34:8444: connect: connection refused" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:47:59+09:00" level=error msg="already created client for \"https://172.24.83.228:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.83.228:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:47:58+09:00" level=error msg="already created client for \"https://172.24.92.68:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.92.68:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-9dlsn/ingress-controller] time="2024-05-24T11:47:50+09:00" level=error msg="already created client for \"https://172.24.102.39:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.102.39:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-9dlsn/ingress-controller] time="2024-05-24T11:47:49+09:00" level=error msg="already created client for \"https://172.24.61.226:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.61.226:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:47:47+09:00" level=error msg="already created client for \"https://172.24.108.59:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.108.59:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:47:46+09:00" level=error msg="already created client for \"https://172.24.107.98:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.107.98:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:47:45+09:00" level=error msg="already created client for \"https://172.24.62.243:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.62.243:8444/status\": dial tcp 172.24.62.243:8444: connect: connection refused" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:47:45+09:00" level=error msg="already created client for \"https://172.24.69.52:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.69.52:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:47:44+09:00" level=error msg="already created client for \"https://172.24.100.9:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.100.9:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:47:43+09:00" level=error msg="already created client for \"https://172.24.75.47:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.75.47:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:47:42+09:00" level=error msg="already created client for \"https://172.24.94.146:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.94.146:8444/status\": EOF" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:47:42+09:00" level=error msg="already created client for \"https://172.24.90.47:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.90.47:8444/status\": dial tcp 172.24.90.47:8444: i/o timeout" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:47:41+09:00" level=error msg="already created client for \"https://172.24.59.97:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.59.97:8444/status\": dial tcp 172.24.59.97:8444: connect: connection refused" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:47:41+09:00" level=error msg="already created client for \"https://172.24.71.160:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.71.160:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:47:40+09:00" level=error msg="already created client for \"https://172.24.72.20:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.72.20:8444/status\": EOF" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:47:40+09:00" level=error msg="already created client for \"https://172.24.60.7:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.60.7:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:47:39+09:00" level=error msg="already created client for \"https://172.24.98.226:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.98.226:8444/status\": dial tcp 172.24.98.226:8444: connect: connection refused" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:47:39+09:00" level=error msg="already created client for \"https://172.24.68.222:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.68.222:8444/status\": dial tcp 172.24.68.222:8444: connect: connection refused" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:47:39+09:00" level=error msg="already created client for \"https://172.24.78.197:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.78.197:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-9dlsn/ingress-controller] time="2024-05-24T11:47:38+09:00" level=error msg="already created client for \"https://172.24.62.243:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.62.243:8444/status\": dial tcp 172.24.62.243:8444: connect: connection refused" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-9dlsn/ingress-controller] time="2024-05-24T11:47:38+09:00" level=error msg="already created client for \"https://172.24.65.36:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.65.36:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:47:38+09:00" level=error msg="already created client for \"https://172.24.65.36:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.65.36:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-9dlsn/ingress-controller] time="2024-05-24T11:47:37+09:00" level=error msg="already created client for \"https://172.24.72.20:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.72.20:8444/status\": EOF" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-9dlsn/ingress-controller] time="2024-05-24T11:47:37+09:00" level=error msg="already created client for \"https://172.24.90.47:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.90.47:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:47:37+09:00" level=error msg="already created client for \"https://172.24.81.86:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.81.86:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-9dlsn/ingress-controller] time="2024-05-24T11:47:36+09:00" level=error msg="already created client for \"https://172.24.60.7:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.60.7:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:47:36+09:00" level=error msg="already created client for \"https://172.24.85.158:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.85.158:8444/status\": dial tcp 172.24.85.158:8444: connect: connection refused" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:47:36+09:00" level=error msg="already created client for \"https://172.24.82.41:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.82.41:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-9dlsn/ingress-controller] time="2024-05-24T11:47:35+09:00" level=error msg="already created client for \"https://172.24.107.98:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.107.98:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:47:35+09:00" level=error msg="already created client for \"https://172.24.81.245:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.81.245:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-9dlsn/ingress-controller] time="2024-05-24T11:47:34+09:00" level=error msg="already created client for \"https://172.24.78.197:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.78.197:8444/status\": dial tcp 172.24.78.197:8444: i/o timeout" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:47:34+09:00" level=error msg="already created client for \"https://172.24.83.84:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.83.84:8444/status\": context deadline exceeded" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-9dlsn/ingress-controller] time="2024-05-24T11:47:33+09:00" level=error msg="already created client for \"https://172.24.85.158:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.85.158:8444/status\": dial tcp 172.24.85.158:8444: connect: connection refused" logger=setup.readiness-checker |
| | [clous-api-gateway-controller-647bff4749-wvhlr/ingress-controller] time="2024-05-24T11:47:33+09:00" level=error msg="already created client for \"https://172.24.61.226:8444\" is not ready, moving to pending" error="making HTTP request: Get \"https://172.24.61.226:8444/status\": context deadline exceeded" logger=setup.readiness-checker
tao12345666333
commented
2 months ago I found that there are two reasons for the occurrence of this situation.
/status is used to determine whether Gateway Clients are ready. However, the response of Gateway's /status will be available before it is truly ready. At the same time, there is no verification of the response in KIC. In Gateway v3.3+, a /status/ready endpoint has been provided. This endpoint should be used to health-check Kong nodes. This can be health checks from orchestration frameworks like k8s or by load-balancers fronting Kong nodes that proxy traffic. This endpoint returns 200 only after the Kong node has configured itself and is ready to start proxying traffic.
https://docs.konghq.com/gateway/api/status/latest/#/default/get_status_ready
So we can switch to using /status/ready to check if the Gateway clients are truly ready.
czeslavo
commented
1 month ago So we can switch to using /status/ready to check if the Gateway clients are truly ready.
@tao12345666333 Not really I'm afraid. We intentionally used /status, as /status/ready returns 200 only after a Gateway gets configured (This endpoint returns 200 only after the Kong node has configured itself and is ready to start proxying traffic). If we use /status/ready in KIC, we will never configure the new gateways we discover.
In essence, what KIC needs is the Admin API readiness (provided by /status), not the data-plane readiness (provided by /status/ready).
tao12345666333
commented
1 month ago @czeslavo oops! You are right!
The /status/ready will return different results for each deploy mode.
Is there an existing issue for this?
Problem Statement
A customer has reported receiving an unexpected amount of logs regarding a single Gateway client being stuck in
AdminAPIClientsManagerready list:Even though the logged message indicates that the client is being moved to the
pendingstate, the message repeats constantly even though the mentioned client should have been gone completely from both lists as it has already terminated.Logs stopped coming up after restarting a KIC pod.
Proposed Solution
Additional information
No response
Acceptance Criteria
readytopendingconstantly when no state changes are happening in reality