multi cluster with one ip

RedHat-EMEA-SSA-Team / hetzner-ocp4

Installing OCP 4 on single bare metal server.

Apache License 2.0

183 stars 114 forks source link

multi cluster with one ip #315

Open wingsuitist opened 3 months ago

wingsuitist commented 3 months ago

Possibility for multiple clusters with one IP.

Scenario 10 clusters:

osc01
osc02
...
osc10

Main Domain: example.com

API using different ports:

api.osc01.example.com:6001
api.osc02.example.com:6002
...
api.osc10.example.com:6010

Todo: Check if reverse proxy can reliably handle API calls using different host names or if different ports are required.

Apps:

*.apps.osc01.example.com
*.apps.osc02.example.com
...
*.apps.osc10.example.com

Possible solutions:

Single HA Proxy which differentiates per "cluster domain" (e.g. osc01.exymple.com).
Separate HA Proxy per cluster, but additional reverse Proxy sending traffic to each HA proxy.

rbo commented 3 months ago

I tried a long time ago to put many clusters behind a haproxy via "cluster domain" based routing. And I failed, there were some strange errors. That's why I decided to go with additional IPs. If you can provide a reliable solution, we can add a new docs part how to set it up or an add-on.

I'm not pretty sure how many users who really need. Most of the users I know have just one cluster running.

wingsuitist commented 3 months ago

We are currently evaluating if we can use it to spin up a clusters for a few days or just hours, and then destroy it again. Mostly for integration testing, but also for experiments where we quickly need a clean setup, and can not do the experiment on the same cluster as other experiments. Hope we can find the time to solve it.

=> About the errors: Was ist also problematic for the whole "*apps.xyz" part or only for the api?

rbo commented 3 months ago

I cannot remember, might be API only because of client cert auth.