k8s-for-greeks / gpmr

Greek Pet Monster Race - K8s and Cassandra at scale
Apache License 2.0
43 stars 9 forks source link

GCE Multiple K8s DC C* Deployment - Networking #36

Open chrislovecnm opened 8 years ago

chrislovecnm commented 8 years ago

@paralin please submit a PR for getting muitple DC's Racks on GCE.

  1. Bash scripts for networking
  2. VPN Docker
  3. Documentation

Once you have submitted a PR, let me know and I can get you a baby k8s cluster.

paralin commented 8 years ago

for rack I would just specify the rack name as the node attribute for availability zone

for DC most of what youre going to do is configuration in the GCE UI

chrislovecnm commented 8 years ago

so nothing in GCE ui please. Please do all through gcloud api 😄

Bash is beautiful.

https://cloud.google.com/sdk/gcloud/

Or if you are really adventurous you can do terraform ...

mward29 commented 8 years ago

kubectl label nodes $PRIVATE_IP failure-domain.beta.kubernetes.io/region=$REGION kubectl label nodes $PRIVATE_IP failure-domain.beta.kubernetes.io/zone=$AVAIL_ZONE

chrislovecnm commented 8 years ago

@paralin have you worked out the networking as of yet with vpn?

paralin commented 8 years ago

Yes it works. At least for the purpose of bridging 2 clusters.

chrislovecnm commented 8 years ago

@paralin when will you have a chance to document? I will mention on Monday that examples are coming for multiple physical Datacenter K8s installs with Multiple DC C*, are coming.

The demo will have two Datacenters btw. I stopped the custom seedprovider, and went to DNS. Do you know of a way to have nodetool use DNS rather than IPs? IPs are not guaranteed with PetSets ... we may have a challenge with Token ranges :(