obriensystems
commented
7 months ago Prototype: Latency connectivity between all regions 39 (why 42 by default)
org: old
Create 2nd default global routing VPC enable dns dns.googleapis.com -bgp-routing-mode=global
gcloud compute networks create global --project=interconnect-ol --description=global-auto --subnet-mode=auto --mtu=1460 --bgp-routing-mode=global
gcloud compute firewall-rules create global-allow-custom --project=interconnect-ol --network=projects/interconnect-ol/global/networks/global --description=Allows\ connection\ from\ any\ source\ to\ any\ instance\ on\ the\ network\ using\ custom\ protocols. --direction=INGRESS --priority=65534 --source-ranges=10.128.0.0/9 --action=ALLOW --rules=all
gcloud compute firewall-rules create global-allow-icmp --project=interconnect-ol --network=projects/interconnect-ol/global/networks/global --description=Allows\ ICMP\ connections\ from\ any\ source\ to\ any\ instance\ on\ the\ network. --direction=INGRESS --priority=65534 --source-ranges=0.0.0.0/0 --action=ALLOW --rules=icmp
gcloud compute firewall-rules create global-allow-rdp --project=interconnect-ol --network=projects/interconnect-ol/global/networks/global --description=Allows\ RDP\ connections\ from\ any\ source\ to\ any\ instance\ on\ the\ network\ using\ port\ 3389. --direction=INGRESS --priority=65534 --source-ranges=0.0.0.0/0 --action=ALLOW --rules=tcp:3389
gcloud compute firewall-rules create global-allow-ssh --project=interconnect-ol --network=projects/interconnect-ol/global/networks/global --description=Allows\ TCP\ connections\ from\ any\ source\ to\ any\ instance\ on\ the\ network\ using\ port\ 22. --direction=INGRESS --priority=65534 --source-ranges=0.0.0.0/0 --action=ALLOW --rules=tcp:22
VM with at least 30 vCores has Tier_1 networking performance - in this case N2-32 has 50gbps private, 25gpbs public
gcloud compute instances create nane1-vm --project=interconnect-ol --zone=northamerica-northeast1-a --machine-type=n2-standard-32 --network-interface=network-tier=PREMIUM,nic-type=GVNIC,stack-type=IPV4_ONLY,subnet=default --maintenance-policy=MIGRATE --provisioning-model=STANDARD --service-account=470582674421-compute@developer.gserviceaccount.com --scopes=https://www.googleapis.com/auth/cloud-platform --tags=http-server,https-server --create-disk=auto-delete=yes,boot=yes,device-name=nane1-vm,image=projects/debian-cloud/global/images/debian-11-bullseye-v20231115,mode=rw,size=20,type=projects/interconnect-ol/zones/northamerica-northeast1-a/diskTypes/pd-standard --no-shielded-secure-boot --shielded-vtpm --shielded-integrity-monitoring --labels=goog-ec-src=vm_add-gcloud --reservation-affinity=any --network-performance-configs=total-egress-bandwidth-tier=TIER_1Nearest region to YVR is Oregon
gcloud compute instances create us-west1-vm --project=interconnect-ol --zone=us-west1-b --machine-type=n2-standard-32 --network-interface=network-tier=PREMIUM,nic-type=GVNIC,stack-type=IPV4_ONLY,subnet=default --maintenance-policy=MIGRATE --provisioning-model=STANDARD --service-account=470582674421-compute@developer.gserviceaccount.com --scopes=https://www.googleapis.com/auth/cloud-platform --tags=http-server,https-server --create-disk=auto-delete=yes,boot=yes,device-name=us-west1-vm,image=projects/debian-cloud/global/images/debian-11-bullseye-v20231115,mode=rw,size=20,type=projects/interconnect-ol/zones/us-west1-b/diskTypes/pd-standard --no-shielded-secure-boot --shielded-vtpm --shielded-integrity-monitoring --labels=goog-ec-src=vm_add-gcloud --reservation-affinity=any --network-performance-configs=total-egress-bandwidth-tier=TIER_1fixing quota Current limit: 8.0. Metric: compute.googleapis.com/n2_cpus
Your quota request for interconnect-ol has been partially approved and your project quota has been adjusted according to the following requested limits:
+------------------+------------+--------+-----------------+----------------+
| NAME | DIMENSIONS | REGION | REQUESTED LIMIT | APPROVED LIMIT |
+------------------+------------+--------+-----------------+----------------+
| CPUS_ALL_REGIONS | | GLOBAL | 32 | 32 |
+------------------+------------+--------+-----------------+----------------+
Unfortunately, we were unable to grant your below quota request(s):
+---------+--------------------------------+-------------------------+
| NAME | DIMENSIONS | REGION |
+---------+--------------------------------+-------------------------+
| N2_CPUS | region=northamerica-northeast1 | northamerica-northeast1 |
+---------+--------------------------------+-------------------------+
Unfortunately, we were unable to grant your below quota request(s):
+---------+-----------------+----------+
| NAME | DIMENSIONS | REGION |
+---------+-----------------+----------+
| N2_CPUS | region=us-west1 | us-west1 |
+---------+-----------------+----------+16vCPUs - no 32/7gbps for now
gcloud compute instances create nane-vm16 --project=interconnect-ol --zone=northamerica-northeast1-a --machine-type=n2-standard-16 --network-interface=network-tier=PREMIUM,stack-type=IPV4_ONLY,subnet=default --maintenance-policy=MIGRATE --provisioning-model=STANDARD --service-account=470582674421-compute@developer.gserviceaccount.com --scopes=https://www.googleapis.com/auth/devstorage.read_only,https://www.googleapis.com/auth/logging.write,https://www.googleapis.com/auth/monitoring.write,https://www.googleapis.com/auth/servicecontrol,https://www.googleapis.com/auth/service.management.readonly,https://www.googleapis.com/auth/trace.append --tags=http-server,https-server --create-disk=auto-delete=yes,boot=yes,device-name=nane-vm16,image=projects/debian-cloud/global/images/debian-11-bullseye-v20231115,mode=rw,size=20,type=projects/interconnect-ol/zones/northamerica-northeast1-a/diskTypes/pd-standard --no-shielded-secure-boot --shielded-vtpm --shielded-integrity-monitoring --labels=goog-ec-src=vm_add-gcloud --reservation-affinity=any
The N2-CPUS-per-project-region quota maximum in region northamerica-northeast1 has been exceeded. Current limit: 8.0. Metric: compute.googleapis.com/n2_cpus
Change N2 CPUs - northamerica-northeast1 from 8 to 16
use 8 for now
gcloud compute instances create nane1-8 --project=interconnect-ol --zone=us-central1-a --machine-type=n2-standard-8 --network-interface=network-tier=PREMIUM,stack-type=IPV4_ONLY,subnet=default --maintenance-policy=MIGRATE --provisioning-model=STANDARD --service-account=470582674421-compute@developer.gserviceaccount.com --scopes=https://www.googleapis.com/auth/cloud-platform --tags=http-server,https-server --create-disk=auto-delete=yes,boot=yes,device-name=nane1-8,image=projects/debian-cloud/global/images/debian-11-bullseye-v20231115,mode=rw,size=20,type=projects/interconnect-ol/zones/us-central1-a/diskTypes/pd-standard --no-shielded-secure-boot --shielded-vtpm --shielded-integrity-monitoring --labels=goog-ec-src=vm_add-gcloud --reservation-affinity=any
ok
gcloud compute instances create us-west1-8 --project=interconnect-ol --zone=us-west1-b --machine-type=n2-standard-8 --network-interface=network-tier=PREMIUM,stack-type=IPV4_ONLY,subnet=default --maintenance-policy=MIGRATE --provisioning-model=STANDARD --service-account=470582674421-compute@developer.gserviceaccount.com --scopes=https://www.googleapis.com/auth/cloud-platform --tags=http-server,https-server --create-disk=auto-delete=yes,boot=yes,device-name=us-west1-8,image=projects/debian-cloud/global/images/debian-11-bullseye-v20231115,mode=rw,size=20,type=projects/interconnect-ol/zones/us-west1-b/diskTypes/pd-standard --no-shielded-secure-boot --shielded-vtpm --shielded-integrity-monitoring --labels=goog-ec-src=vm_add-gcloud --reservation-affinity=anyI can create up to 4 vms globally for now
Plan is to standup 2 VMs at a time and iterate them across all regions - to get around max quota of 64 (2 vms with tier_1 networking)
+------------------+------------+--------+-----------------+----------------+
| NAME | DIMENSIONS | REGION | REQUESTED LIMIT | APPROVED LIMIT |
+------------------+------------+--------+-----------------+----------------+
| CPUS_ALL_REGIONS | | GLOBAL | 64 | 64 |
+------------------+------------+--------+-----------------+----------------+
gcloud compute instances create n2d-64 --project=interconnect-ol --zone=us-central1-a --machine-type=n2d-standard-64 --network-interface=network-tier=PREMIUM,nic-type=GVNIC,stack-type=IPV4_ONLY,subnet=default --maintenance-policy=MIGRATE --provisioning-model=STANDARD --service-account=470582674421-compute@developer.gserviceaccount.com --scopes=https://www.googleapis.com/auth/cloud-platform --tags=http-server,https-server --create-disk=auto-delete=yes,boot=yes,device-name=n2d-64,image=projects/debian-cloud/global/images/debian-11-bullseye-v20231115,mode=rw,size=80,type=projects/interconnect-ol/zones/us-central1-a/diskTypes/pd-standard --no-shielded-secure-boot --shielded-vtpm --shielded-integrity-monitoring --labels=goog-ec-src=vm_add-gcloud --reservation-affinity=any --network-performance-configs=total-egress-bandwidth-tier=TIER_1
switch to n2d epyc
+------------------+--------------------+-------------+-----------------+----------------+
| NAME | DIMENSIONS | REGION | REQUESTED LIMIT | APPROVED LIMIT |
+------------------+--------------------+-------------+-----------------+----------------+
| CPUS_ALL_REGIONS | | GLOBAL | 64 | 64 |
| | | | | |
| N2D_CPUS | region=us-central1 | us-central1 | 64 | 64 |
+------------------+--------------------+-------------+-----------------+----------------+
n2d n/a
nane2
+------------------+--------------------------------+-------------------------+-----------------+----------------+
| NAME | DIMENSIONS | REGION | REQUESTED LIMIT | APPROVED LIMIT |
+------------------+--------------------------------+-------------------------+-----------------+----------------+
| CPUS_ALL_REGIONS | | GLOBAL | 64 | 64 |
| | | | | |
| N2D_CPUS | region=northamerica-northeast1 | northamerica-northeast1 | 64 | 64 |
| N2D_CPUS | region=southamerica-east1 | southamerica-east1 | 64 | 64 |
| N2D_CPUS | region=us-east1 | us-east1 | 64 | 64 |
| N2D_CPUS | region=us-east4 | us-east4 | 64 | 64 |
| N2D_CPUS | region=us-east5 | us-east5 | 64 | 64 |
us-sourth1 dallas n/a
| N2D_CPUS | region=us-west1 | us-west1 | 64 | 64 |
| N2D_CPUS | region=us-west2 | us-west2 | - full
| N2D_CPUS | region=us-west3 | us-west3 | 64 | 64 |
| N2D_CPUS | region=us-west4 | us-west4 | 64 | 64 |
| N2D_CPUS | region=europe-north1 | europe-north1 | full
A 10GB pd-standard disk is currently unavailable in the europe-southwest1-a
| N2D_CPUS | region=europe-west1 | europe-west1 | 64 | 64 |
| N2D_CPUS | region=europe-west10 | europe-west10 | 64 | 64 |
| N2D_CPUS | region=europe-west12 | europe-west12 | - full
| N2D_CPUS | region=europe-west2 | europe-west2 | 64 | 64 |
| N2D_CPUS | region=europe-west3 | europe-west3 | 64 | 64 |
| N2D_CPUS | region=europe-west4 | europe-west4 | 64 | 64 |
europe-west6 zurich - no N2D
| N2D_CPUS | region=europe-west8 | europe-west8 | 64 | 64 |
+------------------+---------------------------+--------------------+-----------------+----------------+
This is an extension of #298 Site to Site Data Transfer
Purpose:
code
provisioning examples
Cologix
Equinix
PacketFabric
Other CSPs