roachtest: cluster_creation failed

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test jepsen/multi-register/start-stop-2 was skipped due to  test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-4 --labels created=2022-10-12t11_41_08z,roachprod=true,cluster=teamcity-6897539-1665552014-65-n6cpu4,lifetime=12h0m0s --metadata-from-file startup-script=/tmp/gce-startup-script1565213459 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-4 --labels created=2022-10-12t11_41_08z,roachprod=true,cluster=teamcity-6897539-1665552014-65-n6cpu4,lifetime=12h0m0s --metadata-from-file startup-script=/tmp/gce-startup-script1565213459 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=4 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

/cc @cockroachdb/dev-inf

This test on roachdash | Improve this report!

Jira issue: CRDB-20451

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test rebalance/by-load/replicas/ssds=2 was skipped due to   test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --local-ssd interface=NVME --machine-type n1-standard-4 --labels lifetime=12h0m0s,created=2022-10-12t12_13_37z,roachprod=true,cluster=teamcity-6897539-1665552014-226-n7cpu4 --metadata-from-file startup-script=/tmp/gce-startup-script2230787125 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --local-ssd interface=NVME --machine-type n1-standard-4 --labels lifetime=12h0m0s,created=2022-10-12t12_13_37z,roachprod=true,cluster=teamcity-6897539-1665552014-226-n7cpu4 --metadata-from-file startup-script=/tmp/gce-startup-script2230787125 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=4 , ROACHTEST_ssd=2

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test replicate/wide was skipped due to  test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-1 --labels roachprod=true,cluster=teamcity-6897539-1665552014-228-n9cpu1,lifetime=12h0m0s,created=2022-10-12t12_13_46z --metadata-from-file startup-script=/tmp/gce-startup-script205223912 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-1 --labels roachprod=true,cluster=teamcity-6897539-1665552014-228-n9cpu1,lifetime=12h0m0s,created=2022-10-12t12_13_46z --metadata-from-file startup-script=/tmp/gce-startup-script205223912 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=1 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test kv95/enc=false/nodes=3/cpu=96 was skipped due to   test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-highcpu-96 --labels cluster=teamcity-6897539-1665552014-230-n4cpu96,lifetime=12h0m0s,created=2022-10-12t12_14_00z,roachprod=true --metadata-from-file startup-script=/tmp/gce-startup-script1725220721 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-highcpu-96 --labels cluster=teamcity-6897539-1665552014-230-n4cpu96,lifetime=12h0m0s,created=2022-10-12t12_14_00z,roachprod=true --metadata-from-file startup-script=/tmp/gce-startup-script1725220721 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=96 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test restore2TB/nodes=10 was skipped due to     test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-highmem-4 --labels cluster=teamcity-6897539-1665552014-229-n10cpu4m,lifetime=12h0m0s,created=2022-10-12t12_14_00z,roachprod=true --metadata-from-file startup-script=/tmp/gce-startup-script2958421046 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-highmem-4 --labels cluster=teamcity-6897539-1665552014-229-n10cpu4m,lifetime=12h0m0s,created=2022-10-12t12_14_00z,roachprod=true --metadata-from-file startup-script=/tmp/gce-startup-script2958421046 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=4 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test restoreTPCCInc/nodes=10 was skipped due to     test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-highmem-4 --labels cluster=teamcity-6897539-1665552014-237-n10cpu4m,lifetime=12h0m0s,created=2022-10-12t12_14_46z,roachprod=true --metadata-from-file startup-script=/tmp/gce-startup-script2085109533 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-highmem-4 --labels cluster=teamcity-6897539-1665552014-237-n10cpu4m,lifetime=12h0m0s,created=2022-10-12t12_14_46z,roachprod=true --metadata-from-file startup-script=/tmp/gce-startup-script2085109533 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=4 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test smoketest/secure/multitenant was skipped due to    test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-4 --labels lifetime=12h0m0s,created=2022-10-12t12_15_20z,roachprod=true,cluster=teamcity-6897539-1665552014-242-n2cpu4 --metadata-from-file startup-script=/tmp/gce-startup-script1209030686 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-4 --labels lifetime=12h0m0s,created=2022-10-12t12_15_20z,roachprod=true,cluster=teamcity-6897539-1665552014-242-n2cpu4 --metadata-from-file startup-script=/tmp/gce-startup-script1209030686 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=4 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test restoreTPCCIncLatest/nodes=10 was skipped due to   test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-highmem-4 --labels roachprod=true,cluster=teamcity-6897539-1665552014-244-n10cpu4m,lifetime=12h0m0s,created=2022-10-12t12_15_24z --metadata-from-file startup-script=/tmp/gce-startup-script3439750839 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-highmem-4 --labels roachprod=true,cluster=teamcity-6897539-1665552014-244-n10cpu4m,lifetime=12h0m0s,created=2022-10-12t12_15_24z --metadata-from-file startup-script=/tmp/gce-startup-script3439750839 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=4 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test restore2TB/nodes=32 was skipped due to     test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-highmem-4 --labels lifetime=12h0m0s,created=2022-10-12t12_15_44z,roachprod=true,cluster=teamcity-6897539-1665552014-245-n32cpu4m --metadata-from-file startup-script=/tmp/gce-startup-script4057360492 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-highmem-4 --labels lifetime=12h0m0s,created=2022-10-12t12_15_44z,roachprod=true,cluster=teamcity-6897539-1665552014-245-n32cpu4m --metadata-from-file startup-script=/tmp/gce-startup-script4057360492 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=4 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test restore2TB/nodes=6/cpus=8/pd-volume=2500GB was skipped due to  test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=2500GB,auto-delete=yes --machine-type n1-highmem-8 --labels created=2022-10-12t12_15_47z,roachprod=true,cluster=teamcity-6897539-1665552014-246-n6cpu8m,lifetime=12h0m0s --metadata-from-file startup-script=/tmp/gce-startup-script2647487919 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=2500GB,auto-delete=yes --machine-type n1-highmem-8 --labels created=2022-10-12t12_15_47z,roachprod=true,cluster=teamcity-6897539-1665552014-246-n6cpu8m,lifetime=12h0m0s --metadata-from-file startup-script=/tmp/gce-startup-script2647487919 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test sysbench/oltp_delete/nodes=3/cpu=32/conc=256 was skipped due to    test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-highcpu-32 --labels created=2022-10-12t12_17_10z,roachprod=true,cluster=teamcity-6897539-1665552014-255-n4cpu32,lifetime=12h0m0s --metadata-from-file startup-script=/tmp/gce-startup-script2034893209 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-highcpu-32 --labels created=2022-10-12t12_17_10z,roachprod=true,cluster=teamcity-6897539-1665552014-255-n4cpu32,lifetime=12h0m0s --metadata-from-file startup-script=/tmp/gce-startup-script2034893209 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=32 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test sysbench/oltp_point_select/nodes=3/cpu=32/conc=256 was skipped due to  test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-highcpu-32 --labels roachprod=true,cluster=teamcity-6897539-1665552014-257-n4cpu32,lifetime=12h0m0s,created=2022-10-12t12_17_28z --metadata-from-file startup-script=/tmp/gce-startup-script1096520847 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-highcpu-32 --labels roachprod=true,cluster=teamcity-6897539-1665552014-257-n4cpu32,lifetime=12h0m0s,created=2022-10-12t12_17_28z --metadata-from-file startup-script=/tmp/gce-startup-script1096520847 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=32 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test sysbench/oltp_insert/nodes=3/cpu=32/conc=256 was skipped due to    test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-highcpu-32 --labels cluster=teamcity-6897539-1665552014-256-n4cpu32,lifetime=12h0m0s,created=2022-10-12t12_17_26z,roachprod=true --metadata-from-file startup-script=/tmp/gce-startup-script297214071 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-highcpu-32 --labels cluster=teamcity-6897539-1665552014-256-n4cpu32,lifetime=12h0m0s,created=2022-10-12t12_17_26z,roachprod=true --metadata-from-file startup-script=/tmp/gce-startup-script297214071 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=32 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test sysbench/oltp_read_only/nodes=3/cpu=32/conc=256 was skipped due to     test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-highcpu-32 --labels roachprod=true,cluster=teamcity-6897539-1665552014-265-n4cpu32,lifetime=12h0m0s,created=2022-10-12t12_18_47z --metadata-from-file startup-script=/tmp/gce-startup-script810489998 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-highcpu-32 --labels roachprod=true,cluster=teamcity-6897539-1665552014-265-n4cpu32,lifetime=12h0m0s,created=2022-10-12t12_18_47z --metadata-from-file startup-script=/tmp/gce-startup-script810489998 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=32 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test sysbench/oltp_update_index/nodes=3/cpu=32/conc=256 was skipped due to  test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-highcpu-32 --labels roachprod=true,cluster=teamcity-6897539-1665552014-266-n4cpu32,lifetime=12h0m0s,created=2022-10-12t12_19_11z --metadata-from-file startup-script=/tmp/gce-startup-script1730224918 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-highcpu-32 --labels roachprod=true,cluster=teamcity-6897539-1665552014-266-n4cpu32,lifetime=12h0m0s,created=2022-10-12t12_19_11z --metadata-from-file startup-script=/tmp/gce-startup-script1730224918 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=32 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test sysbench/oltp_read_write/nodes=3/cpu=32/conc=256 was skipped due to    test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-highcpu-32 --labels roachprod=true,cluster=teamcity-6897539-1665552014-267-n4cpu32,lifetime=12h0m0s,created=2022-10-12t12_19_12z --metadata-from-file startup-script=/tmp/gce-startup-script3350210394 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-highcpu-32 --labels roachprod=true,cluster=teamcity-6897539-1665552014-267-n4cpu32,lifetime=12h0m0s,created=2022-10-12t12_19_12z --metadata-from-file startup-script=/tmp/gce-startup-script3350210394 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=32 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test sysbench/oltp_update_non_index/nodes=3/cpu=32/conc=256 was skipped due to  test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-highcpu-32 --labels roachprod=true,cluster=teamcity-6897539-1665552014-275-n4cpu32,lifetime=12h0m0s,created=2022-10-12t12_20_34z --metadata-from-file startup-script=/tmp/gce-startup-script1668922810 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-highcpu-32 --labels roachprod=true,cluster=teamcity-6897539-1665552014-275-n4cpu32,lifetime=12h0m0s,created=2022-10-12t12_20_34z --metadata-from-file startup-script=/tmp/gce-startup-script1668922810 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=32 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test sysbench/oltp_write_only/nodes=3/cpu=32/conc=256 was skipped due to    test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-highcpu-32 --labels roachprod=true,cluster=teamcity-6897539-1665552014-276-n4cpu32,lifetime=12h0m0s,created=2022-10-12t12_20_53z --metadata-from-file startup-script=/tmp/gce-startup-script310053375 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-highcpu-32 --labels roachprod=true,cluster=teamcity-6897539-1665552014-276-n4cpu32,lifetime=12h0m0s,created=2022-10-12t12_20_53z --metadata-from-file startup-script=/tmp/gce-startup-script310053375 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=32 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test tpcc/headroom/n4cpu16 was skipped due to   test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-16 --labels created=2022-10-12t12_20_58z,roachprod=true,cluster=teamcity-6897539-1665552014-277-n4cpu16,lifetime=12h0m0s --metadata-from-file startup-script=/tmp/gce-startup-script290075923 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-16 --labels created=2022-10-12t12_20_58z,roachprod=true,cluster=teamcity-6897539-1665552014-277-n4cpu16,lifetime=12h0m0s --metadata-from-file startup-script=/tmp/gce-startup-script290075923 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=16 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test schemachange/random-load was skipped due to    test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-4 --labels roachprod=true,cluster=teamcity-6897539-1665552014-268-n3cpu4-geo,lifetime=12h0m0s,created=2022-10-12t12_19_13z --metadata-from-file startup-script=/tmp/gce-startup-script2441489958 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-4 --labels roachprod=true,cluster=teamcity-6897539-1665552014-268-n3cpu4-geo,lifetime=12h0m0s,created=2022-10-12t12_19_13z --metadata-from-file startup-script=/tmp/gce-startup-script2441489958 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=4 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test tpcc/mixed-headroom/n5cpu16 was skipped due to     test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-16 --labels cluster=teamcity-6897539-1665552014-284-n5cpu16,lifetime=12h0m0s,created=2022-10-12t12_22_14z,roachprod=true --metadata-from-file startup-script=/tmp/gce-startup-script746603447 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-16 --labels cluster=teamcity-6897539-1665552014-284-n5cpu16,lifetime=12h0m0s,created=2022-10-12t12_22_14z,roachprod=true --metadata-from-file startup-script=/tmp/gce-startup-script746603447 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=16 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test sqlsmith/setup=seed-multi-region/setting=multi-region was skipped due to   test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-4 --labels created=2022-10-12t12_21_39z,roachprod=true,cluster=teamcity-6897539-1665552014-281-n4cpu4-geo,lifetime=12h0m0s --metadata-from-file startup-script=/tmp/gce-startup-script4103703051 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-4 --labels created=2022-10-12t12_21_39z,roachprod=true,cluster=teamcity-6897539-1665552014-281-n4cpu4-geo,lifetime=12h0m0s --metadata-from-file startup-script=/tmp/gce-startup-script4103703051 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=4 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test tpce/c=5000/nodes=3 was skipped due to     test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-4 --labels roachprod=true,cluster=teamcity-6897539-1665552014-290-n4cpu4,lifetime=12h0m0s,created=2022-10-12t12_25_39z --metadata-from-file startup-script=/tmp/gce-startup-script2488073381 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-4 --labels roachprod=true,cluster=teamcity-6897539-1665552014-290-n4cpu4,lifetime=12h0m0s,created=2022-10-12t12_25_39z --metadata-from-file startup-script=/tmp/gce-startup-script2488073381 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=4 , ROACHTEST_ssd=1

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test ycsb/A/nodes=3 was skipped due to  test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-8 --labels created=2022-10-12t12_27_27z,roachprod=true,cluster=teamcity-6897539-1665552014-297-n4cpu8,lifetime=12h0m0s --metadata-from-file startup-script=/tmp/gce-startup-script4246144862 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-8 --labels created=2022-10-12t12_27_27z,roachprod=true,cluster=teamcity-6897539-1665552014-297-n4cpu8,lifetime=12h0m0s --metadata-from-file startup-script=/tmp/gce-startup-script4246144862 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test ycsb/A/nodes=3/cpu=32 was skipped due to   test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-highcpu-32 --labels lifetime=12h0m0s,created=2022-10-12t12_28_28z,roachprod=true,cluster=teamcity-6897539-1665552014-300-n4cpu32 --metadata-from-file startup-script=/tmp/gce-startup-script2221248844 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-highcpu-32 --labels lifetime=12h0m0s,created=2022-10-12t12_28_28z,roachprod=true,cluster=teamcity-6897539-1665552014-300-n4cpu32 --metadata-from-file startup-script=/tmp/gce-startup-script2221248844 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=32 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test ycsb/A/nodes=3/cpu=32/mvcc-range-keys=global was skipped due to    test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-highcpu-32 --labels created=2022-10-12t12_29_11z,roachprod=true,cluster=teamcity-6897539-1665552014-304-n4cpu32,lifetime=12h0m0s --metadata-from-file startup-script=/tmp/gce-startup-script2123629257 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-highcpu-32 --labels created=2022-10-12t12_29_11z,roachprod=true,cluster=teamcity-6897539-1665552014-304-n4cpu32,lifetime=12h0m0s --metadata-from-file startup-script=/tmp/gce-startup-script2123629257 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=32 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test tpcc/multiregion/survive=region/chaos=true was skipped due to  test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-4 --labels roachprod=true,cluster=teamcity-6897539-1665552014-295-n10cpu4-geo,lifetime=12h0m0s,created=2022-10-12t12_27_12z --metadata-from-file startup-script=/tmp/gce-startup-script2231688812 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-4 --labels roachprod=true,cluster=teamcity-6897539-1665552014-295-n10cpu4-geo,lifetime=12h0m0s,created=2022-10-12t12_27_12z --metadata-from-file startup-script=/tmp/gce-startup-script2231688812 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=4 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test tpcc/multiregion/survive=zone/chaos=true was skipped due to    test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-4 --labels roachprod=true,cluster=teamcity-6897539-1665552014-296-n10cpu4-geo,lifetime=12h0m0s,created=2022-10-12t12_27_14z --metadata-from-file startup-script=/tmp/gce-startup-script3306102100 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-4 --labels roachprod=true,cluster=teamcity-6897539-1665552014-296-n10cpu4-geo,lifetime=12h0m0s,created=2022-10-12t12_27_14z --metadata-from-file startup-script=/tmp/gce-startup-script3306102100 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=4 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test ycsb/B/nodes=3 was skipped due to  test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-8 --labels roachprod=true,cluster=teamcity-6897539-1665552014-309-n4cpu8,lifetime=12h0m0s,created=2022-10-12t12_30_12z --metadata-from-file startup-script=/tmp/gce-startup-script157880798 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-8 --labels roachprod=true,cluster=teamcity-6897539-1665552014-309-n4cpu8,lifetime=12h0m0s,created=2022-10-12t12_30_12z --metadata-from-file startup-script=/tmp/gce-startup-script157880798 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test ycsb/B/nodes=3/cpu=32 was skipped due to   test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-highcpu-32 --labels cluster=teamcity-6897539-1665552014-315-n4cpu32,lifetime=12h0m0s,created=2022-10-12t12_30_54z,roachprod=true --metadata-from-file startup-script=/tmp/gce-startup-script3087884667 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-highcpu-32 --labels cluster=teamcity-6897539-1665552014-315-n4cpu32,lifetime=12h0m0s,created=2022-10-12t12_30_54z,roachprod=true --metadata-from-file startup-script=/tmp/gce-startup-script3087884667 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=32 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test tpccbench/nodes=9/cpu=4/multi-region was skipped due to    test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-highmem-4 --labels roachprod=true,cluster=teamcity-6897539-1665552014-302-n12cpu4m-geo,lifetime=12h0m0s,created=2022-10-12t12_28_37z --metadata-from-file startup-script=/tmp/gce-startup-script1074691765 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-highmem-4 --labels roachprod=true,cluster=teamcity-6897539-1665552014-302-n12cpu4m-geo,lifetime=12h0m0s,created=2022-10-12t12_28_37z --metadata-from-file startup-script=/tmp/gce-startup-script1074691765 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=4 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test ycsb/B/nodes=3/cpu=32/mvcc-range-keys=global was skipped due to    test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-highcpu-32 --labels roachprod=true,cluster=teamcity-6897539-1665552014-317-n4cpu32,lifetime=12h0m0s,created=2022-10-12t12_31_09z --metadata-from-file startup-script=/tmp/gce-startup-script2283735934 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-highcpu-32 --labels roachprod=true,cluster=teamcity-6897539-1665552014-317-n4cpu32,lifetime=12h0m0s,created=2022-10-12t12_31_09z --metadata-from-file startup-script=/tmp/gce-startup-script2283735934 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=32 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test ycsb/C/nodes=3 was skipped due to  test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-8 --labels lifetime=12h0m0s,created=2022-10-12t12_31_15z,roachprod=true,cluster=teamcity-6897539-1665552014-318-n4cpu8 --metadata-from-file startup-script=/tmp/gce-startup-script692185888 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-8 --labels lifetime=12h0m0s,created=2022-10-12t12_31_15z,roachprod=true,cluster=teamcity-6897539-1665552014-318-n4cpu8 --metadata-from-file startup-script=/tmp/gce-startup-script692185888 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test ycsb/C/nodes=3/cpu=32 was skipped due to   test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-highcpu-32 --labels roachprod=true,cluster=teamcity-6897539-1665552014-324-n4cpu32,lifetime=12h0m0s,created=2022-10-12t12_31_38z --metadata-from-file startup-script=/tmp/gce-startup-script3582559720 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-highcpu-32 --labels roachprod=true,cluster=teamcity-6897539-1665552014-324-n4cpu32,lifetime=12h0m0s,created=2022-10-12t12_31_38z --metadata-from-file startup-script=/tmp/gce-startup-script3582559720 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=32 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test ycsb/D/nodes=3 was skipped due to  test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-8 --labels roachprod=true,cluster=teamcity-6897539-1665552014-326-n4cpu8,lifetime=12h0m0s,created=2022-10-12t12_31_52z --metadata-from-file startup-script=/tmp/gce-startup-script3380476160 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-8 --labels roachprod=true,cluster=teamcity-6897539-1665552014-326-n4cpu8,lifetime=12h0m0s,created=2022-10-12t12_31_52z --metadata-from-file startup-script=/tmp/gce-startup-script3380476160 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test ycsb/E/nodes=3 was skipped due to  test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-8 --labels roachprod=true,cluster=teamcity-6897539-1665552014-333-n4cpu8,lifetime=12h0m0s,created=2022-10-12t12_32_28z --metadata-from-file startup-script=/tmp/gce-startup-script1227306705 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-8 --labels roachprod=true,cluster=teamcity-6897539-1665552014-333-n4cpu8,lifetime=12h0m0s,created=2022-10-12t12_32_28z --metadata-from-file startup-script=/tmp/gce-startup-script1227306705 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test ycsb/F/nodes=3 was skipped due to  test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-8 --labels lifetime=12h0m0s,created=2022-10-12t12_32_31z,roachprod=true,cluster=teamcity-6897539-1665552014-334-n4cpu8 --metadata-from-file startup-script=/tmp/gce-startup-script15643276 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-8 --labels lifetime=12h0m0s,created=2022-10-12t12_32_31z,roachprod=true,cluster=teamcity-6897539-1665552014-334-n4cpu8 --metadata-from-file startup-script=/tmp/gce-startup-script15643276 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test ycsb/C/nodes=3/cpu=32/mvcc-range-keys=global was skipped due to    test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-highcpu-32 --labels cluster=teamcity-6897539-1665552014-335-n4cpu32,lifetime=12h0m0s,created=2022-10-12t12_32_38z,roachprod=true --metadata-from-file startup-script=/tmp/gce-startup-script2861842913 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-highcpu-32 --labels cluster=teamcity-6897539-1665552014-335-n4cpu32,lifetime=12h0m0s,created=2022-10-12t12_32_38z,roachprod=true --metadata-from-file startup-script=/tmp/gce-startup-script2861842913 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=32 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test zfs/ycsb/A/nodes=3/cpu=8 was skipped due to    test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-8 --labels lifetime=12h0m0s,created=2022-10-12t12_32_39z,roachprod=true,cluster=teamcity-6897539-1665552014-336-n4cpu8 --metadata-from-file startup-script=/tmp/gce-startup-script2326648790 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-8 --labels lifetime=12h0m0s,created=2022-10-12t12_32_39z,roachprod=true,cluster=teamcity-6897539-1665552014-336-n4cpu8 --metadata-from-file startup-script=/tmp/gce-startup-script2326648790 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test ycsb/D/nodes=3/cpu=32 was skipped due to   test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-highcpu-32 --labels roachprod=true,cluster=teamcity-6897539-1665552014-338-n4cpu32,lifetime=12h0m0s,created=2022-10-12t12_32_48z --metadata-from-file startup-script=/tmp/gce-startup-script685267696 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-highcpu-32 --labels roachprod=true,cluster=teamcity-6897539-1665552014-338-n4cpu32,lifetime=12h0m0s,created=2022-10-12t12_32_48z --metadata-from-file startup-script=/tmp/gce-startup-script685267696 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=32 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test ycsb/D/nodes=3/cpu=32/mvcc-range-keys=global was skipped due to    test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-highcpu-32 --labels roachprod=true,cluster=teamcity-6897539-1665552014-341-n4cpu32,lifetime=12h0m0s,created=2022-10-12t12_33_14z --metadata-from-file startup-script=/tmp/gce-startup-script1161434504 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-highcpu-32 --labels roachprod=true,cluster=teamcity-6897539-1665552014-341-n4cpu32,lifetime=12h0m0s,created=2022-10-12t12_33_14z --metadata-from-file startup-script=/tmp/gce-startup-script1161434504 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=32 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test ycsb/E/nodes=3/cpu=32 was skipped due to   test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-highcpu-32 --labels lifetime=12h0m0s,created=2022-10-12t12_34_09z,roachprod=true,cluster=teamcity-6897539-1665552014-347-n4cpu32 --metadata-from-file startup-script=/tmp/gce-startup-script2560321222 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-highcpu-32 --labels lifetime=12h0m0s,created=2022-10-12t12_34_09z,roachprod=true,cluster=teamcity-6897539-1665552014-347-n4cpu32 --metadata-from-file startup-script=/tmp/gce-startup-script2560321222 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=32 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test ycsb/E/nodes=3/cpu=32/mvcc-range-keys=global was skipped due to    test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-highcpu-32 --labels roachprod=true,cluster=teamcity-6897539-1665552014-349-n4cpu32,lifetime=12h0m0s,created=2022-10-12t12_34_24z --metadata-from-file startup-script=/tmp/gce-startup-script3913096024 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-highcpu-32 --labels roachprod=true,cluster=teamcity-6897539-1665552014-349-n4cpu32,lifetime=12h0m0s,created=2022-10-12t12_34_24z --metadata-from-file startup-script=/tmp/gce-startup-script3913096024 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=32 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test ycsb/F/nodes=3/cpu=32 was skipped due to   test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-highcpu-32 --labels lifetime=12h0m0s,created=2022-10-12t12_34_28z,roachprod=true,cluster=teamcity-6897539-1665552014-350-n4cpu32 --metadata-from-file startup-script=/tmp/gce-startup-script774758064 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-highcpu-32 --labels lifetime=12h0m0s,created=2022-10-12t12_34_28z,roachprod=true,cluster=teamcity-6897539-1665552014-350-n4cpu32 --metadata-from-file startup-script=/tmp/gce-startup-script774758064 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=32 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test ycsb/F/nodes=3/cpu=32/mvcc-range-keys=global was skipped due to    test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-highcpu-32 --labels roachprod=true,cluster=teamcity-6897539-1665552014-352-n4cpu32,lifetime=12h0m0s,created=2022-10-12t12_34_52z --metadata-from-file startup-script=/tmp/gce-startup-script3537144676 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-highcpu-32 --labels roachprod=true,cluster=teamcity-6897539-1665552014-352-n4cpu32,lifetime=12h0m0s,created=2022-10-12t12_34_52z --metadata-from-file startup-script=/tmp/gce-startup-script3537144676 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=32 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test zfs/ycsb/A/nodes=3/cpu=32 was skipped due to   test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-highcpu-32 --labels lifetime=12h0m0s,created=2022-10-12t12_35_40z,roachprod=true,cluster=teamcity-6897539-1665552014-354-n4cpu32 --metadata-from-file startup-script=/tmp/gce-startup-script1192808556 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-highcpu-32 --labels lifetime=12h0m0s,created=2022-10-12t12_35_40z,roachprod=true,cluster=teamcity-6897539-1665552014-354-n4cpu32 --metadata-from-file startup-script=/tmp/gce-startup-script1192808556 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=32 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

blathers-crl[bot] commented 2 years ago

cc @cockroachdb/test-eng

srosenberg commented 1 year ago

Dupe of https://github.com/cockroachdb/cockroach/issues/87695

cockroachdb / cockroach

roachtest: cluster_creation failed #89810