cockroachdb / cockroach

CockroachDB — the cloud native, distributed SQL database designed for high availability, effortless scale, and control over data placement.
https://www.cockroachlabs.com
Other
30.21k stars 3.82k forks source link

roachtest: cluster_creation failed #89810

Closed cockroach-teamcity closed 1 year ago

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test jepsen/multi-register/start-stop-2 was skipped due to  test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-4 --labels created=2022-10-12t11_41_08z,roachprod=true,cluster=teamcity-6897539-1665552014-65-n6cpu4,lifetime=12h0m0s --metadata-from-file startup-script=/tmp/gce-startup-script1565213459 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-4 --labels created=2022-10-12t11_41_08z,roachprod=true,cluster=teamcity-6897539-1665552014-65-n6cpu4,lifetime=12h0m0s --metadata-from-file startup-script=/tmp/gce-startup-script1565213459 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=4 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

/cc @cockroachdb/dev-inf

This test on roachdash | Improve this report!

Jira issue: CRDB-20451

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test jepsen/multi-register/strobe-skews was skipped due to  test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-4 --labels roachprod=true,cluster=teamcity-6897539-1665552014-68-n6cpu4,lifetime=12h0m0s,created=2022-10-12t11_43_04z --metadata-from-file startup-script=/tmp/gce-startup-script2482752620 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-4 --labels roachprod=true,cluster=teamcity-6897539-1665552014-68-n6cpu4,lifetime=12h0m0s,created=2022-10-12t11_43_04z --metadata-from-file startup-script=/tmp/gce-startup-script2482752620 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=4 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test jepsen/register/majority-ring was skipped due to   test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-4 --labels cluster=teamcity-6897539-1665552014-71-n6cpu4,lifetime=12h0m0s,created=2022-10-12t11_44_57z,roachprod=true --metadata-from-file startup-script=/tmp/gce-startup-script4160340257 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-4 --labels cluster=teamcity-6897539-1665552014-71-n6cpu4,lifetime=12h0m0s,created=2022-10-12t11_44_57z,roachprod=true --metadata-from-file startup-script=/tmp/gce-startup-script4160340257 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=4 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test jepsen/register/parts-start-kill-2 was skipped due to  test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-4 --labels roachprod=true,cluster=teamcity-6897539-1665552014-74-n6cpu4,lifetime=12h0m0s,created=2022-10-12t11_46_52z --metadata-from-file startup-script=/tmp/gce-startup-script2883046039 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-4 --labels roachprod=true,cluster=teamcity-6897539-1665552014-74-n6cpu4,lifetime=12h0m0s,created=2022-10-12t11_46_52z --metadata-from-file startup-script=/tmp/gce-startup-script2883046039 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=4 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test jepsen/register/start-kill-2 was skipped due to    test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-4 --labels cluster=teamcity-6897539-1665552014-77-n6cpu4,lifetime=12h0m0s,created=2022-10-12t11_48_42z,roachprod=true --metadata-from-file startup-script=/tmp/gce-startup-script1379417368 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-4 --labels cluster=teamcity-6897539-1665552014-77-n6cpu4,lifetime=12h0m0s,created=2022-10-12t11_48_42z,roachprod=true --metadata-from-file startup-script=/tmp/gce-startup-script1379417368 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=4 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test jepsen/register/strobe-skews was skipped due to    test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-4 --labels lifetime=12h0m0s,created=2022-10-12t11_50_35z,roachprod=true,cluster=teamcity-6897539-1665552014-80-n6cpu4 --metadata-from-file startup-script=/tmp/gce-startup-script3592518689 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-4 --labels lifetime=12h0m0s,created=2022-10-12t11_50_35z,roachprod=true,cluster=teamcity-6897539-1665552014-80-n6cpu4 --metadata-from-file startup-script=/tmp/gce-startup-script3592518689 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=4 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test jepsen/sequential/majority-ring-start-kill-2 was skipped due to    test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-4 --labels created=2022-10-12t11_52_27z,roachprod=true,cluster=teamcity-6897539-1665552014-83-n6cpu4,lifetime=12h0m0s --metadata-from-file startup-script=/tmp/gce-startup-script1670390540 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-4 --labels created=2022-10-12t11_52_27z,roachprod=true,cluster=teamcity-6897539-1665552014-83-n6cpu4,lifetime=12h0m0s --metadata-from-file startup-script=/tmp/gce-startup-script1670390540 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=4 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test jepsen/sequential/start-kill-2 was skipped due to  test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-4 --labels roachprod=true,cluster=teamcity-6897539-1665552014-86-n6cpu4,lifetime=12h0m0s,created=2022-10-12t11_54_24z --metadata-from-file startup-script=/tmp/gce-startup-script810253265 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-4 --labels roachprod=true,cluster=teamcity-6897539-1665552014-86-n6cpu4,lifetime=12h0m0s,created=2022-10-12t11_54_24z --metadata-from-file startup-script=/tmp/gce-startup-script810253265 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=4 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test jepsen/sets/majority-ring was skipped due to   test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-4 --labels roachprod=true,cluster=teamcity-6897539-1665552014-89-n6cpu4,lifetime=12h0m0s,created=2022-10-12t11_56_22z --metadata-from-file startup-script=/tmp/gce-startup-script3027235342 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-4 --labels roachprod=true,cluster=teamcity-6897539-1665552014-89-n6cpu4,lifetime=12h0m0s,created=2022-10-12t11_56_22z --metadata-from-file startup-script=/tmp/gce-startup-script3027235342 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=4 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test jepsen/sets/parts-start-kill-2 was skipped due to  test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-4 --labels roachprod=true,cluster=teamcity-6897539-1665552014-92-n6cpu4,lifetime=12h0m0s,created=2022-10-12t11_58_14z --metadata-from-file startup-script=/tmp/gce-startup-script1899609070 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-4 --labels roachprod=true,cluster=teamcity-6897539-1665552014-92-n6cpu4,lifetime=12h0m0s,created=2022-10-12t11_58_14z --metadata-from-file startup-script=/tmp/gce-startup-script1899609070 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=4 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test jepsen/sets/split was skipped due to   test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-4 --labels roachprod=true,cluster=teamcity-6897539-1665552014-97-n6cpu4,lifetime=12h0m0s,created=2022-10-12t11_59_40z --metadata-from-file startup-script=/tmp/gce-startup-script27603021 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-4 --labels roachprod=true,cluster=teamcity-6897539-1665552014-97-n6cpu4,lifetime=12h0m0s,created=2022-10-12t11_59_40z --metadata-from-file startup-script=/tmp/gce-startup-script27603021 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=4 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test jepsen/sets/start-kill-2 was skipped due to    test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-4 --labels lifetime=12h0m0s,created=2022-10-12t12_00_10z,roachprod=true,cluster=teamcity-6897539-1665552014-98-n6cpu4 --metadata-from-file startup-script=/tmp/gce-startup-script2390429040 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-4 --labels lifetime=12h0m0s,created=2022-10-12t12_00_10z,roachprod=true,cluster=teamcity-6897539-1665552014-98-n6cpu4 --metadata-from-file startup-script=/tmp/gce-startup-script2390429040 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=4 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test kv/multi-store-with-overload was skipped due to    test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --local-ssd interface=NVME --machine-type n1-standard-8 --labels roachprod=true,cluster=teamcity-6897539-1665552014-103-n2cpu8,lifetime=12h0m0s,created=2022-10-12t12_01_29z --metadata-from-file startup-script=/tmp/gce-startup-script515040798 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --local-ssd interface=NVME --machine-type n1-standard-8 --labels roachprod=true,cluster=teamcity-6897539-1665552014-103-n2cpu8,lifetime=12h0m0s,created=2022-10-12t12_01_29z --metadata-from-file startup-script=/tmp/gce-startup-script515040798 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=2

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test kv0/enc=false/nodes=1 was skipped due to   test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-8 --labels roachprod=true,cluster=teamcity-6897539-1665552014-104-n2cpu8,lifetime=12h0m0s,created=2022-10-12t12_02_03z --metadata-from-file startup-script=/tmp/gce-startup-script2670598246 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-8 --labels roachprod=true,cluster=teamcity-6897539-1665552014-104-n2cpu8,lifetime=12h0m0s,created=2022-10-12t12_02_03z --metadata-from-file startup-script=/tmp/gce-startup-script2670598246 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test kv0/enc=false/nodes=1/cpu=32 was skipped due to    test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-highcpu-32 --labels cluster=teamcity-6897539-1665552014-109-n2cpu32,lifetime=12h0m0s,created=2022-10-12t12_03_14z,roachprod=true --metadata-from-file startup-script=/tmp/gce-startup-script445063854 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-highcpu-32 --labels cluster=teamcity-6897539-1665552014-109-n2cpu32,lifetime=12h0m0s,created=2022-10-12t12_03_14z,roachprod=true --metadata-from-file startup-script=/tmp/gce-startup-script445063854 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=32 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test kv0/enc=false/nodes=1/size=64kb/conc=4096 was skipped due to   test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-8 --labels roachprod=true,cluster=teamcity-6897539-1665552014-114-n2cpu8,lifetime=12h0m0s,created=2022-10-12t12_03_51z --metadata-from-file startup-script=/tmp/gce-startup-script3182922224 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-8 --labels roachprod=true,cluster=teamcity-6897539-1665552014-114-n2cpu8,lifetime=12h0m0s,created=2022-10-12t12_03_51z --metadata-from-file startup-script=/tmp/gce-startup-script3182922224 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test kv0/enc=false/nodes=3 was skipped due to   test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-8 --labels roachprod=true,cluster=teamcity-6897539-1665552014-115-n4cpu8,lifetime=12h0m0s,created=2022-10-12t12_04_05z --metadata-from-file startup-script=/tmp/gce-startup-script3708449382 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-8 --labels roachprod=true,cluster=teamcity-6897539-1665552014-115-n4cpu8,lifetime=12h0m0s,created=2022-10-12t12_04_05z --metadata-from-file startup-script=/tmp/gce-startup-script3708449382 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test kv0/enc=false/nodes=3/batch=16 was skipped due to  test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-8 --labels roachprod=true,cluster=teamcity-6897539-1665552014-121-n4cpu8,lifetime=12h0m0s,created=2022-10-12t12_04_45z --metadata-from-file startup-script=/tmp/gce-startup-script3626201895 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-8 --labels roachprod=true,cluster=teamcity-6897539-1665552014-121-n4cpu8,lifetime=12h0m0s,created=2022-10-12t12_04_45z --metadata-from-file startup-script=/tmp/gce-startup-script3626201895 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test kv0/enc=false/nodes=3/cpu=96 was skipped due to    test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-highcpu-96 --labels roachprod=true,cluster=teamcity-6897539-1665552014-125-n4cpu96,lifetime=12h0m0s,created=2022-10-12t12_05_07z --metadata-from-file startup-script=/tmp/gce-startup-script2279547271 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-highcpu-96 --labels roachprod=true,cluster=teamcity-6897539-1665552014-125-n4cpu96,lifetime=12h0m0s,created=2022-10-12t12_05_07z --metadata-from-file startup-script=/tmp/gce-startup-script2279547271 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=96 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test kv0/enc=false/nodes=3/size=4kb was skipped due to  test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-8 --labels roachprod=true,cluster=teamcity-6897539-1665552014-127-n4cpu8,lifetime=12h0m0s,created=2022-10-12t12_05_25z --metadata-from-file startup-script=/tmp/gce-startup-script3391761109 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-8 --labels roachprod=true,cluster=teamcity-6897539-1665552014-127-n4cpu8,lifetime=12h0m0s,created=2022-10-12t12_05_25z --metadata-from-file startup-script=/tmp/gce-startup-script3391761109 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test kv0/enc=false/nodes=3/size=64kb was skipped due to     test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-8 --labels roachprod=true,cluster=teamcity-6897539-1665552014-130-n4cpu8,lifetime=12h0m0s,created=2022-10-12t12_05_37z --metadata-from-file startup-script=/tmp/gce-startup-script1975888884 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-8 --labels roachprod=true,cluster=teamcity-6897539-1665552014-130-n4cpu8,lifetime=12h0m0s,created=2022-10-12t12_05_37z --metadata-from-file startup-script=/tmp/gce-startup-script1975888884 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test kv0/enc=false/nodes=3/splt=0 was skipped due to    test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-8 --labels roachprod=true,cluster=teamcity-6897539-1665552014-134-n4cpu8,lifetime=12h0m0s,created=2022-10-12t12_06_08z --metadata-from-file startup-script=/tmp/gce-startup-script2240270635 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-8 --labels roachprod=true,cluster=teamcity-6897539-1665552014-134-n4cpu8,lifetime=12h0m0s,created=2022-10-12t12_06_08z --metadata-from-file startup-script=/tmp/gce-startup-script2240270635 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test kv0/enc=true/nodes=1 was skipped due to    test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-8 --labels roachprod=true,cluster=teamcity-6897539-1665552014-135-n2cpu8,lifetime=12h0m0s,created=2022-10-12t12_06_11z --metadata-from-file startup-script=/tmp/gce-startup-script358179095 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-8 --labels roachprod=true,cluster=teamcity-6897539-1665552014-135-n2cpu8,lifetime=12h0m0s,created=2022-10-12t12_06_11z --metadata-from-file startup-script=/tmp/gce-startup-script358179095 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test kv0/enc=true/nodes=3 was skipped due to    test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-8 --labels lifetime=12h0m0s,created=2022-10-12t12_06_33z,roachprod=true,cluster=teamcity-6897539-1665552014-138-n4cpu8 --metadata-from-file startup-script=/tmp/gce-startup-script2404412559 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-8 --labels lifetime=12h0m0s,created=2022-10-12t12_06_33z,roachprod=true,cluster=teamcity-6897539-1665552014-138-n4cpu8 --metadata-from-file startup-script=/tmp/gce-startup-script2404412559 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test kv50/enc=false/nodes=1/conc=8192 was skipped due to    test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-8 --labels roachprod=true,cluster=teamcity-6897539-1665552014-141-n2cpu8,lifetime=12h0m0s,created=2022-10-12t12_06_51z --metadata-from-file startup-script=/tmp/gce-startup-script4090981402 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-8 --labels roachprod=true,cluster=teamcity-6897539-1665552014-141-n2cpu8,lifetime=12h0m0s,created=2022-10-12t12_06_51z --metadata-from-file startup-script=/tmp/gce-startup-script4090981402 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test kv50/enc=false/nodes=4/cpu=96/batch=64 was skipped due to  test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-highcpu-96 --labels created=2022-10-12t12_07_10z,roachprod=true,cluster=teamcity-6897539-1665552014-144-n5cpu96,lifetime=12h0m0s --metadata-from-file startup-script=/tmp/gce-startup-script1237651468 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-highcpu-96 --labels created=2022-10-12t12_07_10z,roachprod=true,cluster=teamcity-6897539-1665552014-144-n5cpu96,lifetime=12h0m0s --metadata-from-file startup-script=/tmp/gce-startup-script1237651468 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=96 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test kv95/enc=false/nodes=1 was skipped due to  test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-8 --labels lifetime=12h0m0s,created=2022-10-12t12_07_31z,roachprod=true,cluster=teamcity-6897539-1665552014-150-n2cpu8 --metadata-from-file startup-script=/tmp/gce-startup-script3627591268 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-8 --labels lifetime=12h0m0s,created=2022-10-12t12_07_31z,roachprod=true,cluster=teamcity-6897539-1665552014-150-n2cpu8 --metadata-from-file startup-script=/tmp/gce-startup-script3627591268 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test kv95/enc=false/nodes=1/cpu=32 was skipped due to   test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-highcpu-32 --labels roachprod=true,cluster=teamcity-6897539-1665552014-154-n2cpu32,lifetime=12h0m0s,created=2022-10-12t12_07_55z --metadata-from-file startup-script=/tmp/gce-startup-script3552971769 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-highcpu-32 --labels roachprod=true,cluster=teamcity-6897539-1665552014-154-n2cpu32,lifetime=12h0m0s,created=2022-10-12t12_07_55z --metadata-from-file startup-script=/tmp/gce-startup-script3552971769 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=32 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test kv95/enc=true/nodes=1 was skipped due to   test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-8 --labels roachprod=true,cluster=teamcity-6897539-1665552014-156-n2cpu8,lifetime=12h0m0s,created=2022-10-12t12_08_07z --metadata-from-file startup-script=/tmp/gce-startup-script2095437864 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-8 --labels roachprod=true,cluster=teamcity-6897539-1665552014-156-n2cpu8,lifetime=12h0m0s,created=2022-10-12t12_08_07z --metadata-from-file startup-script=/tmp/gce-startup-script2095437864 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test kv95/enc=false/nodes=3 was skipped due to  test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-8 --labels created=2022-10-12t12_08_21z,roachprod=true,cluster=teamcity-6897539-1665552014-158-n4cpu8,lifetime=12h0m0s --metadata-from-file startup-script=/tmp/gce-startup-script982761582 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-8 --labels created=2022-10-12t12_08_21z,roachprod=true,cluster=teamcity-6897539-1665552014-158-n4cpu8,lifetime=12h0m0s --metadata-from-file startup-script=/tmp/gce-startup-script982761582 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test kv95limited-spans/enc=false/nodes=1/splt=0/seq/no-load-splitting was skipped due to    test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-8 --labels roachprod=true,cluster=teamcity-6897539-1665552014-160-n2cpu8,lifetime=12h0m0s,created=2022-10-12t12_08_29z --metadata-from-file startup-script=/tmp/gce-startup-script2541275984 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-8 --labels roachprod=true,cluster=teamcity-6897539-1665552014-160-n2cpu8,lifetime=12h0m0s,created=2022-10-12t12_08_29z --metadata-from-file startup-script=/tmp/gce-startup-script2541275984 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test multitenant-upgrade was skipped due to     test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-4 --labels roachprod=true,cluster=teamcity-6897539-1665552014-163-n2cpu4,lifetime=12h0m0s,created=2022-10-12t12_08_38z --metadata-from-file startup-script=/tmp/gce-startup-script1834333135 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-4 --labels roachprod=true,cluster=teamcity-6897539-1665552014-163-n2cpu4,lifetime=12h0m0s,created=2022-10-12t12_08_38z --metadata-from-file startup-script=/tmp/gce-startup-script1834333135 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=4 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test kv50/rangelookups/relocate/nodes=8 was skipped due to  test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-8 --labels created=2022-10-12t12_09_16z,roachprod=true,cluster=teamcity-6897539-1665552014-171-n9cpu8,lifetime=12h0m0s --metadata-from-file startup-script=/tmp/gce-startup-script1181198735 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-8 --labels created=2022-10-12t12_09_16z,roachprod=true,cluster=teamcity-6897539-1665552014-171-n9cpu8,lifetime=12h0m0s --metadata-from-file startup-script=/tmp/gce-startup-script1181198735 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test kv50/rangelookups/split/nodes=8 was skipped due to     test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-8 --labels roachprod=true,cluster=teamcity-6897539-1665552014-172-n9cpu8,lifetime=12h0m0s,created=2022-10-12t12_09_18z --metadata-from-file startup-script=/tmp/gce-startup-script3097445487 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-8 --labels roachprod=true,cluster=teamcity-6897539-1665552014-172-n9cpu8,lifetime=12h0m0s,created=2022-10-12t12_09_18z --metadata-from-file startup-script=/tmp/gce-startup-script3097445487 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test kv95/enc=false/nodes=3/batch=16 was skipped due to     test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-8 --labels roachprod=true,cluster=teamcity-6897539-1665552014-175-n4cpu8,lifetime=12h0m0s,created=2022-10-12t12_09_35z --metadata-from-file startup-script=/tmp/gce-startup-script888952379 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-8 --labels roachprod=true,cluster=teamcity-6897539-1665552014-175-n4cpu8,lifetime=12h0m0s,created=2022-10-12t12_09_35z --metadata-from-file startup-script=/tmp/gce-startup-script888952379 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test kv95/enc=false/nodes=3/cpu=32/size=4kb was skipped due to  test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-highcpu-32 --labels roachprod=true,cluster=teamcity-6897539-1665552014-177-n4cpu32,lifetime=12h0m0s,created=2022-10-12t12_09_43z --metadata-from-file startup-script=/tmp/gce-startup-script3983528684 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-highcpu-32 --labels roachprod=true,cluster=teamcity-6897539-1665552014-177-n4cpu32,lifetime=12h0m0s,created=2022-10-12t12_09_43z --metadata-from-file startup-script=/tmp/gce-startup-script3983528684 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=32 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test kv95/enc=false/nodes=3/cpu=32/size=64kb was skipped due to     test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-highcpu-32 --labels cluster=teamcity-6897539-1665552014-181-n4cpu32,lifetime=12h0m0s,created=2022-10-12t12_09_55z,roachprod=true --metadata-from-file startup-script=/tmp/gce-startup-script1091021502 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-highcpu-32 --labels cluster=teamcity-6897539-1665552014-181-n4cpu32,lifetime=12h0m0s,created=2022-10-12t12_09_55z,roachprod=true --metadata-from-file startup-script=/tmp/gce-startup-script1091021502 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=32 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test kv95/enc=false/nodes=3/cpu=32/size=64kb/no-admission was skipped due to    test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-highcpu-32 --labels lifetime=12h0m0s,created=2022-10-12t12_10_05z,roachprod=true,cluster=teamcity-6897539-1665552014-182-n4cpu32 --metadata-from-file startup-script=/tmp/gce-startup-script315615780 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-highcpu-32 --labels lifetime=12h0m0s,created=2022-10-12t12_10_05z,roachprod=true,cluster=teamcity-6897539-1665552014-182-n4cpu32 --metadata-from-file startup-script=/tmp/gce-startup-script315615780 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=32 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test kv95/enc=false/nodes=3/size=4kb was skipped due to     test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-8 --labels roachprod=true,cluster=teamcity-6897539-1665552014-184-n4cpu8,lifetime=12h0m0s,created=2022-10-12t12_10_14z --metadata-from-file startup-script=/tmp/gce-startup-script2981284364 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-8 --labels roachprod=true,cluster=teamcity-6897539-1665552014-184-n4cpu8,lifetime=12h0m0s,created=2022-10-12t12_10_14z --metadata-from-file startup-script=/tmp/gce-startup-script2981284364 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test kv95/enc=false/nodes=3/size=64kb was skipped due to    test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-8 --labels roachprod=true,cluster=teamcity-6897539-1665552014-186-n4cpu8,lifetime=12h0m0s,created=2022-10-12t12_10_26z --metadata-from-file startup-script=/tmp/gce-startup-script194106834 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-8 --labels roachprod=true,cluster=teamcity-6897539-1665552014-186-n4cpu8,lifetime=12h0m0s,created=2022-10-12t12_10_26z --metadata-from-file startup-script=/tmp/gce-startup-script194106834 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test kv95/enc=false/nodes=3/splt=0 was skipped due to   test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-8 --labels roachprod=true,cluster=teamcity-6897539-1665552014-194-n4cpu8,lifetime=12h0m0s,created=2022-10-12t12_11_02z --metadata-from-file startup-script=/tmp/gce-startup-script890917518 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-8 --labels roachprod=true,cluster=teamcity-6897539-1665552014-194-n4cpu8,lifetime=12h0m0s,created=2022-10-12t12_11_02z --metadata-from-file startup-script=/tmp/gce-startup-script890917518 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test kv95/enc=false/nodes=3/cpu=32/splt=0 was skipped due to    test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-highcpu-32 --labels roachprod=true,cluster=teamcity-6897539-1665552014-196-n4cpu32,lifetime=12h0m0s,created=2022-10-12t12_11_03z --metadata-from-file startup-script=/tmp/gce-startup-script2138958458 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-highcpu-32 --labels roachprod=true,cluster=teamcity-6897539-1665552014-196-n4cpu32,lifetime=12h0m0s,created=2022-10-12t12_11_03z --metadata-from-file startup-script=/tmp/gce-startup-script2138958458 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=32 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test kv95/enc=false/nodes=3/tracing was skipped due to  test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-8 --labels lifetime=12h0m0s,created=2022-10-12t12_11_17z,roachprod=true,cluster=teamcity-6897539-1665552014-198-n4cpu8 --metadata-from-file startup-script=/tmp/gce-startup-script645563507 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-8 --labels lifetime=12h0m0s,created=2022-10-12t12_11_17z,roachprod=true,cluster=teamcity-6897539-1665552014-198-n4cpu8 --metadata-from-file startup-script=/tmp/gce-startup-script645563507 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test kv95/enc=false/nodes=4 was skipped due to  test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-8 --labels cluster=teamcity-6897539-1665552014-201-n5cpu8,lifetime=12h0m0s,created=2022-10-12t12_11_34z,roachprod=true --metadata-from-file startup-script=/tmp/gce-startup-script3613163828 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-8 --labels cluster=teamcity-6897539-1665552014-201-n5cpu8,lifetime=12h0m0s,created=2022-10-12t12_11_34z,roachprod=true --metadata-from-file startup-script=/tmp/gce-startup-script3613163828 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test kv95/enc=false/nodes=4/ssds=8 was skipped due to   test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --local-ssd interface=NVME --local-ssd interface=NVME --local-ssd interface=NVME --local-ssd interface=NVME --local-ssd interface=NVME --local-ssd interface=NVME --local-ssd interface=NVME --machine-type n1-standard-8 --labels roachprod=true,cluster=teamcity-6897539-1665552014-205-n5cpu8,lifetime=12h0m0s,created=2022-10-12t12_11_44z --metadata-from-file startup-script=/tmp/gce-startup-script3280999882 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --local-ssd interface=NVME --local-ssd interface=NVME --local-ssd interface=NVME --local-ssd interface=NVME --local-ssd interface=NVME --local-ssd interface=NVME --local-ssd interface=NVME --machine-type n1-standard-8 --labels roachprod=true,cluster=teamcity-6897539-1665552014-205-n5cpu8,lifetime=12h0m0s,created=2022-10-12t12_11_44z --metadata-from-file startup-script=/tmp/gce-startup-script3280999882 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=8

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test kv95/enc=false/nodes=4/ssds=8/raid0 was skipped due to     test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --local-ssd interface=NVME --local-ssd interface=NVME --local-ssd interface=NVME --local-ssd interface=NVME --local-ssd interface=NVME --local-ssd interface=NVME --local-ssd interface=NVME --machine-type n1-standard-8 --labels created=2022-10-12t12_11_52z,roachprod=true,cluster=teamcity-6897539-1665552014-206-n5cpu8,lifetime=12h0m0s --metadata-from-file startup-script=/tmp/gce-startup-script1581502196 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --local-ssd interface=NVME --local-ssd interface=NVME --local-ssd interface=NVME --local-ssd interface=NVME --local-ssd interface=NVME --local-ssd interface=NVME --local-ssd interface=NVME --machine-type n1-standard-8 --labels created=2022-10-12t12_11_52z,roachprod=true,cluster=teamcity-6897539-1665552014-206-n5cpu8,lifetime=12h0m0s --metadata-from-file startup-script=/tmp/gce-startup-script1581502196 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=8

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test kv95/enc=true/nodes=3 was skipped due to   test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-8 --labels lifetime=12h0m0s,created=2022-10-12t12_12_09z,roachprod=true,cluster=teamcity-6897539-1665552014-208-n4cpu8 --metadata-from-file startup-script=/tmp/gce-startup-script961419918 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-8 --labels lifetime=12h0m0s,created=2022-10-12t12_12_09z,roachprod=true,cluster=teamcity-6897539-1665552014-208-n4cpu8 --metadata-from-file startup-script=/tmp/gce-startup-script961419918 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test kv95limited-spans/enc=false/nodes=1/cpu=32/splt=0/seq/no-load-splitting was skipped due to     test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-highcpu-32 --labels lifetime=12h0m0s,created=2022-10-12t12_12_14z,roachprod=true,cluster=teamcity-6897539-1665552014-209-n2cpu32 --metadata-from-file startup-script=/tmp/gce-startup-script1106954442 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-highcpu-32 --labels lifetime=12h0m0s,created=2022-10-12t12_12_14z,roachprod=true,cluster=teamcity-6897539-1665552014-209-n2cpu32 --metadata-from-file startup-script=/tmp/gce-startup-script1106954442 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=32 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test overload/tpcc_olap/nodes=3/cpu=8/w=50/c=96 was skipped due to  test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-8 --labels roachprod=true,cluster=teamcity-6897539-1665552014-219-n4cpu8,lifetime=12h0m0s,created=2022-10-12t12_12_58z --metadata-from-file startup-script=/tmp/gce-startup-script2560821481 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-8 --labels roachprod=true,cluster=teamcity-6897539-1665552014-219-n4cpu8,lifetime=12h0m0s,created=2022-10-12t12_12_58z --metadata-from-file startup-script=/tmp/gce-startup-script2560821481 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test rebalance/by-load/replicas was skipped due to  test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-4 --labels roachprod=true,cluster=teamcity-6897539-1665552014-220-n7cpu4,lifetime=12h0m0s,created=2022-10-12t12_13_00z --metadata-from-file startup-script=/tmp/gce-startup-script3722511054 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-4 --labels roachprod=true,cluster=teamcity-6897539-1665552014-220-n7cpu4,lifetime=12h0m0s,created=2022-10-12t12_13_00z --metadata-from-file startup-script=/tmp/gce-startup-script3722511054 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=4 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 2 years ago

roachtest.cluster_creation failed with artifacts on release-22.2.0 @ 58ba620ed525d6e5cf6f509c8a6b9fef75e0f35e:

test rebalance/by-load/replicas/mixed-version was skipped due to    test_runner.go:624,test_runner.go:266,stopper.go:489: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-4 --labels roachprod=true,cluster=teamcity-6897539-1665552014-224-n7cpu4,lifetime=12h0m0s,created=2022-10-12t12_13_35z --metadata-from-file startup-script=/tmp/gce-startup-script3064169965 --project cockroach-ephemeral --boot-disk-size=32GB]: exit status 1
        (1) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm.ForProvider
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/vm.go:374
          | [...repeated from below...]
        Wraps: (2) in provider: gce
        Wraps: (3) attached stack trace
          -- stack trace:
          | github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce.(*Provider).Create.func2
          |     github.com/cockroachdb/cockroach/pkg/roachprod/vm/gce/gcloud.go:538
          | golang.org/x/sync/errgroup.(*Group).Go.func1
          |     golang.org/x/sync/errgroup/external/org_golang_x_sync/errgroup/errgroup.go:74
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1594
        Wraps: (4) Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-4 --labels roachprod=true,cluster=teamcity-6897539-1665552014-224-n7cpu4,lifetime=12h0m0s,created=2022-10-12t12_13_35z --metadata-from-file startup-script=/tmp/gce-startup-script3064169965 --project cockroach-ephemeral --boot-disk-size=32GB]
          | Output: WARNING: Some requests generated warnings:
          |  - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
          |  - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20220927'.
          |
          | ERROR: (gcloud.compute.instances.create) Could not fetch resource:
          |  - The zone 'projects/cockroach-ephemeral/zones/us-east1-b' does not have enough resources available to fulfill the request.  Try a different zone, or try again later.
        Wraps: (5) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *exec.ExitError

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=4 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!