roachtest: cluster_creation failed

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ c8a4703f9853a442ac676b44d074b43eb387f60c:

test cdc/ledger was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-16 --labels usage=roachtest,roachprod=true,cluster=teamcity-9554151-1681277484-43-n4cpu16,lifetime=12h0m0s,created=2023-04-12t09_45_00z, --metadata-from-file startup-script=/tmp/gce-startup-script596628129 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-east1-b teamcity-9554151-1681277484-43-n4cpu16-0001 teamcity-9554151-1681277484-43-n4cpu16-0002 teamcity-9554151-1681277484-43-n4cpu16-0003 teamcity-9554151-1681277484-43-n4cpu16-0004]
Output: WARNING: Some requests generated warnings:
 - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
 - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20230302'.
ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Quota 'CPUS' exceeded.  Limit: 7200.0 in region us-east1.
    metric name = compute.googleapis.com/cpus
    limit name = CPUS-per-project-region
    dimensions = region: us-east1
Try your request in another zone, or view documentation on how to increase quotas: https://cloud.google.com/compute/quotas.: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=16 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

/cc @cockroachdb/dev-inf

This test on roachdash | Improve this report!

Jira issue: CRDB-26894

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ bc953426b8cc479406c3b54b99154eb15fa4107b:

test follower-reads/survival=zone/locality=global/reads=strong was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute disks update --update-labels usage=roachtest,roachprod=true,cluster=teamcity-10044669-1683868822-119-n6cpu4-geo,lifetime=12h0m0s,created=2023-05-12t14_05_58z --project cockroach-ephemeral --zone us-east1-b --zone us-west1-b --zone europe-west2-b teamcity-10044669-1683868822-119-n6cpu4-geo-0002]
Output: ERROR: (gcloud.compute.disks.update) HTTPError 404: The resource 'projects/cockroach-ephemeral/zones/europe-west2-b/disks/teamcity-10044669-1683868822-119-n6cpu4-geo-0002' was not found: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=4 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-23.1.0] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ bc953426b8cc479406c3b54b99154eb15fa4107b:

test follower-reads/survival=zone/locality=regional/reads=bounded-staleness was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute disks update --update-labels usage=roachtest,roachprod=true,cluster=teamcity-10044669-1683868822-120-n6cpu4-geo,lifetime=12h0m0s,created=2023-05-12t14_06_15z --project cockroach-ephemeral --zone us-west1-b --zone europe-west2-b --zone us-east1-b teamcity-10044669-1683868822-120-n6cpu4-geo-0006]
Output: ERROR: (gcloud.compute.disks.update) HTTPError 404: The resource 'projects/cockroach-ephemeral/zones/us-east1-b/disks/teamcity-10044669-1683868822-120-n6cpu4-geo-0006' was not found: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=4 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-23.1.0] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ bc953426b8cc479406c3b54b99154eb15fa4107b:

test follower-reads/survival=zone/locality=regional/reads=bounded-staleness/insufficient-quorum was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute disks update --update-labels usage=roachtest,roachprod=true,cluster=teamcity-10044669-1683868822-122-n6cpu4-geo,lifetime=12h0m0s,created=2023-05-12t14_06_55z --project cockroach-ephemeral --zone us-east1-b --zone us-west1-b --zone europe-west2-b teamcity-10044669-1683868822-122-n6cpu4-geo-0003]
Output: ERROR: (gcloud.compute.disks.update) HTTPError 404: The resource 'projects/cockroach-ephemeral/zones/europe-west2-b/disks/teamcity-10044669-1683868822-122-n6cpu4-geo-0003' was not found: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=4 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-23.1.0] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ bc953426b8cc479406c3b54b99154eb15fa4107b:

test follower-reads/survival=zone/locality=regional/reads=exact-staleness was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute disks update --update-labels usage=roachtest,roachprod=true,cluster=teamcity-10044669-1683868822-125-n6cpu4-geo,lifetime=12h0m0s,created=2023-05-12t14_09_21z --project cockroach-ephemeral --zone europe-west2-b --zone us-east1-b --zone us-west1-b teamcity-10044669-1683868822-125-n6cpu4-geo-0001]
Output: ERROR: (gcloud.compute.disks.update) HTTPError 404: The resource 'projects/cockroach-ephemeral/zones/us-west1-b/disks/teamcity-10044669-1683868822-125-n6cpu4-geo-0001' was not found: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=4 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-23.1.0] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ bc953426b8cc479406c3b54b99154eb15fa4107b:

test import/tpcc/warehouses=4000/geo was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute disks update --update-labels usage=roachtest,roachprod=true,cluster=teamcity-10044669-1683868822-134-n8cpu16-geo,lifetime=12h0m0s,created=2023-05-12t14_58_26z --project cockroach-ephemeral --zone europe-west2-b --zone europe-west4-b --zone asia-northeast1-b --zone us-west1-b teamcity-10044669-1683868822-134-n8cpu16-geo-0004]
Output: ERROR: (gcloud.compute.disks.update) HTTPError 404: The resource 'projects/cockroach-ephemeral/zones/us-west1-b/disks/teamcity-10044669-1683868822-134-n8cpu16-geo-0004' was not found: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=16 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-23.1.0] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ bc953426b8cc479406c3b54b99154eb15fa4107b:

test indexes/2/nodes=6/multi-region was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute disks update --update-labels usage=roachtest,roachprod=true,cluster=teamcity-10044669-1683868822-137-n7cpu16-geo,lifetime=12h0m0s,created=2023-05-12t15_07_41z --project cockroach-ephemeral --zone us-east1-b --zone us-west1-b --zone europe-west2-b teamcity-10044669-1683868822-137-n7cpu16-geo-0002]
Output: ERROR: (gcloud.compute.disks.update) HTTPError 404: The resource 'projects/cockroach-ephemeral/zones/europe-west2-b/disks/teamcity-10044669-1683868822-137-n7cpu16-geo-0002' was not found: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=16 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-23.1.0] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ bc953426b8cc479406c3b54b99154eb15fa4107b:

test ledger/nodes=6/multi-az was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute disks update --update-labels usage=roachtest,roachprod=true,cluster=teamcity-10044669-1683868822-157-n7cpu16-geo,lifetime=12h0m0s,created=2023-05-12t16_30_14z --project cockroach-ephemeral --zone us-central1-f --zone us-central1-b --zone us-central1-c teamcity-10044669-1683868822-157-n7cpu16-geo-0002]
Output: ERROR: (gcloud.compute.disks.update) HTTPError 404: The resource 'projects/cockroach-ephemeral/zones/us-central1-c/disks/teamcity-10044669-1683868822-157-n7cpu16-geo-0002' was not found: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=16 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-23.1.0] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ bc953426b8cc479406c3b54b99154eb15fa4107b:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n1-standard-8 --labels usage=roachtest,roachprod=true,cluster=teamcity-10044669-1683868822-174-n9cpu8-geo,lifetime=12h0m0s,created=2023-05-12t17_00_42z --metadata-from-file startup-script=/tmp/gce-startup-script3050566884 --project cockroach-ephemeral --boot-disk-size=32GB --zone eu-west-1b teamcity-10044669-1683868822-174-n9cpu8-geo-0007 teamcity-10044669-1683868822-174-n9cpu8-geo-0008 teamcity-10044669-1683868822-174-n9cpu8-geo-0009]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/eu-west-1b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-23.1.0] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ bc953426b8cc479406c3b54b99154eb15fa4107b:

test roachmart/partition=false was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute disks update --update-labels usage=roachtest,roachprod=true,cluster=teamcity-10044669-1683868822-181-n9cpu4-geo,lifetime=12h0m0s,created=2023-05-12t17_07_26z --project cockroach-ephemeral --zone us-central1-b --zone us-west1-b --zone europe-west2-b teamcity-10044669-1683868822-181-n9cpu4-geo-0006]
Output: ERROR: (gcloud.compute.disks.update) HTTPError 404: The resource 'projects/cockroach-ephemeral/zones/europe-west2-b/disks/teamcity-10044669-1683868822-181-n9cpu4-geo-0006' was not found: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=4 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-23.1.0] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ bc953426b8cc479406c3b54b99154eb15fa4107b:

test roachmart/partition=true was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute disks update --update-labels usage=roachtest,roachprod=true,cluster=teamcity-10044669-1683868822-182-n9cpu4-geo,lifetime=12h0m0s,created=2023-05-12t17_07_32z --project cockroach-ephemeral --zone us-central1-b --zone us-west1-b --zone europe-west2-b teamcity-10044669-1683868822-182-n9cpu4-geo-0004]
Output: ERROR: (gcloud.compute.disks.update) HTTPError 404: The resource 'projects/cockroach-ephemeral/zones/europe-west2-b/disks/teamcity-10044669-1683868822-182-n9cpu4-geo-0004' was not found: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=4 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-23.1.0] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ bc953426b8cc479406c3b54b99154eb15fa4107b:

test schemachange/random-load was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute disks update --update-labels usage=roachtest,created=2023-05-12t17_08_42z,roachprod=true,cluster=teamcity-10044669-1683868822-183-n3cpu4-geo,lifetime=12h0m0s --project cockroach-ephemeral --zone us-east1-b --zone us-west1-b --zone europe-west2-b teamcity-10044669-1683868822-183-n3cpu4-geo-0001]
Output: ERROR: (gcloud.compute.disks.update) HTTPError 404: The resource 'projects/cockroach-ephemeral/zones/europe-west2-b/disks/teamcity-10044669-1683868822-183-n3cpu4-geo-0001' was not found: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=4 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-23.1.0] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ bc953426b8cc479406c3b54b99154eb15fa4107b:

test sqlsmith/setup=seed-multi-region/setting=multi-region was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute disks update --update-labels usage=roachtest,roachprod=true,cluster=teamcity-10044669-1683868822-188-n4cpu4-geo,lifetime=12h0m0s,created=2023-05-12t17_16_20z --project cockroach-ephemeral --zone us-east1-b --zone us-west1-b --zone europe-west2-b --zone us-east1-c teamcity-10044669-1683868822-188-n4cpu4-geo-0003]
Output: ERROR: (gcloud.compute.disks.update) HTTPError 404: The resource 'projects/cockroach-ephemeral/zones/us-east1-c/disks/teamcity-10044669-1683868822-188-n4cpu4-geo-0003' was not found: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=4 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-23.1.0] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ bc953426b8cc479406c3b54b99154eb15fa4107b:

test tpcc/multiregion/survive=region/chaos=true was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute disks update --update-labels usage=roachtest,roachprod=true,cluster=teamcity-10044669-1683868822-200-n10cpu4-geo,lifetime=12h0m0s,created=2023-05-12t17_24_45z --project cockroach-ephemeral --zone us-west1-b --zone europe-west2-b --zone us-east1-b teamcity-10044669-1683868822-200-n10cpu4-geo-0006]
Output: ERROR: (gcloud.compute.disks.update) HTTPError 404: The resource 'projects/cockroach-ephemeral/zones/us-east1-b/disks/teamcity-10044669-1683868822-200-n10cpu4-geo-0006' was not found: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=4 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-23.1.0] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ bc953426b8cc479406c3b54b99154eb15fa4107b:

test tpcc/multiregion/survive=zone/chaos=true was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute disks update --update-labels usage=roachtest,lifetime=12h0m0s,created=2023-05-12t17_25_23z,roachprod=true,cluster=teamcity-10044669-1683868822-201-n10cpu4-geo --project cockroach-ephemeral --zone us-east1-b --zone us-west1-b --zone europe-west2-b teamcity-10044669-1683868822-201-n10cpu4-geo-0010]
Output: ERROR: (gcloud.compute.disks.update) HTTPError 404: The resource 'projects/cockroach-ephemeral/zones/europe-west2-b/disks/teamcity-10044669-1683868822-201-n10cpu4-geo-0010' was not found: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=4 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-23.1.0] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ bc953426b8cc479406c3b54b99154eb15fa4107b:

test tpccbench/nodes=9/cpu=4/multi-region was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute disks update --update-labels usage=roachtest,roachprod=true,cluster=teamcity-10044669-1683868822-202-n12cpu4hm-geo,lifetime=12h0m0s,created=2023-05-12t17_26_37z --project cockroach-ephemeral --zone europe-west2-b --zone us-east1-b --zone us-west1-b teamcity-10044669-1683868822-202-n12cpu4hm-geo-0001]
Output: ERROR: (gcloud.compute.disks.update) HTTPError 404: The resource 'projects/cockroach-ephemeral/zones/us-west1-b/disks/teamcity-10044669-1683868822-202-n12cpu4hm-geo-0001' was not found: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=4 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-23.1.0] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ bc953426b8cc479406c3b54b99154eb15fa4107b:

test unoptimized-query-oracle/disable-rules=all/seed-multi-region was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute disks update --update-labels usage=roachtest,roachprod=true,cluster=teamcity-10044669-1683868822-203-n9cpu4-geo,lifetime=12h0m0s,created=2023-05-12t17_26_46z --project cockroach-ephemeral --zone us-west1-c --zone us-east1-d --zone us-west1-a --zone europe-west2-b --zone us-west1-b --zone us-east1-c --zone europe-west2-c --zone europe-west2-a --zone us-east1-b teamcity-10044669-1683868822-203-n9cpu4-geo-0009]
Output: ERROR: (gcloud.compute.disks.update) HTTPError 404: The resource 'projects/cockroach-ephemeral/zones/us-east1-b/disks/teamcity-10044669-1683868822-203-n9cpu4-geo-0009' was not found: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=4 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-23.1.0] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ bc953426b8cc479406c3b54b99154eb15fa4107b:

test unoptimized-query-oracle/disable-rules=half/seed-multi-region was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute disks update --update-labels usage=roachtest,created=2023-05-12t17_33_50z,roachprod=true,cluster=teamcity-10044669-1683868822-209-n9cpu4-geo,lifetime=12h0m0s --project cockroach-ephemeral --zone us-east1-d --zone us-west1-a --zone europe-west2-c --zone europe-west2-a --zone us-east1-b --zone us-west1-b --zone europe-west2-b --zone us-east1-c --zone us-west1-c teamcity-10044669-1683868822-209-n9cpu4-geo-0004]
Output: ERROR: (gcloud.compute.disks.update) HTTPError 404: The resource 'projects/cockroach-ephemeral/zones/us-west1-c/disks/teamcity-10044669-1683868822-209-n9cpu4-geo-0004' was not found: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=4 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-23.1.0] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ bc953426b8cc479406c3b54b99154eb15fa4107b:

test tpccbench/nodes=6/cpu=16/multi-az was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute disks update --update-labels usage=roachtest,roachprod=true,cluster=teamcity-10044669-1683868822-210-n7cpu16-geo,lifetime=12h0m0s,created=2023-05-12t17_35_38z --project cockroach-ephemeral --zone us-central1-f --zone us-central1-b --zone us-central1-c teamcity-10044669-1683868822-210-n7cpu16-geo-0004]
Output: ERROR: (gcloud.compute.disks.update) HTTPError 404: The resource 'projects/cockroach-ephemeral/zones/us-central1-c/disks/teamcity-10044669-1683868822-210-n7cpu16-geo-0004' was not found: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=16 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-23.1.0] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ b4533bdbc4b478f0ad311bad80b62bd072cf61cf:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n1-standard-8 --labels usage=roachtest,roachprod=true,cluster=teamcity-10061488-1683955261-123-n9cpu8-geo,lifetime=12h0m0s,created=2023-05-13t17_14_16z --metadata-from-file startup-script=/tmp/gce-startup-script3951249579 --project cockroach-ephemeral --boot-disk-size=32GB --zone eu-west-1b teamcity-10061488-1683955261-123-n9cpu8-geo-0007 teamcity-10061488-1683955261-123-n9cpu8-geo-0008 teamcity-10061488-1683955261-123-n9cpu8-geo-0009]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/eu-west-1b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-23.1.0] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ b4533bdbc4b478f0ad311bad80b62bd072cf61cf:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n1-standard-8 --labels usage=roachtest,roachprod=true,cluster=teamcity-10072014-1684041679-122-n9cpu8-geo,lifetime=12h0m0s,created=2023-05-14t17_15_43z --metadata-from-file startup-script=/tmp/gce-startup-script1809676629 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-east-2b teamcity-10072014-1684041679-122-n9cpu8-geo-0001 teamcity-10072014-1684041679-122-n9cpu8-geo-0002 teamcity-10072014-1684041679-122-n9cpu8-geo-0003]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/us-east-2b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-23.1.0] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ 27ea509a79d5cdbcf21c53649146d893139e631a:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n1-standard-8 --labels usage=roachtest,roachprod=true,cluster=teamcity-10083601-1684128006-141-n9cpu8-geo,lifetime=12h0m0s,created=2023-05-15t17_55_31z --metadata-from-file startup-script=/tmp/gce-startup-script323130336 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-east-2b teamcity-10083601-1684128006-141-n9cpu8-geo-0001 teamcity-10083601-1684128006-141-n9cpu8-geo-0002 teamcity-10083601-1684128006-141-n9cpu8-geo-0003]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/us-east-2b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-23.1.0] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ b1bab792290cbbd1bba9be644d40b5674a3c056a:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n1-standard-8 --labels usage=roachtest,cluster=teamcity-10104157-1684214403-141-n9cpu8-geo,lifetime=12h0m0s,created=2023-05-16t18_01_19z,roachprod=true --metadata-from-file startup-script=/tmp/gce-startup-script1557302085 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-east-2b teamcity-10104157-1684214403-141-n9cpu8-geo-0001 teamcity-10104157-1684214403-141-n9cpu8-geo-0002 teamcity-10104157-1684214403-141-n9cpu8-geo-0003]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/us-east-2b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot todo-deprecate.branch-release-23.1.0] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng todo-deprecate.branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ 4c24848334fa068ae0eef950c687b42497bb7bd0:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n1-standard-8 --labels usage=roachtest,roachprod=true,cluster=teamcity-10122168-1684300932-133-n9cpu8-geo,lifetime=12h0m0s,created=2023-05-17t17_54_06z --metadata-from-file startup-script=/tmp/gce-startup-script295006601 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-east-2b teamcity-10122168-1684300932-133-n9cpu8-geo-0001 teamcity-10122168-1684300932-133-n9cpu8-geo-0002 teamcity-10122168-1684300932-133-n9cpu8-geo-0003]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/us-east-2b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot todo-deprecate.branch-release-23.1.0] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng todo-deprecate.branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ 4d53217fb2d27559257d46261badb3be91428d1a:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n1-standard-8 --labels usage=roachtest,lifetime=12h0m0s,created=2023-05-18t17_52_12z,roachprod=true,cluster=teamcity-10137691-1684387251-145-n9cpu8-geo --metadata-from-file startup-script=/tmp/gce-startup-script2933451545 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-west-2b teamcity-10137691-1684387251-145-n9cpu8-geo-0004 teamcity-10137691-1684387251-145-n9cpu8-geo-0005 teamcity-10137691-1684387251-145-n9cpu8-geo-0006]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/us-west-2b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot todo-deprecate.branch-release-23.1.0] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng todo-deprecate.branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ f1357fd07e0bc9df29154067ffd4b003d78bb32c:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n1-standard-8 --labels usage=roachtest,cluster=teamcity-10155252-1684473627-143-n9cpu8-geo,lifetime=12h0m0s,created=2023-05-19t17_50_33z,roachprod=true --metadata-from-file startup-script=/tmp/gce-startup-script3205549446 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-east-2b teamcity-10155252-1684473627-143-n9cpu8-geo-0001 teamcity-10155252-1684473627-143-n9cpu8-geo-0002 teamcity-10155252-1684473627-143-n9cpu8-geo-0003]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/us-east-2b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot todo-deprecate.branch-release-23.1.0] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng todo-deprecate.branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ a3377f18a45c461780fe46473041260baa0293ac:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n1-standard-8 --labels usage=roachtest,roachprod=true,cluster=teamcity-10169381-1684560083-146-n9cpu8-geo,lifetime=12h0m0s,created=2023-05-20t18_00_14z --metadata-from-file startup-script=/tmp/gce-startup-script4234885819 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-east-2b teamcity-10169381-1684560083-146-n9cpu8-geo-0001 teamcity-10169381-1684560083-146-n9cpu8-geo-0002 teamcity-10169381-1684560083-146-n9cpu8-geo-0003]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/us-east-2b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot todo-deprecate.branch-release-23.1.0] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng todo-deprecate.branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ 1443aa2b0a4b906ba2b252da53e04097ed75051a:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n1-standard-8 --labels usage=roachtest,roachprod=true,cluster=teamcity-10177850-1684646374-152-n9cpu8-geo,lifetime=12h0m0s,created=2023-05-21t18_20_06z --metadata-from-file startup-script=/tmp/gce-startup-script2776507438 --project cockroach-ephemeral --boot-disk-size=32GB --zone eu-west-1b teamcity-10177850-1684646374-152-n9cpu8-geo-0007 teamcity-10177850-1684646374-152-n9cpu8-geo-0008 teamcity-10177850-1684646374-152-n9cpu8-geo-0009]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/eu-west-1b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot todo-deprecate.branch-release-23.1.0] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng todo-deprecate.branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ 1443aa2b0a4b906ba2b252da53e04097ed75051a:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n1-standard-8 --labels usage=roachtest,roachprod=true,cluster=teamcity-10186226-1684732828-146-n9cpu8-geo,lifetime=12h0m0s,created=2023-05-22t17_42_29z --metadata-from-file startup-script=/tmp/gce-startup-script1684466198 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-west-2b teamcity-10186226-1684732828-146-n9cpu8-geo-0004 teamcity-10186226-1684732828-146-n9cpu8-geo-0005 teamcity-10186226-1684732828-146-n9cpu8-geo-0006]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/us-west-2b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot todo-deprecate.branch-release-23.1.0] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng todo-deprecate.branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ 38af000823855ea428bc9b3618cbe74012aeccdc:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n1-standard-8 --labels usage=roachtest,roachprod=true,cluster=teamcity-10200590-1684819168-153-n9cpu8-geo,lifetime=12h0m0s,created=2023-05-23t18_14_02z --metadata-from-file startup-script=/tmp/gce-startup-script2028390191 --project cockroach-ephemeral --boot-disk-size=32GB --zone eu-west-1b teamcity-10200590-1684819168-153-n9cpu8-geo-0007 teamcity-10200590-1684819168-153-n9cpu8-geo-0008 teamcity-10200590-1684819168-153-n9cpu8-geo-0009]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/eu-west-1b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot todo-deprecate.branch-release-23.1.0] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng todo-deprecate.branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ 06fb842da778bc651357789b0bcfcbd1acac3bee:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n1-standard-8 --labels usage=roachtest,roachprod=true,cluster=teamcity-10217771-1684905571-142-n9cpu8-geo,lifetime=12h0m0s,created=2023-05-24t18_07_58z --metadata-from-file startup-script=/tmp/gce-startup-script1493039976 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-east-2b teamcity-10217771-1684905571-142-n9cpu8-geo-0001 teamcity-10217771-1684905571-142-n9cpu8-geo-0002 teamcity-10217771-1684905571-142-n9cpu8-geo-0003]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/us-east-2b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot todo-deprecate.branch-release-23.1.0] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng todo-deprecate.branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ 14228d57c683954fa950f20217e41cbed16008ad:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n1-standard-8 --labels usage=roachtest,cluster=teamcity-10236475-1684992006-142-n9cpu8-geo,lifetime=12h0m0s,created=2023-05-25t18_06_33z,roachprod=true --metadata-from-file startup-script=/tmp/gce-startup-script104294044 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-east-2b teamcity-10236475-1684992006-142-n9cpu8-geo-0001 teamcity-10236475-1684992006-142-n9cpu8-geo-0002 teamcity-10236475-1684992006-142-n9cpu8-geo-0003]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/us-east-2b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot todo-deprecate.branch-release-23.1.0] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng todo-deprecate.branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ ac03080b01fd57dcaf6a3eeaa6686751a6094fa2:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n1-standard-8 --labels usage=roachtest,cluster=teamcity-10253392-1685078486-156-n9cpu8-geo,lifetime=12h0m0s,created=2023-05-26t18_44_07z,roachprod=true --metadata-from-file startup-script=/tmp/gce-startup-script1790812875 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-west-2b teamcity-10253392-1685078486-156-n9cpu8-geo-0004 teamcity-10253392-1685078486-156-n9cpu8-geo-0005 teamcity-10253392-1685078486-156-n9cpu8-geo-0006]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/us-west-2b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot todo-deprecate.branch-release-23.1.0] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng todo-deprecate.branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ afe0240f6266af0b21fb521bd6120858ae99f442:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n1-standard-8 --labels usage=roachtest,roachprod=true,cluster=teamcity-10271844-1685164838-150-n9cpu8-geo,lifetime=12h0m0s,created=2023-05-27t18_34_02z --metadata-from-file startup-script=/tmp/gce-startup-script1561496722 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-east-2b teamcity-10271844-1685164838-150-n9cpu8-geo-0001 teamcity-10271844-1685164838-150-n9cpu8-geo-0002 teamcity-10271844-1685164838-150-n9cpu8-geo-0003]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/us-east-2b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot todo-deprecate.branch-release-23.1.0] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng todo-deprecate.branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ 76b4c6ece0e687aefbf45da57a526f7d3b1a7f8a:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n1-standard-8 --labels usage=roachtest,roachprod=true,cluster=teamcity-10281183-1685251295-140-n9cpu8-geo,lifetime=12h0m0s,created=2023-05-28t18_21_20z --metadata-from-file startup-script=/tmp/gce-startup-script1962170454 --project cockroach-ephemeral --boot-disk-size=32GB --zone eu-west-1b teamcity-10281183-1685251295-140-n9cpu8-geo-0007 teamcity-10281183-1685251295-140-n9cpu8-geo-0008 teamcity-10281183-1685251295-140-n9cpu8-geo-0009]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/eu-west-1b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot todo-deprecate.branch-release-23.1.0] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng todo-deprecate.branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ 76b4c6ece0e687aefbf45da57a526f7d3b1a7f8a:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n1-standard-8 --labels usage=roachtest,lifetime=12h0m0s,created=2023-05-29t18_37_51z,roachprod=true,cluster=teamcity-10289806-1685337532-154-n9cpu8-geo --metadata-from-file startup-script=/tmp/gce-startup-script42213854 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-west-2b teamcity-10289806-1685337532-154-n9cpu8-geo-0004 teamcity-10289806-1685337532-154-n9cpu8-geo-0005 teamcity-10289806-1685337532-154-n9cpu8-geo-0006]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/us-west-2b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot todo-deprecate.branch-release-23.1.0] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng todo-deprecate.branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ f462a0e04526d90b004b6865938587a1bec28c21:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n1-standard-8 --labels usage=roachtest,roachprod=true,cluster=teamcity-10301365-1685424036-140-n9cpu8-geo,lifetime=12h0m0s,created=2023-05-30t18_21_08z --metadata-from-file startup-script=/tmp/gce-startup-script766660827 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-east-2b teamcity-10301365-1685424036-140-n9cpu8-geo-0001 teamcity-10301365-1685424036-140-n9cpu8-geo-0002 teamcity-10301365-1685424036-140-n9cpu8-geo-0003]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/us-east-2b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot todo-deprecate.branch-release-23.1.0] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng todo-deprecate.branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ b3d54e3ddf996e4ec751da45898ebf9de0378a16:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n1-standard-8 --labels usage=roachtest,roachprod=true,cluster=teamcity-10321152-1685510366-142-n9cpu8-geo,lifetime=12h0m0s,created=2023-05-31t18_35_17z --metadata-from-file startup-script=/tmp/gce-startup-script2528053035 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-east-2b teamcity-10321152-1685510366-142-n9cpu8-geo-0001 teamcity-10321152-1685510366-142-n9cpu8-geo-0002 teamcity-10321152-1685510366-142-n9cpu8-geo-0003]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/us-east-2b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot todo-deprecate.branch-release-23.1.0] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng todo-deprecate.branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ 9a32b64ebd8aeb68364bb3d85a2fa9220b87032f:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n1-standard-8 --labels usage=roachtest,lifetime=12h0m0s,created=2023-06-01t18_31_13z,roachprod=true,cluster=teamcity-10338267-1685596921-152-n9cpu8-geo --metadata-from-file startup-script=/tmp/gce-startup-script2694558 --project cockroach-ephemeral --boot-disk-size=32GB --zone eu-west-1b teamcity-10338267-1685596921-152-n9cpu8-geo-0007 teamcity-10338267-1685596921-152-n9cpu8-geo-0008 teamcity-10338267-1685596921-152-n9cpu8-geo-0009]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/eu-west-1b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot todo-deprecate.branch-release-23.1.0] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng todo-deprecate.branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ e84e2cabef32a59d88041132f059a6768dfe56bb:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n1-standard-8 --labels usage=roachtest,roachprod=true,cluster=teamcity-10356442-1685683217-149-n9cpu8-geo,lifetime=12h0m0s,created=2023-06-02t18_59_34z --metadata-from-file startup-script=/tmp/gce-startup-script2925972811 --project cockroach-ephemeral --boot-disk-size=32GB --zone eu-west-1b teamcity-10356442-1685683217-149-n9cpu8-geo-0007 teamcity-10356442-1685683217-149-n9cpu8-geo-0008 teamcity-10356442-1685683217-149-n9cpu8-geo-0009]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/eu-west-1b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot todo-deprecate.branch-release-23.1.0] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng todo-deprecate.branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ 870f9f667dd34bd0c926d38c08193db2672d78ff:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n1-standard-8 --labels usage=roachtest,lifetime=12h0m0s,created=2023-06-03t18_25_03z,roachprod=true,cluster=teamcity-10372244-1685769568-143-n9cpu8-geo --metadata-from-file startup-script=/tmp/gce-startup-script1438339345 --project cockroach-ephemeral --boot-disk-size=32GB --zone eu-west-1b teamcity-10372244-1685769568-143-n9cpu8-geo-0007 teamcity-10372244-1685769568-143-n9cpu8-geo-0008 teamcity-10372244-1685769568-143-n9cpu8-geo-0009]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/eu-west-1b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot todo-deprecate.branch-release-23.1.0] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng todo-deprecate.branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ 870f9f667dd34bd0c926d38c08193db2672d78ff:

test disk-stalled/cgroup/write-only/logs-too=true was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=500GB,auto-delete=yes --machine-type n1-standard-4 --labels usage=roachtest,roachprod=true,cluster=teamcity-10381239-1685855981-61-n4cpu4,lifetime=12h0m0s,created=2023-06-04t13_31_00z --metadata-from-file startup-script=/tmp/gce-startup-script259735266 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-east1-b teamcity-10381239-1685855981-61-n4cpu4-0001 teamcity-10381239-1685855981-61-n4cpu4-0002 teamcity-10381239-1685855981-61-n4cpu4-0003 teamcity-10381239-1685855981-61-n4cpu4-0004]
Output: WARNING: Some requests generated warnings:
 - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
 - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20230531'.
ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Internal error. Please try again or contact Google Support. (Code: '2125818976454638177'): exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=4 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot todo-deprecate.branch-release-23.1.0] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng todo-deprecate.branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ 870f9f667dd34bd0c926d38c08193db2672d78ff:

test disk-stalled/dmsetup was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=500GB,auto-delete=yes --machine-type n1-standard-4 --labels usage=roachtest,roachprod=true,cluster=teamcity-10381239-1685855981-64-n4cpu4,lifetime=12h0m0s,created=2023-06-04t13_41_42z --metadata-from-file startup-script=/tmp/gce-startup-script750699703 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-east1-b teamcity-10381239-1685855981-64-n4cpu4-0001 teamcity-10381239-1685855981-64-n4cpu4-0002 teamcity-10381239-1685855981-64-n4cpu4-0003 teamcity-10381239-1685855981-64-n4cpu4-0004]
Output: WARNING: Some requests generated warnings:
 - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
 - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20230531'.
ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Internal error. Please try again or contact Google Support. (Code: '888027318266758096'): exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=4 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot todo-deprecate.branch-release-23.1.0] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng todo-deprecate.branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ 870f9f667dd34bd0c926d38c08193db2672d78ff:

test failover/liveness/disk-stall was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=500GB,auto-delete=yes --machine-type n1-standard-4 --labels usage=roachtest,lifetime=12h0m0s,created=2023-06-04t14_11_01z,roachprod=true,cluster=teamcity-10381239-1685855981-69-n5cpu4 --metadata-from-file startup-script=/tmp/gce-startup-script2832545767 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-east1-b teamcity-10381239-1685855981-69-n5cpu4-0001 teamcity-10381239-1685855981-69-n5cpu4-0002 teamcity-10381239-1685855981-69-n5cpu4-0003 teamcity-10381239-1685855981-69-n5cpu4-0004 teamcity-10381239-1685855981-69-n5cpu4-0005]
Output: WARNING: Some requests generated warnings:
 - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
 - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20230531'.
ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Internal error. Please try again or contact Google Support. (Code: '5793701215335451703'): exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=4 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot todo-deprecate.branch-release-23.1.0] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng todo-deprecate.branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ 870f9f667dd34bd0c926d38c08193db2672d78ff:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n1-standard-8 --labels usage=roachtest,roachprod=true,cluster=teamcity-10381239-1685855981-145-n9cpu8-geo,lifetime=12h0m0s,created=2023-06-04t18_38_19z --metadata-from-file startup-script=/tmp/gce-startup-script1238272737 --project cockroach-ephemeral --boot-disk-size=32GB --zone eu-west-1b teamcity-10381239-1685855981-145-n9cpu8-geo-0007 teamcity-10381239-1685855981-145-n9cpu8-geo-0008 teamcity-10381239-1685855981-145-n9cpu8-geo-0009]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/eu-west-1b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot todo-deprecate.branch-release-23.1.0] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng todo-deprecate.branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ ab03bdfe5b635c37bad80e01e1fdc37023844b15:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n1-standard-8 --labels usage=roachtest,roachprod=true,cluster=teamcity-10390384-1685942401-135-n9cpu8-geo,lifetime=12h0m0s,created=2023-06-05t18_09_03z --metadata-from-file startup-script=/tmp/gce-startup-script1074297563 --project cockroach-ephemeral --boot-disk-size=32GB --zone eu-west-1b teamcity-10390384-1685942401-135-n9cpu8-geo-0007 teamcity-10390384-1685942401-135-n9cpu8-geo-0008 teamcity-10390384-1685942401-135-n9cpu8-geo-0009]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/eu-west-1b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot todo-deprecate.branch-release-23.1.0] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng todo-deprecate.branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ a84cfb9d8fb0f3da6b0b9c4197caa4e79e2ca968:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n1-standard-8 --labels usage=roachtest,roachprod=true,cluster=teamcity-10409549-1686028886-133-n9cpu8-geo,lifetime=12h0m0s,created=2023-06-06t17_30_15z --metadata-from-file startup-script=/tmp/gce-startup-script780302752 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-east-2b teamcity-10409549-1686028886-133-n9cpu8-geo-0001 teamcity-10409549-1686028886-133-n9cpu8-geo-0002 teamcity-10409549-1686028886-133-n9cpu8-geo-0003]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/us-east-2b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot todo-deprecate.branch-release-23.1.0] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng todo-deprecate.branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ 1a5dc2aad16ca4185afcda75d923804324dcfeb9:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:679).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n1-standard-8 --labels usage=roachtest,lifetime=12h0m0s,created=2023-06-07t17_57_09z,roachprod=true,cluster=teamcity-10428557-1686115298-146-n9cpu8-geo --metadata-from-file startup-script=/tmp/gce-startup-script1834321080 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-west-2b teamcity-10428557-1686115298-146-n9cpu8-geo-0004 teamcity-10428557-1686115298-146-n9cpu8-geo-0005 teamcity-10428557-1686115298-146-n9cpu8-geo-0006]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/us-west-2b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot todo-deprecate.branch-release-23.1.0] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng todo-deprecate.branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ dcffb6a0a3f8ed7ab55b80d5a65d56be7a574f55:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:679).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n1-standard-8 --labels usage=roachtest,lifetime=12h0m0s,created=2023-06-08t17_56_07z,roachprod=true,cluster=teamcity-10446957-1686201635-136-n9cpu8-geo --metadata-from-file startup-script=/tmp/gce-startup-script3640147000 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-west-2b teamcity-10446957-1686201635-136-n9cpu8-geo-0004 teamcity-10446957-1686201635-136-n9cpu8-geo-0005 teamcity-10446957-1686201635-136-n9cpu8-geo-0006]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/us-west-2b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot todo-deprecate.branch-release-23.1.0] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng todo-deprecate.branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ 8cfaf3b4731273cedaa9e81600a7b1778700b702:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:679).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n1-standard-8 --labels usage=roachtest,lifetime=12h0m0s,created=2023-06-10t17_50_11z,roachprod=true,cluster=teamcity-10477911-1686374438-141-n9cpu8-geo --metadata-from-file startup-script=/tmp/gce-startup-script2349502865 --project cockroach-ephemeral --boot-disk-size=32GB --zone eu-west-1b teamcity-10477911-1686374438-141-n9cpu8-geo-0007 teamcity-10477911-1686374438-141-n9cpu8-geo-0008 teamcity-10477911-1686374438-141-n9cpu8-geo-0009]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/eu-west-1b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot todo-deprecate.branch-release-23.1.0] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng todo-deprecate.branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ 8cfaf3b4731273cedaa9e81600a7b1778700b702:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:679).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n1-standard-8 --labels usage=roachtest,roachprod=true,cluster=teamcity-10484333-1686460920-129-n9cpu8-geo,lifetime=12h0m0s,created=2023-06-11t17_37_11z --metadata-from-file startup-script=/tmp/gce-startup-script3533449296 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-west-2b teamcity-10484333-1686460920-129-n9cpu8-geo-0004 teamcity-10484333-1686460920-129-n9cpu8-geo-0005 teamcity-10484333-1686460920-129-n9cpu8-geo-0006]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/us-west-2b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot todo-deprecate.branch-release-23.1.0] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng todo-deprecate.branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroachdb / cockroach

roachtest: cluster_creation failed #101289