roachtest: cluster_creation failed

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ c8a4703f9853a442ac676b44d074b43eb387f60c:

test cdc/ledger was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-16 --labels usage=roachtest,roachprod=true,cluster=teamcity-9554151-1681277484-43-n4cpu16,lifetime=12h0m0s,created=2023-04-12t09_45_00z, --metadata-from-file startup-script=/tmp/gce-startup-script596628129 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-east1-b teamcity-9554151-1681277484-43-n4cpu16-0001 teamcity-9554151-1681277484-43-n4cpu16-0002 teamcity-9554151-1681277484-43-n4cpu16-0003 teamcity-9554151-1681277484-43-n4cpu16-0004]
Output: WARNING: Some requests generated warnings:
 - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
 - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20230302'.
ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Quota 'CPUS' exceeded.  Limit: 7200.0 in region us-east1.
    metric name = compute.googleapis.com/cpus
    limit name = CPUS-per-project-region
    dimensions = region: us-east1
Try your request in another zone, or view documentation on how to increase quotas: https://cloud.google.com/compute/quotas.: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=16 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

/cc @cockroachdb/dev-inf

This test on roachdash | Improve this report!

Jira issue: CRDB-26894

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ c8a4703f9853a442ac676b44d074b43eb387f60c:

test c2c/tpcc/warehouses=500/duration=10/cutover=5 was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-pro-fips-2004-focal-v20230302 --image-project ubuntu-os-pro-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n1-standard-8 --labels usage=roachtest,roachprod=true,cluster=teamcity-9554162-1681277516-40-n9cpu8,lifetime=12h0m0s,created=2023-04-12t09_45_35z, --metadata-from-file startup-script=/tmp/gce-startup-script1802429020 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-east1-b teamcity-9554162-1681277516-40-n9cpu8-0001 teamcity-9554162-1681277516-40-n9cpu8-0002 teamcity-9554162-1681277516-40-n9cpu8-0003 teamcity-9554162-1681277516-40-n9cpu8-0004 teamcity-9554162-1681277516-40-n9cpu8-0005 teamcity-9554162-1681277516-40-n9cpu8-0006 teamcity-9554162-1681277516-40-n9cpu8-0007 teamcity-9554162-1681277516-40-n9cpu8-0008 teamcity-9554162-1681277516-40-n9cpu8-0009]
Output: Created [https://www.googleapis.com/compute/v1/projects/cockroach-ephemeral/zones/us-east1-b/instances/teamcity-9554162-1681277516-40-n9cpu8-0001].
Created [https://www.googleapis.com/compute/v1/projects/cockroach-ephemeral/zones/us-east1-b/instances/teamcity-9554162-1681277516-40-n9cpu8-0002].
Created [https://www.googleapis.com/compute/v1/projects/cockroach-ephemeral/zones/us-east1-b/instances/teamcity-9554162-1681277516-40-n9cpu8-0003].
Created [https://www.googleapis.com/compute/v1/projects/cockroach-ephemeral/zones/us-east1-b/instances/teamcity-9554162-1681277516-40-n9cpu8-0004].
Created [https://www.googleapis.com/compute/v1/projects/cockroach-ephemeral/zones/us-east1-b/instances/teamcity-9554162-1681277516-40-n9cpu8-0005].
Created [https://www.googleapis.com/compute/v1/projects/cockroach-ephemeral/zones/us-east1-b/instances/teamcity-9554162-1681277516-40-n9cpu8-0006].
Created [https://www.googleapis.com/compute/v1/projects/cockroach-ephemeral/zones/us-east1-b/instances/teamcity-9554162-1681277516-40-n9cpu8-0007].
Created [https://www.googleapis.com/compute/v1/projects/cockroach-ephemeral/zones/us-east1-b/instances/teamcity-9554162-1681277516-40-n9cpu8-0009].
WARNING: Some requests generated warnings:
 - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Quota 'CPUS' exceeded.  Limit: 7200.0 in region us-east1.
    metric name = compute.googleapis.com/cpus
    limit name = CPUS-per-project-region
    dimensions = region: us-east1
Try your request in another zone, or view documentation on how to increase quotas: https://cloud.google.com/compute/quotas.: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-23.1.0 release-blocker] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ c8a4703f9853a442ac676b44d074b43eb387f60c:

test cdc/crdb-chaos was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-pro-fips-2004-focal-v20230302 --image-project ubuntu-os-pro-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-16 --labels usage=roachtest,roachprod=true,cluster=teamcity-9554162-1681277516-46-n4cpu16,lifetime=12h0m0s,created=2023-04-12t09_52_18z, --metadata-from-file startup-script=/tmp/gce-startup-script830702183 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-east1-b teamcity-9554162-1681277516-46-n4cpu16-0001 teamcity-9554162-1681277516-46-n4cpu16-0002 teamcity-9554162-1681277516-46-n4cpu16-0003 teamcity-9554162-1681277516-46-n4cpu16-0004]
Output: Created [https://www.googleapis.com/compute/v1/projects/cockroach-ephemeral/zones/us-east1-b/instances/teamcity-9554162-1681277516-46-n4cpu16-0001].
Created [https://www.googleapis.com/compute/v1/projects/cockroach-ephemeral/zones/us-east1-b/instances/teamcity-9554162-1681277516-46-n4cpu16-0003].
WARNING: Some requests generated warnings:
 - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Quota 'CPUS' exceeded.  Limit: 7200.0 in region us-east1.
    metric name = compute.googleapis.com/cpus
    limit name = CPUS-per-project-region
    dimensions = region: us-east1
Try your request in another zone, or view documentation on how to increase quotas: https://cloud.google.com/compute/quotas.: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=16 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-23.1.0 release-blocker] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ c8a4703f9853a442ac676b44d074b43eb387f60c:

test cdc/tpcc-1000 was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-pro-fips-2004-focal-v20230302 --image-project ubuntu-os-pro-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-16 --labels usage=roachtest,lifetime=12h0m0s,created=2023-04-12t10_20_06z,roachprod=true,cluster=teamcity-9554162-1681277516-53-n4cpu16, --metadata-from-file startup-script=/tmp/gce-startup-script1105716752 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-east1-b teamcity-9554162-1681277516-53-n4cpu16-0001 teamcity-9554162-1681277516-53-n4cpu16-0002 teamcity-9554162-1681277516-53-n4cpu16-0003 teamcity-9554162-1681277516-53-n4cpu16-0004]
Output: WARNING: Some requests generated warnings:
 - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Quota 'CPUS' exceeded.  Limit: 7200.0 in region us-east1.
    metric name = compute.googleapis.com/cpus
    limit name = CPUS-per-project-region
    dimensions = region: us-east1
Try your request in another zone, or view documentation on how to increase quotas: https://cloud.google.com/compute/quotas.: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=16 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-23.1.0 release-blocker] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ c8a4703f9853a442ac676b44d074b43eb387f60c:

test clearrange/checks=false/rangeTs=true was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-16 --labels usage=roachtest,created=2023-04-12t10_19_04z,roachprod=true,cluster=teamcity-9554151-1681277484-49-n10cpu16,lifetime=12h0m0s, --metadata-from-file startup-script=/tmp/gce-startup-script2367122512 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-east1-b teamcity-9554151-1681277484-49-n10cpu16-0001 teamcity-9554151-1681277484-49-n10cpu16-0002 teamcity-9554151-1681277484-49-n10cpu16-0003 teamcity-9554151-1681277484-49-n10cpu16-0004 teamcity-9554151-1681277484-49-n10cpu16-0005 teamcity-9554151-1681277484-49-n10cpu16-0006 teamcity-9554151-1681277484-49-n10cpu16-0007 teamcity-9554151-1681277484-49-n10cpu16-0008 teamcity-9554151-1681277484-49-n10cpu16-0009 teamcity-9554151-1681277484-49-n10cpu16-0010]
Output: Created [https://www.googleapis.com/compute/v1/projects/cockroach-ephemeral/zones/us-east1-b/instances/teamcity-9554151-1681277484-49-n10cpu16-0001].
WARNING: Some requests generated warnings:
 - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
 - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20230302'.
ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Quota 'CPUS' exceeded.  Limit: 7200.0 in region us-east1.
    metric name = compute.googleapis.com/cpus
    limit name = CPUS-per-project-region
    dimensions = region: us-east1
Try your request in another zone, or view documentation on how to increase quotas: https://cloud.google.com/compute/quotas.: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=16 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-23.1.0 release-blocker] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ c8a4703f9853a442ac676b44d074b43eb387f60c:

test clearrange/checks=true/rangeTs=false was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-16 --labels usage=roachtest,roachprod=true,cluster=teamcity-9554151-1681277484-52-n10cpu16,lifetime=12h0m0s,created=2023-04-12t10_28_09z, --metadata-from-file startup-script=/tmp/gce-startup-script225796789 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-east1-b teamcity-9554151-1681277484-52-n10cpu16-0001 teamcity-9554151-1681277484-52-n10cpu16-0002 teamcity-9554151-1681277484-52-n10cpu16-0003 teamcity-9554151-1681277484-52-n10cpu16-0004 teamcity-9554151-1681277484-52-n10cpu16-0005 teamcity-9554151-1681277484-52-n10cpu16-0006 teamcity-9554151-1681277484-52-n10cpu16-0007 teamcity-9554151-1681277484-52-n10cpu16-0008 teamcity-9554151-1681277484-52-n10cpu16-0009 teamcity-9554151-1681277484-52-n10cpu16-0010]
Output: WARNING: Some requests generated warnings:
 - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
 - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20230302'.
ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Quota 'CPUS' exceeded.  Limit: 7200.0 in region us-east1.
    metric name = compute.googleapis.com/cpus
    limit name = CPUS-per-project-region
    dimensions = region: us-east1
Try your request in another zone, or view documentation on how to increase quotas: https://cloud.google.com/compute/quotas.: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=16 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-23.1.0 release-blocker] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ c8a4703f9853a442ac676b44d074b43eb387f60c:

test clearrange/checks=false/rangeTs=false was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-pro-fips-2004-focal-v20230302 --image-project ubuntu-os-pro-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-16 --labels usage=roachtest,roachprod=true,cluster=teamcity-9554162-1681277516-56-n10cpu16,lifetime=12h0m0s,created=2023-04-12t10_24_46z, --metadata-from-file startup-script=/tmp/gce-startup-script3098620901 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-east1-b teamcity-9554162-1681277516-56-n10cpu16-0001 teamcity-9554162-1681277516-56-n10cpu16-0002 teamcity-9554162-1681277516-56-n10cpu16-0003 teamcity-9554162-1681277516-56-n10cpu16-0004 teamcity-9554162-1681277516-56-n10cpu16-0005 teamcity-9554162-1681277516-56-n10cpu16-0006 teamcity-9554162-1681277516-56-n10cpu16-0007 teamcity-9554162-1681277516-56-n10cpu16-0008 teamcity-9554162-1681277516-56-n10cpu16-0009 teamcity-9554162-1681277516-56-n10cpu16-0010]
Output: Created [https://www.googleapis.com/compute/v1/projects/cockroach-ephemeral/zones/us-east1-b/instances/teamcity-9554162-1681277516-56-n10cpu16-0002].
Created [https://www.googleapis.com/compute/v1/projects/cockroach-ephemeral/zones/us-east1-b/instances/teamcity-9554162-1681277516-56-n10cpu16-0005].
WARNING: Some requests generated warnings:
 - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Quota 'CPUS' exceeded.  Limit: 7200.0 in region us-east1.
    metric name = compute.googleapis.com/cpus
    limit name = CPUS-per-project-region
    dimensions = region: us-east1
Try your request in another zone, or view documentation on how to increase quotas: https://cloud.google.com/compute/quotas.: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=16 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-23.1.0 release-blocker] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ c8a4703f9853a442ac676b44d074b43eb387f60c:

test clearrange/checks=false/rangeTs=true was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-pro-fips-2004-focal-v20230302 --image-project ubuntu-os-pro-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-16 --labels usage=roachtest,roachprod=true,cluster=teamcity-9554162-1681277516-60-n10cpu16,lifetime=12h0m0s,created=2023-04-12t10_36_49z, --metadata-from-file startup-script=/tmp/gce-startup-script920528184 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-east1-b teamcity-9554162-1681277516-60-n10cpu16-0001 teamcity-9554162-1681277516-60-n10cpu16-0002 teamcity-9554162-1681277516-60-n10cpu16-0003 teamcity-9554162-1681277516-60-n10cpu16-0004 teamcity-9554162-1681277516-60-n10cpu16-0005 teamcity-9554162-1681277516-60-n10cpu16-0006 teamcity-9554162-1681277516-60-n10cpu16-0007 teamcity-9554162-1681277516-60-n10cpu16-0008 teamcity-9554162-1681277516-60-n10cpu16-0009 teamcity-9554162-1681277516-60-n10cpu16-0010]
Output: Created [https://www.googleapis.com/compute/v1/projects/cockroach-ephemeral/zones/us-east1-b/instances/teamcity-9554162-1681277516-60-n10cpu16-0001].
Created [https://www.googleapis.com/compute/v1/projects/cockroach-ephemeral/zones/us-east1-b/instances/teamcity-9554162-1681277516-60-n10cpu16-0002].
WARNING: Some requests generated warnings:
 - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Quota 'CPUS' exceeded.  Limit: 7200.0 in region us-east1.
    metric name = compute.googleapis.com/cpus
    limit name = CPUS-per-project-region
    dimensions = region: us-east1
Try your request in another zone, or view documentation on how to increase quotas: https://cloud.google.com/compute/quotas.: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=16 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-23.1.0 release-blocker] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ c8a4703f9853a442ac676b44d074b43eb387f60c:

test decommission/randomized was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-4 --labels usage=roachtest,roachprod=true,cluster=teamcity-9554151-1681277484-67-n6cpu4,lifetime=12h0m0s,created=2023-04-12t11_09_44z, --metadata-from-file startup-script=/tmp/gce-startup-script2110029102 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-east1-b teamcity-9554151-1681277484-67-n6cpu4-0001 teamcity-9554151-1681277484-67-n6cpu4-0002 teamcity-9554151-1681277484-67-n6cpu4-0003 teamcity-9554151-1681277484-67-n6cpu4-0004 teamcity-9554151-1681277484-67-n6cpu4-0005 teamcity-9554151-1681277484-67-n6cpu4-0006]
Output: Created [https://www.googleapis.com/compute/v1/projects/cockroach-ephemeral/zones/us-east1-b/instances/teamcity-9554151-1681277484-67-n6cpu4-0006].
WARNING: Some requests generated warnings:
 - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
 - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20230302'.
ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Quota 'CPUS' exceeded.  Limit: 7200.0 in region us-east1.
    metric name = compute.googleapis.com/cpus
    limit name = CPUS-per-project-region
    dimensions = region: us-east1
Try your request in another zone, or view documentation on how to increase quotas: https://cloud.google.com/compute/quotas.: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=4 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-23.1.0 release-blocker] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ c8a4703f9853a442ac676b44d074b43eb387f60c:

test decommissionBench/nodes=4/warehouses=1000 was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-16 --labels usage=roachtest,lifetime=12h0m0s,created=2023-04-12t11_16_46z,roachprod=true,cluster=teamcity-9554151-1681277484-71-n5cpu16, --metadata-from-file startup-script=/tmp/gce-startup-script703758065 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-east1-b teamcity-9554151-1681277484-71-n5cpu16-0001 teamcity-9554151-1681277484-71-n5cpu16-0002 teamcity-9554151-1681277484-71-n5cpu16-0003 teamcity-9554151-1681277484-71-n5cpu16-0004 teamcity-9554151-1681277484-71-n5cpu16-0005]
Output: WARNING: Some requests generated warnings:
 - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
 - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20230302'.
ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Quota 'CPUS' exceeded.  Limit: 7200.0 in region us-east1.
    metric name = compute.googleapis.com/cpus
    limit name = CPUS-per-project-region
    dimensions = region: us-east1
Try your request in another zone, or view documentation on how to increase quotas: https://cloud.google.com/compute/quotas.: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=16 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-23.1.0 release-blocker] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ c8a4703f9853a442ac676b44d074b43eb387f60c:

test decommissionBench/nodes=4/warehouses=1000/while-down was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-16 --labels usage=roachtest,roachprod=true,cluster=teamcity-9554151-1681277484-75-n5cpu16,lifetime=12h0m0s,created=2023-04-12t11_25_20z, --metadata-from-file startup-script=/tmp/gce-startup-script3755719111 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-east1-b teamcity-9554151-1681277484-75-n5cpu16-0001 teamcity-9554151-1681277484-75-n5cpu16-0002 teamcity-9554151-1681277484-75-n5cpu16-0003 teamcity-9554151-1681277484-75-n5cpu16-0004 teamcity-9554151-1681277484-75-n5cpu16-0005]
Output: WARNING: Some requests generated warnings:
 - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
 - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20230302'.
ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Quota 'CPUS' exceeded.  Limit: 7200.0 in region us-east1.
    metric name = compute.googleapis.com/cpus
    limit name = CPUS-per-project-region
    dimensions = region: us-east1
Try your request in another zone, or view documentation on how to increase quotas: https://cloud.google.com/compute/quotas.: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=16 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-23.1.0 release-blocker] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ 84905b8396e7cd7ef999b264faaafe13110d631a:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n1-standard-8 --labels usage=roachtest,roachprod=true,cluster=teamcity-9616167-1681536170-124-n9cpu8-geo,lifetime=12h0m0s,created=2023-04-15t17_19_44z, --metadata-from-file startup-script=/tmp/gce-startup-script1149329961 --project cockroach-ephemeral --boot-disk-size=32GB --zone eu-west-1b teamcity-9616167-1681536170-124-n9cpu8-geo-0007 teamcity-9616167-1681536170-124-n9cpu8-geo-0008 teamcity-9616167-1681536170-124-n9cpu8-geo-0009]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/eu-west-1b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-23.1.0 release-blocker] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ 6cce6c746150307a9ecf3b529dfd633a6985c110:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n1-standard-8 --labels usage=roachtest,roachprod=true,cluster=teamcity-9627078-1681622387-128-n9cpu8-geo,lifetime=12h0m0s,created=2023-04-16t17_21_24z, --metadata-from-file startup-script=/tmp/gce-startup-script3656377900 --project cockroach-ephemeral --boot-disk-size=32GB --zone eu-west-1b teamcity-9627078-1681622387-128-n9cpu8-geo-0007 teamcity-9627078-1681622387-128-n9cpu8-geo-0008 teamcity-9627078-1681622387-128-n9cpu8-geo-0009]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/eu-west-1b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-23.1.0 release-blocker] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ 6cce6c746150307a9ecf3b529dfd633a6985c110:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n1-standard-8 --labels usage=roachtest,lifetime=12h0m0s,created=2023-04-17t06_01_44z,roachprod=true,cluster=teamcity-9637843-1681668600-125-n9cpu8-geo, --metadata-from-file startup-script=/tmp/gce-startup-script1745438865 --project cockroach-ephemeral --boot-disk-size=32GB --zone eu-west-1b teamcity-9637843-1681668600-125-n9cpu8-geo-0007 teamcity-9637843-1681668600-125-n9cpu8-geo-0008 teamcity-9637843-1681668600-125-n9cpu8-geo-0009]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/eu-west-1b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-23.1.0 release-blocker] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ 6cce6c746150307a9ecf3b529dfd633a6985c110:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n1-standard-8 --labels usage=roachtest,lifetime=12h0m0s,created=2023-04-17t17_34_45z,roachprod=true,cluster=teamcity-9638532-1681708911-132-n9cpu8-geo, --metadata-from-file startup-script=/tmp/gce-startup-script2768276040 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-west-2b teamcity-9638532-1681708911-132-n9cpu8-geo-0004 teamcity-9638532-1681708911-132-n9cpu8-geo-0005 teamcity-9638532-1681708911-132-n9cpu8-geo-0006]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/us-west-2b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-23.1.0 release-blocker] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ 12607684868d04f957b3385f142e4e8b9b55c799:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n1-standard-8 --labels usage=roachtest,roachprod=true,cluster=teamcity-9658510-1681795204-120-n9cpu8-geo,lifetime=12h0m0s,created=2023-04-18t17_29_38z, --metadata-from-file startup-script=/tmp/gce-startup-script4105505876 --project cockroach-ephemeral --boot-disk-size=32GB --zone eu-west-1b teamcity-9658510-1681795204-120-n9cpu8-geo-0007 teamcity-9658510-1681795204-120-n9cpu8-geo-0008 teamcity-9658510-1681795204-120-n9cpu8-geo-0009]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/eu-west-1b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-23.1.0] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ 2f86475f2e3d713b4c8c976c34dba99acce7c4c7:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n1-standard-8 --labels usage=roachtest,roachprod=true,cluster=teamcity-9680367-1681881616-139-n9cpu8-geo,lifetime=12h0m0s,created=2023-04-19t17_36_42z, --metadata-from-file startup-script=/tmp/gce-startup-script2520675249 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-east-2b teamcity-9680367-1681881616-139-n9cpu8-geo-0001 teamcity-9680367-1681881616-139-n9cpu8-geo-0002 teamcity-9680367-1681881616-139-n9cpu8-geo-0003]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/us-east-2b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-23.1.0] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ ad6ce866ea3b5c5bb47ba9a0ac19b721a0c98add:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n1-standard-8 --labels usage=roachtest,roachprod=true,cluster=teamcity-9699489-1681968016-136-n9cpu8-geo,lifetime=12h0m0s,created=2023-04-20t17_34_15z, --metadata-from-file startup-script=/tmp/gce-startup-script2782900443 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-east-2b teamcity-9699489-1681968016-136-n9cpu8-geo-0001 teamcity-9699489-1681968016-136-n9cpu8-geo-0002 teamcity-9699489-1681968016-136-n9cpu8-geo-0003]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/us-east-2b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-23.1.0] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ 2c34f145b83f771667baf3f7ef8633e7e1cd2ad6:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n1-standard-8 --labels usage=roachtest,roachprod=true,cluster=teamcity-9721250-1682054508-130-n9cpu8-geo,lifetime=12h0m0s,created=2023-04-21t17_15_18z, --metadata-from-file startup-script=/tmp/gce-startup-script2384407304 --project cockroach-ephemeral --boot-disk-size=32GB --zone eu-west-1b teamcity-9721250-1682054508-130-n9cpu8-geo-0007 teamcity-9721250-1682054508-130-n9cpu8-geo-0008 teamcity-9721250-1682054508-130-n9cpu8-geo-0009]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/eu-west-1b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-23.1.0] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ 01f129a59ab66166d6ef7189a8930f2b37cced74:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n1-standard-8 --labels usage=roachtest,roachprod=true,cluster=teamcity-9738195-1682140836-127-n9cpu8-geo,lifetime=12h0m0s,created=2023-04-22t17_08_19z, --metadata-from-file startup-script=/tmp/gce-startup-script3950306230 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-east-2b teamcity-9738195-1682140836-127-n9cpu8-geo-0001 teamcity-9738195-1682140836-127-n9cpu8-geo-0002 teamcity-9738195-1682140836-127-n9cpu8-geo-0003]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/us-east-2b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-23.1.0] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ e82cf4ec488258875dcf5e42e7d6745b03210edd:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n1-standard-8 --labels usage=roachtest,created=2023-04-23t17_05_37z,roachprod=true,cluster=teamcity-9749931-1682226983-130-n9cpu8-geo,lifetime=12h0m0s, --metadata-from-file startup-script=/tmp/gce-startup-script1556628197 --project cockroach-ephemeral --boot-disk-size=32GB --zone eu-west-1b teamcity-9749931-1682226983-130-n9cpu8-geo-0007 teamcity-9749931-1682226983-130-n9cpu8-geo-0008 teamcity-9749931-1682226983-130-n9cpu8-geo-0009]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/eu-west-1b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-23.1.0] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ 33677face99e0b20b041458bd653d8846906b44e:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n1-standard-8 --labels usage=roachtest,created=2023-04-24t16_50_11z,roachprod=true,cluster=teamcity-9761126-1682313430-137-n9cpu8-geo,lifetime=12h0m0s, --metadata-from-file startup-script=/tmp/gce-startup-script1898326610 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-west-2b teamcity-9761126-1682313430-137-n9cpu8-geo-0004 teamcity-9761126-1682313430-137-n9cpu8-geo-0005 teamcity-9761126-1682313430-137-n9cpu8-geo-0006]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/us-west-2b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-23.1.0] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ fa10e980c24442f18e688bea904ece4777ba0ca9:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n1-standard-8 --labels usage=roachtest,created=2023-04-25t17_20_04z,roachprod=true,cluster=teamcity-9782025-1682400009-127-n9cpu8-geo,lifetime=12h0m0s, --metadata-from-file startup-script=/tmp/gce-startup-script2013632502 --project cockroach-ephemeral --boot-disk-size=32GB --zone eu-west-1b teamcity-9782025-1682400009-127-n9cpu8-geo-0007 teamcity-9782025-1682400009-127-n9cpu8-geo-0008 teamcity-9782025-1682400009-127-n9cpu8-geo-0009]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/eu-west-1b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-23.1.0] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ d329422358d677325c818eee10d23f35b080c877:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n1-standard-8 --labels usage=roachtest,cluster=teamcity-9803991-1682486243-129-n9cpu8-geo,lifetime=12h0m0s,created=2023-04-26t17_04_57z,roachprod=true, --metadata-from-file startup-script=/tmp/gce-startup-script2440678167 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-east-2b teamcity-9803991-1682486243-129-n9cpu8-geo-0001 teamcity-9803991-1682486243-129-n9cpu8-geo-0002 teamcity-9803991-1682486243-129-n9cpu8-geo-0003]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/us-east-2b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-23.1.0] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ 6636edf9d8c0ebf9cdeedeeffd563ecb49da5b8a:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n1-standard-8 --labels usage=roachtest,roachprod=true,cluster=teamcity-9825975-1682572796-131-n9cpu8-geo,lifetime=12h0m0s,created=2023-04-27t17_15_04z, --metadata-from-file startup-script=/tmp/gce-startup-script2085617740 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-east-2b teamcity-9825975-1682572796-131-n9cpu8-geo-0001 teamcity-9825975-1682572796-131-n9cpu8-geo-0002 teamcity-9825975-1682572796-131-n9cpu8-geo-0003]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/us-east-2b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-23.1.0] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ 7f6458093d42bb7131cef623deb47f6318a233e9:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n1-standard-8 --labels usage=roachtest,roachprod=true,cluster=teamcity-9848434-1682659358-136-n9cpu8-geo,lifetime=12h0m0s,created=2023-04-28t17_40_18z, --metadata-from-file startup-script=/tmp/gce-startup-script1369144471 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-west-2b teamcity-9848434-1682659358-136-n9cpu8-geo-0004 teamcity-9848434-1682659358-136-n9cpu8-geo-0005 teamcity-9848434-1682659358-136-n9cpu8-geo-0006]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/us-west-2b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-23.1.0] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ f0e37ada00cf99a1fa25236e158861647c2ea713:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n1-standard-8 --labels usage=roachtest,roachprod=true,cluster=teamcity-9868374-1682745630-128-n9cpu8-geo,lifetime=12h0m0s,created=2023-04-29t17_18_56z, --metadata-from-file startup-script=/tmp/gce-startup-script2485289565 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-east-2b teamcity-9868374-1682745630-128-n9cpu8-geo-0001 teamcity-9868374-1682745630-128-n9cpu8-geo-0002 teamcity-9868374-1682745630-128-n9cpu8-geo-0003]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/us-east-2b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-23.1.0] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ 6944c293f14d5c1c5b28d6ea53329c3e214dd9ea:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n1-standard-8 --labels usage=roachtest,roachprod=true,cluster=teamcity-9880110-1682831940-127-n9cpu8-geo,lifetime=12h0m0s,created=2023-04-30t17_03_16z, --metadata-from-file startup-script=/tmp/gce-startup-script2478796739 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-east-2b teamcity-9880110-1682831940-127-n9cpu8-geo-0001 teamcity-9880110-1682831940-127-n9cpu8-geo-0002 teamcity-9880110-1682831940-127-n9cpu8-geo-0003]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/us-east-2b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-23.1.0] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ fa8d237846052ae72cc44b3eaebe1f38c89834f8:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n1-standard-8 --labels usage=roachtest,roachprod=true,cluster=teamcity-9890704-1682918178-133-n9cpu8-geo,lifetime=12h0m0s,created=2023-05-01t17_09_52z, --metadata-from-file startup-script=/tmp/gce-startup-script3305008429 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-east-2b teamcity-9890704-1682918178-133-n9cpu8-geo-0001 teamcity-9890704-1682918178-133-n9cpu8-geo-0002 teamcity-9890704-1682918178-133-n9cpu8-geo-0003]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/us-east-2b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-23.1.0] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ fb4670bf26561963694a5b431549c7ae87bb12cd:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n1-standard-8 --labels usage=roachtest,roachprod=true,cluster=teamcity-9916451-1683091088-137-n9cpu8-geo,lifetime=12h0m0s,created=2023-05-03t17_15_53z, --metadata-from-file startup-script=/tmp/gce-startup-script482269871 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-west-2b teamcity-9916451-1683091088-137-n9cpu8-geo-0004 teamcity-9916451-1683091088-137-n9cpu8-geo-0005 teamcity-9916451-1683091088-137-n9cpu8-geo-0006]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/us-west-2b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-23.1.0] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ fbea48d5cd399ab1889ae8ce76b11f521d914686:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n1-standard-8 --labels usage=roachtest,lifetime=12h0m0s,created=2023-05-04t17_03_18z,roachprod=true,cluster=teamcity-9928271-1683177417-128-n9cpu8-geo, --metadata-from-file startup-script=/tmp/gce-startup-script1658901949 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-west-2b teamcity-9928271-1683177417-128-n9cpu8-geo-0004 teamcity-9928271-1683177417-128-n9cpu8-geo-0005 teamcity-9928271-1683177417-128-n9cpu8-geo-0006]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/us-west-2b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-23.1.0] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ 26713f81a397d13db4f2257eaa0f6bb70d1a7cb3:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n1-standard-8 --labels usage=roachtest,roachprod=true,cluster=teamcity-9940968-1683263818-123-n9cpu8-geo,lifetime=12h0m0s,created=2023-05-05t17_10_54z, --metadata-from-file startup-script=/tmp/gce-startup-script1658682856 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-east-2b teamcity-9940968-1683263818-123-n9cpu8-geo-0001 teamcity-9940968-1683263818-123-n9cpu8-geo-0002 teamcity-9940968-1683263818-123-n9cpu8-geo-0003]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/us-east-2b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-23.1.0] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ e8cad69249719e193cedcfd30d6a91350210d9d5:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n1-standard-8 --labels usage=roachtest,roachprod=true,cluster=teamcity-9954965-1683350439-131-n9cpu8-geo,lifetime=12h0m0s,created=2023-05-06t17_04_01z, --metadata-from-file startup-script=/tmp/gce-startup-script3417115044 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-west-2b teamcity-9954965-1683350439-131-n9cpu8-geo-0004 teamcity-9954965-1683350439-131-n9cpu8-geo-0005 teamcity-9954965-1683350439-131-n9cpu8-geo-0006]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/us-west-2b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-23.1.0] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ 4226a83871bbce776bc9389fca5cf084b4bb7632:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n1-standard-8 --labels usage=roachtest,roachprod=true,cluster=teamcity-9963567-1683436893-129-n9cpu8-geo,lifetime=12h0m0s,created=2023-05-07t17_08_54z, --metadata-from-file startup-script=/tmp/gce-startup-script2044026669 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-east-2b teamcity-9963567-1683436893-129-n9cpu8-geo-0001 teamcity-9963567-1683436893-129-n9cpu8-geo-0002 teamcity-9963567-1683436893-129-n9cpu8-geo-0003]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/us-east-2b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-23.1.0] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ 4226a83871bbce776bc9389fca5cf084b4bb7632:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n1-standard-8 --labels usage=roachtest,roachprod=true,cluster=teamcity-9974822-1683523207-131-n9cpu8-geo,lifetime=12h0m0s,created=2023-05-08t17_03_18z, --metadata-from-file startup-script=/tmp/gce-startup-script1031521610 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-east-2b teamcity-9974822-1683523207-131-n9cpu8-geo-0001 teamcity-9974822-1683523207-131-n9cpu8-geo-0002 teamcity-9974822-1683523207-131-n9cpu8-geo-0003]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/us-east-2b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-23.1.0] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ 5376e479204d6e8243f67c30aea3d031df529afd:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n1-standard-8 --labels usage=roachtest,roachprod=true,cluster=teamcity-9990839-1683609760-124-n9cpu8-geo,lifetime=12h0m0s,created=2023-05-09t17_06_56z, --metadata-from-file startup-script=/tmp/gce-startup-script78444185 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-east-2b teamcity-9990839-1683609760-124-n9cpu8-geo-0001 teamcity-9990839-1683609760-124-n9cpu8-geo-0002 teamcity-9990839-1683609760-124-n9cpu8-geo-0003]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/us-east-2b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-23.1.0] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ 6c6d6657a21dd94d98e4c99c8d6c64f6353a5774:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n1-standard-8 --labels usage=roachtest,roachprod=true,cluster=teamcity-10006707-1683695976-125-n9cpu8-geo,lifetime=12h0m0s,created=2023-05-10t17_26_05z, --metadata-from-file startup-script=/tmp/gce-startup-script3972785522 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-east-2b teamcity-10006707-1683695976-125-n9cpu8-geo-0001 teamcity-10006707-1683695976-125-n9cpu8-geo-0002 teamcity-10006707-1683695976-125-n9cpu8-geo-0003]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/us-east-2b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-23.1.0] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ 6ceddbd9dc6b987add91ea93a665088e7928cb88:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n1-standard-8 --labels usage=roachtest,roachprod=true,cluster=teamcity-10025455-1683782459-124-n9cpu8-geo,lifetime=12h0m0s,created=2023-05-11t17_06_42z, --metadata-from-file startup-script=/tmp/gce-startup-script1141799562 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-east-2b teamcity-10025455-1683782459-124-n9cpu8-geo-0001 teamcity-10025455-1683782459-124-n9cpu8-geo-0002 teamcity-10025455-1683782459-124-n9cpu8-geo-0003]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/us-east-2b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-23.1.0] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ bc953426b8cc479406c3b54b99154eb15fa4107b:

test connection_latency/nodes=9/multiregion/password was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute disks update --update-labels usage=roachtest,roachprod=true,cluster=teamcity-10044669-1683868822-58-n12cpu4-geo,lifetime=12h0m0s,created=2023-05-12t10_47_18z --project cockroach-ephemeral --zone us-east1-b --zone us-west1-b --zone europe-west2-b teamcity-10044669-1683868822-58-n12cpu4-geo-0005]
Output: ERROR: (gcloud.compute.disks.update) HTTPError 404: The resource 'projects/cockroach-ephemeral/zones/europe-west2-b/disks/teamcity-10044669-1683868822-58-n12cpu4-geo-0005' was not found: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=4 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-23.1.0] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ bc953426b8cc479406c3b54b99154eb15fa4107b:

test costfuzz/seed-multi-region was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute disks update --update-labels usage=roachtest,roachprod=true,cluster=teamcity-10044669-1683868822-61-n9cpu4-geo,lifetime=12h0m0s,created=2023-05-12t10_51_14z --project cockroach-ephemeral --zone us-east1-c --zone europe-west2-c --zone us-east1-d --zone us-west1-a --zone europe-west2-b --zone us-west1-b --zone us-west1-c --zone europe-west2-a --zone us-east1-b teamcity-10044669-1683868822-61-n9cpu4-geo-0003]
Output: ERROR: (gcloud.compute.disks.update) HTTPError 404: The resource 'projects/cockroach-ephemeral/zones/us-east1-b/disks/teamcity-10044669-1683868822-61-n9cpu4-geo-0003' was not found: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=4 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-23.1.0] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ bc953426b8cc479406c3b54b99154eb15fa4107b:

test connection_latency/nodes=9/multiregion/certs was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n1-standard-4 --labels usage=roachtest,roachprod=true,cluster=teamcity-10044669-1683868822-56-n12cpu4-geo,lifetime=12h0m0s,created=2023-05-12t10_44_51z --metadata-from-file startup-script=/tmp/gce-startup-script3961319602 --project cockroach-ephemeral --boot-disk-size=32GB --zone europe-west2-b teamcity-10044669-1683868822-56-n12cpu4-geo-0009 teamcity-10044669-1683868822-56-n12cpu4-geo-0010 teamcity-10044669-1683868822-56-n12cpu4-geo-0011 teamcity-10044669-1683868822-56-n12cpu4-geo-0012]
Output: Created [https://www.googleapis.com/compute/v1/projects/cockroach-ephemeral/zones/europe-west2-b/instances/teamcity-10044669-1683868822-56-n12cpu4-geo-0009].
Created [https://www.googleapis.com/compute/v1/projects/cockroach-ephemeral/zones/europe-west2-b/instances/teamcity-10044669-1683868822-56-n12cpu4-geo-0010].
Created [https://www.googleapis.com/compute/v1/projects/cockroach-ephemeral/zones/europe-west2-b/instances/teamcity-10044669-1683868822-56-n12cpu4-geo-0012].
WARNING: Some requests generated warnings:
 - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
 - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20230302'.
ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Internal error. Please try again or contact Google Support. (Code: '-6303850338917941230'): exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=4 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-23.1.0] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ bc953426b8cc479406c3b54b99154eb15fa4107b:

test decommissionBench/nodes=6/warehouses=1000/drain-first/while-upreplicating/target=2/multi-region was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute disks update --update-labels usage=roachtest,lifetime=12h0m0s,created=2023-05-12t12_19_20z,roachprod=true,cluster=teamcity-10044669-1683868822-70-n8cpu16-geo --project cockroach-ephemeral --zone us-east1-b --zone us-west1-b --zone us-central1-b teamcity-10044669-1683868822-70-n8cpu16-geo-0008]
Output: ERROR: (gcloud.compute.disks.update) HTTPError 404: The resource 'projects/cockroach-ephemeral/zones/us-central1-b/disks/teamcity-10044669-1683868822-70-n8cpu16-geo-0008' was not found: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=16 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-23.1.0] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ bc953426b8cc479406c3b54b99154eb15fa4107b:

test decommissionBench/nodes=6/warehouses=1000/drain-first/while-upreplicating/target=3/multi-region was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute disks update --update-labels usage=roachtest,roachprod=true,cluster=teamcity-10044669-1683868822-74-n8cpu16-geo,lifetime=12h0m0s,created=2023-05-12t12_28_41z --project cockroach-ephemeral --zone us-east1-b --zone us-west1-b --zone us-central1-b teamcity-10044669-1683868822-74-n8cpu16-geo-0003]
Output: ERROR: (gcloud.compute.disks.update) HTTPError 404: The resource 'projects/cockroach-ephemeral/zones/us-central1-b/disks/teamcity-10044669-1683868822-74-n8cpu16-geo-0003' was not found: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=16 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-23.1.0] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ bc953426b8cc479406c3b54b99154eb15fa4107b:

test follower-reads/survival=region/locality=global/reads=bounded-staleness was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute disks update --update-labels usage=roachtest,lifetime=12h0m0s,created=2023-05-12t13_51_11z,roachprod=true,cluster=teamcity-10044669-1683868822-91-n6cpu4-geo --project cockroach-ephemeral --zone us-east1-b --zone us-west1-b --zone europe-west2-b teamcity-10044669-1683868822-91-n6cpu4-geo-0001]
Output: ERROR: (gcloud.compute.disks.update) HTTPError 404: The resource 'projects/cockroach-ephemeral/zones/europe-west2-b/disks/teamcity-10044669-1683868822-91-n6cpu4-geo-0001' was not found: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=4 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-23.1.0] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ bc953426b8cc479406c3b54b99154eb15fa4107b:

test follower-reads/survival=region/locality=global/reads=exact-staleness was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute disks update --update-labels usage=roachtest,roachprod=true,cluster=teamcity-10044669-1683868822-92-n6cpu4-geo,lifetime=12h0m0s,created=2023-05-12t13_52_06z --project cockroach-ephemeral --zone us-east1-b --zone us-west1-b --zone europe-west2-b teamcity-10044669-1683868822-92-n6cpu4-geo-0004]
Output: ERROR: (gcloud.compute.disks.update) HTTPError 404: The resource 'projects/cockroach-ephemeral/zones/europe-west2-b/disks/teamcity-10044669-1683868822-92-n6cpu4-geo-0004' was not found: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=4 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-23.1.0] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ bc953426b8cc479406c3b54b99154eb15fa4107b:

test follower-reads/survival=region/locality=global/reads=strong was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute disks update --update-labels usage=roachtest,roachprod=true,cluster=teamcity-10044669-1683868822-99-n6cpu4-geo,lifetime=12h0m0s,created=2023-05-12t13_56_37z --project cockroach-ephemeral --zone us-east1-b --zone us-west1-b --zone europe-west2-b teamcity-10044669-1683868822-99-n6cpu4-geo-0003]
Output: ERROR: (gcloud.compute.disks.update) HTTPError 404: The resource 'projects/cockroach-ephemeral/zones/europe-west2-b/disks/teamcity-10044669-1683868822-99-n6cpu4-geo-0003' was not found: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=4 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-23.1.0] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ bc953426b8cc479406c3b54b99154eb15fa4107b:

test follower-reads/survival=region/locality=regional/reads=bounded-staleness was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute disks update --update-labels usage=roachtest,lifetime=12h0m0s,created=2023-05-12t13_56_58z,roachprod=true,cluster=teamcity-10044669-1683868822-100-n6cpu4-geo --project cockroach-ephemeral --zone us-west1-b --zone europe-west2-b --zone us-east1-b teamcity-10044669-1683868822-100-n6cpu4-geo-0006]
Output: ERROR: (gcloud.compute.disks.update) HTTPError 404: The resource 'projects/cockroach-ephemeral/zones/us-east1-b/disks/teamcity-10044669-1683868822-100-n6cpu4-geo-0006' was not found: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=4 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-23.1.0] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ bc953426b8cc479406c3b54b99154eb15fa4107b:

test follower-reads/survival=region/locality=regional/reads=bounded-staleness/insufficient-quorum was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute disks update --update-labels usage=roachtest,lifetime=12h0m0s,created=2023-05-12t14_00_20z,roachprod=true,cluster=teamcity-10044669-1683868822-107-n6cpu4-geo --project cockroach-ephemeral --zone us-east1-b --zone us-west1-b --zone europe-west2-b teamcity-10044669-1683868822-107-n6cpu4-geo-0005]
Output: ERROR: (gcloud.compute.disks.update) HTTPError 404: The resource 'projects/cockroach-ephemeral/zones/europe-west2-b/disks/teamcity-10044669-1683868822-107-n6cpu4-geo-0005' was not found: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=4 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-23.1.0] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ bc953426b8cc479406c3b54b99154eb15fa4107b:

test follower-reads/survival=region/locality=regional/reads=exact-staleness was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute disks update --update-labels usage=roachtest,roachprod=true,cluster=teamcity-10044669-1683868822-109-n6cpu4-geo,lifetime=12h0m0s,created=2023-05-12t14_00_49z --project cockroach-ephemeral --zone us-east1-b --zone us-west1-b --zone europe-west2-b teamcity-10044669-1683868822-109-n6cpu4-geo-0005]
Output: ERROR: (gcloud.compute.disks.update) HTTPError 404: The resource 'projects/cockroach-ephemeral/zones/europe-west2-b/disks/teamcity-10044669-1683868822-109-n6cpu4-geo-0005' was not found: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=4 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-23.1.0] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ bc953426b8cc479406c3b54b99154eb15fa4107b:

test follower-reads/survival=zone/locality=global/reads=bounded-staleness was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute disks update --update-labels usage=roachtest,roachprod=true,cluster=teamcity-10044669-1683868822-110-n6cpu4-geo,lifetime=12h0m0s,created=2023-05-12t14_01_23z --project cockroach-ephemeral --zone us-east1-b --zone us-west1-b --zone europe-west2-b teamcity-10044669-1683868822-110-n6cpu4-geo-0005]
Output: ERROR: (gcloud.compute.disks.update) HTTPError 404: The resource 'projects/cockroach-ephemeral/zones/europe-west2-b/disks/teamcity-10044669-1683868822-110-n6cpu4-geo-0005' was not found: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=4 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-23.1.0] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ bc953426b8cc479406c3b54b99154eb15fa4107b:

test follower-reads/survival=zone/locality=global/reads=exact-staleness was skipped due to (test_runner.go:678).runWorker: in provider: gce: Command: gcloud [compute disks update --update-labels usage=roachtest,roachprod=true,cluster=teamcity-10044669-1683868822-111-n6cpu4-geo,lifetime=12h0m0s,created=2023-05-12t14_02_33z --project cockroach-ephemeral --zone us-east1-b --zone us-west1-b --zone europe-west2-b teamcity-10044669-1683868822-111-n6cpu4-geo-0003]
Output: ERROR: (gcloud.compute.disks.update) HTTPError 404: The resource 'projects/cockroach-ephemeral/zones/europe-west2-b/disks/teamcity-10044669-1683868822-111-n6cpu4-geo-0003' was not found: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=4 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #101290 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-23.1.0] - #89810 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2.0] - #87695 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.2] - #78601 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master sync-me-8] - #78035 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-release-22.1]

This test on roachdash | Improve this report!

cockroachdb / cockroach

roachtest: cluster_creation failed #101289