roachtest: cluster_creation failed

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ b1194729b7be664edf159ed76e574b0855879866:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:725).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n2-standard-8 --labels usage=roachtest,lifetime=12h0m0s,arch=amd64,created=2023-08-10t17_16_00z,roachprod=true,cluster=teamcity-11261553-1691646222-148-n9cpu8-geo --metadata-from-file startup-script=/tmp/gce-startup-script2578581384 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-west-2b teamcity-11261553-1691646222-148-n9cpu8-geo-0004 teamcity-11261553-1691646222-148-n9cpu8-geo-0005 teamcity-11261553-1691646222-148-n9cpu8-geo-0006]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/us-west-2b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #108200 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master]

/cc @cockroachdb/dev-inf

This test on roachdash | Improve this report!

Jira issue: CRDB-30510

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ 94860a03416ef03c81b8cb31c827469354a35af8:

test restore/tpce/8TB/aws/nodes=10/cpus=8 was skipped due to (test_runner.go:725).runWorker: in provider: aws: failed to run: aws ec2 run-instances --associate-public-ip-address --count 1 --instance-type c6i.2xlarge --image-id ami-0a14db46282743a66 --key-name teamcity-runner-jVORjC7Vks7PeQLkM6yIPeDMDBY= --region us-east-2 --security-group-ids sg-0319fc9c9599a6145 --subnet-id subnet-004c6ad7121a8d5a7 --tag-specifications ResourceType=instance,Tags=[{Key=usage,Value=roachtest},{Key=Created,Value=2023-08-11T08:01:32Z},{Key=Name,Value=teamcity-11277566-1691732642-29-n10cpu8-0002},{Key=Roachprod,Value=true},{Key=Cluster,Value=teamcity-11277566-1691732642-29-n10cpu8},{Key=Lifetime,Value=12h0m0s},{Key=arch,Value=amd64}] ResourceType=volume,Tags=[{Key=usage,Value=roachtest},{Key=Created,Value=2023-08-11T08:01:32Z},{Key=Name,Value=teamcity-11277566-1691732642-29-n10cpu8-0002},{Key=Roachprod,Value=true},{Key=Cluster,Value=teamcity-11277566-1691732642-29-n10cpu8},{Key=Lifetime,Value=12h0m0s},{Key=arch,Value=amd64}] --user-data file:///tmp/aws-startup-script4078814971 --iam-instance-profile Name=roachprod-testing --block-device-mapping file:///tmp/aws-block-device-mapping3061003271 --output json: stderr: 
Parameter validation failed:
Unknown parameter in BlockDeviceMappings[0].Ebs: "Throughput", must be one of: DeleteOnTermination, Iops, SnapshotId, VolumeSize, VolumeType, KmsKeyId, Encrypted: exit status 252

Parameters: ROACHTEST_arch=amd64 , ROACHTEST_cloud=aws , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #108200 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master]

This test on roachdash | Improve this report!

smg260 commented 1 year ago

This latest one seems to be introduced by https://github.com/cockroachdb/cockroach/pull/108427 cc: @pavelkalinnikov

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ 94860a03416ef03c81b8cb31c827469354a35af8:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:725).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n2-standard-8 --labels usage=roachtest,cluster=teamcity-11277565-1691732628-145-n9cpu8-geo,lifetime=12h0m0s,arch=amd64,created=2023-08-11t17_42_37z,roachprod=true --metadata-from-file startup-script=/tmp/gce-startup-script166572881 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-east-2b teamcity-11277565-1691732628-145-n9cpu8-geo-0001 teamcity-11277565-1691732628-145-n9cpu8-geo-0002 teamcity-11277565-1691732628-145-n9cpu8-geo-0003]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/us-east-2b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #108200 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master]

This test on roachdash | Improve this report!

blathers-crl[bot] commented 1 year ago

cc @cockroachdb/test-eng

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ 84e0190d613b96728ff4622c7573f0743a9d5bb3:

test restore/tpce/8TB/aws/nodes=10/cpus=8 was skipped due to (test_runner.go:725).runWorker: in provider: aws: failed to run: aws ec2 run-instances --associate-public-ip-address --count 1 --instance-type c6i.2xlarge --image-id ami-0a14db46282743a66 --key-name teamcity-runner-vNQPieQMjvFJr5iQweG8YBjlPYI= --region us-east-2 --security-group-ids sg-0319fc9c9599a6145 --subnet-id subnet-004c6ad7121a8d5a7 --tag-specifications ResourceType=instance,Tags=[{Key=usage,Value=roachtest},{Key=Lifetime,Value=12h0m0s},{Key=arch,Value=amd64},{Key=Created,Value=2023-08-12T07:58:35Z},{Key=Name,Value=teamcity-11290593-1691818940-28-n10cpu8-0002},{Key=Roachprod,Value=true},{Key=Cluster,Value=teamcity-11290593-1691818940-28-n10cpu8}] ResourceType=volume,Tags=[{Key=usage,Value=roachtest},{Key=Lifetime,Value=12h0m0s},{Key=arch,Value=amd64},{Key=Created,Value=2023-08-12T07:58:35Z},{Key=Name,Value=teamcity-11290593-1691818940-28-n10cpu8-0002},{Key=Roachprod,Value=true},{Key=Cluster,Value=teamcity-11290593-1691818940-28-n10cpu8}] --user-data file:///tmp/aws-startup-script652637822 --iam-instance-profile Name=roachprod-testing --block-device-mapping file:///tmp/aws-block-device-mapping197316976 --output json: stderr: 
Parameter validation failed:
Unknown parameter in BlockDeviceMappings[0].Ebs: "Throughput", must be one of: DeleteOnTermination, Iops, SnapshotId, VolumeSize, VolumeType, KmsKeyId, Encrypted: exit status 252

Parameters: ROACHTEST_arch=amd64 , ROACHTEST_cloud=aws , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #108629 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ 84e0190d613b96728ff4622c7573f0743a9d5bb3:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:725).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n2-standard-8 --labels usage=roachtest,created=2023-08-12t17_19_32z,roachprod=true,cluster=teamcity-11290592-1691819083-143-n9cpu8-geo,lifetime=12h0m0s,arch=amd64 --metadata-from-file startup-script=/tmp/gce-startup-script3125883753 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-east-2b teamcity-11290592-1691819083-143-n9cpu8-geo-0001 teamcity-11290592-1691819083-143-n9cpu8-geo-0002 teamcity-11290592-1691819083-143-n9cpu8-geo-0003]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/us-east-2b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #108653 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-23.1.9-rc release-blocker] - #108629 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ 76ea9a2b98758fd056d6d5366b9734dce9a337fd:

test restore/tpce/8TB/aws/nodes=10/cpus=8 was skipped due to (test_runner.go:725).runWorker: in provider: aws: failed to run: aws ec2 run-instances --associate-public-ip-address --count 1 --instance-type c6i.2xlarge --image-id ami-0a14db46282743a66 --key-name teamcity-runner-62qfZKCVE9u_M5MbUog1_BP5TT4= --region us-east-2 --security-group-ids sg-0319fc9c9599a6145 --subnet-id subnet-004c6ad7121a8d5a7 --tag-specifications ResourceType=instance,Tags=[{Key=usage,Value=roachtest},{Key=Roachprod,Value=true},{Key=Cluster,Value=teamcity-11300115-1691905309-34-n10cpu8},{Key=Lifetime,Value=12h0m0s},{Key=arch,Value=amd64},{Key=Created,Value=2023-08-13T08:02:26Z},{Key=Name,Value=teamcity-11300115-1691905309-34-n10cpu8-0001}] ResourceType=volume,Tags=[{Key=usage,Value=roachtest},{Key=Roachprod,Value=true},{Key=Cluster,Value=teamcity-11300115-1691905309-34-n10cpu8},{Key=Lifetime,Value=12h0m0s},{Key=arch,Value=amd64},{Key=Created,Value=2023-08-13T08:02:26Z},{Key=Name,Value=teamcity-11300115-1691905309-34-n10cpu8-0001}] --user-data file:///tmp/aws-startup-script4019317834 --iam-instance-profile Name=roachprod-testing --block-device-mapping file:///tmp/aws-block-device-mapping3935907734 --output json: stderr: 
Parameter validation failed:
Unknown parameter in BlockDeviceMappings[0].Ebs: "Throughput", must be one of: DeleteOnTermination, Iops, SnapshotId, VolumeSize, VolumeType, KmsKeyId, Encrypted: exit status 252

Parameters: ROACHTEST_arch=amd64 , ROACHTEST_cloud=aws , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #108653 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-23.1.9-rc release-blocker] - #108629 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ 76ea9a2b98758fd056d6d5366b9734dce9a337fd:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:725).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n2-standard-8 --labels usage=roachtest,roachprod=true,cluster=teamcity-11300114-1691905330-137-n9cpu8-geo,lifetime=12h0m0s,arch=amd64,created=2023-08-13t17_10_49z --metadata-from-file startup-script=/tmp/gce-startup-script3740837604 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-west-2b teamcity-11300114-1691905330-137-n9cpu8-geo-0004 teamcity-11300114-1691905330-137-n9cpu8-geo-0005 teamcity-11300114-1691905330-137-n9cpu8-geo-0006]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/us-west-2b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #108653 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-23.1.9-rc release-blocker] - #108629 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ 76ea9a2b98758fd056d6d5366b9734dce9a337fd:

test restore/tpce/8TB/aws/nodes=10/cpus=8 was skipped due to (test_runner.go:725).runWorker: in provider: aws: failed to run: aws ec2 run-instances --associate-public-ip-address --count 1 --instance-type c6i.2xlarge --image-id ami-0a14db46282743a66 --key-name teamcity-runner-XhhfxMnDqLKZmZPgYYHPxHerfnU= --region us-east-2 --security-group-ids sg-0319fc9c9599a6145 --subnet-id subnet-004c6ad7121a8d5a7 --tag-specifications ResourceType=instance,Tags=[{Key=usage,Value=roachtest},{Key=Lifetime,Value=12h0m0s},{Key=arch,Value=amd64},{Key=Created,Value=2023-08-14T08:03:39Z},{Key=Name,Value=teamcity-11308712-1691991998-29-n10cpu8-0001},{Key=Roachprod,Value=true},{Key=Cluster,Value=teamcity-11308712-1691991998-29-n10cpu8}] ResourceType=volume,Tags=[{Key=usage,Value=roachtest},{Key=Lifetime,Value=12h0m0s},{Key=arch,Value=amd64},{Key=Created,Value=2023-08-14T08:03:39Z},{Key=Name,Value=teamcity-11308712-1691991998-29-n10cpu8-0001},{Key=Roachprod,Value=true},{Key=Cluster,Value=teamcity-11308712-1691991998-29-n10cpu8}] --user-data file:///tmp/aws-startup-script4088333315 --iam-instance-profile Name=roachprod-testing --block-device-mapping file:///tmp/aws-block-device-mapping1059779786 --output json: stderr: 
Parameter validation failed:
Unknown parameter in BlockDeviceMappings[0].Ebs: "Throughput", must be one of: DeleteOnTermination, Iops, SnapshotId, VolumeSize, VolumeType, KmsKeyId, Encrypted: exit status 252

Parameters: ROACHTEST_arch=amd64 , ROACHTEST_cloud=aws , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #108653 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-23.1.9-rc release-blocker] - #108629 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ 76ea9a2b98758fd056d6d5366b9734dce9a337fd:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:725).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n2-standard-8 --labels usage=roachtest,roachprod=true,cluster=teamcity-11308711-1691991932-150-n9cpu8-geo,lifetime=12h0m0s,arch=amd64,created=2023-08-14t17_31_35z --metadata-from-file startup-script=/tmp/gce-startup-script915985337 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-west-2b teamcity-11308711-1691991932-150-n9cpu8-geo-0004 teamcity-11308711-1691991932-150-n9cpu8-geo-0005 teamcity-11308711-1691991932-150-n9cpu8-geo-0006]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/us-west-2b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #108653 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-23.1.9-rc release-blocker] - #108629 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ 6d20f93562a6a78c8a4c4dc84ceb4167376b8faf:

test restore/tpce/8TB/aws/nodes=10/cpus=8 was skipped due to (test_runner.go:725).runWorker: in provider: aws: failed to run: aws ec2 run-instances --associate-public-ip-address --count 1 --instance-type c6i.2xlarge --image-id ami-0a14db46282743a66 --key-name teamcity-runner-KSBu_RUhe3pC1cD8ugpcRHonwsc= --region us-east-2 --security-group-ids sg-0319fc9c9599a6145 --subnet-id subnet-004c6ad7121a8d5a7 --tag-specifications ResourceType=instance,Tags=[{Key=usage,Value=roachtest},{Key=Roachprod,Value=true},{Key=Cluster,Value=teamcity-11324178-1692078125-28-n10cpu8},{Key=Lifetime,Value=12h0m0s},{Key=arch,Value=amd64},{Key=Created,Value=2023-08-15T07:58:22Z},{Key=Name,Value=teamcity-11324178-1692078125-28-n10cpu8-0002}] ResourceType=volume,Tags=[{Key=usage,Value=roachtest},{Key=Roachprod,Value=true},{Key=Cluster,Value=teamcity-11324178-1692078125-28-n10cpu8},{Key=Lifetime,Value=12h0m0s},{Key=arch,Value=amd64},{Key=Created,Value=2023-08-15T07:58:22Z},{Key=Name,Value=teamcity-11324178-1692078125-28-n10cpu8-0002}] --user-data file:///tmp/aws-startup-script1430701466 --iam-instance-profile Name=roachprod-testing --block-device-mapping file:///tmp/aws-block-device-mapping1022840563 --output json: stderr: 
Parameter validation failed:
Unknown parameter in BlockDeviceMappings[0].Ebs: "Throughput", must be one of: DeleteOnTermination, Iops, SnapshotId, VolumeSize, VolumeType, KmsKeyId, Encrypted: exit status 252

Parameters: ROACHTEST_arch=amd64 , ROACHTEST_cloud=aws , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #108653 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-23.1.9-rc release-blocker] - #108629 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ 6d20f93562a6a78c8a4c4dc84ceb4167376b8faf:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:725).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n2-standard-8 --labels usage=roachtest,roachprod=true,cluster=teamcity-11324177-1692078142-143-n9cpu8-geo,lifetime=12h0m0s,arch=amd64,created=2023-08-15t17_05_10z --metadata-from-file startup-script=/tmp/gce-startup-script875288865 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-west-2b teamcity-11324177-1692078142-143-n9cpu8-geo-0004 teamcity-11324177-1692078142-143-n9cpu8-geo-0005 teamcity-11324177-1692078142-143-n9cpu8-geo-0006]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/us-west-2b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #108653 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-23.1.9-rc release-blocker] - #108629 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot T-testeng branch-master]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ 10cbcf7497b4e56d43b6c461a10787a4a4fb9ca4:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:725).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n2-standard-8 --labels usage=roachtest,arch=amd64,created=2023-08-16t17_13_06z,roachprod=true,cluster=teamcity-11339567-1692164629-141-n9cpu8-geo,lifetime=12h0m0s --metadata-from-file startup-script=/tmp/gce-startup-script3229083532 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-east-2b teamcity-11339567-1692164629-141-n9cpu8-geo-0001 teamcity-11339567-1692164629-141-n9cpu8-geo-0002 teamcity-11339567-1692164629-141-n9cpu8-geo-0003]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/us-east-2b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #108653 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-23.1.9-rc release-blocker] - #108629 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng branch-master] - #87695 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng branch-release-22.2]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ e0e71af3fc0d357968e5dc46ca95d881bc8937e4:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:725).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n2-standard-8 --labels usage=roachtest,arch=amd64,created=2023-08-17t16_57_08z,roachprod=true,cluster=teamcity-11354773-1692250972-138-n9cpu8-geo,lifetime=12h0m0s --metadata-from-file startup-script=/tmp/gce-startup-script2126132351 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-west-2b teamcity-11354773-1692250972-138-n9cpu8-geo-0004 teamcity-11354773-1692250972-138-n9cpu8-geo-0005 teamcity-11354773-1692250972-138-n9cpu8-geo-0006]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/us-west-2b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #108859 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2 release-blocker] - #108653 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-23.1.9-rc release-blocker] - #108629 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng branch-master] - #87695 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng branch-release-22.2]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ 8013532fc7ad7ff447751b36744a5588c7456d06:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:725).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n2-standard-8 --labels usage=roachtest,roachprod=true,cluster=teamcity-11373161-1692337433-147-n9cpu8-geo,lifetime=12h0m0s,arch=amd64,created=2023-08-18t17_39_55z --metadata-from-file startup-script=/tmp/gce-startup-script4170085607 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-east-2b teamcity-11373161-1692337433-147-n9cpu8-geo-0001 teamcity-11373161-1692337433-147-n9cpu8-geo-0002 teamcity-11373161-1692337433-147-n9cpu8-geo-0003]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/us-east-2b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #108859 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2 release-blocker] - #108653 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-23.1.9-rc release-blocker] - #108629 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng branch-master] - #87695 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng branch-release-22.2]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ a15babbc6871749568b50206b124680aac937191:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:725).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n2-standard-8 --labels usage=roachtest,roachprod=true,cluster=teamcity-11390683-1692423820-155-n9cpu8-geo,lifetime=12h0m0s,arch=amd64,created=2023-08-19t17_53_58z --metadata-from-file startup-script=/tmp/gce-startup-script3271799588 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-west-2b teamcity-11390683-1692423820-155-n9cpu8-geo-0004 teamcity-11390683-1692423820-155-n9cpu8-geo-0005 teamcity-11390683-1692423820-155-n9cpu8-geo-0006]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/us-west-2b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #108859 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2 release-blocker] - #108653 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-23.1.9-rc release-blocker] - #108629 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng branch-master] - #87695 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng branch-release-22.2]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ b3c4b5c9f282a9f44b455cb61cc7498b45bd258f:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:725).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n2-standard-8 --labels usage=roachtest,roachprod=true,cluster=teamcity-11400825-1692510126-139-n9cpu8-geo,lifetime=12h0m0s,arch=amd64,created=2023-08-20t17_21_30z --metadata-from-file startup-script=/tmp/gce-startup-script654235329 --project cockroach-ephemeral --boot-disk-size=32GB --zone eu-west-1b teamcity-11400825-1692510126-139-n9cpu8-geo-0007 teamcity-11400825-1692510126-139-n9cpu8-geo-0008 teamcity-11400825-1692510126-139-n9cpu8-geo-0009]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/eu-west-1b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #108859 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-22.2 release-blocker] - #108653 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-23.1.9-rc release-blocker] - #108629 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng branch-master] - #87695 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng branch-release-22.2]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ 82c797305a9cbfd55f33091f5148ab6e913281e0:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:725).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n2-standard-8 --labels usage=roachtest,lifetime=12h0m0s,arch=amd64,created=2023-08-21t17_29_05z,roachprod=true,cluster=teamcity-11410888-1692596609-144-n9cpu8-geo --metadata-from-file startup-script=/tmp/gce-startup-script1951702425 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-east-2b teamcity-11410888-1692596609-144-n9cpu8-geo-0001 teamcity-11410888-1692596609-144-n9cpu8-geo-0002 teamcity-11410888-1692596609-144-n9cpu8-geo-0003]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/us-east-2b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #109155 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-23.1.9-rc release-blocker] - #108859 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-22.2] - #108653 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.1.9-rc] - #108629 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-master]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ 2fc54d40f4d04230c2365f10854acd3a8d7984c3:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:745).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n2-standard-8 --labels usage=roachtest,cluster=teamcity-11429810-1692682970-161-n9cpu8-geo,lifetime=12h0m0s,arch=amd64,created=2023-08-22t18_07_03z,roachprod=true --metadata-from-file startup-script=/tmp/gce-startup-script360616035 --project cockroach-ephemeral --boot-disk-size=32GB --zone eu-west-1b teamcity-11429810-1692682970-161-n9cpu8-geo-0007 teamcity-11429810-1692682970-161-n9cpu8-geo-0008 teamcity-11429810-1692682970-161-n9cpu8-geo-0009]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/eu-west-1b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #109155 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-23.1.9-rc release-blocker] - #108859 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-22.2] - #108653 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.1.9-rc] - #108629 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-master]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ 2fc54d40f4d04230c2365f10854acd3a8d7984c3:

test roachmart/partition=true was skipped due to (test_runner.go:745).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n2-standard-4 --labels usage=roachtest,roachprod=true,cluster=teamcity-11429810-1692682970-158-n9cpu4-geo,lifetime=12h0m0s,arch=amd64,created=2023-08-22t18_06_04z --metadata-from-file startup-script=/tmp/gce-startup-script2300657933 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-central1-b teamcity-11429810-1692682970-158-n9cpu4-geo-0001 teamcity-11429810-1692682970-158-n9cpu4-geo-0002 teamcity-11429810-1692682970-158-n9cpu4-geo-0003]
Output: Created [https://www.googleapis.com/compute/v1/projects/cockroach-ephemeral/zones/us-central1-b/instances/teamcity-11429810-1692682970-158-n9cpu4-geo-0001].
Created [https://www.googleapis.com/compute/v1/projects/cockroach-ephemeral/zones/us-central1-b/instances/teamcity-11429810-1692682970-158-n9cpu4-geo-0002].
WARNING: Some requests generated warnings:
 - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
 - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20230817'.
ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Quota 'LOCAL_SSD_TOTAL_GB_PER_VM_FAMILY' exceeded.  Limit: 99568.0 in region us-central1.
    metric name = compute.googleapis.com/local_ssd_total_storage_per_vm_family
    limit name = LOCAL-SSD-TOTAL-GB-PER-VM-FAMILY-per-project-region
    limit = 99568.0
    dimensions = region: us-central1
vm_family: N2
Try your request in another zone, or view documentation on how to increase quotas: https://cloud.google.com/compute/quotas.: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=4 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #109155 roachtest: cluster_creation failed [C-test-failure O-roachtest O-robot branch-release-23.1.9-rc release-blocker] - #108859 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-22.2] - #108653 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.1.9-rc] - #108629 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-master]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ d7c6fdbd29c808734f79d685892cb6b7b68df15d:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:745).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n2-standard-8 --labels usage=roachtest,arch=amd64,created=2023-08-23t18_05_55z,roachprod=true,cluster=teamcity-11449071-1692769380-149-n9cpu8-geo,lifetime=12h0m0s --metadata-from-file startup-script=/tmp/gce-startup-script2179225980 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-west-2b teamcity-11449071-1692769380-149-n9cpu8-geo-0004 teamcity-11449071-1692769380-149-n9cpu8-geo-0005 teamcity-11449071-1692769380-149-n9cpu8-geo-0006]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/us-west-2b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #108859 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-22.2] - #108653 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.1.9-rc] - #108629 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-master]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ e6d0a5283b82a9d5485101bf3508c16b1597f085:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:745).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n2-standard-8 --labels usage=roachtest,arch=amd64,created=2023-08-24t18_18_37z,roachprod=true,cluster=teamcity-11467132-1692855761-154-n9cpu8-geo,lifetime=12h0m0s --metadata-from-file startup-script=/tmp/gce-startup-script3252083262 --project cockroach-ephemeral --boot-disk-size=32GB --zone eu-west-1b teamcity-11467132-1692855761-154-n9cpu8-geo-0007 teamcity-11467132-1692855761-154-n9cpu8-geo-0008 teamcity-11467132-1692855761-154-n9cpu8-geo-0009]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/eu-west-1b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #108859 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-22.2] - #108653 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.1.9-rc] - #108629 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-master]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ b151af8ea747b3dcd7aebfc1aa0c6d5ed2bc5708:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:745).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n2-standard-8 --labels usage=roachtest,roachprod=true,cluster=teamcity-11485027-1692942210-164-n9cpu8-geo,lifetime=12h0m0s,arch=amd64,created=2023-08-25t18_31_00z --metadata-from-file startup-script=/tmp/gce-startup-script2703419140 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-west-2b teamcity-11485027-1692942210-164-n9cpu8-geo-0004 teamcity-11485027-1692942210-164-n9cpu8-geo-0005 teamcity-11485027-1692942210-164-n9cpu8-geo-0006]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/us-west-2b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #108859 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-22.2] - #108653 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.1.9-rc] - #108629 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-master]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ e9a99ca5edea2d3f838467323355be76d9d3ec92:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:745).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n2-standard-8 --labels usage=roachtest,roachprod=true,cluster=teamcity-11499580-1693028530-151-n9cpu8-geo,lifetime=12h0m0s,arch=amd64,created=2023-08-26t18_07_59z --metadata-from-file startup-script=/tmp/gce-startup-script3954308696 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-west-2b teamcity-11499580-1693028530-151-n9cpu8-geo-0004 teamcity-11499580-1693028530-151-n9cpu8-geo-0005 teamcity-11499580-1693028530-151-n9cpu8-geo-0006]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/us-west-2b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #108859 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-22.2] - #108653 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.1.9-rc] - #108629 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-master]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ e9a99ca5edea2d3f838467323355be76d9d3ec92:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:745).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n2-standard-8 --labels usage=roachtest,roachprod=true,cluster=teamcity-11508355-1693115043-159-n9cpu8-geo,lifetime=12h0m0s,arch=amd64,created=2023-08-27t18_04_53z --metadata-from-file startup-script=/tmp/gce-startup-script3105134968 --project cockroach-ephemeral --boot-disk-size=32GB --zone eu-west-1b teamcity-11508355-1693115043-159-n9cpu8-geo-0007 teamcity-11508355-1693115043-159-n9cpu8-geo-0008 teamcity-11508355-1693115043-159-n9cpu8-geo-0009]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/eu-west-1b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #108859 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-22.2] - #108653 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.1.9-rc] - #108629 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-master]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ e9a99ca5edea2d3f838467323355be76d9d3ec92:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:745).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n2-standard-8 --labels usage=roachtest,created=2023-08-28t18_21_37z,roachprod=true,cluster=teamcity-11516841-1693201411-158-n9cpu8-geo,lifetime=12h0m0s,arch=amd64 --metadata-from-file startup-script=/tmp/gce-startup-script55622194 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-west-2b teamcity-11516841-1693201411-158-n9cpu8-geo-0004 teamcity-11516841-1693201411-158-n9cpu8-geo-0005 teamcity-11516841-1693201411-158-n9cpu8-geo-0006]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/us-west-2b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #108859 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-22.2] - #108653 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.1.9-rc] - #108629 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-master]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ e6e624c3cdbc1748826e4c37a988e7685630a82e:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:745).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n2-standard-8 --labels usage=roachtest,roachprod=true,cluster=teamcity-11548471-1693374204-161-n9cpu8-geo,lifetime=12h0m0s,arch=amd64,created=2023-08-30t18_03_09z --metadata-from-file startup-script=/tmp/gce-startup-script2135903546 --project cockroach-ephemeral --boot-disk-size=32GB --zone eu-west-1b teamcity-11548471-1693374204-161-n9cpu8-geo-0007 teamcity-11548471-1693374204-161-n9cpu8-geo-0008 teamcity-11548471-1693374204-161-n9cpu8-geo-0009]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/eu-west-1b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #108859 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-22.2] - #108653 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.1.9-rc] - #108629 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-master]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ e6e624c3cdbc1748826e4c37a988e7685630a82e:

test tpcc/multiregion/survive=region/chaos=true was skipped due to (test_runner.go:745).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n2-standard-4 --labels usage=roachtest,created=2023-08-30t18_25_21z,roachprod=true,cluster=teamcity-11548471-1693374204-175-n10cpu4-geo,lifetime=12h0m0s,arch=amd64 --metadata-from-file startup-script=/tmp/gce-startup-script1897688459 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-east1-b teamcity-11548471-1693374204-175-n10cpu4-geo-0001 teamcity-11548471-1693374204-175-n10cpu4-geo-0002 teamcity-11548471-1693374204-175-n10cpu4-geo-0003 teamcity-11548471-1693374204-175-n10cpu4-geo-0010]
Output: WARNING: Some requests generated warnings:
 - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
 - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20210603' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20230817'.
ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Quota 'LOCAL_SSD_TOTAL_GB_PER_VM_FAMILY' exceeded.  Limit: 400000.0 in region us-east1.
    metric name = compute.googleapis.com/local_ssd_total_storage_per_vm_family
    limit name = LOCAL-SSD-TOTAL-GB-PER-VM-FAMILY-per-project-region
    limit = 400000.0
    dimensions = region: us-east1
vm_family: N2
Try your request in another zone, or view documentation on how to increase quotas: https://cloud.google.com/compute/quotas.: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=4 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #108859 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-22.2] - #108653 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.1.9-rc] - #108629 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-master]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ 953350ffadaebf2e33f4aff3cf95a5e2e8b69d5f:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:745).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n2-standard-8 --labels usage=roachtest,created=2023-08-31t17_51_59z,roachprod=true,cluster=teamcity-11564547-1693460547-153-n9cpu8-geo,lifetime=12h0m0s,arch=amd64 --metadata-from-file startup-script=/tmp/gce-startup-script3154591586 --project cockroach-ephemeral --boot-disk-size=32GB --zone eu-west-1b teamcity-11564547-1693460547-153-n9cpu8-geo-0007 teamcity-11564547-1693460547-153-n9cpu8-geo-0008 teamcity-11564547-1693460547-153-n9cpu8-geo-0009]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/eu-west-1b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #108859 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-22.2] - #108653 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.1.9-rc] - #108629 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-master]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ d762d323b40b09feba4604e5c9c475614fd21b0c:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:745).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20210603 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n2-standard-8 --labels usage=roachtest,roachprod=true,cluster=teamcity-11581541-1693547132-153-n9cpu8-geo,lifetime=12h0m0s,arch=amd64,created=2023-09-01t17_47_11z --metadata-from-file startup-script=/tmp/gce-startup-script3220619153 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-west-2b teamcity-11581541-1693547132-153-n9cpu8-geo-0004 teamcity-11581541-1693547132-153-n9cpu8-geo-0005 teamcity-11581541-1693547132-153-n9cpu8-geo-0006]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/us-west-2b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #108859 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-22.2] - #108653 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.1.9-rc] - #108629 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-master]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ 58ac87a9b24e1cfb446143dafe04808ea186637f:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:745).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20230817 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n2-standard-8 --labels usage=roachtest,roachprod=true,cluster=teamcity-11597408-1693633324-149-n9cpu8-geo,lifetime=12h0m0s,arch=amd64,created=2023-09-02t17_55_01z --metadata-from-file startup-script=/tmp/gce-startup-script2874798377 --project cockroach-ephemeral --boot-disk-size=32GB --zone eu-west-1b teamcity-11597408-1693633324-149-n9cpu8-geo-0007 teamcity-11597408-1693633324-149-n9cpu8-geo-0008 teamcity-11597408-1693633324-149-n9cpu8-geo-0009]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/eu-west-1b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #109964 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.1.9-rc] - #108859 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-22.2] - #108653 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.1.9-rc.FROZEN] - #108629 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-master]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ 58ac87a9b24e1cfb446143dafe04808ea186637f:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:745).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20230817 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n2-standard-8 --labels usage=roachtest,roachprod=true,cluster=teamcity-11606168-1693719834-149-n9cpu8-geo,lifetime=12h0m0s,arch=amd64,created=2023-09-03t17_42_25z --metadata-from-file startup-script=/tmp/gce-startup-script908749510 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-east-2b teamcity-11606168-1693719834-149-n9cpu8-geo-0001 teamcity-11606168-1693719834-149-n9cpu8-geo-0002 teamcity-11606168-1693719834-149-n9cpu8-geo-0003]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/us-east-2b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #109964 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.1.9-rc] - #108859 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-22.2] - #108653 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.1.9-rc.FROZEN] - #108629 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-master]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ fde98bbb2423906a7e3bfd9cd7956bc3f29918ad:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:745).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20230817 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n2-standard-8 --labels usage=roachtest,arch=amd64,created=2023-09-04t17_52_24z,roachprod=true,cluster=teamcity-11616147-1693806253-149-n9cpu8-geo,lifetime=12h0m0s --metadata-from-file startup-script=/tmp/gce-startup-script1127580313 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-east-2b teamcity-11616147-1693806253-149-n9cpu8-geo-0001 teamcity-11616147-1693806253-149-n9cpu8-geo-0002 teamcity-11616147-1693806253-149-n9cpu8-geo-0003]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/us-east-2b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #109982 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.1.10-rc] - #109964 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.1.9-rc] - #108859 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-22.2] - #108653 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.1.9-rc.FROZEN] - #108629 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-master]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ fde98bbb2423906a7e3bfd9cd7956bc3f29918ad:

test ycsb/A/nodes=3/cpu=32/mvcc-range-keys=global was skipped due to (test_runner.go:745).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20230817 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --local-ssd interface=NVME --local-ssd interface=NVME --local-ssd interface=NVME --machine-type n2-highcpu-32 --labels usage=roachtest,roachprod=true,cluster=teamcity-11616147-1693806253-166-n4cpu32,lifetime=12h0m0s,arch=amd64,created=2023-09-04t18_16_56z --metadata-from-file startup-script=/tmp/gce-startup-script1423638021 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-east1-b teamcity-11616147-1693806253-166-n4cpu32-0001 teamcity-11616147-1693806253-166-n4cpu32-0002 teamcity-11616147-1693806253-166-n4cpu32-0003 teamcity-11616147-1693806253-166-n4cpu32-0004]
Output: WARNING: Some requests generated warnings:
 - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
 - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20230817' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20230831'.
ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Quota 'LOCAL_SSD_TOTAL_GB_PER_VM_FAMILY' exceeded.  Limit: 400000.0 in region us-east1.
    metric name = compute.googleapis.com/local_ssd_total_storage_per_vm_family
    limit name = LOCAL-SSD-TOTAL-GB-PER-VM-FAMILY-per-project-region
    limit = 400000.0
    dimensions = region: us-east1
vm_family: N2
Try your request in another zone, or view documentation on how to increase quotas: https://cloud.google.com/compute/quotas.: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=32 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #109982 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.1.10-rc] - #109964 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.1.9-rc] - #108859 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-22.2] - #108653 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.1.9-rc.FROZEN] - #108629 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-master]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ fde98bbb2423906a7e3bfd9cd7956bc3f29918ad:

test zfs/ycsb/A/nodes=3/cpu=8 was skipped due to (test_runner.go:745).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20230817 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --machine-type n2-standard-8 --labels usage=roachtest,roachprod=true,cluster=teamcity-11616147-1693806253-176-n4cpu8,lifetime=12h0m0s,arch=amd64,created=2023-09-04t18_35_35z --metadata-from-file startup-script=/tmp/gce-startup-script1504390380 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-east1-b teamcity-11616147-1693806253-176-n4cpu8-0001 teamcity-11616147-1693806253-176-n4cpu8-0002 teamcity-11616147-1693806253-176-n4cpu8-0003 teamcity-11616147-1693806253-176-n4cpu8-0004]
Output: Created [https://www.googleapis.com/compute/v1/projects/cockroach-ephemeral/zones/us-east1-b/instances/teamcity-11616147-1693806253-176-n4cpu8-0001].
Created [https://www.googleapis.com/compute/v1/projects/cockroach-ephemeral/zones/us-east1-b/instances/teamcity-11616147-1693806253-176-n4cpu8-0002].
WARNING: Some requests generated warnings:
 - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
 - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20230817' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20230831'.
ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Quota 'LOCAL_SSD_TOTAL_GB_PER_VM_FAMILY' exceeded.  Limit: 400000.0 in region us-east1.
    metric name = compute.googleapis.com/local_ssd_total_storage_per_vm_family
    limit name = LOCAL-SSD-TOTAL-GB-PER-VM-FAMILY-per-project-region
    limit = 400000.0
    dimensions = region: us-east1
vm_family: N2
Try your request in another zone, or view documentation on how to increase quotas: https://cloud.google.com/compute/quotas.: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #109982 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.1.10-rc] - #109964 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.1.9-rc] - #108859 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-22.2] - #108653 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.1.9-rc.FROZEN] - #108629 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-master]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ 6e34fffddbb0a88612b712ec5d41e4781d130bab:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:745).runWorker: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20230817 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n2-standard-8 --labels usage=roachtest,cluster=teamcity-11626659-1693892641-149-n9cpu8-geo,lifetime=12h0m0s,arch=amd64,created=2023-09-05t17_54_45z,roachprod=true --metadata-from-file startup-script=/tmp/gce-startup-script326798068 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-west-2b teamcity-11626659-1693892641-149-n9cpu8-geo-0004 teamcity-11626659-1693892641-149-n9cpu8-geo-0005 teamcity-11626659-1693892641-149-n9cpu8-geo-0006]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/us-west-2b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #109982 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.1.10-rc] - #109964 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.1.9-rc] - #108859 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-22.2] - #108653 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.1.9-rc.FROZEN] - #108629 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-master]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ 6db39099511584d8b41094237f5b26333fb4c7be:

test acceptance/gossip/locality-address was skipped due to (test_runner.go:746).func5: cluster.PutE: put /go/src/github.com/cockroachdb/cockroach/bin/cockroach.linux-amd64 failed: ~ scp -r -C -o StrictHostKeyChecking=no -o ConnectTimeout=10 -i /home/roach/.ssh/id_rsa -i /home/roach/.ssh/google_compute_engine ubuntu@34.75.128.13:./cockroach-default ubuntu@34.75.36.146:./cockroach-default
ubuntu@34.75.36.146: Permission denied (publickey).
lost connection: exit status 1

Parameters: ROACHTEST_arch=amd64 , ROACHTEST_cloud=gce , ROACHTEST_cpu=4 , ROACHTEST_encrypted=false , ROACHTEST_fs=ext4 , ROACHTEST_localSSD=true , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7) See: [Grafana](https://go.crdb.dev/p/roachfana/teamcity-11645260-1693979025-13-n4cpu4/-62135596800000/-62135596800000)

Same failure on other branches

- #109982 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.1.10-rc] - #109964 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.1.9-rc] - #108859 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-22.2] - #108653 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.1.9-rc.FROZEN] - #108629 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-master]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ 6db39099511584d8b41094237f5b26333fb4c7be:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:746).func5: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20230817 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n2-standard-8 --labels usage=roachtest,roachprod=true,cluster=teamcity-11645260-1693979025-146-n9cpu8-geo,lifetime=12h0m0s,arch=amd64,created=2023-09-06t17_35_19z --metadata-from-file startup-script=/tmp/gce-startup-script25373910 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-west-2b teamcity-11645260-1693979025-146-n9cpu8-geo-0004 teamcity-11645260-1693979025-146-n9cpu8-geo-0005 teamcity-11645260-1693979025-146-n9cpu8-geo-0006]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/us-west-2b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #109982 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.1.10-rc] - #109964 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.1.9-rc] - #108859 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-22.2] - #108653 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.1.9-rc.FROZEN] - #108629 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-master]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ 6db39099511584d8b41094237f5b26333fb4c7be:

test tpcc/headroom/n4cpu16 was skipped due to (test_runner.go:746).func5: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20230817 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --local-ssd interface=NVME --machine-type n2-standard-16 --labels usage=roachtest,roachprod=true,cluster=teamcity-11645260-1693979025-163-n4cpu16,lifetime=12h0m0s,arch=amd64,created=2023-09-06t17_58_23z --metadata-from-file startup-script=/tmp/gce-startup-script2048261790 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-east1-b teamcity-11645260-1693979025-163-n4cpu16-0001 teamcity-11645260-1693979025-163-n4cpu16-0002 teamcity-11645260-1693979025-163-n4cpu16-0003 teamcity-11645260-1693979025-163-n4cpu16-0004]
Output: WARNING: Some requests generated warnings:
 - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
 - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20230817' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20230831'.
ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Quota 'LOCAL_SSD_TOTAL_GB_PER_VM_FAMILY' exceeded.  Limit: 400000.0 in region us-east1.
    metric name = compute.googleapis.com/local_ssd_total_storage_per_vm_family
    limit name = LOCAL-SSD-TOTAL-GB-PER-VM-FAMILY-per-project-region
    limit = 400000.0
    dimensions = region: us-east1
vm_family: N2
Try your request in another zone, or view documentation on how to increase quotas: https://cloud.google.com/compute/quotas.: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=16 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #109982 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.1.10-rc] - #109964 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.1.9-rc] - #108859 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-22.2] - #108653 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.1.9-rc.FROZEN] - #108629 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-master]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ 6db39099511584d8b41094237f5b26333fb4c7be:

test tpcc/mixed-headroom/multiple-upgrades/n5cpu16 was skipped due to (test_runner.go:746).func5: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20230817 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --local-ssd interface=NVME --machine-type n2-standard-16 --labels usage=roachtest,lifetime=12h0m0s,arch=amd64,created=2023-09-06t17_58_34z,roachprod=true,cluster=teamcity-11645260-1693979025-166-n5cpu16 --metadata-from-file startup-script=/tmp/gce-startup-script2105263762 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-east1-b teamcity-11645260-1693979025-166-n5cpu16-0001 teamcity-11645260-1693979025-166-n5cpu16-0002 teamcity-11645260-1693979025-166-n5cpu16-0003 teamcity-11645260-1693979025-166-n5cpu16-0004 teamcity-11645260-1693979025-166-n5cpu16-0005]
Output: WARNING: Some requests generated warnings:
 - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
 - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20230817' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20230831'.
ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Quota 'LOCAL_SSD_TOTAL_GB_PER_VM_FAMILY' exceeded.  Limit: 400000.0 in region us-east1.
    metric name = compute.googleapis.com/local_ssd_total_storage_per_vm_family
    limit name = LOCAL-SSD-TOTAL-GB-PER-VM-FAMILY-per-project-region
    limit = 400000.0
    dimensions = region: us-east1
vm_family: N2
Try your request in another zone, or view documentation on how to increase quotas: https://cloud.google.com/compute/quotas.: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=16 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #109982 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.1.10-rc] - #109964 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.1.9-rc] - #108859 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-22.2] - #108653 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.1.9-rc.FROZEN] - #108629 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-master]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ 6db39099511584d8b41094237f5b26333fb4c7be:

test ycsb/A/nodes=3/cpu=32 was skipped due to (test_runner.go:746).func5: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20230817 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --local-ssd interface=NVME --local-ssd interface=NVME --local-ssd interface=NVME --machine-type n2-highcpu-32 --labels usage=roachtest,lifetime=12h0m0s,arch=amd64,created=2023-09-06t18_03_36z,roachprod=true,cluster=teamcity-11645260-1693979025-178-n4cpu32 --metadata-from-file startup-script=/tmp/gce-startup-script1114966145 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-east1-b teamcity-11645260-1693979025-178-n4cpu32-0001 teamcity-11645260-1693979025-178-n4cpu32-0002 teamcity-11645260-1693979025-178-n4cpu32-0003 teamcity-11645260-1693979025-178-n4cpu32-0004]
Output: Created [https://www.googleapis.com/compute/v1/projects/cockroach-ephemeral/zones/us-east1-b/instances/teamcity-11645260-1693979025-178-n4cpu32-0004].
WARNING: Some requests generated warnings:
 - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
 - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20230817' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20230831'.
ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Quota 'LOCAL_SSD_TOTAL_GB_PER_VM_FAMILY' exceeded.  Limit: 400000.0 in region us-east1.
    metric name = compute.googleapis.com/local_ssd_total_storage_per_vm_family
    limit name = LOCAL-SSD-TOTAL-GB-PER-VM-FAMILY-per-project-region
    limit = 400000.0
    dimensions = region: us-east1
vm_family: N2
Try your request in another zone, or view documentation on how to increase quotas: https://cloud.google.com/compute/quotas.: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=32 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #109982 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.1.10-rc] - #109964 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.1.9-rc] - #108859 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-22.2] - #108653 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.1.9-rc.FROZEN] - #108629 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-master]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ 914e15822b995399c22b12ed7d0bfe1c24503051:

test kv0/enc=false/nodes=3/cpu=96 was skipped due to (test_runner.go:749).func5: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20230817 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --local-ssd interface=NVME --local-ssd interface=NVME --local-ssd interface=NVME --local-ssd interface=NVME --local-ssd interface=NVME --local-ssd interface=NVME --local-ssd interface=NVME --local-ssd interface=NVME --local-ssd interface=NVME --local-ssd interface=NVME --local-ssd interface=NVME --local-ssd interface=NVME --local-ssd interface=NVME --local-ssd interface=NVME --local-ssd interface=NVME --machine-type n2-highcpu-96 --labels usage=roachtest,arch=amd64,created=2023-09-07t18_00_17z,roachprod=true,cluster=teamcity-11663820-1694065556-136-n4cpu96,lifetime=12h0m0s --metadata-from-file startup-script=/tmp/gce-startup-script1955027906 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-east1-b teamcity-11663820-1694065556-136-n4cpu96-0001 teamcity-11663820-1694065556-136-n4cpu96-0002 teamcity-11663820-1694065556-136-n4cpu96-0003 teamcity-11663820-1694065556-136-n4cpu96-0004]
Output: Created [https://www.googleapis.com/compute/v1/projects/cockroach-ephemeral/zones/us-east1-b/instances/teamcity-11663820-1694065556-136-n4cpu96-0001].
Created [https://www.googleapis.com/compute/v1/projects/cockroach-ephemeral/zones/us-east1-b/instances/teamcity-11663820-1694065556-136-n4cpu96-0003].
Created [https://www.googleapis.com/compute/v1/projects/cockroach-ephemeral/zones/us-east1-b/instances/teamcity-11663820-1694065556-136-n4cpu96-0004].
WARNING: Some requests generated warnings:
 - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
 - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20230817' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20230831'.
ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Quota 'LOCAL_SSD_TOTAL_GB_PER_VM_FAMILY' exceeded.  Limit: 400000.0 in region us-east1.
    metric name = compute.googleapis.com/local_ssd_total_storage_per_vm_family
    limit name = LOCAL-SSD-TOTAL-GB-PER-VM-FAMILY-per-project-region
    limit = 400000.0
    dimensions = region: us-east1
vm_family: N2
Try your request in another zone, or view documentation on how to increase quotas: https://cloud.google.com/compute/quotas.: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=96 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #109982 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.1.10-rc] - #108859 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-22.2] - #108653 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.1.9-rc.FROZEN] - #108629 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-master]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ 914e15822b995399c22b12ed7d0bfe1c24503051:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:749).func5: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20230817 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n2-standard-8 --labels usage=roachtest,arch=amd64,created=2023-09-07t18_25_36z,roachprod=true,cluster=teamcity-11663820-1694065556-158-n9cpu8-geo,lifetime=12h0m0s --metadata-from-file startup-script=/tmp/gce-startup-script1820281570 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-west-2b teamcity-11663820-1694065556-158-n9cpu8-geo-0004 teamcity-11663820-1694065556-158-n9cpu8-geo-0005 teamcity-11663820-1694065556-158-n9cpu8-geo-0006]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/us-west-2b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #109982 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.1.10-rc] - #108859 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-22.2] - #108653 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.1.9-rc.FROZEN] - #108629 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-master]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ 914e15822b995399c22b12ed7d0bfe1c24503051:

test ycsb/D/nodes=3/cpu=32 was skipped due to (test_runner.go:749).func5: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20230817 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --local-ssd interface=NVME --local-ssd interface=NVME --local-ssd interface=NVME --machine-type n2-highcpu-32 --labels usage=roachtest,created=2023-09-07t19_46_55z,roachprod=true,cluster=teamcity-11663820-1694065556-172-n4cpu32,lifetime=12h0m0s,arch=amd64 --metadata-from-file startup-script=/tmp/gce-startup-script1250710910 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-east1-b teamcity-11663820-1694065556-172-n4cpu32-0001 teamcity-11663820-1694065556-172-n4cpu32-0002 teamcity-11663820-1694065556-172-n4cpu32-0003 teamcity-11663820-1694065556-172-n4cpu32-0004]
Output: WARNING: Some requests generated warnings:
 - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
 - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20230817' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20230831'.
ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Quota 'LOCAL_SSD_TOTAL_GB_PER_VM_FAMILY' exceeded.  Limit: 400000.0 in region us-east1.
    metric name = compute.googleapis.com/local_ssd_total_storage_per_vm_family
    limit name = LOCAL-SSD-TOTAL-GB-PER-VM-FAMILY-per-project-region
    limit = 400000.0
    dimensions = region: us-east1
vm_family: N2
Try your request in another zone, or view documentation on how to increase quotas: https://cloud.google.com/compute/quotas.: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=32 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #109982 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.1.10-rc] - #108859 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-22.2] - #108653 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.1.9-rc.FROZEN] - #108629 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-master]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ 914e15822b995399c22b12ed7d0bfe1c24503051:

test ycsb/D/nodes=3/cpu=32/mvcc-range-keys=global was skipped due to (test_runner.go:749).func5: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20230817 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --local-ssd interface=NVME --local-ssd interface=NVME --local-ssd interface=NVME --local-ssd interface=NVME --machine-type n2-highcpu-32 --labels usage=roachtest,roachprod=true,cluster=teamcity-11663820-1694065556-175-n4cpu32,lifetime=12h0m0s,arch=amd64,created=2023-09-07t19_49_05z --metadata-from-file startup-script=/tmp/gce-startup-script1439657224 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-east1-b teamcity-11663820-1694065556-175-n4cpu32-0001 teamcity-11663820-1694065556-175-n4cpu32-0002 teamcity-11663820-1694065556-175-n4cpu32-0003 teamcity-11663820-1694065556-175-n4cpu32-0004]
Output: Created [https://www.googleapis.com/compute/v1/projects/cockroach-ephemeral/zones/us-east1-b/instances/teamcity-11663820-1694065556-175-n4cpu32-0002].
Created [https://www.googleapis.com/compute/v1/projects/cockroach-ephemeral/zones/us-east1-b/instances/teamcity-11663820-1694065556-175-n4cpu32-0003].
WARNING: Some requests generated warnings:
 - Disk size: '32 GB' is larger than image size: '10 GB'. You might need to resize the root repartition manually if the operating system does not support automatic resizing. See https://cloud.google.com/compute/docs/disks/add-persistent-disk#resize_pd for details.
 - The resource 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20230817' is deprecated. A suggested replacement is 'projects/ubuntu-os-cloud/global/images/ubuntu-2004-focal-v20230831'.
ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Quota 'LOCAL_SSD_TOTAL_GB_PER_VM_FAMILY' exceeded.  Limit: 400000.0 in region us-east1.
    metric name = compute.googleapis.com/local_ssd_total_storage_per_vm_family
    limit name = LOCAL-SSD-TOTAL-GB-PER-VM-FAMILY-per-project-region
    limit = 400000.0
    dimensions = region: us-east1
vm_family: N2
Try your request in another zone, or view documentation on how to increase quotas: https://cloud.google.com/compute/quotas.: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=32 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #109982 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.1.10-rc] - #108859 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-22.2] - #108653 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.1.9-rc.FROZEN] - #108629 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-master]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ 4f16f07f201f2c2c601ce8baba0107d1f5453aad:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:749).func5: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20230817 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n2-standard-8 --labels usage=roachtest,arch=amd64,created=2023-09-08t17_59_49z,roachprod=true,cluster=teamcity-11682551-1694151950-149-n9cpu8-geo,lifetime=12h0m0s --metadata-from-file startup-script=/tmp/gce-startup-script348005127 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-west-2b teamcity-11682551-1694151950-149-n9cpu8-geo-0004 teamcity-11682551-1694151950-149-n9cpu8-geo-0005 teamcity-11682551-1694151950-149-n9cpu8-geo-0006]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/us-west-2b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #109982 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.1.10-rc] - #108859 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-22.2] - #108653 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.1.9-rc.FROZEN] - #108629 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-master]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ 50c96a6208c5a211a6174654ac3dd6487a046006:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:749).func5: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20230817 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n2-standard-8 --labels usage=roachtest,roachprod=true,cluster=teamcity-11699970-1694238291-157-n9cpu8-geo,lifetime=12h0m0s,arch=amd64,created=2023-09-09t18_23_17z --metadata-from-file startup-script=/tmp/gce-startup-script1411225511 --project cockroach-ephemeral --boot-disk-size=32GB --zone us-west-2b teamcity-11699970-1694238291-157-n9cpu8-geo-0004 teamcity-11699970-1694238291-157-n9cpu8-geo-0005 teamcity-11699970-1694238291-157-n9cpu8-geo-0006]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/us-west-2b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #109982 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.1.10-rc] - #108859 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-22.2] - #108653 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.1.9-rc.FROZEN] - #108629 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-master]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ 50c96a6208c5a211a6174654ac3dd6487a046006:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:749).func5: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20230817 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n2-standard-8 --labels usage=roachtest,roachprod=true,cluster=teamcity-11709011-1694324692-156-n9cpu8-geo,lifetime=12h0m0s,arch=amd64,created=2023-09-10t18_22_43z --metadata-from-file startup-script=/tmp/gce-startup-script250063347 --project cockroach-ephemeral --boot-disk-size=32GB --zone eu-west-1b teamcity-11709011-1694324692-156-n9cpu8-geo-0007 teamcity-11709011-1694324692-156-n9cpu8-geo-0008 teamcity-11709011-1694324692-156-n9cpu8-geo-0009]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/eu-west-1b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #109982 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.1.10-rc] - #108859 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-22.2] - #108653 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.1.9-rc.FROZEN] - #108629 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-master]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ 50c96a6208c5a211a6174654ac3dd6487a046006:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:749).func5: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20230817 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n2-standard-8 --labels usage=roachtest,roachprod=true,cluster=teamcity-11717233-1694411069-160-n9cpu8-geo,lifetime=12h0m0s,arch=amd64,created=2023-09-11t18_30_51z --metadata-from-file startup-script=/tmp/gce-startup-script2438396409 --project cockroach-ephemeral --boot-disk-size=32GB --zone eu-west-1b teamcity-11717233-1694411069-160-n9cpu8-geo-0007 teamcity-11717233-1694411069-160-n9cpu8-geo-0008 teamcity-11717233-1694411069-160-n9cpu8-geo-0009]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/eu-west-1b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #109982 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.1.10-rc] - #108859 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-22.2] - #108653 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.1.9-rc.FROZEN] - #108629 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-master]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 year ago

roachtest.cluster_creation failed with artifacts on release-23.1 @ a3573e6b39530731621f90717649feac2c5dd47e:

test restore/tpce/400GB/aws/nodes=9/cpus=8/zones=us-east-2b,us-west-2b,eu-west-1b was skipped due to (test_runner.go:749).func5: in provider: gce: Command: gcloud [compute instances create --subnet default --scopes cloud-platform --image ubuntu-2004-focal-v20230817 --image-project ubuntu-os-cloud --boot-disk-type pd-ssd --service-account 21965078311-compute@developer.gserviceaccount.com --maintenance-policy MIGRATE --create-disk type=pd-ssd,size=1000GB,auto-delete=yes --machine-type n2-standard-8 --labels usage=roachtest,roachprod=true,cluster=teamcity-11734765-1694497412-158-n9cpu8-geo,lifetime=12h0m0s,arch=amd64,created=2023-09-12t18_17_34z --metadata-from-file startup-script=/tmp/gce-startup-script2831988243 --project cockroach-ephemeral --boot-disk-size=32GB --zone eu-west-1b teamcity-11734765-1694497412-158-n9cpu8-geo-0007 teamcity-11734765-1694497412-158-n9cpu8-geo-0008 teamcity-11734765-1694497412-158-n9cpu8-geo-0009]
Output: ERROR: (gcloud.compute.instances.create) Could not fetch resource:
 - Permission denied on 'locations/eu-west-1b' (or it may not exist).: exit status 1

Parameters: ROACHTEST_cloud=gce , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

Same failure on other branches

- #109982 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.1.10-rc] - #108859 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-22.2] - #108653 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.1.9-rc.FROZEN] - #108629 roachtest: cluster_creation failed [O-roachtest O-robot T-testeng X-infra-flake branch-master]

This test on roachdash | Improve this report!

cockroachdb / cockroach

roachtest: cluster_creation failed #108533