search

cockroachdb / cockroach

CockroachDB — the cloud native, distributed SQL database designed for high availability, effortless scale, and control over data placement.
https://www.cockroachlabs.com
Other
30.02k stars 3.79k forks source link

roachtest: dns_problem failed #121092

Open cockroach-teamcity opened 6 months ago

cockroach-teamcity commented 6 months ago

roachtest.dns_problem failed with artifacts on release-23.1 @ 4abad13e2803a8c06f31b24966241e1dfa7812a6:

test kv/splits/nodes=3/quiesce=false/lease=expiration failed: (cluster.go:2038).Start: in provider: gce: output: ERROR: (gcloud.dns.record-sets.create) HTTPError 409: The resource 'entity.rrset' named '_system-ui._tcp.teamcity-14559447-1711430645-15-n4cpu4.roachprod-managed.crdb.io. (SRV)' already exists: exit status 1
test artifacts and logs in: /artifacts/kv/splits/nodes=3/quiesce=false/lease=expiration/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

See: Grafana

Same failure on other branches

- #121091 roachtest: dns_problem failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.1.18-rc] - #121090 roachtest: dns_problem failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.2] - #120959 roachtest: dns_problem failed [O-roachtest O-robot T-testeng X-infra-flake branch-master] - #120131 roachtest: dns_problem failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.2.3-rc]

/cc @cockroachdb/test-eng

This test on roachdash | Improve this report!

Jira issue: CRDB-37064

cockroach-teamcity commented 6 months ago

roachtest.dns_problem failed with artifacts on release-23.1 @ 4abad13e2803a8c06f31b24966241e1dfa7812a6:

test drain/not-at-quorum failed: (cluster.go:2038).Start: in provider: gce: output: ERROR: (gcloud.dns.record-sets.create) HTTPError 409: The resource 'entity.rrset' named '_system-sql._tcp.teamcity-14559447-1711430645-03-n3cpu4.roachprod-managed.crdb.io. (SRV)' already exists: exit status 1
test artifacts and logs in: /artifacts/drain/not-at-quorum/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

See: Grafana

Same failure on other branches

- #121094 roachtest: dns_problem failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.2.4-rc] - #121093 roachtest: dns_problem failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.2.4-rc] - #121091 roachtest: dns_problem failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.1.18-rc] - #121090 roachtest: dns_problem failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.2] - #120959 roachtest: dns_problem failed [O-roachtest O-robot T-testeng X-infra-flake branch-master] - #120131 roachtest: dns_problem failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.2.3-rc]

This test on roachdash | Improve this report!

cockroach-teamcity commented 6 months ago

roachtest.dns_problem failed with artifacts on release-23.1 @ 4abad13e2803a8c06f31b24966241e1dfa7812a6:

test kv/splits/nodes=3/quiesce=true/lease=epoch failed: (cluster.go:2038).Start: in provider: gce: output: ERROR: (gcloud.dns.record-sets.create) HTTPError 409: The resource 'entity.rrset' named '_system-sql._tcp.teamcity-14559447-1711430645-08-n4cpu4.roachprod-managed.crdb.io. (SRV)' already exists: exit status 1
test artifacts and logs in: /artifacts/kv/splits/nodes=3/quiesce=true/lease=epoch/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

See: Grafana

Same failure on other branches

- #121094 roachtest: dns_problem failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.2.4-rc] - #121093 roachtest: dns_problem failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.2.4-rc] - #121091 roachtest: dns_problem failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.1.18-rc] - #121090 roachtest: dns_problem failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.2] - #120959 roachtest: dns_problem failed [O-roachtest O-robot T-testeng X-infra-flake branch-master] - #120131 roachtest: dns_problem failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.2.3-rc]

This test on roachdash | Improve this report!

cockroach-teamcity commented 5 months ago

roachtest.dns_problem failed with artifacts on release-23.1 @ 4da457363a79a81f07f891c6bdab82dc4ac00967:

test failover/partial/lease-leader failed: (cluster.go:2042).Start: output: ERROR: (gcloud.dns.record-sets.list) HTTPError 400: Invalid value for 'parameters.project': 'cockroach-shared'
[]: exit status 1
(cluster.go:2144).Run: context canceled
test artifacts and logs in: /artifacts/failover/partial/lease-leader/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

See: Grafana

Same failure on other branches

- #123608 roachtest: dns_problem failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-24.1.0-rc] - #121094 roachtest: dns_problem failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.2.4-rc] - #121093 roachtest: dns_problem failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.2.4-rc] - #121090 roachtest: dns_problem failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.2] - #120959 roachtest: dns_problem failed [O-roachtest O-robot T-testeng X-infra-flake branch-master]

This test on roachdash | Improve this report!

cockroach-teamcity commented 5 months ago

roachtest.dns_problem failed with artifacts on release-23.1 @ bd10e40659d40ea1ff4893df2d27c95e8800fcc2:

test multitenant/distsql/instances=20/bundle=on/timeout=0 failed: (cluster.go:2042).Start: in provider: gce: output: ERROR: (gcloud.dns.record-sets.create) HTTPError 409: The resource 'entity.rrset' named '_system-ui._tcp.teamcity-15175594-1715233131-04-n4cpu4.roachprod-managed.crdb.io. (SRV)' already exists: exit status 1
test artifacts and logs in: /artifacts/multitenant/distsql/instances=20/bundle=on/timeout=0/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

See: Grafana

Same failure on other branches

- #123655 roachtest: dns_problem failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.1.21-rc] - #123608 roachtest: dns_problem failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-24.1.0-rc] - #121094 roachtest: dns_problem failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.2.4-rc] - #121093 roachtest: dns_problem failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.2.4-rc] - #121090 roachtest: dns_problem failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.2] - #120959 roachtest: dns_problem failed [O-roachtest O-robot T-testeng X-infra-flake branch-master]

This test on roachdash | Improve this report!

cockroach-teamcity commented 4 months ago

roachtest.dns_problem failed with artifacts on release-23.1 @ b493f6f5d8a356d5f63339414dccba0757f99438:

test kv/splits/nodes=3/quiesce=false/lease=expiration failed: (cluster.go:2042).Start: in provider: gce: output: ERROR: (gcloud.dns.record-sets.create) HTTPError 409: The resource 'entity.rrset' named '_system-ui._tcp.teamcity-15574171-1717911715-02-n4cpu4.roachprod-managed.crdb.io. (SRV)' already exists: exit status 1
test artifacts and logs in: /artifacts/kv/splits/nodes=3/quiesce=false/lease=expiration/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

See: Grafana

Same failure on other branches

- #125300 roachtest: dns_problem failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-24.1] - #123977 roachtest: dns_problem failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.2.5-rc] - #123655 roachtest: dns_problem failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.1.21-rc] - #123608 roachtest: dns_problem failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-24.1.0-rc] - #121094 roachtest: dns_problem failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.2.4-rc] - #121093 roachtest: dns_problem failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.2.4-rc] - #121090 roachtest: dns_problem failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.2] - #120959 roachtest: dns_problem failed [O-roachtest O-robot T-testeng X-infra-flake branch-master]

This test on roachdash | Improve this report!

cockroach-teamcity commented 1 week ago

roachtest.dns_problem failed with artifacts on release-23.1 @ d595270111fac1f9e0bf052928d67e260eea4ef7:

test splits/largerange/size=32GiB,nodes=6 failed: (cluster.go:2037).Start: in provider: gce: output: ERROR: (gcloud.dns.record-sets.update) HTTPError 404: The 'parameters.name' resource named '_system-sql._tcp.teamcity-17218297-1728366086-40-n6cpu4.roachprod-managed.crdb.io.' does not exist.: exit status 1
test artifacts and logs in: /artifacts/splits/largerange/size=32GiB_nodes=6/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

See: Grafana

Same failure on other branches

- #132060 roachtest: dns_problem failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.2.13-rc] - #125300 roachtest: dns_problem failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-24.1] - #123655 roachtest: dns_problem failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.1.21-rc] - #121094 roachtest: dns_problem failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.2.4-rc] - #121093 roachtest: dns_problem failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.2.4-rc] - #121090 roachtest: dns_problem failed [O-roachtest O-robot T-testeng X-infra-flake branch-release-23.2] - #120959 roachtest: dns_problem failed [O-roachtest O-robot T-testeng X-infra-flake branch-master]

This test on roachdash | Improve this report!