cockroachdb / cockroach

CockroachDB — the cloud native, distributed SQL database designed for high availability, effortless scale, and control over data placement.
https://www.cockroachlabs.com
Other
30.18k stars 3.82k forks source link

roachtest: c2c/mixed-version failed #135785

Closed cockroach-teamcity closed 2 hours ago

cockroach-teamcity commented 5 days ago

roachtest.c2c/mixed-version failed with artifacts on master @ 8eeb7f2ae3b2cede564b46ca47e2353fd147c061:

(mixedversion.go:759).Run: source: mixed-version test failure while running step 8 (run "initialize tpcc workload"): full command output in run_064627.076735144_n9_cockroach-workload-i.log: COMMAND_PROBLEM: exit status 1
(mixedversion.go:759).Run: dest: cluster.StopE: one or more parallel execution failure(s): context canceled
test artifacts and logs in: /artifacts/c2c/mixed-version/cpu_arch=arm64/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

/cc @cockroachdb/disaster-recovery

This test on roachdash | Improve this report!

Jira issue: CRDB-44705

cockroach-teamcity commented 5 days ago

roachtest.c2c/mixed-version failed with artifacts on master @ 8eeb7f2ae3b2cede564b46ca47e2353fd147c061:

(mixedversion.go:759).Run: source: mixed-version test failure while running step 7 (run "initialize tpcc workload"): full command output in run_075237.238857877_n9_cockroach-workload-i.log: COMMAND_PROBLEM: exit status 1
(mixedversion.go:759).Run: dest: context canceled
test artifacts and logs in: /artifacts/c2c/mixed-version/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

See: Grafana

This test on roachdash | Improve this report!

cockroach-teamcity commented 4 days ago

roachtest.c2c/mixed-version failed with artifacts on master @ eb2d2e19eb29d2747d9e267bd0612a69d066adad:

(mixedversion.go:759).Run: source: mixed-version test failure while running step 9 (run "initialize tpcc workload"): full command output in run_070342.987960959_n9_cockroach-workload-i.log: COMMAND_PROBLEM: exit status 1
(mixedversion.go:759).Run: dest: creating store-dir: context canceled [owner=test-eng]
test artifacts and logs in: /artifacts/c2c/mixed-version/cpu_arch=arm64/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for aws clusters

This test on roachdash | Improve this report!

cockroach-teamcity commented 4 days ago

roachtest.c2c/mixed-version failed with artifacts on master @ eb2d2e19eb29d2747d9e267bd0612a69d066adad:

(mixedversion.go:759).Run: source: mixed-version test failure while running step 8 (run "initialize tpcc workload"): full command output in run_080443.285761679_n9_cockroach-workload-i.log: COMMAND_PROBLEM: exit status 1
(mixedversion.go:759).Run: dest: context canceled
test artifacts and logs in: /artifacts/c2c/mixed-version/cpu_arch=arm64/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

See: Grafana

This test on roachdash | Improve this report!

msbutler commented 3 days ago

hrmm. looks like repair-order-ids is an unrecognized option, oh because of the mixed version binary. ugh

Error: importing fixture: importing table stock: pq: parsing parameters --warehouses=10 --families=false --fks=true --repair-order-ids=false --seed=5880914551461854042: unknown flag: --repair-order-ids
run_080443.285761679_n9_cockroach-workload-i: 2024/11/21 08:04:45 cluster.go:2493: > result: COMMAND_PROBLEM: exit status 1
cockroach-teamcity commented 17 hours ago

Note: This build has runtime assertions enabled. If the same failure was hit in a run without assertions enabled, there should be a similar failure without this message. If there isn't one, then this failure is likely due to an assertion violation or (assertion) timeout.

roachtest.c2c/mixed-version failed with artifacts on master @ f717f6bd218121bb5e3376af658545f6bff30c22:

(mixedversion.go:759).Run: source: mixed-version test failure while running step 29 (wait for all nodes (:1-4) to acknowledge cluster version <current> on mixed-version-tenant-kih4v tenant): timed out after 10m0s: expected n1 to be at cluster version 24.3-upgrading-to-25.1-step-004, but is still at 24.2-upgrading-to-24.3-step-013: not upgraded yet
test artifacts and logs in: /artifacts/c2c/mixed-version/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for azure clusters

This test on roachdash | Improve this report!

cockroach-teamcity commented 17 hours ago

Note: This build has runtime assertions enabled. If the same failure was hit in a run without assertions enabled, there should be a similar failure without this message. If there isn't one, then this failure is likely due to an assertion violation or (assertion) timeout.

roachtest.c2c/mixed-version failed with artifacts on master @ f717f6bd218121bb5e3376af658545f6bff30c22:

(mixedversion.go:759).Run: source: preparing to run step 23: failed to get binary version for node 2 (system): read tcp 172.17.0.3:39114 -> 3.144.222.235:26257: i/o timeout
test artifacts and logs in: /artifacts/c2c/mixed-version/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

Grafana is not yet available for aws clusters

This test on roachdash | Improve this report!