cockroachdb / cockroach

CockroachDB — the cloud native, distributed SQL database designed for high availability, effortless scale, and control over data placement.
https://www.cockroachlabs.com
Other
30.05k stars 3.8k forks source link

roachtest: multitenant/distsql/instances=20/bundle=off/timeout=0 failed #117265

Closed cockroach-teamcity closed 9 months ago

cockroach-teamcity commented 9 months ago

roachtest.multitenant/distsql/instances=20/bundle=off/timeout=0 failed with artifacts on master @ a8d806658ae8118e7aca4cd5d1810b5fdc45b15c:

(cluster.go:2036).StartServiceForVirtualCluster: COMMAND_PROBLEM: exit status 1
test artifacts and logs in: /artifacts/multitenant/distsql/instances=20/bundle=off/timeout=0/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

See: Grafana

/cc @cockroachdb/sql-queries

This test on roachdash | Improve this report!

Jira issue: CRDB-35091

cockroach-teamcity commented 9 months ago

roachtest.multitenant/distsql/instances=20/bundle=off/timeout=0 failed with artifacts on master @ f2917d82b235db6fda145a932050e5a58f957b9f:

(cluster.go:2036).StartServiceForVirtualCluster: COMMAND_PROBLEM: exit status 1
test artifacts and logs in: /artifacts/multitenant/distsql/instances=20/bundle=off/timeout=0/run_1

Parameters:

See: roachtest README

See: How To Investigate (internal)

See: Grafana

This test on roachdash | Improve this report!

rharding6373 commented 9 months ago

Failed to start cockroach. From 1.journalctl.txt:

Jan 03 06:50:34 teamcity-13372865-1704263368-07-n4cpu4-0001 systemd[1]: Starting /usr/bin/bash ./cockroach.sh run...
Jan 03 06:50:34 teamcity-13372865-1704263368-07-n4cpu4-0001 bash[10834]: cockroach start: Wed Jan  3 06:50:34 UTC 2024, logging to logs-test-tenant-0
Jan 03 06:50:34 teamcity-13372865-1704263368-07-n4cpu4-0001 bash[10847]: cockroach exited with code 1: Wed Jan  3 06:50:34 UTC 2024
Jan 03 06:50:34 teamcity-13372865-1704263368-07-n4cpu4-0001 systemd[1]: cockroach-test-tenant_0.service: Main process exited, code=exited, status=1/FAILURE
Jan 03 06:50:34 teamcity-13372865-1704263368-07-n4cpu4-0001 systemd[1]: cockroach-test-tenant_0.service: Failed with result 'exit-code'.
Jan 03 06:50:34 teamcity-13372865-1704263368-07-n4cpu4-0001 systemd[1]: Failed to start /usr/bin/bash ./cockroach.sh run.

From run_065034.944734052_n1-4_du-c-mntdata1-exclud.log:

run_065034.944734052_n1-4_du-c-mntdata1-exclud: 06:50:34 cluster.go:2241: > du -c /mnt/data1 --exclude lost+found >> logs/diskusage.txt
teamcity-13372865-1704263368-07-n4cpu4:[1 2 3 4]: du -c /mnt/data1 --exclude ...
   2:   <ok>
   3:   <ok>
   4:   <err> COMMAND_PROBLEM: exit status 1
    bash: line 1: logs/diskusage.txt: No such file or directory

run_065034.944734052_n1-4_du-c-mntdata1-exclud: 06:50:35 cluster.go:2251: > result: COMMAND_PROBLEM: exit status 1
rharding6373 commented 9 months ago

Removing the release-blocker label since this appears to be some kind of test infra issue (though I don't know the root cause yet).

rharding6373 commented 9 months ago

Dupe of #117150