cockroachdb / cockroach

CockroachDB — the cloud native, distributed SQL database designed for high availability, effortless scale, and control over data placement.
https://www.cockroachlabs.com
Other
30.07k stars 3.8k forks source link

roachtest: jepsen/bank-multitable/start-stop-2 failed #69028

Closed cockroach-teamcity closed 3 years ago

cockroach-teamcity commented 3 years ago

roachtest.jepsen/bank-multitable/start-stop-2 failed with artifacts on master @ dd82053908203cf6d77c36c06a8280831bb93d57:

The test failed on branch=master, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/jepsen/bank-multitable/start-stop-2/run_1
    jepsen.go:155,jepsen.go:360,test_runner.go:777: pgurl for nodes :1-5 got urls [problem loading clusters: could not read /root/.roachprod/hosts/teamcity-3311258-1629180553-59-n9cpu4-geo: open /root/.roachprod/hosts/teamcity-3311258-1629180553-59-n9cpu4-geo: no such file or directory
        (1) attached stack trace
          -- stack trace:
          | main.(*clusterImpl).pgURLErr
          |     /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cluster.go:2033
          | main.(*clusterImpl).InternalAddr
          |     /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cluster.go:2153
          | main.(*clusterImpl).InternalIP
          |     /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/cluster.go:2172
          | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.runJepsen
          |     /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/jepsen.go:153
          | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.RegisterJepsen.func1
          |     /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/jepsen.go:360
          | main.(*testRunner).runTest.func2
          |     /home/agent/work/.go/src/github.com/cockroachdb/cockroach/pkg/cmd/roachtest/test_runner.go:777
          | runtime.goexit
          |     /usr/local/go/src/runtime/asm_amd64.s:1371
        Wraps: (2) pgurl for nodes :1-5 got urls [problem loading clusters: could not read /root/.roachprod/hosts/teamcity-3311258-1629180553-59-n9cpu4-geo: open /root/.roachprod/hosts/teamcity-3311258-1629180553-59-n9cpu4-geo: no such file or directory
          | 'postgres://root@10.142.0.152:26257?sslmode=disable' 'postgres://root@10.142.0.150:26257?sslmode=disable' 'postgres://root@10.142.0.64:26257?sslmode=disable' 'postgres://root@10.142.0.162:26257?sslmode=disable' 'postgres://root@10.142.0.159:26257?sslmode=disable'] from stdout:
          | problem loading clusters: could not read /root/.roachprod/hosts/teamcity-3311258-1629180553-59-n9cpu4-geo: open /root/.roachprod/hosts/teamcity-3311258-1629180553-59-n9cpu4-geo: no such file or directory
          | 'postgres://root@10.142.0.152:26257?sslmode=disable' 'postgres://root@10.142.0.150:26257?sslmode=disable' 'postgres://root@10.142.0.64:26257?sslmode=disable' 'postgres://root@10.142.0.162:26257?sslmode=disable' 'postgres://root@10.142.0.159:26257?sslmode=disable'
          | stderr:
          | 
        Error types: (1) *withstack.withStack (2) *errutil.leafError
Reproduce

See: [roachtest README](https://github.com/cockroachdb/cockroach/tree/master/pkg/cmd/roachtest) See: [CI job to stress roachtests](https://teamcity.cockroachdb.com/buildConfiguration/Cockroach_Nightlies_RoachtestStress)

For the CI stress job, click the ellipsis (...) next to the Run button and fill in: * Changes / Build branch: master * Parameters / `env.TESTS`: `^jepsen/bank-multitable/start-stop-2$` * Parameters / `env.COUNT`: <number of runs>

/cc @cockroachdb/kv-triage

This test on roachdash | Improve this report!

tbg commented 3 years ago

Not sure what happened here. Going to close hoping it will not reappear. Wraps: (2) pgurl for nodes :1-5 got urls [problem loading clusters: could not read /root/.roachprod/hosts/teamcity-3311258-1629180553-59-n9cpu4-geo: open /root/.roachprod/hosts/teamcity-3311258-1629180553-59-n9cpu4-geo: no such file or directory