cockroachdb / cockroach

CockroachDB — the cloud native, distributed SQL database designed for high availability, effortless scale, and control over data placement.
https://www.cockroachlabs.com
Other
30.2k stars 3.82k forks source link

roachtest: ycsb/A/nodes=3 failed #80046

Closed cockroach-teamcity closed 2 years ago

cockroach-teamcity commented 2 years ago

roachtest.ycsb/A/nodes=3 failed with artifacts on master @ 771432d1099e516dbc11827c5458886c176e73e3:

          |   215.0s        0         7766.3         7609.1      6.3     16.3     46.1    260.0 update
          |   216.0s        0         8081.7         7610.4      1.8     11.5     56.6    159.4 read
          |   216.0s        0         7832.6         7610.1      6.8     17.8     32.5    268.4 update
          |   217.0s        0         7761.0         7611.1      2.0     11.5     35.7    100.7 read
          |   217.0s        0         7741.0         7610.8      7.3     21.0     33.6    121.6 update
          |   218.0s        0         7933.6         7612.6      1.9     11.5     39.8    121.6 read
          |   218.0s        0         7893.6         7612.0      7.1     19.9     35.7    176.2 update
          |   219.0s        0         7122.8         7610.3      1.9     12.1     41.9     96.5 read
          |   219.0s        0         7145.8         7609.9      7.3     19.9     33.6    159.4 update
          |   220.0s        0            0.0         7575.7      0.0      0.0      0.0      0.0 read
          |   220.0s        0            0.0         7575.3      0.0      0.0      0.0      0.0 update
        Wraps: (4) COMMAND_PROBLEM
        Wraps: (5) Node 4. Command with error:
          | ``````
          | ./workload run ycsb --init --insert-count=1000000 --workload=A --concurrency=96 --splits=3 --histograms=perf/stats.json --select-for-update=true --ramp=2m --duration=30m {pgurl:1-3}
          | ``````
        Wraps: (6) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) errors.Cmd (5) *hintdetail.withDetail (6) *exec.ExitError

    monitor.go:127,ycsb.go:84,ycsb.go:101,test_runner.go:875: monitor failure: monitor task failed: t.Fatal() was called
        (1) attached stack trace
          -- stack trace:
          | main.(*monitorImpl).WaitE
          |     main/pkg/cmd/roachtest/monitor.go:115
          | main.(*monitorImpl).Wait
          |     main/pkg/cmd/roachtest/monitor.go:123
          | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.registerYCSB.func1
          |     github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/ycsb.go:84
          | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.registerYCSB.func2
          |     github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/ycsb.go:101
          | main.(*testRunner).runTest.func2
          |     main/pkg/cmd/roachtest/test_runner.go:875
        Wraps: (2) monitor failure
        Wraps: (3) attached stack trace
          -- stack trace:
          | main.(*monitorImpl).wait.func2
          |     main/pkg/cmd/roachtest/monitor.go:171
        Wraps: (4) monitor task failed
        Wraps: (5) attached stack trace
          -- stack trace:
          | main.init
          |     main/pkg/cmd/roachtest/monitor.go:80
          | runtime.doInit
          |     GOROOT/src/runtime/proc.go:6498
          | runtime.main
          |     GOROOT/src/runtime/proc.go:238
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1581
        Wraps: (6) t.Fatal() was called
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *withstack.withStack (6) *errutil.leafError
Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

/cc @cockroachdb/kv-triage

This test on roachdash | Improve this report!

Jira issue: CRDB-15655

kvoli commented 2 years ago

tracking issue #80072, caused by #76609. Resolved in #80071.