cockroachdb / cockroach

CockroachDB — the cloud native, distributed SQL database designed for high availability, effortless scale, and control over data placement.
https://www.cockroachlabs.com
Other
30.2k stars 3.82k forks source link

roachtest: ycsb/A/nodes=3 failed #84817

Closed cockroach-teamcity closed 2 years ago

cockroach-teamcity commented 2 years ago

roachtest.ycsb/A/nodes=3 failed with artifacts on master @ 457d724622e4fa2e62d6f4e7926509dbc7d18511:

          |  1331.0s        0         5016.8         6204.3      5.0     23.1    109.1    402.7 update
          |  1332.0s        0         3534.0         6203.8      1.4     14.7    130.0    335.5 read
          |  1332.0s        0         3574.0         6202.3      4.1     29.4    142.6   1610.6 update
          |  1333.0s        0         4288.1         6202.4      1.6     13.6    167.8    285.2 read
          |  1333.0s        0         4232.1         6200.8      5.0     28.3    125.8   1744.8 update
          |  1334.0s        0         4615.5         6201.2      1.3     11.5    130.0    218.1 read
          |  1334.0s        0         4537.6         6199.6      5.0     26.2     92.3   1677.7 update
          |  1335.0s        0         4636.6         6200.0      1.4     12.1    142.6    251.7 read
          |  1335.0s        0         4586.6         6198.4      5.2     26.2     79.7   1476.4 update
          |  1336.0s        0         4830.6         6199.0      1.6     10.5    151.0    268.4 read
          |  1336.0s        0         4898.6         6197.4      5.2     19.9     88.1   1140.9 update
        Wraps: (4) COMMAND_PROBLEM
        Wraps: (5) Node 4. Command with error:
          | ``````
          | ./workload run ycsb --init --insert-count=1000000 --workload=A --concurrency=96 --splits=3 --histograms=perf/stats.json --select-for-update=true --ramp=2m --duration=30m {pgurl:1-3}
          | ``````
        Wraps: (6) exit status 1
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *cluster.WithCommandDetails (4) errors.Cmd (5) *hintdetail.withDetail (6) *exec.ExitError

    monitor.go:127,ycsb.go:84,ycsb.go:101,test_runner.go:896: monitor failure: monitor task failed: t.Fatal() was called
        (1) attached stack trace
          -- stack trace:
          | main.(*monitorImpl).WaitE
          |     main/pkg/cmd/roachtest/monitor.go:115
          | main.(*monitorImpl).Wait
          |     main/pkg/cmd/roachtest/monitor.go:123
          | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.registerYCSB.func1
          |     github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/ycsb.go:84
          | github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests.registerYCSB.func2
          |     github.com/cockroachdb/cockroach/pkg/cmd/roachtest/tests/ycsb.go:101
          | main.(*testRunner).runTest.func2
          |     main/pkg/cmd/roachtest/test_runner.go:896
        Wraps: (2) monitor failure
        Wraps: (3) attached stack trace
          -- stack trace:
          | main.(*monitorImpl).wait.func2
          |     main/pkg/cmd/roachtest/monitor.go:171
        Wraps: (4) monitor task failed
        Wraps: (5) attached stack trace
          -- stack trace:
          | main.init
          |     main/pkg/cmd/roachtest/monitor.go:80
          | runtime.doInit
          |     GOROOT/src/runtime/proc.go:6498
          | runtime.main
          |     GOROOT/src/runtime/proc.go:238
          | runtime.goexit
          |     GOROOT/src/runtime/asm_amd64.s:1581
        Wraps: (6) t.Fatal() was called
        Error types: (1) *withstack.withStack (2) *errutil.withPrefix (3) *withstack.withStack (4) *errutil.withPrefix (5) *withstack.withStack (6) *errutil.leafError

Parameters: ROACHTEST_cloud=aws , ROACHTEST_cpu=8 , ROACHTEST_ssd=0

Help

See: [roachtest README](https://github.com/cockroachdb/cockroach/blob/master/pkg/cmd/roachtest/README.md) See: [How To Investigate \(internal\)](https://cockroachlabs.atlassian.net/l/c/SSSBr8c7)

/cc @cockroachdb/test-eng

This test on roachdash | Improve this report!

Jira issue: CRDB-17887

yuzefovich commented 2 years ago

dup of #84801