search

cockroachdb / cockroach

CockroachDB — the cloud native, distributed SQL database designed for high availability, effortless scale, and control over data placement.
https://www.cockroachlabs.com
Other
30.07k stars 3.8k forks source link

roachtest: jepsen-batch2/sequential/majority-ring failed #38097

Closed cockroach-teamcity closed 5 years ago

cockroach-teamcity commented 5 years ago

SHA: https://github.com/cockroachdb/cockroach/commits/8892e379d84a36b29003420189edd1e10db41d71

Parameters:

To repro, try:

# Don't forget to check out a clean suitable branch and experiment with the
# stress invocation until the desired results present themselves. For example,
# using stress instead of stressrace and passing the '-p' stressflag which
# controls concurrency.
./scripts/gceworker.sh start && ./scripts/gceworker.sh mosh
cd ~/go/src/github.com/cockroachdb/cockroach && \
stdbuf -oL -eL \
make stressrace TESTS=jepsen-batch2/sequential/majority-ring PKG=roachtest TESTTIMEOUT=5m STRESSFLAGS='-maxtime 20m -timeout 10m' 2>&1 | tee /tmp/stress.log

Failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=1328407&tab=buildLog

The test failed on branch=release-19.1, cloud=gce:
    cluster.go:1589,cluster.go:1673,cluster.go:1682,jepsen.go:141,jepsen.go:323,test.go:1248: exit status 1
tbg commented 5 years ago 
[10:48:00]
jepsen-batch2/sequential/majority-ring (2m:09s)
[10:50:06]
    cluster.go:1589,cluster.go:1673,cluster.go:1682,jepsen.go:141,jepsen.go:323,test.go:1248: exit status 1

Not a real failure. c.InternalIP failed, though not with any kind of useful failure. cc @ajwerner (not sure there's anything for you to do here, just pointing it out)

also cc https://github.com/cockroachdb/cockroach/issues/36929