cockroachdb / cockroach

CockroachDB — the cloud native, distributed SQL database designed for high availability, effortless scale, and control over data placement.
https://www.cockroachlabs.com
Other
30.07k stars 3.8k forks source link

roachtest: jepsen/sequential/strobe-skews failed #42226

Closed cockroach-teamcity closed 4 years ago

cockroach-teamcity commented 4 years ago

SHA: https://github.com/cockroachdb/cockroach/commits/2535f0363b5d9b1e466ca3144fe5bcf7ff17e63c

Parameters:

To repro, try:

# Don't forget to check out a clean suitable branch and experiment with the
# stress invocation until the desired results present themselves. For example,
# using stress instead of stressrace and passing the '-p' stressflag which
# controls concurrency.
./scripts/gceworker.sh start && ./scripts/gceworker.sh mosh
cd ~/go/src/github.com/cockroachdb/cockroach && \
stdbuf -oL -eL \
make stressrace TESTS=jepsen/sequential/strobe-skews PKG=roachtest TESTTIMEOUT=5m STRESSFLAGS='-maxtime 20m -timeout 10m' 2>&1 | tee /tmp/stress.log

Failed test: https://teamcity.cockroachdb.com/viewLog.html?buildId=1577529&tab=artifacts#/jepsen/sequential/strobe-skews

The test failed on branch=provisional_201911052027_v19.2.0-rc.4, cloud=gce:
test artifacts and logs in: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/artifacts/20191106-1577529/jepsen/sequential/strobe-skews/run_1
    cluster.go:1783,jepsen.go:126,jepsen.go:138,jepsen.go:320,test_runner.go:697: /home/agent/work/.go/src/github.com/cockroachdb/cockroach/bin/roachprod run teamcity-1577529-1573039843-45-n6cpu4:1-5 -- sh -c "cat controller_id_rsa.pub >> .ssh/authorized_keys" returned:
        stderr:

        stdout:
        teamcity-1577529-1573039843-45-n6cpu4: sh -c "cat controller_id_rs...
           1: 
           2: 
           3: 
           4: 
           5: 
        exit status 255
        Error:  exit status 255
        : exit status 1
andreimatei commented 4 years ago

Can't tell what happened because it seems that the runner failed to collect the jepsen logs.