search

canonical / dqlite

Embeddable, replicated and fault-tolerant SQL engine.
https://dqlite.io
Other
3.8k stars 215 forks source link

0.17.1: test suite is failing #581

Open kloczek opened 1 year ago

kloczek commented 1 year ago 
[tkloczko@pers-jacek raft-0.17.1]$ make check
make  test/unit/core test/integration/core test/fuzzy/core test/unit/uv test/integration/uv libtest.la
make[1]: Entering directory '/home/tkloczko/rpmbuild/BUILD/raft-0.17.1'
make[1]: 'test/unit/core' is up to date.
make[1]: 'test/integration/core' is up to date.
make[1]: 'test/fuzzy/core' is up to date.
make[1]: 'test/unit/uv' is up to date.
make[1]: 'test/integration/uv' is up to date.
make[1]: 'libtest.la' is up to date.
make[1]: Leaving directory '/home/tkloczko/rpmbuild/BUILD/raft-0.17.1'
make  check-TESTS
make[1]: Entering directory '/home/tkloczko/rpmbuild/BUILD/raft-0.17.1'
make[2]: Entering directory '/home/tkloczko/rpmbuild/BUILD/raft-0.17.1'
FAIL: test/unit/core
FAIL: test/integration/core
FAIL: test/fuzzy/core
PASS: test/unit/uv
FAIL: test/integration/uv
============================================================================
Testsuite summary for raft 0.17.1
============================================================================
# TOTAL: 5
# PASS:  1
# SKIP:  0
# XFAIL: 0
# FAIL:  4
# XPASS: 0
# ERROR: 0
============================================================================
See ./test-suite.log
============================================================================
make[2]: *** [Makefile:3707: test-suite.log] Error 1
make[2]: Leaving directory '/home/tkloczko/rpmbuild/BUILD/raft-0.17.1'
make[1]: *** [Makefile:3815: check-TESTS] Error 2
make[1]: Leaving directory '/home/tkloczko/rpmbuild/BUILD/raft-0.17.1'
make: *** [Makefile:4055: check-am] Error 2
kloczek commented 1 year ago

And test-suite.log file scontesnt

```console [tkloczko@pers-jacek raft-0.17.1]$ cat ./test-suite.log =================================== raft 0.17.1: ./test-suite.log =================================== # TOTAL: 5 # PASS: 1 # SKIP: 0 # XFAIL: 0 # FAIL: 4 # XPASS: 0 # ERROR: 0 .. contents:: :depth: 2 FAIL: test/unit/core ==================== Running test suite with seed 0x3f981b28... QUEUE_FOREACH/two [ OK ] [ 0.00001845 / 0.00001581 CPU ] QUEUE_FOREACH/one [ OK ] [ 0.00000913 / 0.00000796 CPU ] QUEUE_FOREACH/zero [ OK ] [ 0.00000420 / 0.00000332 CPU ] QUEUE_TAIL/three [ OK ] [ 0.00000779 / 0.00000708 CPU ] QUEUE_TAIL/two [ OK ] [ 0.00001757 / 0.00001632 CPU ] QUEUE_TAIL/one [ OK ] [ 0.00000820 / 0.00000735 CPU ] QUEUE_REMOVE/success [ OK ] [ 0.00000812 / 0.00000740 CPU ] QUEUE_REMOVE/second [ OK ] [ 0.00002683 / 0.00002472 CPU ] QUEUE_REMOVE/first [ OK ] [ 0.00001706 / 0.00001591 CPU ] QUEUE_PUSH/two [ OK ] [ 0.00000793 / 0.00000719 CPU ] QUEUE_PUSH/one [ OK ] [ 0.00000856 / 0.00000766 CPU ] QUEUE_IS_EMPTY/no [ OK ] [ 0.00000816 / 0.00000742 CPU ] QUEUE_IS_EMPTY/yes [ OK ] [ 0.00000796 / 0.00000654 CPU ] logRestore/wipe [ OK ] [ 0.00003324 / 0.00003236 CPU ] logRestore/initial [ OK ] [ 0.00000789 / 0.00000709 CPU ] logSnapshot/wrap [ OK ] [ 0.00003764 / 0.00003672 CPU ] logSnapshot/lessThanHighestIndex [ OK ] [ 0.00006371 / 0.00006258 CPU ] logSnapshot/trailingMatchesOutstanding [ OK ] [ 0.00002888 / 0.00002805 CPU ] logSnapshot/trailingHigherThanNumEntries [ OK ] [ 0.00003019 / 0.00002933 CPU ] logSnapshot/trailing [ OK ] [ 0.00004816 / 0.00003683 CPU ] logTruncate/acquiredOom heap-fault-delay=0, heap-fault-repeat=1 [ OK ] [ 0.00002463 / 0.00002394 CPU ] logTruncate/acquireAppend [ OK ] [ 0.00012818 / 0.00012750 CPU ] logTruncate/acquired [ OK ] [ 0.00003012 / 0.00002926 CPU ] logTruncate/batch [ OK ] [ 0.00002875 / 0.00002795 CPU ] logTruncate/referenced [ OK ] [ 0.00004657 / 0.00003610 CPU ] logTruncate/wrap [ OK ] [ 0.00003625 / 0.00003526 CPU ] logTruncate/lastOfTwo [ OK ] [ 0.00006238 / 0.00006123 CPU ] logTruncate/lastOfOne [ OK ] [ 0.00003732 / 0.00002903 CPU ] logAcquire/oom [ OK ] [ 0.00002765 / 0.00002677 CPU ] logAcquire/outOfRange [ OK ] [ 0.00004349 / 0.00004263 CPU ] logAcquire/batch [ OK ] [ 0.00003505 / 0.00003433 CPU ] logAcquire/wrap [ OK ] [ 0.00003587 / 0.00003487 CPU ] logAcquire/two [ OK ] [ 0.00003587 / 0.00003494 CPU ] logAcquire/one [ OK ] [ 0.00002919 / 0.00002834 CPU ] logAppendConfiguration/oom heap-fault-delay=0, heap-fault-repeat=1 [ OK ] [ 0.00001563 / 0.00001475 CPU ] heap-fault-delay=1, heap-fault-repeat=1 [ OK ] [ 0.00001502 / 0.00001428 CPU ] logAppend/oomRefs [ OK ] [ 0.00010838 / 0.00010789 CPU ] logAppend/oom heap-fault-delay=0, heap-fault-repeat=1 [ OK ] [ 0.00000833 / 0.00000698 CPU ] heap-fault-delay=1, heap-fault-repeat=1 [ OK ] [ 0.00001029 / 0.00000934 CPU ] logAppend/batch [ OK ] [ 0.00002970 / 0.00002900 CPU ] logAppend/wrap [ OK ] [ 0.00003716 / 0.00003625 CPU ] logAppend/many [ OK ] [ 0.00087101 / 0.00086227 CPU ] logAppend/three [ OK ] [ 0.00003745 / 0.00003650 CPU ] logAppend/two [ OK ] [ 0.00003429 / 0.00003331 CPU ] logAppend/one [ OK ] [ 0.00002390 / 0.00002341 CPU ] logGet/twoWithOffset [ OK ] [ 0.00003040 / 0.00002957 CPU ] logGet/two [ OK ] [ 0.00002807 / 0.00002738 CPU ] logGet/one [ OK ] [ 0.00002319 / 0.00002242 CPU ] logGet/emptyWithOffset [ OK ] [ 0.00003234 / 0.00003140 CPU ] logGet/empty_log [ OK ] [ 0.00000411 / 0.00000323 CPU ] logTermOf/snapshotTrailing [ OK ] [ 0.00003064 / 0.00002971 CPU ] logTermOf/withSnapshot [ OK ] [ 0.00002962 / 0.00002885 CPU ] logTermOf/two [ OK ] [ 0.00002875 / 0.00002792 CPU ] logTermOf/one [ OK ] [ 0.00002334 / 0.00002254 CPU ] logTermOf/snapshotLastIndex [ OK ] [ 0.00002930 / 0.00002857 CPU ] logTermOf/beyondLast [ OK ] [ 0.00000461 / 0.00000361 CPU ] logLastTerm/snapshot [ OK ] [ 0.00002750 / 0.00002675 CPU ] logLastTerm/empty [ OK ] [ 0.00000366 / 0.00000281 CPU ] logLastIndex/twoWithOffset [ OK ] [ 0.00002877 / 0.00002792 CPU ] logLastIndex/two [ OK ] [ 0.00002998 / 0.00002920 CPU ] logLastIndex/one [ OK ] [ 0.00002462 / 0.00002382 CPU ] logLastIndex/emptyWithOffset [ OK ] [ 0.00002812 / 0.00002728 CPU ] logLastIndex/empty [ OK ] [ 0.00000412 / 0.00000318 CPU ] logNumEntries/offsetNotEmpty [ OK ] [ 0.00002994 / 0.00002893 CPU ] logNumEntries/offset [ OK ] [ 0.00004619 / 0.00003237 CPU ] logNumEntries/wrapped [ OK ] [ 0.00002997 / 0.00002912 CPU ] logNumEntries/not_wrapped [ OK ] [ 0.00002378 / 0.00002293 CPU ] logNumEntries/empty [ OK ] [ 0.00000391 / 0.00000318 CPU ] ErrMsgWrapf/fullTruncate [ OK ] [ 0.00003384 / 0.00003294 CPU ] ErrMsgWrapf/partialTruncate [ OK ] [ 0.00004160 / 0.00004090 CPU ] ErrMsgWrapf/params [ OK ] [ 0.00004656 / 0.00004572 CPU ] ErrMsgWrapf/noParams [ OK ] [ 0.00016513 / 0.00010374 CPU ] ErrMsgPrintf/params [ OK ] [ 0.00004603 / 0.00004512 CPU ] ErrMsgPrintf/noParams [ OK ] [ 0.00000793 / 0.00000667 CPU ] configurationDecode/badAddress [ OK ] [ 0.00000674 / 0.00000586 CPU ] configurationDecode/badVersion [ OK ] [ 0.00000401 / 0.00000318 CPU ] configurationDecode/oom [ ERROR ] Error: test/unit/test_configuration.c:563: assertion failed: configurationDecode(&buf, &f->configuration) == RAFT_NOMEM (5 == 1) Error: child killed by signal 6 (Aborted) configurationDecode/two_servers [ ERROR ] Error: test/unit/test_configuration.c:542: assertion failed: configurationDecode(&buf, &f->configuration) == 0 (5 == 0) Error: child killed by signal 6 (Aborted) configurationDecode/one_server [ ERROR ] Error: test/unit/test_configuration.c:518: assertion failed: rv == 0 (5 == 0) Error: child killed by signal 6 (Aborted) configurationEncode/oom [ OK ] [ 0.00004692 / 0.00004389 CPU ] configurationEncode/two_servers [ OK ] [ 0.00006237 / 0.00006106 CPU ] configurationEncode/one_server [ OK ] [ 0.00007350 / 0.00007257 CPU ] configurationRemove/oom [ OK ] [ 0.00006520 / 0.00006398 CPU ] configurationRemove/unknownId [ OK ] [ 0.00000297 / 0.00000232 CPU ] configurationRemove/middle [ OK ] [ 0.00003175 / 0.00003073 CPU ] configurationRemove/first [ OK ] [ 0.00002467 / 0.00002444 CPU ] configurationRemove/last [ OK ] [ 0.00002696 / 0.00002600 CPU ] configurationAdd/oom heap-fault-delay=0, heap-fault-repeat=1 [ OK ] [ 0.00000772 / 0.00000719 CPU ] heap-fault-delay=1, heap-fault-repeat=1 [ OK ] [ 0.00001410 / 0.00001317 CPU ] configurationAdd/invalidRole [ OK ] [ 0.00000747 / 0.00000621 CPU ] configurationAdd/duplicateAddress [ OK ] [ 0.00002509 / 0.00002390 CPU ] configurationAdd/duplicateId [ OK ] [ 0.00002355 / 0.00002254 CPU ] configurationAdd/two [ OK ] [ 0.00002682 / 0.00002624 CPU ] configurationAdd/one [ OK ] [ 0.00004170 / 0.00004008 CPU ] configurationCopy/oom [ OK ] [ 0.00001880 / 0.00001773 CPU ] configurationCopy/two [ OK ] [ 0.00003250 / 0.00003180 CPU ] configurationGet/no_match [ OK ] [ 0.00002344 / 0.00002257 CPU ] configurationGet/match [ OK ] [ 0.00007437 / 0.00006603 CPU ] configurationIndexOfVoter/non_voting [ OK ] [ 0.00002452 / 0.00002375 CPU ] configurationIndexOfVoter/no_match [ OK ] [ 0.00002233 / 0.00002205 CPU ] configurationIndexOfVoter/match [ OK ] [ 0.00003181 / 0.00003108 CPU ] configurationIndexOf/no_match [ OK ] [ 0.00002548 / 0.00002467 CPU ] configurationIndexOf/match [ OK ] [ 0.00003172 / 0.00003096 CPU ] configurationVoterCount/filter [ OK ] [ 0.00003191 / 0.00003111 CPU ] configurationVoterCount/all_voters [ OK ] [ 0.00002695 / 0.00002670 CPU ] Compress/notCompressed [ OK ] [ 0.00000421 / 0.00000347 CPU ] Compress/isCompressed [ OK ] [ 0.00000680 / 0.00000643 CPU ] Compress/isCompressedNull [ OK ] [ 0.00000414 / 0.00000325 CPU ] Compress/isCompressedTooSmall [ OK ] [ 0.00000403 / 0.00000328 CPU ] Compress/lz4Disabled [ OK ] [ 0.00005746 / 0.00005675 CPU ] byteSha1/abcbd [ OK ] [ 0.00006852 / 0.00006787 CPU ] byteSha1/abcWithZeroLen [ OK ] [ 0.00008013 / 0.00007101 CPU ] byteSha1/abc [ OK ] [ 0.00005601 / 0.00005520 CPU ] byteGet64/success [ OK ] [ 0.00002293 / 0.00002202 CPU ] byteGetString/malformed [ OK ] [ 0.00000377 / 0.00000301 CPU ] byteGetString/success [ OK ] [ 0.00000458 / 0.00000369 CPU ] byteFlip/64 [ OK ] [ 0.00000414 / 0.00000336 CPU ] byteFlip/32 [ OK ] [ 0.00000344 / 0.00000277 CPU ] byteCrc32/invalid [ OK ] [ 0.00000860 / 0.00000785 CPU ] byteCrc32/valid [ OK ] [ 0.00001616 / 0.00001452 CPU ] 117 of 120 (98%) tests successful, 0 (0%) test skipped. FAIL test/unit/core (exit status: 1) FAIL: test/integration/core =========================== Running test suite with seed 0xc0c8b2e9... raft_transfer/preVote cluster-pre-vote=0, cluster-heartbeat=1 [ ERROR ] Error: test/integration/test_transfer.c:77: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) cluster-pre-vote=0, cluster-heartbeat=100 [ ERROR ] Error: test/integration/test_transfer.c:77: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) cluster-pre-vote=1, cluster-heartbeat=1 [ ERROR ] Error: test/integration/test_transfer.c:77: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) cluster-pre-vote=1, cluster-heartbeat=100 [ ERROR ] Error: test/integration/test_transfer.c:77: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) raft_transfer/afterDemotion [ ERROR ] Error: test/integration/test_transfer.c:77: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) raft_transfer/autoSelectUpToDate [ ERROR ] Error: test/integration/test_transfer.c:77: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) raft_transfer/autoSelect [ ERROR ] Error: test/integration/test_transfer.c:77: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) raft_transfer/twice [ ERROR ] Error: test/integration/test_transfer.c:77: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) raft_transfer/unknownServer [ ERROR ] Error: test/integration/test_transfer.c:77: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) raft_transfer/expire [ ERROR ] Error: test/integration/test_transfer.c:77: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) raft_transfer/catchUp [ ERROR ] Error: test/integration/test_transfer.c:77: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) raft_transfer/upToDate [ ERROR ] Error: test/integration/test_transfer.c:77: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) tick/request_vote_only_to_voters n_voting=2 [ ERROR ] Error: test/integration/test_tick.c:26: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) tick/during_election [ ERROR ] Error: test/integration/test_tick.c:26: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) tick/new_election [ ERROR ] Error: test/integration/test_tick.c:26: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) tick/no_contact [ ERROR ] Error: test/integration/test_tick.c:26: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) tick/not_voter n_voting=1 [ ERROR ] Error: test/integration/test_tick.c:26: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) tick/electionTimerNotExpired [ ERROR ] Error: test/integration/test_tick.c:26: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) tick/candidate [ ERROR ] Error: test/integration/test_tick.c:26: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) tick/electionTimer [ ERROR ] Error: test/integration/test_tick.c:26: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) raft_strerror/default [ OK ] [ 0.00003279 / 0.00003132 CPU ] raft_strerror/RAFT_IOERR [ OK ] [ 0.00002735 / 0.00002656 CPU ] raft_strerror/RAFT_BUSY [ OK ] [ 0.00003860 / 0.00003695 CPU ] raft_strerror/RAFT_NOCONNECTION [ OK ] [ 0.00002688 / 0.00002575 CPU ] raft_strerror/RAFT_TOOBIG [ OK ] [ 0.00003445 / 0.00003375 CPU ] raft_strerror/RAFT_NAMETOOLONG [ OK ] [ 0.00004179 / 0.00002558 CPU ] raft_strerror/RAFT_CANCELED [ OK ] [ 0.00005015 / 0.00004968 CPU ] raft_strerror/RAFT_CORRUPT [ OK ] [ 0.00002406 / 0.00002355 CPU ] raft_strerror/RAFT_CANTCHANGE [ OK ] [ 0.00001705 / 0.00001679 CPU ] raft_strerror/RAFT_CANTBOOTSTRAP [ OK ] [ 0.00004939 / 0.00004800 CPU ] raft_strerror/RAFT_SHUTDOWN [ OK ] [ 0.00004938 / 0.00004802 CPU ] raft_strerror/RAFT_LEADERSHIPLOST [ OK ] [ 0.00005028 / 0.00004860 CPU ] raft_strerror/RAFT_NOTLEADER [ OK ] [ 0.00002314 / 0.00002293 CPU ] raft_strerror/RAFT_MALFORMED [ OK ] [ 0.00002367 / 0.00002337 CPU ] raft_strerror/RAFT_BADROLE [ OK ] [ 0.00002360 / 0.00002330 CPU ] raft_strerror/RAFT_DUPLICATEADDRESS [ OK ] [ 0.00002358 / 0.00002290 CPU ] raft_strerror/RAFT_DUPLICATEID [ OK ] [ 0.00002272 / 0.00002243 CPU ] raft_strerror/RAFT_BADID [ OK ] [ 0.00001685 / 0.00001666 CPU ] raft_strerror/RAFT_NOMEM [ OK ] [ 0.00002287 / 0.00002265 CPU ] raft_start/singleVotingNotUs [ ERROR ] Error: test/integration/test_start.c:199: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) raft_start/singleVotingSelfElect [ ERROR ] Error: test/integration/test_start.c:186: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) raft_start/twoEntries [ ERROR ] Error: test/integration/test_start.c:166: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) raft_start/noEntries [ ERROR ] Error: test/integration/test_start.c:133: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) raft_start/oneSnapshotAndSomeFollowUpEntries [ ERROR ] Error: test/integration/test_start.c:110: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) raft_start/oneSnapshotAndNoEntries [ ERROR ] Error: test/integration/test_start.c:76: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) snapshot/newTermWhileInstalling [ ERROR ] Error: test/integration/test_snapshot.c:20: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) snapshot/unavailableDiscardsSnapshot [ ERROR ] Error: test/integration/test_snapshot.c:20: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) snapshot/snapshotBlocksCandidate [ ERROR ] Error: test/integration/test_snapshot.c:20: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) snapshot/takeSnapshotFail cluster-snapshot-async=0, fsm-version=1 [ ERROR ] Error: test/integration/test_snapshot.c:20: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) cluster-snapshot-async=0, fsm-version=2 [ ERROR ] Error: test/integration/test_snapshot.c:20: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) cluster-snapshot-async=0, fsm-version=3 [ ERROR ] Error: test/integration/test_snapshot.c:20: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) cluster-snapshot-async=1, fsm-version=1 [ ERROR ] Error: test/integration/test_snapshot.c:20: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) cluster-snapshot-async=1, fsm-version=2 [ ERROR ] Error: test/integration/test_snapshot.c:20: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) cluster-snapshot-async=1, fsm-version=3 [ ERROR ] Error: test/integration/test_snapshot.c:20: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) snapshot/takeSnapshotAsyncFailOnce cluster-snapshot-async=1, fsm-version=3 [ ERROR ] Error: test/integration/test_snapshot.c:20: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) snapshot/takeSnapshotAsyncFail cluster-snapshot-async=1, fsm-version=3 [ ERROR ] Error: test/integration/test_snapshot.c:20: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) snapshot/takeSnapshotAsyncWorkFail cluster-snapshot-async=0, fsm-version=1 [ ERROR ] Error: test/integration/test_snapshot.c:20: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) cluster-snapshot-async=0, fsm-version=2 [ ERROR ] Error: test/integration/test_snapshot.c:20: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) cluster-snapshot-async=0, fsm-version=3 [ ERROR ] Error: test/integration/test_snapshot.c:20: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) cluster-snapshot-async=1, fsm-version=1 [ ERROR ] Error: test/integration/test_snapshot.c:20: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) cluster-snapshot-async=1, fsm-version=2 [ ERROR ] Error: test/integration/test_snapshot.c:20: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) cluster-snapshot-async=1, fsm-version=3 [ ERROR ] Error: test/integration/test_snapshot.c:20: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) snapshot/takeSnapshotSnapshotPutFail cluster-snapshot-async=0, fsm-version=1 [ ERROR ] Error: test/integration/test_snapshot.c:20: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) cluster-snapshot-async=0, fsm-version=2 [ ERROR ] Error: test/integration/test_snapshot.c:20: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) cluster-snapshot-async=0, fsm-version=3 [ ERROR ] Error: test/integration/test_snapshot.c:20: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) cluster-snapshot-async=1, fsm-version=1 [ ERROR ] Error: test/integration/test_snapshot.c:20: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) cluster-snapshot-async=1, fsm-version=2 [ ERROR ] Error: test/integration/test_snapshot.c:20: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) cluster-snapshot-async=1, fsm-version=3 [ ERROR ] Error: test/integration/test_snapshot.c:20: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) snapshot/takeSnapshotAppendEntries cluster-snapshot-async=0, fsm-version=1 [ ERROR ] Error: test/integration/test_snapshot.c:20: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) cluster-snapshot-async=0, fsm-version=2 [ ERROR ] Error: test/integration/test_snapshot.c:20: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) cluster-snapshot-async=0, fsm-version=3 [ ERROR ] Error: test/integration/test_snapshot.c:20: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) cluster-snapshot-async=1, fsm-version=1 [ ERROR ] Error: test/integration/test_snapshot.c:20: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) cluster-snapshot-async=1, fsm-version=2 [ ERROR ] Error: test/integration/test_snapshot.c:20: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) cluster-snapshot-async=1, fsm-version=3 [ ERROR ] Error: test/integration/test_snapshot.c:20: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) snapshot/installSnapshotDuringEntriesWrite [ ERROR ] Error: test/integration/test_snapshot.c:20: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) snapshot/installSnapshotHeartBeats [ ERROR ] Error: test/integration/test_snapshot.c:20: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) snapshot/installMultipleTimeOutAppendAfter [ ERROR ] Error: test/integration/test_snapshot.c:20: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) snapshot/installMultipleTimeOut [ ERROR ] Error: test/integration/test_snapshot.c:20: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) snapshot/installOneTimeOutAppendAfter [ ERROR ] Error: test/integration/test_snapshot.c:20: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) snapshot/noSnapshotInstallToKilled [ ERROR ] Error: test/integration/test_snapshot.c:20: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) snapshot/installOneDisconnectedDuringOperationReconnects [ ERROR ] Error: test/integration/test_snapshot.c:20: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) snapshot/installOneDisconnectedFromBeginningReconnects [ ERROR ] Error: test/integration/test_snapshot.c:20: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) snapshot/installOneTimeOut [ ERROR ] Error: test/integration/test_snapshot.c:20: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) snapshot/installOne [ ERROR ] Error: test/integration/test_snapshot.c:20: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) replication/newTermWhileAppending [ ERROR ] Error: test/integration/test_replication.c:1032: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) replication/diskWriteFailure [ ERROR ] Error: test/integration/test_replication.c:1010: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) replication/resultRetry [ ERROR ] Error: test/integration/test_replication.c:994: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) replication/resultHigherTerm [ ERROR ] Error: test/integration/test_replication.c:956: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) replication/resultLowerTerm [ ERROR ] Error: test/integration/test_replication.c:923: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) replication/resultNotLeader [ ERROR ] Error: test/integration/test_replication.c:896: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) replication/recvCandidateHigherTerm [ ERROR ] Error: test/integration/test_replication.c:860: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) replication/recvCandidateSameTerm [ ERROR ] Error: test/integration/test_replication.c:814: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) replication/recvMatch_last_snapshot [ ERROR ] Error: test/integration/test_replication.c:787: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) replication/recvSkip [ ERROR ] Error: test/integration/test_replication.c:737: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) replication/recvPrevIndexConflict [ ERROR ] Error: test/integration/test_replication.c:720: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) replication/recvPrevLogTermMismatchConfigurationSnapshotNoPrev[ ERROR ] Error: test/integration/test_replication.c:686: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) replication/recvPrevLogTermMismatchConfigurationWithPrevious[ ERROR ] Error: test/integration/test_replication.c:631: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) replication/recvPrevLogTermMismatchConfiguration [ ERROR ] Error: test/integration/test_replication.c:575: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) replication/recvPrevLogTermMismatch [ ERROR ] Error: test/integration/test_replication.c:520: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) replication/recvMissingEntries [ ERROR ] Error: test/integration/test_replication.c:489: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) replication/recvStaleTerm [ ERROR ] Error: test/integration/test_replication.c:451: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) replication/recvTwice [ ERROR ] Error: test/integration/test_replication.c:426: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) replication/sendIoError [ SKIP ] replication/sendOom heap-fault-delay=5, heap-fault-repeat=1 [ SKIP ] replication/sendDisconnectPipeline [ ERROR ] Error: test/integration/test_replication.c:349: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) replication/sendDisconnect [ ERROR ] Error: test/integration/test_replication.c:317: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) replication/sendPipeline [ ERROR ] Error: test/integration/test_replication.c:273: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) replication/sendProbe [ ERROR ] Error: test/integration/test_replication.c:217: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) replication/skipIdle [ ERROR ] Error: test/integration/test_replication.c:198: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) replication/sendSkipHeartbeat [ ERROR ] Error: test/integration/test_replication.c:163: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) replication/sendFollowupHeartbeat [ ERROR ] Error: test/integration/test_replication.c:119: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) replication/sendInitialHeartbeat [ ERROR ] Error: test/integration/test_replication.c:83: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) raft_recover/busy [ ERROR ] Error: test/integration/test_recover.c:47: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) raft_remove/badId [ ERROR ] Error: test/integration/test_membership.c:24: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) raft_remove/inProgress [ ERROR ] Error: test/integration/test_membership.c:24: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) raft_remove/notLeader [ ERROR ] Error: test/integration/test_membership.c:24: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) raft_remove/selfThreeNodeClusterReplicate [ ERROR ] Error: test/integration/test_membership.c:24: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) raft_remove/self [ ERROR ] Error: test/integration/test_membership.c:24: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) raft_remove/committed [ ERROR ] Error: test/integration/test_membership.c:24: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) raft_add/duplicateId [ ERROR ] Error: test/integration/test_membership.c:24: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) raft_add/busy [ ERROR ] Error: test/integration/test_membership.c:24: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) raft_add/notLeader [ ERROR ] Error: test/integration/test_membership.c:24: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) raft_add/committed [ ERROR ] Error: test/integration/test_membership.c:24: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) raft_init/fsmVersionNotSet [ OK ] [ 0.00005105 / 0.00004918 CPU ] raft_init/ioVersionNotSet [ OK ] [ 0.00005080 / 0.00004928 CPU ] raft_init/incompatIoFsmAsyncSnapshotNull [ OK ] [ 0.00006949 / 0.00006803 CPU ] raft_init/incompatIoFsmAsyncSnapshotNotNull [ OK ] [ 0.00006299 / 0.00006138 CPU ] raft_heap/aligned_alloc [ OK ] [ 0.00009363 / 0.00009240 CPU ] raft_heap/realloc [ OK ] [ 0.00003316 / 0.00003286 CPU ] raft_heap/calloc [ OK ] [ 0.00004109 / 0.00004028 CPU ] raft_heap/malloc [ OK ] [ 0.00003182 / 0.00003187 CPU ] raft_fixture_step_until_applied/two [ ERROR ] Error: test/integration/test_fixture.c:49: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) raft_fixture_step_until_applied/one [ ERROR ] Error: test/integration/test_fixture.c:49: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) raft_fixture_elect/again [ ERROR ] Error: test/integration/test_fixture.c:49: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) raft_fixture_elect/change [ ERROR ] Error: test/integration/test_fixture.c:49: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) raft_fixture_elect/second [ ERROR ] Error: test/integration/test_fixture.c:49: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) raft_fixture_elect/first [ ERROR ] Error: test/integration/test_fixture.c:49: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) raft_fixture_step/deliver [ ERROR ] Error: test/integration/test_fixture.c:49: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) raft_fixture_step/flushSend [ ERROR ] Error: test/integration/test_fixture.c:49: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) raft_fixture_step/electionTimeout [ ERROR ] Error: test/integration/test_fixture.c:49: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) raft_fixture_step/tick [ ERROR ] Error: test/integration/test_fixture.c:49: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) election/preVoteNoStaleVotes cluster-n=3 [ ERROR ] Error: test/integration/test_election.c:722: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) election/preVoteWithcandidateCrash cluster-n=3 [ ERROR ] Error: test/integration/test_election.c:627: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) election/preVote [ ERROR ] Error: test/integration/test_election.c:585: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) election/ioErrorPersistVote [ SKIP ] election/ioErrorSendVoteRequest [ SKIP ] election/ioErrorConvert delay=0 [ SKIP ] delay=1 [ SKIP ] election/receiveRejectResult cluster-n=5 [ ERROR ] Error: test/integration/test_election.c:486: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) election/rejectIfNotVoter cluster-n=3, cluster-n-voting=2 [ ERROR ] Error: test/integration/test_election.c:450: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) election/rejectIfLastIndexIsLower [ ERROR ] Error: test/integration/test_election.c:407: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) election/rejectIfLastTermIsLower [ ERROR ] Error: test/integration/test_election.c:368: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) election/rejectIfAlreadyVoted cluster-n=3 [ ERROR ] Error: test/integration/test_election.c:327: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) election/rejectIfHasLeader cluster-n=3 [ ERROR ] Error: test/integration/test_election.c:299: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) election/rejectIfHigherTerm [ ERROR ] Error: test/integration/test_election.c:273: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) election/waitQuorum cluster-n=5 [ ERROR ] Error: test/integration/test_election.c:239: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) election/grantIfLastIndexIsHigher [ ERROR ] Error: test/integration/test_election.c:217: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) election/grantIfLastIndexIsSame [ ERROR ] Error: test/integration/test_election.c:190: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) election/grantAgain [ ERROR ] Error: test/integration/test_election.c:145: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) election/twoVoters [ ERROR ] Error: test/integration/test_election.c:115: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) raft_digest/bootstrapServerId [ OK ] [ 0.00005511 / 0.00005357 CPU ] raft_bootstrap/busy [ ERROR ] Error: test/integration/test_bootstrap.c:48: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) raft_barrier/cb [ ERROR ] Error: test/integration/test_barrier.c:20: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) raft_assign/demoteLeaderToSpare [ ERROR ] Error: test/integration/test_assign.c:113: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) raft_assign/demoteLeader [ ERROR ] Error: test/integration/test_assign.c:113: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) raft_assign/demoteToStandBy [ ERROR ] Error: test/integration/test_assign.c:113: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) raft_assign/promoteUnresponsive [ ERROR ] Error: test/integration/test_assign.c:113: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) raft_assign/leadershipLost [ ERROR ] Error: test/integration/test_assign.c:113: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) raft_assign/changeRequestAlreadyInProgress [ ERROR ] Error: test/integration/test_assign.c:113: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) raft_assign/alreadyHasRole [ ERROR ] Error: test/integration/test_assign.c:113: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) raft_assign/badRole [ ERROR ] Error: test/integration/test_assign.c:113: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) raft_assign/unknownId [ ERROR ] Error: test/integration/test_assign.c:113: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) raft_assign/notLeader [ ERROR ] Error: test/integration/test_assign.c:113: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) raft_assign/promoteToStandBy [ ERROR ] Error: test/integration/test_assign.c:113: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) raft_assign/changeIsImmediate [ ERROR ] Error: test/integration/test_assign.c:113: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) raft_assign/promoteNewRound [ ERROR ] Error: test/integration/test_assign.c:113: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) raft_assign/promoteCatchUp [ ERROR ] Error: test/integration/test_assign.c:113: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) raft_assign/promoteUpToDate [ ERROR ] Error: test/integration/test_assign.c:113: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) raft_apply/leadershipLost [ ERROR ] Error: test/integration/test_apply.c:20: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) raft_apply/notLeader [ ERROR ] Error: test/integration/test_apply.c:20: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) raft_apply/two [ ERROR ] Error: test/integration/test_apply.c:20: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) raft_apply/first [ ERROR ] Error: test/integration/test_apply.c:20: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) 28 of 176 (16%) tests successful, 6 (3%) test skipped. FAIL test/integration/core (exit status: 1) FAIL: test/fuzzy/core ===================== Running test suite with seed 0xe1c0d91a... replication/partitioned cluster-n=3 [ ERROR ] Error: test/fuzzy/test_replication.c:28: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) cluster-n=5 [ ERROR ] Error: test/fuzzy/test_replication.c:28: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) cluster-n=7 [ ERROR ] Error: test/fuzzy/test_replication.c:28: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) replication/noQuorum cluster-n=3 [ ERROR ] Error: test/fuzzy/test_replication.c:28: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) cluster-n=5 [ ERROR ] Error: test/fuzzy/test_replication.c:28: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) cluster-n=7 [ ERROR ] Error: test/fuzzy/test_replication.c:28: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) replication/availability cluster-n=3 [ ERROR ] Error: test/fuzzy/test_replication.c:28: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) cluster-n=5 [ ERROR ] Error: test/fuzzy/test_replication.c:28: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) cluster-n=7 [ ERROR ] Error: test/fuzzy/test_replication.c:28: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) replication/appendEntries cluster-n=3 [ ERROR ] Error: test/fuzzy/test_replication.c:28: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) cluster-n=5 [ ERROR ] Error: test/fuzzy/test_replication.c:28: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) cluster-n=7 [ ERROR ] Error: test/fuzzy/test_replication.c:28: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) membership/removeVoting cluster-n=3 [ ERROR ] Error: test/fuzzy/test_membership.c:29: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) cluster-n=4 [ ERROR ] Error: test/fuzzy/test_membership.c:29: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) cluster-n=5 [ ERROR ] Error: test/fuzzy/test_membership.c:29: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) membership/addVoting cluster-n=3 [ ERROR ] Error: test/fuzzy/test_membership.c:29: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) cluster-n=4 [ ERROR ] Error: test/fuzzy/test_membership.c:29: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) cluster-n=5 [ ERROR ] Error: test/fuzzy/test_membership.c:29: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) membership/addNonVoting cluster-n=3 [ ERROR ] Error: test/fuzzy/test_membership.c:29: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) cluster-n=4 [ ERROR ] Error: test/fuzzy/test_membership.c:29: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) cluster-n=5 [ ERROR ] Error: test/fuzzy/test_membership.c:29: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) liveness/networkDisconnect cluster-n=3, cluster-pre-vote=0 [ ERROR ] Error: test/fuzzy/test_liveness.c:85: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) cluster-n=3, cluster-pre-vote=1 [ ERROR ] Error: test/fuzzy/test_liveness.c:85: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) cluster-n=4, cluster-pre-vote=0 [ ERROR ] Error: test/fuzzy/test_liveness.c:85: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) cluster-n=4, cluster-pre-vote=1 [ ERROR ] Error: test/fuzzy/test_liveness.c:85: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) election/noQuorum cluster-n=3, cluster-pre-vote=0 [ ERROR ] Error: test/fuzzy/test_election.c:30: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) cluster-n=3, cluster-pre-vote=1 [ ERROR ] Error: test/fuzzy/test_election.c:30: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) cluster-n=4, cluster-pre-vote=0 [ ERROR ] Error: test/fuzzy/test_election.c:30: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) cluster-n=4, cluster-pre-vote=1 [ ERROR ] Error: test/fuzzy/test_election.c:30: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) cluster-n=5, cluster-pre-vote=0 [ ERROR ] Error: test/fuzzy/test_election.c:30: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) cluster-n=5, cluster-pre-vote=1 [ ERROR ] Error: test/fuzzy/test_election.c:30: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) cluster-n=7, cluster-pre-vote=0 [ ERROR ] Error: test/fuzzy/test_election.c:30: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) cluster-n=7, cluster-pre-vote=1 [ ERROR ] Error: test/fuzzy/test_election.c:30: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) election/changeReviveOutdated cluster-n=3, cluster-pre-vote=0 [ ERROR ] Error: test/fuzzy/test_election.c:30: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) cluster-n=3, cluster-pre-vote=1 [ ERROR ] Error: test/fuzzy/test_election.c:30: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) cluster-n=4, cluster-pre-vote=0 [ ERROR ] Error: test/fuzzy/test_election.c:30: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) cluster-n=4, cluster-pre-vote=1 [ ERROR ] Error: test/fuzzy/test_election.c:30: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) cluster-n=5, cluster-pre-vote=0 [ ERROR ] Error: test/fuzzy/test_election.c:30: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) cluster-n=5, cluster-pre-vote=1 [ ERROR ] Error: test/fuzzy/test_election.c:30: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) cluster-n=7, cluster-pre-vote=0 [ ERROR ] Error: test/fuzzy/test_election.c:30: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) cluster-n=7, cluster-pre-vote=1 [ ERROR ] Error: test/fuzzy/test_election.c:30: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) election/change cluster-n=3, cluster-pre-vote=0 [ ERROR ] Error: test/fuzzy/test_election.c:30: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) cluster-n=3, cluster-pre-vote=1 [ ERROR ] Error: test/fuzzy/test_election.c:30: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) cluster-n=4, cluster-pre-vote=0 [ ERROR ] Error: test/fuzzy/test_election.c:30: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) cluster-n=4, cluster-pre-vote=1 [ ERROR ] Error: test/fuzzy/test_election.c:30: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) cluster-n=5, cluster-pre-vote=0 [ ERROR ] Error: test/fuzzy/test_election.c:30: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) cluster-n=5, cluster-pre-vote=1 [ ERROR ] Error: test/fuzzy/test_election.c:30: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) cluster-n=7, cluster-pre-vote=0 [ ERROR ] Error: test/fuzzy/test_election.c:30: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) cluster-n=7, cluster-pre-vote=1 [ ERROR ] Error: test/fuzzy/test_election.c:30: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) election/win cluster-n=3, cluster-pre-vote=0 [ ERROR ] Error: test/fuzzy/test_election.c:30: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) cluster-n=3, cluster-pre-vote=1 [ ERROR ] Error: test/fuzzy/test_election.c:30: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) cluster-n=4, cluster-pre-vote=0 [ ERROR ] Error: test/fuzzy/test_election.c:30: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) cluster-n=4, cluster-pre-vote=1 [ ERROR ] Error: test/fuzzy/test_election.c:30: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) cluster-n=5, cluster-pre-vote=0 [ ERROR ] Error: test/fuzzy/test_election.c:30: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) cluster-n=5, cluster-pre-vote=1 [ ERROR ] Error: test/fuzzy/test_election.c:30: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) cluster-n=7, cluster-pre-vote=0 [ ERROR ] Error: test/fuzzy/test_election.c:30: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) cluster-n=7, cluster-pre-vote=1 [ ERROR ] Error: test/fuzzy/test_election.c:30: assertion failed: rc == 0 (5 == 0) Error: child killed by signal 6 (Aborted) 0 of 57 (0%) tests successful, 0 (0%) test skipped. FAIL test/fuzzy/core (exit status: 1) FAIL: test/integration/uv ========================= Running test suite with seed 0x764d3de2... UvAsyncWork/work rv=-1 [ OK ] [ 1.00070876 / 0.00078552 CPU ] rv=0 [ OK ] [ 1.00058278 / 0.00083897 CPU ] rv=1 [ OK ] [ 1.00104365 / 0.00115178 CPU ] rv=37 [ OK ] [ 1.00060616 / 0.00080085 CPU ] truncate/closingMultiple [ OK ] [ 0.00669700 / 0.00701806 CPU ] truncate/closing [ OK ] [ 0.00689372 / 0.00717346 CPU ] truncate/multiplePending [ OK ] [ 0.06580848 / 0.02559541 CPU ] truncate/pendingAppend [ OK ] [ 0.04010848 / 0.02218906 CPU ] truncate/partialSegment [ OK ] [ 0.06135409 / 0.02097383 CPU ] truncate/sameAsLastIndex [ OK ] [ 0.05621408 / 0.02342573 CPU ] truncate/wholeSegment [ OK ] [ 0.04779277 / 0.02009013 CPU ] snapshot_put/installMultipleAppendEntriesInBetween [ ERROR ] src/uv_prepare.c:164 - create open segment open-1 src/uv_snapshot.c:645 - put snapshot at 1, keeping 0 src/uv_prepare.c:230 - completed creation of open-1 src/uv_prepare.c:164 - create open segment open-2 src/uv_finalize.c: 39 - finalize open-1 into 0000000000000001-0000000000000512 src/uv.c:159 - uv maybe fire close cb src/uv_finalize.c: 78 - uv finalize after work cb status:0 src/uv_finalize.c: 92 - unblock barrier or close src/uv.c:159 - uv maybe fire close cb src/uv_prepare.c:230 - completed creation of open-2 src/uv_prepare.c:164 - create open segment open-3 src/uv_snapshot.c:522 - snapshot write start src/uv_snapshot.c:530 - snapshot write end 18 src/uv_snapshot.c:533 - snapshot creation failed 18 Error: test/integration/test_uv_snapshot_put.c:40: assertion failed: status == result->status (18 == 0) Error: child killed by signal 6 (Aborted) snapshot_put/installMultipleWithoutPreviousEntries [ ERROR ] src/uv_snapshot.c:645 - put snapshot at 1, keeping 0 src/uv_snapshot.c:522 - snapshot write start src/uv_snapshot.c:530 - snapshot write end 18 src/uv_snapshot.c:533 - snapshot creation failed 18 Error: test/integration/test_uv_snapshot_put.c:40: assertion failed: status == result->status (18 == 0) Error: child killed by signal 6 (Aborted) snapshot_put/installWithoutPreviousEntries [ ERROR ] src/uv_snapshot.c:645 - put snapshot at 1, keeping 0 src/uv_snapshot.c:522 - snapshot write start src/uv_snapshot.c:530 - snapshot write end 18 src/uv_snapshot.c:533 - snapshot creation failed 18 Error: test/integration/test_uv_snapshot_put.c:40: assertion failed: status == result->status (18 == 0) Error: child killed by signal 6 (Aborted) snapshot_put/installNoCompression [ OK ] [ 0.02886949 / 0.01077927 CPU ] snapshot_put/install [ ERROR ] src/uv_prepare.c:164 - create open segment open-1 src/uv_prepare.c:230 - completed creation of open-1 src/uv_prepare.c:164 - create open segment open-2 src/uv_snapshot.c:645 - put snapshot at 1, keeping 0 src/uv_finalize.c: 39 - finalize open-1 into 0000000000000001-0000000000000004 src/uv.c:159 - uv maybe fire close cb src/uv_finalize.c: 78 - uv finalize after work cb status:0 src/uv_finalize.c: 92 - unblock barrier or close src/uv.c:159 - uv maybe fire close cb src/uv_prepare.c:230 - completed creation of open-2 src/uv_prepare.c:164 - create open segment open-3 src/uv_snapshot.c:522 - snapshot write start src/uv_snapshot.c:530 - snapshot write end 18 src/uv_snapshot.c:533 - snapshot creation failed 18 Error: test/integration/test_uv_snapshot_put.c:40: assertion failed: status == result->status (18 == 0) Error: child killed by signal 6 (Aborted) snapshot_put/entriesMoreThanTrailing [ ERROR ] src/uv_prepare.c:164 - create open segment open-1 src/uv_prepare.c:230 - completed creation of open-1 src/uv_prepare.c:164 - create open segment open-2 src/uv_prepare.c:230 - completed creation of open-2 src/uv_prepare.c:164 - create open segment open-3 src/uv_prepare.c:230 - completed creation of open-3 src/uv_prepare.c:164 - create open segment open-4 src/uv_finalize.c: 39 - finalize open-1 into 0000000000000001-0000000000000150 src/uv_prepare.c:230 - completed creation of open-4 src/uv.c:159 - uv maybe fire close cb src/uv_finalize.c: 78 - uv finalize after work cb status:0 src/uv_finalize.c: 92 - unblock barrier or close src/uv.c:159 - uv maybe fire close cb src/uv_prepare.c:164 - create open segment open-5 src/uv_finalize.c: 39 - finalize open-2 into 0000000000000151-0000000000000300 src/uv.c:159 - uv maybe fire close cb src/uv_prepare.c:230 - completed creation of open-5 src/uv_finalize.c: 78 - uv finalize after work cb status:0 src/uv_finalize.c: 92 - unblock barrier or close src/uv.c:159 - uv maybe fire close cb src/uv_snapshot.c:645 - put snapshot at 280, keeping 128 src/uv_finalize.c: 39 - finalize open-3 into 0000000000000301-0000000000000400 src/uv.c:159 - uv maybe fire close cb src/uv_finalize.c: 78 - uv finalize after work cb status:0 src/uv_finalize.c: 92 - unblock barrier or close src/uv.c:159 - uv maybe fire close cb src/uv_snapshot.c:522 - snapshot write start src/uv_snapshot.c:530 - snapshot write end 18 src/uv_snapshot.c:533 - snapshot creation failed 18 Error: test/integration/test_uv_snapshot_put.c:40: assertion failed: status == result->status (18 == 0) Error: child killed by signal 6 (Aborted) snapshot_put/entriesLessThanTrailing [ ERROR ] src/uv_prepare.c:164 - create open segment open-1 src/uv_prepare.c:230 - completed creation of open-1 src/uv_prepare.c:164 - create open segment open-2 src/uv_prepare.c:230 - completed creation of open-2 src/uv_prepare.c:164 - create open segment open-3 src/uv_prepare.c:230 - completed creation of open-3 src/uv_prepare.c:164 - create open segment open-4 src/uv_finalize.c: 39 - finalize open-1 into 0000000000000001-0000000000000150 src/uv_prepare.c:230 - completed creation of open-4 src/uv.c:159 - uv maybe fire close cb src/uv_finalize.c: 78 - uv finalize after work cb status:0 src/uv_finalize.c: 92 - unblock barrier or close src/uv.c:159 - uv maybe fire close cb src/uv_prepare.c:164 - create open segment open-5 src/uv_finalize.c: 39 - finalize open-2 into 0000000000000151-0000000000000300 src/uv_prepare.c:230 - completed creation of open-5 src/uv.c:159 - uv maybe fire close cb src/uv_finalize.c: 78 - uv finalize after work cb status:0 src/uv_finalize.c: 92 - unblock barrier or close src/uv.c:159 - uv maybe fire close cb src/uv_snapshot.c:645 - put snapshot at 100, keeping 128 src/uv_finalize.c: 39 - finalize open-3 into 0000000000000301-0000000000000400 src/uv.c:159 - uv maybe fire close cb src/uv_finalize.c: 78 - uv finalize after work cb status:0 src/uv_finalize.c: 92 - unblock barrier or close src/uv.c:159 - uv maybe fire close cb src/uv_snapshot.c:522 - snapshot write start src/uv_snapshot.c:530 - snapshot write end 18 src/uv_snapshot.c:533 - snapshot creation failed 18 Error: test/integration/test_uv_snapshot_put.c:40: assertion failed: status == result->status (18 == 0) Error: child killed by signal 6 (Aborted) snapshot_put/first [ ERROR ] src/uv_snapshot.c:645 - put snapshot at 1, keeping 10 src/uv_snapshot.c:522 - snapshot write start src/uv_snapshot.c:530 - snapshot write end 18 src/uv_snapshot.c:533 - snapshot creation failed 18 Error: test/integration/test_uv_snapshot_put.c:40: assertion failed: status == result->status (18 == 0) Error: child killed by signal 6 (Aborted) tcp_listen/handshake n=8 [ OK ] [ 0.00072771 / 0.00065381 CPU ] n=16 [ OK ] [ 0.00038766 / 0.00034593 CPU ] n=24 [ OK ] [ 0.00029192 / 0.00026705 CPU ] n=32 [ OK ] [ 0.00032317 / 0.00029901 CPU ] tcp_listen/closeBeforeHandshake [ OK ] [ 0.00025111 / 0.00022485 CPU ] tcp_listen/pending [ OK ] [ 0.00021241 / 0.00019056 CPU ] tcp_listen/oom heap-fault-delay=0, heap-fault-repeat=1 [ OK ] [ 0.00027082 / 0.00024877 CPU ] heap-fault-delay=1, heap-fault-repeat=1 [ OK ] [ 0.00025952 / 0.00023817 CPU ] heap-fault-delay=3, heap-fault-repeat=1 [ OK ] [ 0.00027498 / 0.00025218 CPU ] tcp_listen/peerAbort n=8 [ OK ] [ 0.00026067 / 0.00023846 CPU ] n=16 [ OK ] [ 0.00034554 / 0.00030403 CPU ] n=24 [ OK ] [ 0.00031161 / 0.00028324 CPU ] n=32 [ OK ] [ 0.00031952 / 0.00028520 CPU ] tcp_listen/badProtocol [ OK ] [ 0.00028836 / 0.00026390 CPU ] tcp_listen/resolveFailure [ OK ] [ 0.00001259 / 0.00001206 CPU ] tcp_listen/cannotBindSecond [ OK ] [ 0.00007086 / 0.00007056 CPU ] tcp_listen/cannotBindFirst [ OK ] [ 0.00005309 / 0.00005251 CPU ] tcp_listen/alreadyBound [ OK ] [ 0.00007502 / 0.00007458 CPU ] tcp_listen/secondOfTwo [ OK ] [ 0.00020954 / 0.00018493 CPU ] tcp_listen/firstOfTwo [ OK ] [ 0.00021337 / 0.00018767 CPU ] tcp_listen/invalidAddress address=500.1.2.3:9000, bind-address= [ OK ] [ 0.00022132 / 0.00021689 CPU ] address=500.1.2.3:9000, bind-address=500.1.2.3:9000 [ OK ] [ 0.00024918 / 0.00024087 CPU ] address=500.1.2.3:9000, bind-address=not-existing:9000 [ OK ] [ 4.01436833 / 0.00142654 CPU ] address=500.1.2.3:9000, bind-address=192.0.2.0:9000 [ OK ] [ 0.00020863 / 0.00020828 CPU ] address=not-existing:9000, bind-address= [ OK ] [ 3.99652383 / 0.00145893 CPU ] address=not-existing:9000, bind-address=500.1.2.3:9000 [ OK ] [ 0.00029488 / 0.00029455 CPU ] address=not-existing:9000, bind-address=not-existing:9000 [ OK ] [ 3.99648890 / 0.00115747 CPU ] address=not-existing:9000, bind-address=192.0.2.0:9000 [ OK ] [ 0.00020786 / 0.00020101 CPU ] address=192.0.2.0:9000, bind-address= [ OK ] [ 0.00018127 / 0.00018069 CPU ] address=192.0.2.0:9000, bind-address=500.1.2.3:9000 [ OK ] [ 0.00024104 / 0.00024060 CPU ] address=192.0.2.0:9000, bind-address=not-existing:9000 [ OK ] [ 3.99381343 / 0.00127871 CPU ] address=192.0.2.0:9000, bind-address=192.0.2.0:9000 [ OK ] [ 0.00021688 / 0.00021680 CPU ] tcp_listen/success address=127.0.0.1:9000, bind-address= [ OK ] [ 0.00037021 / 0.00032982 CPU ] address=127.0.0.1:9000, bind-address=127.0.0.1:9000 [ OK ] [ 0.00053449 / 0.00050557 CPU ] address=127.0.0.1:9000, bind-address=localhost:9000 [ OK ] [ 0.00051356 / 0.00048573 CPU ] address=127.0.0.1:9000, bind-address=:9000 [ OK ] [ 0.00031827 / 0.00029035 CPU ] address=127.0.0.1:9000, bind-address=0.0.0.0:9000 [ OK ] [ 0.00034525 / 0.00028604 CPU ] address=localhost:9000, bind-address= [ OK ] [ 0.00049219 / 0.00045341 CPU ] address=localhost:9000, bind-address=127.0.0.1:9000 [ OK ] [ 0.00027625 / 0.00025188 CPU ] address=localhost:9000, bind-address=localhost:9000 [ OK ] [ 0.00052164 / 0.00048371 CPU ] address=localhost:9000, bind-address=:9000 [ OK ] [ 0.00031526 / 0.00028738 CPU ] address=localhost:9000, bind-address=0.0.0.0:9000 [ OK ] [ 0.00033338 / 0.00030591 CPU ] tcp_connect/closeDuringSecondConnect [ OK ] [ 0.00052602 / 0.00082378 CPU ] tcp_connect/closeDuringConnectAbort [ OK ] [ 0.00064354 / 0.00089142 CPU ] tcp_connect/closeDuringDnsLookupAbort [ OK ] [ 0.00067999 / 0.00102956 CPU ] tcp_connect/closeDuringHandshake [ SKIP ] tcp_connect/closeDuringDnsLookup [ OK ] [ 0.00058482 / 0.00069720 CPU ] tcp_connect/closeImmediately [ OK ] [ 0.00042067 / 0.00057463 CPU ] tcp_connect/oom heap-fault-delay=0, heap-fault-repeat=1 [ OK ] [ 0.00001404 / 0.00001292 CPU ] heap-fault-delay=1, heap-fault-repeat=1 [ OK ] [ 0.00001583 / 0.00001513 CPU ] heap-fault-delay=2, heap-fault-repeat=1 [ OK ] [ 0.00001756 / 0.00001682 CPU ] tcp_connect/refused [ OK ] [ 0.00058426 / 0.00070399 CPU ] tcp_connect/secondIP [ OK ] [ 0.00055818 / 0.00067158 CPU ] tcp_connect/firstIP [ OK ] [ 0.00045597 / 0.00054400 CPU ] tcp_connect/connectByName [ OK ] [ 0.00083152 / 0.00106499 CPU ] tcp_connect/first [ OK ] [ 0.00062312 / 0.00074279 CPU ] set_term/metadataTwoIsGreater [ OK ] [ 0.00025229 / 0.00025205 CPU ] set_term/metadataOneIsGreater [ OK ] [ 0.00024112 / 0.00023315 CPU ] set_term/metadataOneExists [ OK ] [ 0.00021801 / 0.00021771 CPU ] set_term/fourth [ OK ] [ 0.00009545 / 0.00009498 CPU ] set_term/third [ OK ] [ 0.00010594 / 0.00009742 CPU ] set_term/second [ OK ] [ 0.00007750 / 0.00007686 CPU ] set_term/first [ OK ] [ 0.00005192 / 0.00005129 CPU ] send/closeDuringConnection [ OK ] [ 0.00049207 / 0.00065992 CPU ] send/closeDuringWrite [ OK ] [ 0.00046462 / 0.00066889 CPU ] send/oomAsync heap-fault-delay=2, heap-fault-repeat=1 [ OK ] [ 0.00066643 / 0.00080495 CPU ] send/oom heap-fault-delay=0, heap-fault-repeat=1 [ OK ] [ 0.00000859 / 0.00000762 CPU ] heap-fault-delay=1, heap-fault-repeat=1 [ OK ] [ 0.00001205 / 0.00001148 CPU ] heap-fault-delay=2, heap-fault-repeat=1 [ OK ] [ 0.00001264 / 0.00001184 CPU ] heap-fault-delay=3, heap-fault-repeat=1 [ OK ] [ 0.00001240 / 0.00001168 CPU ] heap-fault-delay=4, heap-fault-repeat=1 [ OK ] [ 0.00001433 / 0.00001353 CPU ] send/reconnectAfterMultipleWriteErrors [ OK ] [ 0.00101666 / 0.00129550 CPU ] send/reconnectAfterWriteError [ OK ] [ 0.00083889 / 0.00095302 CPU ] send/evictOldPending [ OK ] [ 0.00059429 / 0.00080983 CPU ] send/badMessage [ OK ] [ 0.00001315 / 0.00001243 CPU ] send/changeToUnconnectedAddress [ OK ] [ 0.00105600 / 0.00135285 CPU ] send/badAddress [ OK ] [ 0.00050502 / 0.00068716 CPU ] send/noConnection [ OK ] [ 0.00051501 / 0.00070265 CPU ] send/installSnapshot [ OK ] [ 0.00060394 / 0.00077338 CPU ] send/appendEntriesResult [ OK ] [ 0.00070554 / 0.00093034 CPU ] send/heartbeat [ OK ] [ 0.00065034 / 0.00082772 CPU ] send/appendEntries [ OK ] [ 0.00059881 / 0.00080607 CPU ] send/voteResult [ OK ] [ 0.00062981 / 0.00080944 CPU ] send/parallel [ OK ] [ 0.00065808 / 0.00075652 CPU ] send/second [ OK ] [ 0.00057653 / 0.00068451 CPU ] send/first [ OK ] [ 0.00054805 / 0.00065303 CPU ] recv/closeAfterAppendEntriesHeader [ SKIP ] recv/closeBeforeAccept [ OK ] [ 0.00021182 / 0.00014250 CPU ] recv/badType [ OK ] [ 0.00014249 / 0.00011160 CPU ] recv/badSize [ OK ] [ 0.00014925 / 0.00011797 CPU ] recv/badProtocol [ OK ] [ 0.00012898 / 0.00010270 CPU ] recv/timeoutNow [ OK ] [ 0.00057059 / 0.00071516 CPU ] recv/installSnapshot [ ERROR ] src/uv_recv.c:267 - decode message: server role is not valid src/uv.c:159 - uv maybe fire close cb Error: test/integration/test_uv_recv.c:395: uv_run: condition not met in 20 iterations Error: child killed by signal 6 (Aborted) recv/appendEntriesResult [ OK ] [ 0.00057461 / 0.00067504 CPU ] recv/heartbeat [ OK ] [ 0.00053659 / 0.00067048 CPU ] recv/appendEntries [ OK ] [ 0.00052967 / 0.00059120 CPU ] recv/requestVoteResult [ OK ] [ 0.00048164 / 0.00053450 CPU ] recv/second [ OK ] [ 0.00052244 / 0.00056917 CPU ] recv/first [ OK ] [ 0.00056225 / 0.00065040 CPU ] recover/newConfiguration [ OK ] [ 0.00023697 / 0.00022782 CPU ] load/openSegmentWithBadFormat [ OK ] [ 0.03508857 / 0.00122736 CPU ] load/openSegmentWithZeroFormatAndThenData [ OK ] [ 0.03766882 / 0.00130582 CPU ] load/openSegmentWithNoAccessPermission [ OK ] [ 0.03742593 / 0.00116518 CPU ] load/closedSegmentWithBadFormat [ OK ] [ 0.00022952 / 0.00021896 CPU ] load/emptyClosedSegment [ OK ] [ 0.00023500 / 0.00023861 CPU ] load/closedSegmentWithBadIndex [ OK ] [ 0.06558443 / 0.00206803 CPU ] load/closedSegmentWithCorruptedBatchData [ OK ] [ 0.03175544 / 0.00195720 CPU ] load/closedSegmentWithCorruptedBatchHeader [ OK ] [ 0.02386712 / 0.00143961 CPU ] load/openSegmentWithIncompleteBatchData [ OK ] [ 0.04111334 / 0.00158820 CPU ] load/openSegmentWithIncompleteBatchHeader [ OK ] [ 0.04252179 / 0.00129382 CPU ] load/openSegmentWithIncompletePreamble [ OK ] [ 0.02818375 / 0.00138579 CPU ] load/openSegmentWithIncompleteFormat [ OK ] [ 0.00022569 / 0.00022558 CPU ] load/closedSegmentWithEntriesPastSnapshot [ ERROR ] Error: test/integration/test_uv_load.c:40: assertion failed: status == 0 (18 == 0) Error: child killed by signal 6 (Aborted) load/nonContiguousClosedSegments [ ERROR ] Error: test/integration/test_uv_load.c:40: assertion failed: status == 0 (18 == 0) Error: child killed by signal 6 (Aborted) load/closedSegmentsWithSnapshotSecondLastSegmentCorrupt [ ERROR ] Error: test/integration/test_uv_load.c:40: assertion failed: status == 0 (18 == 0) Error: child killed by signal 6 (Aborted) load/closedSegmentsWithSnapshotLastSegmentCorruptOpenSegmentNoRecover[ ERROR ] Error: test/integration/test_uv_load.c:40: assertion failed: status == 0 (18 == 0) Error: child killed by signal 6 (Aborted) load/closedSegmentsWithSnapshotLastSegmentCorruptOpenSegment[ ERROR ] Error: test/integration/test_uv_load.c:40: assertion failed: status == 0 (18 == 0) Error: child killed by signal 6 (Aborted) load/closedSegmentsWithSnapshotLastSegmentCorrupt [ ERROR ] Error: test/integration/test_uv_load.c:40: assertion failed: status == 0 (18 == 0) Error: child killed by signal 6 (Aborted) load/closedSegmentsWithSnapshotLastSegmentCorruptNoRecover [ ERROR ] Error: test/integration/test_uv_load.c:40: assertion failed: status == 0 (18 == 0) Error: child killed by signal 6 (Aborted) load/closedSegmentsOverlappingWithSnapshot [ ERROR ] Error: test/integration/test_uv_load.c:40: assertion failed: status == 0 (18 == 0) Error: child killed by signal 6 (Aborted) load/corruptLastOpenSegmentClosedSegments [ OK ] [ 0.12643044 / 0.00253787 CPU ] load/corruptLastOpenSegmentClosedSegmentsNoRecover [ OK ] [ 0.08356123 / 0.00251524 CPU ] load/corruptOpenSegmentsClosedSegments [ OK ] [ 0.08328364 / 0.00267901 CPU ] load/corruptOpenSegmentsClosedSegmentsNoRecover [ OK ] [ 0.11152799 / 0.00251268 CPU ] load/corruptOpenSegmentClosedSegments [ OK ] [ 0.05096525 / 0.00298294 CPU ] load/corruptOpenSegmentClosedSegmentsNoRecover [ OK ] [ 0.06222627 / 0.00229662 CPU ] load/corruptOpenSegmentClosedSegmentsSnapshotPresentNoRecover[ ERROR ] Error: test/integration/test_uv_load.c:40: assertion failed: status == 0 (18 == 0) Error: child killed by signal 6 (Aborted) load/corruptOpenSegmentClosedSegmentsSnapshotPresent [ ERROR ] Error: test/integration/test_uv_load.c:40: assertion failed: status == 0 (18 == 0) Error: child killed by signal 6 (Aborted) load/corruptOpenSegmentClosedSegmentSnapshotPresent [ ERROR ] Error: test/integration/test_uv_load.c:40: assertion failed: status == 0 (18 == 0) Error: child killed by signal 6 (Aborted) load/corruptOpenSegmentClosedSegmentSnapshotPresentNoRecover[ ERROR ] Error: test/integration/test_uv_load.c:40: assertion failed: status == 0 (18 == 0) Error: child killed by signal 6 (Aborted) load/corruptOpenSegmentNoClosedSegmentsSnapshotPresent [ ERROR ] Error: test/integration/test_uv_load.c:40: assertion failed: status == 0 (18 == 0) Error: child killed by signal 6 (Aborted) load/corruptOpenSegmentNoClosedSegmentsSnapshotPresentNoRecover[ ERROR ] Error: test/integration/test_uv_load.c:40: assertion failed: status == 0 (18 == 0) Error: child killed by signal 6 (Aborted) load/openSegmentNoClosedSegmentsSnapshotPresent [ ERROR ] Error: test/integration/test_uv_load.c:40: assertion failed: status == 0 (18 == 0) Error: child killed by signal 6 (Aborted) load/openSegmentWithEntriesBehindSnapshot [ ERROR ] Error: test/integration/test_uv_load.c:40: assertion failed: status == 0 (18 == 0) Error: child killed by signal 6 (Aborted) load/openSegmentWithEntriesBehindSnapshotNoRecover [ ERROR ] Error: test/integration/test_uv_load.c:40: assertion failed: status == 0 (18 == 0) Error: child killed by signal 6 (Aborted) load/closedSegmentWithInconsistentFilename [ OK ] [ 0.02588917 / 0.00166809 CPU ] load/closedSegmentWithInconsistentFilenameNoRecover [ OK ] [ 0.02806566 / 0.00174949 CPU ] load/openSegmentWithEntriesPastSnapshot [ ERROR ] Error: test/integration/test_uv_load.c:40: assertion failed: status == 0 (18 == 0) Error: child killed by signal 6 (Aborted) load/closedSegmentWithEntriesBehindSnapshot [ ERROR ] Error: test/integration/test_uv_load.c:40: assertion failed: status == 0 (18 == 0) Error: child killed by signal 6 (Aborted) load/orphanedSnapshotFiles [ ERROR ] Error: test/integration/test_uv_load.c:40: assertion failed: status == 0 (18 == 0) Error: child killed by signal 6 (Aborted) load/emptySnapshot [ ERROR ] Error: test/integration/test_uv_load.c:40: assertion failed: status == 0 (18 == 0) Error: child killed by signal 6 (Aborted) load/manySnapshots [ ERROR ] Error: test/integration/test_uv_load.c:40: assertion failed: status == 0 (18 == 0) Error: child killed by signal 6 (Aborted) load/onlyOneSnapshot [ ERROR ] Error: test/integration/test_uv_load.c:40: assertion failed: status == 0 (18 == 0) Error: child killed by signal 6 (Aborted) load/openSegment [ OK ] [ 0.01910316 / 0.00164372 CPU ] load/twoOpenSegmentsFirstCorruptNoRecovery [ OK ] [ 0.01937628 / 0.00122055 CPU ] load/twoOpenSegmentsFirstCorrupt [ OK ] [ 0.01971927 / 0.00167851 CPU ] load/secondOpenSegmentIsAllZeros [ OK ] [ 0.02622999 / 0.00137248 CPU ] load/twoOpenSegments [ OK ] [ 0.04157337 / 0.00203053 CPU ] load/openSegmentWithIncompleteFirstBatch [ OK ] [ 0.02194221 / 0.00174128 CPU ] load/openSegmentWithIncompleteBatch [ OK ] [ 0.02336993 / 0.00159907 CPU ] load/openSegmentWithNonZeroData [ OK ] [ 0.03329242 / 0.00147146 CPU ] load/bothOpenAndClosedSegments [ OK ] [ 0.07424451 / 0.00377306 CPU ] load/openSegmentWithTrailingZeros [ OK ] [ 0.00051518 / 0.00051370 CPU ] load/emptyOpenSegment [ OK ] [ 0.00031184 / 0.00030388 CPU ] load/removeUnusableFiles filename=tmp-0000000001221212-0000000001221217 [ OK ] [ 0.00020501 / 0.00020487 CPU ] filename=tmp-snapshot-15-8260687-512469866 [ OK ] [ 0.00023777 / 0.00022835 CPU ] filename=snapshot-525-43326736-880259052 [ OK ] [ 0.00026286 / 0.00026205 CPU ] filename=snapshot-999-13371337-880259052.meta [ OK ] [ 0.00021116 / 0.00021106 CPU ] filename=snapshot-20-8260687-512469866 [ OK ] [ 0.00023707 / 0.00023687 CPU ] filename=snapshot-88-8260687-512469866.meta [ OK ] [ 0.00022530 / 0.00021958 CPU ] filename=snapshot-88-8260999-512469866.meta [ OK ] [ 0.00054372 / 0.00053210 CPU ] filename=tmp-snapshot-88-8260999-512469866.meta [ OK ] [ 0.00020743 / 0.00020211 CPU ] filename=tmp-snapshot-33-8260687-512469866 [ OK ] [ 0.00020439 / 0.00020425 CPU ] filename=snapshot-33-8260687-512469866.meta [ OK ] [ 0.00023543 / 0.00023530 CPU ] filename=tmp-metadata1 [ OK ] [ 0.00020818 / 0.00020224 CPU ] filename=tmp-metadata2 [ OK ] [ 0.00019840 / 0.00019828 CPU ] filename=tmp-open1 [ OK ] [ 0.00020451 / 0.00020444 CPU ] filename=tmp-open13 [ OK ] [ 0.00020621 / 0.00020098 CPU ] load/ignoreUnknownFiles filename=garbage [ OK ] [ 0.00019015 / 0.00019002 CPU ] filename=0000000000000000000000000001-00000000001garbage [ OK ] [ 0.00018693 / 0.00018680 CPU ] filename=open-1garbage [ OK ] [ 0.00019285 / 0.00019268 CPU ] load/emptyDir [ OK ] [ 0.00015437 / 0.00015422 CPU ] bootstrap/termIsNonZero [ OK ] [ 0.00011100 / 0.00011071 CPU ] bootstrap/pristine [ OK ] [ 0.00010042 / 0.00010005 CPU ] append/blockingBarrierLongBlockingTask [ OK ] [ 1.00070035 / 0.00094615 CPU ] append/nonBlockingBarrierLongBlockingTask [ OK ] [ 1.00061015 / 0.00134245 CPU ] append/blockingBarrierSingleOpenSegment [ OK ] [ 0.06097815 / 0.00298757 CPU ] append/blockingBarrierNoOpenSegments [ OK ] [ 0.04011472 / 0.00237867 CPU ] append/barrierOpenSegments bool=0 [ OK ] [ 0.06824539 / 0.00285357 CPU ] bool=1 [ OK ] [ 0.07051374 / 0.00324598 CPU ] append/ioSetupError [ OK ] [ 0.00318105 / 0.00348805 CPU ] append/currentSegment [ OK ] [ 0.02767247 / 0.00149888 CPU ] append/cancelPrepareRequest [ SKIP ] append/removeSegmentUponClose [ OK ] [ 0.02912052 / 0.00119792 CPU ] append/closeDuringWrite [ SKIP ] append/oom heap-fault-delay=1, heap-fault-repeat=1 [ OK ] [ 0.00000444 / 0.00000364 CPU ] append/writeError [ SKIP ] append/noSpaceResolved dir-fs=tmpfs [ SKIP ] append/noSpaceUponWrite dir-fs=tmpfs [ SKIP ] append/noSpaceUponPrepareSpare dir-fs=tmpfs [ SKIP ] append/noSpaceUponPrepareCurrent dir-fs=tmpfs [ SKIP ] append/cancel [ OK ] [ 0.00065484 / 0.00098160 CPU ] append/counter [ OK ] [ 0.05422373 / 0.00320353 CPU ] append/prepareClosing [ OK ] [ 0.03363710 / 0.00131519 CPU ] append/truncateClosing [ OK ] [ 0.03185863 / 0.00120295 CPU ] append/truncate [ SKIP ] append/resizeArena [ OK ] [ 0.02106300 / 0.00204370 CPU ] append/wait [ OK ] [ 0.00074946 / 0.00110734 CPU ] append/batch [ OK ] [ 0.00058382 / 0.00085261 CPU ] append/exceedBlock [ OK ] [ 0.02451488 / 0.00187680 CPU ] append/matchBlock [ OK ] [ 0.02258366 / 0.00170142 CPU ] append/fitBlock [ OK ] [ 0.03396674 / 0.00180171 CPU ] append/severalBig [ OK ] [ 0.08112844 / 0.00450048 CPU ] append/secondBig [ OK ] [ 0.03631458 / 0.00203398 CPU ] append/firstBig [ OK ] [ 0.03741419 / 0.00192726 CPU ] append/finalizeSegment [ OK ] [ 0.04286645 / 0.00176277 CPU ] append/prepareSegments [ OK ] [ 0.00076403 / 0.00109985 CPU ] append/first [ OK ] [ 0.03553477 / 0.00194317 CPU ] append/unaligned [ OK ] [ 0.00002648 / 0.00002577 CPU ] init/metadataOneAndTwoSameVersion [ OK ] [ 0.00021085 / 0.00021038 CPU ] init/metadataOneBadVersion [ OK ] [ 0.00017963 / 0.00017927 CPU ] init/metadataOneBadFormat [ OK ] [ 0.00019006 / 0.00018971 CPU ] init/metadataOneTooShort [ OK ] [ 0.00020504 / 0.00020483 CPU ] init/noSpace dir-fs=tmpfs [ SKIP ] init/dirNotAccessible [ OK ] [ 0.00005222 / 0.00005163 CPU ] init/dirDoesNotExist [ OK ] [ 0.00004536 / 0.00004448 CPU ] init/oom heap-fault-delay=1, heap-fault-repeat=1 [ SKIP ] init/dirTooLong [ OK ] [ 0.00000463 / 0.00000390 CPU ] 194 of 225 (86%) tests successful, 12 (5%) test skipped. FAIL test/integration/uv (exit status: 1) ```
freeekanayaka commented 1 year ago

Which compiler/platform are you using?

There are a few oddities in this output, like the fact tests seem to run in reverse order and more surprisingly a bunch of tests seem to fail because role codes are not correct (5 is RAFT_BADROLE, see for example the configurationDecode/one_server failure).

kloczek commented 1 year ago

I'm using gcc 13.x from Fedora rawhide.

cole-miller commented 1 year ago

Okay, I can reproduce some test failures (not exactly the same pattern you're seeing) in a rawhide container. In particular test/unit/uv/UvFsProbeCapabilities/noAccess and test/integration/uv/load/openSegmentWithNoAccessPermission seem to be giving trouble.

runderwood commented 1 year ago

@cole-miller FWIW, I think maybe the test/integration/uv/load/openSegmentWithNoAccessPermission error in the container is a result of running the tests as root.

When I run the tests in a rawhide container as a non-privileged user, they all pass.

freeekanayaka commented 1 year ago

@runderwood @cole-miller I've fixed test/integration/uv/load/openSegmentWithNoAccessPermission and test/unit/uv/UvFsProbeCapabilities/noAccess in canonical/raft#436.

I've also modified the Github action job to run make check as root in a rawhide container, and with the fix above no tests fail:

https://github.com/freeekanayaka/raft/actions/runs/5320287062/jobs/9633851538

I'm not sure where the errors @kloczek has seen come from. Perhaps the source tree was unintentionally modified?

cole-miller commented 1 year ago

@kloczek, if you're running the tests from a Git checkout, could you run git status to check that no files have been altered from v0.17.1? Assuming nothing like that is going on, could we see the output of uname -a?

kloczek commented 1 year ago

I'm a bit busy now. Will try to reply tomorrow.