search

IntersectMBO / cardano-node

The core component that is used to participate in a Cardano decentralised blockchain.
https://cardano.org
Apache License 2.0
3.04k stars 724 forks source link

[BUG] - block producer die during startup #2050

Closed jbgi closed 1 year ago

jbgi commented 3 years ago 
cardano-node 1.22.1 - linux-x86_64 - ghc-8.10

Core node (producing blocks) fails to start after upgrade to 1.22.1.

First startup failed with:

Invalid snapshot DiskSnapshot 1InitFailureRead (ReadFailed (DeserialiseFailure 4076 "end of input"))

After purging ledger and volatile, and updating to 986c3e011cc2bb3cca07b8314c4a4dbbd96b4dc4 the node fails without error message:

Nov 03 13:33:02 bft-a-1 cardano[29156]: Replayed block: slot SlotNo 6725440 of At (SlotNo 6725733)
Nov 03 13:33:02 bft-a-1 cardano[29156]: Replayed block: slot SlotNo 6725480 of At (SlotNo 6725733)
Nov 03 13:33:02 bft-a-1 cardano[29156]: before next, messages elided = 6725554
Nov 03 13:33:02 bft-a-1 cardano[29156]: Replayed block: slot SlotNo 6725733 of At (SlotNo 6725733)
Nov 03 13:33:02 bft-a-1 cardano[29156]: Opened lgr db
Nov 03 13:33:02 bft-a-1 cardano[29156]: Opened db with immutable tip at fddf03e49a1d36d1fb9e49eca8b2fab2f60e2a8c94a023bec01b4815137025ac at slot 6725733 and tip 6386e7a301dd64e3bee82f0a468b4f99fa9775d25559e2d3407b178849e466>
Nov 03 13:33:03 bft-a-1 systemd[1]: cardano-node.service: Main process exited, code=killed, status=11/SEGV
Nov 03 13:33:03 bft-a-1 systemd[1]: cardano-node.service: Failed with result 'signal'.

(shelley_qa network).

mrBliss commented 3 years ago

This is a known regression that @nc6 is investigating. It also happens on mainnet. This has to be fixed before the release.

mrBliss commented 3 years ago

2059 fixes the "Invalid snapshot" problem, which is unrelated to the segfault.

Any more details about the segfault?

jbgi commented 3 years ago

gdb gives:

[Thread debugging using libthread_db enabled]
Using host libthread_db library "/nix/store/9df65igwjmf2wbw0gbrrgair6piqjgmi-glibc-2.31/lib/libthread_db.so.1".
Core was generated by `/nix/store/d54n8kzq8v4ikyb8p7jcxnxj6if3hn0i-cardano-node-exe-cardano-node-1.22.'.
Program terminated with signal SIGSEGV, Segmentation fault.
#0  0x00007fe18b6e31b7 in __memmove_avx_unaligned () from /nix/store/9df65igwjmf2wbw0gbrrgair6piqjgmi-glibc-2.31/lib/libc.so.6
[Current thread is 1 (Thread 0x7fe14ffff700 (LWP 20682))]

end of strace gives:

openat(AT_FDCWD, "/var/lib/cardano-node/db-shelley_qa/immutable/18715.chunk", O_RDONLY) = 25
futex(0x7fe178000bec, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x7fe178000bf0, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x7fe178000be8, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x7fe178000bf0, FUTEX_WAKE_PRIVATE, 1) = 1
pread64(25, "\202\2\204\202\217\32\0\5\10\330\32\0f\315\371X \307Xf<\22:k\214\252\202K\33\300\f]"..., 1008, 0) = 1008
pread64(25, "\202\2\204\202\217\32\0\5\10\331\32\0f\316\17X +\n\332G/\201\253n|\303\257\234C\353("..., 1301, 1008) = 1301
pread64(25, "\202\2\204\202\217\32\0\5\10\332\32\0f\316 X (o\332\270\316\303\372\r\234\276\1d\321\203/"..., 1008, 2309) = 1008
pread64(25, "\202\2\204\202\217\32\0\5\10\333\32\0f\316-X \266\352\371\364\231\320\345jBCJ\347g\10@"..., 1008, 3317) = 1008
pread64(25, "\202\2\204\202\217\32\0\5\10\334\32\0f\316=X j\301\v#_\267\t\20B\264r\32\354%\305"..., 1008, 4325) = 1008
rt_sigprocmask(SIG_BLOCK, [INT], [], 8) = 0
clock_gettime(CLOCK_THREAD_CPUTIME_ID, {tv_sec=25, tv_nsec=928853177}) = 0
getrusage(RUSAGE_SELF, {ru_utime={tv_sec=40, tv_usec=20972}, ru_stime={tv_sec=5, tv_usec=808108}, ...}) = 0
clock_gettime(CLOCK_THREAD_CPUTIME_ID, {tv_sec=25, tv_nsec=929248654}) = 0
clock_gettime(CLOCK_PROCESS_CPUTIME_ID, {tv_sec=45, tv_nsec=829474173}) = 0
rt_sigprocmask(SIG_SETMASK, [], NULL, 8) = 0
pread64(25, "\202\2\204\202\217\32\0\5\10\335\32\0f\316HX \342\233\304_4\rN`\230\2\336\303\302o\346"..., 1008, 5333) = 1008
pread64(25, "\202\2\204\202\217\32\0\5\10\336\32\0f\316MX \0276#b\32\216\3414\325w\17A\202\25\17"..., 1008, 6341) = 1008
pread64(25, "\202\2\204\202\217\32\0\5\10\337\32\0f\316]X \211\232z\353j\271\334B\277\271\270i\304\207\277"..., 1008, 7349) = 1008
pread64(25, "\202\2\204\202\217\32\0\5\10\340\32\0f\316qX k\26;\322p\242n\326\256\323\36\r`\277\304"..., 1008, 8357) = 1008
pread64(25, "\202\2\204\202\217\32\0\5\10\341\32\0f\316\203X >\316\345b\257W\213\\\177\253c\6\204\366b"..., 1008, 9365) = 1008
pread64(25, "\202\2\204\202\217\32\0\5\10\342\32\0f\316\230X \315\374\34\322\16AC\333\324\355\346U\303\251\220"..., 1008, 10373) = 1008
pread64(25, "\202\2\204\202\217\32\0\5\10\343\32\0f\316\265X \255n`@\36\311\301\260s\201\360^t\231e"..., 1008, 11381) = 1008
pread64(25, "\202\2\204\202\217\32\0\5\10\344\32\0f\316\300X \313j\326\242\360\251\3\227\270\31\35VE\236\347"..., 1008, 12389) = 1008
pread64(25, "\202\2\204\202\217\32\0\5\10\345\32\0f\316\301X \214*\340m\301\17\324.\314\325<>g\265\5"..., 1008, 13397) = 1008
close(25)                               = 0
futex(0x7fe178000bec, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x7fe178000bf0, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x1bd4438, FUTEX_WAKE_PRIVATE, 1) = 1
openat(AT_FDCWD, "/var/lib/cardano-node/db-shelley_qa/volatile/blocks-3.dat", O_RDONLY) = 25
pread64(25, "\202\217\32\0\5\10\346\32\0f\317\3X  \254\300\343\317\277\270LX`&lbZ\244\303\340\325"..., 1002, 922616) = 1002
close(25)                               = 0
openat(AT_FDCWD, "/var/lib/cardano-node/db-shelley_qa/volatile/blocks-3.dat", O_RDONLY) = 25
pread64(25, "\202\217\32\0\5\10\347\32\0f\317\20X \227\227{;P<)\371`\215%Pn|I\365\373\255"..., 1002, 923624) = 1002
close(25)                               = 0
openat(AT_FDCWD, "/var/lib/cardano-node/db-shelley_qa/volatile/blocks-3.dat", O_RDONLY) = 25
pread64(25, "\202\217\32\0\5\10\350\32\0f\3178X \0340OAU\16At\r\244\235\200\363n\335h&\23"..., 1002, 924632) = 1002
close(25)                               = 0
openat(AT_FDCWD, "/var/lib/cardano-node/db-shelley_qa/volatile/blocks-3.dat", O_RDONLY) = 25
pread64(25, "\202\217\32\0\5\10\351\32\0f\317?X \252\261\4#\272\25O`1;\237\t\235\255\325>/*"..., 1002, 925640) = 1002
close(25)                               = 0
openat(AT_FDCWD, "/var/lib/cardano-node/db-shelley_qa/volatile/blocks-3.dat", O_RDONLY) = 25
pread64(25, "\202\217\32\0\5\10\352\32\0f\317GX ThN\351\332\220Z\24q\222\376y\364G\307\310\316\265"..., 1002, 926648) = 1002
close(25)                               = 0
openat(AT_FDCWD, "/var/lib/cardano-node/db-shelley_qa/volatile/blocks-3.dat", O_RDONLY) = 25
pread64(25, "\202\217\32\0\5\10\353\32\0f\317\210X \366\363}\265\23\347\326\342\22\303\255.\376?$\366^\207"..., 1002, 927656) = 1002
close(25)                               = 0
openat(AT_FDCWD, "/var/lib/cardano-node/db-shelley_qa/volatile/blocks-3.dat", O_RDONLY) = 25
pread64(25, "\202\217\32\0\5\10\354\32\0f\317\260X \26*`\364\321\251KLAW\227_\26\270\254\234G\201"..., 1002, 928664) = 1002
close(25)                               = 0
openat(AT_FDCWD, "/var/lib/cardano-node/db-shelley_qa/volatile/blocks-3.dat", O_RDONLY) = 25
pread64(25, "\202\217\32\0\5\10\355\32\0f\320\0X 8i\262\332x\327\200|C\261Ig\262c\30\371\24\27"..., 1002, 929672) = 1002
close(25)                               = 0
openat(AT_FDCWD, "/var/lib/cardano-node/db-shelley_qa/volatile/blocks-3.dat", O_RDONLY) = 25
pread64(25, "\202\217\32\0\5\10\356\32\0f\320\35X \373\334\2471\341Y\6\373\r\214\301\332\2540\304`\2576"..., 1002, 930680) = 1002
close(25)                               = 0
openat(AT_FDCWD, "/var/lib/cardano-node/db-shelley_qa/volatile/blocks-3.dat", O_RDONLY) = 25
pread64(25, "\202\217\32\0\5\10\357\32\0f\320(X i\366\17'\375lO\302\222\207\216\220\2028{n\220*"..., 1002, 931688) = 1002
close(25)                               = 0
openat(AT_FDCWD, "/var/lib/cardano-node/db-shelley_qa/volatile/blocks-3.dat", O_RDONLY) = 25
pread64(25, "\202\217\32\0\5\10\360\32\0f\320;X \217UZ\274Q\345\305\243&\274\207e\354H\3216\316\312"..., 1002, 932696) = 1002
close(25)                               = 0
openat(AT_FDCWD, "/var/lib/cardano-node/db-shelley_qa/volatile/blocks-3.dat", O_RDONLY) = 25
pread64(25, "\202\217\32\0\5\10\361\32\0f\320EX \213l\22\305&)\250\262\346\302\375-\272\16TvU\0"..., 1002, 933704) = 1002
close(25)                               = 0
openat(AT_FDCWD, "/var/lib/cardano-node/db-shelley_qa/volatile/blocks-3.dat", O_RDONLY) = 25
pread64(25, "\202\217\32\0\5\10\362\32\0f\320xX \3\306Y\352\221\255\177\377\377\230\345\340B\320\336\274\365\21"..., 1002, 934712) = 1002
close(25)                               = 0
openat(AT_FDCWD, "/var/lib/cardano-node/db-shelley_qa/volatile/blocks-3.dat", O_RDONLY) = 25
pread64(25, "\202\217\32\0\5\10\363\32\0f\320\203X Q\223<\4f\233\273\273\214uV(\216\300-\246\177\0"..., 1002, 935720) = 1002
close(25)                               = 0
openat(AT_FDCWD, "/var/lib/cardano-node/db-shelley_qa/volatile/blocks-3.dat", O_RDONLY) = 25
pread64(25, "\202\217\32\0\5\10\364\32\0f\320\227X \222\273W\303XS\270\v\216w&\306\256'M\307Z\374"..., 1002, 936728) = 1002
close(25)                               = 0
openat(AT_FDCWD, "/var/lib/cardano-node/db-shelley_qa/volatile/blocks-3.dat", O_RDONLY) = 25
pread64(25, "\202\217\32\0\5\10\365\32\0f\320\240X \256U\345A\310\253W\237\270\0317;\312\227p\3256R"..., 1002, 937736) = 1002
close(25)                               = 0
openat(AT_FDCWD, "/var/lib/cardano-node/db-shelley_qa/volatile/blocks-3.dat", O_RDONLY) = 25
pread64(25, "\202\217\32\0\5\10\366\32\0f\320\360X \250\377\321\313uo\243\235G\352\333&D1\356\336\367\372"..., 1002, 938744) = 1002
close(25)                               = 0
openat(AT_FDCWD, "/var/lib/cardano-node/db-shelley_qa/volatile/blocks-3.dat", O_RDONLY) = 25
pread64(25, "\202\217\32\0\5\10\367\32\0f\320\363X L\327[\2704\367\272\262\245M[B\257\234\375\345\340\30"..., 1002, 939752) = 1002
close(25)                               = 0
openat(AT_FDCWD, "/var/lib/cardano-node/db-shelley_qa/volatile/blocks-3.dat", O_RDONLY) = 25
pread64(25, "\202\217\32\0\5\10\370\32\0f\320\365X \254hkI+F&Izy\32M;\25\325&Z\305"..., 1002, 940760) = 1002
close(25)                               = 0
openat(AT_FDCWD, "/var/lib/cardano-node/db-shelley_qa/volatile/blocks-3.dat", O_RDONLY) = 25
pread64(25, "\202\217\32\0\5\10\371\32\0f\321\30X \312J]!\260O\315j\262\\\r\374\220\231\225;\37\374"..., 1002, 941768) = 1002
close(25)                               = 0
openat(AT_FDCWD, "/var/lib/cardano-node/db-shelley_qa/volatile/blocks-3.dat", O_RDONLY) = 25
pread64(25, "\202\217\32\0\5\10\372\32\0f\321\35X \1\257\205\276\36\323?\223\300\356\255\203\17\237\32\2774\312"..., 1002, 942776) = 1002
close(25)                               = 0
openat(AT_FDCWD, "/var/lib/cardano-node/db-shelley_qa/volatile/blocks-3.dat", O_RDONLY) = 25
pread64(25, "\202\217\32\0\5\10\373\32\0f\321hX \24\245\255\204\250\16\2275\3609j\324\353x\255,\35\177"..., 1002, 943784) = 1002
close(25)                               = 0
openat(AT_FDCWD, "/var/lib/cardano-node/db-shelley_qa/volatile/blocks-3.dat", O_RDONLY) = 25
pread64(25, "\202\217\32\0\5\10\374\32\0f\321sX \213$\307\237\363R\334\n\352\354V\362^E\257\326\247\304"..., 1002, 944792) = 1002
close(25)                               = 0
openat(AT_FDCWD, "/var/lib/cardano-node/db-shelley_qa/volatile/blocks-3.dat", O_RDONLY) = 25
pread64(25, "\202\217\32\0\5\10\375\32\0f\321wX A\231l\247l\276\337\360\374\254\2508\275Y#2q\300"..., 1002, 945800) = 1002
close(25)                               = 0
openat(AT_FDCWD, "/var/lib/cardano-node/db-shelley_qa/volatile/blocks-3.dat", O_RDONLY) = 25
pread64(25, "\202\217\32\0\5\10\376\32\0f\321\203X d\263\3i\271\360f\263\22K\335\350\343\260\21\311D\1"..., 1002, 946808) = 1002
close(25)                               = 0
openat(AT_FDCWD, "/var/lib/cardano-node/db-shelley_qa/volatile/blocks-3.dat", O_RDONLY) = 25
pread64(25, "\202\217\32\0\5\10\377\32\0f\321\220X \213=\1\272\20@Xh\217,\317\234M\333#\234\235%"..., 1002, 947816) = 1002
close(25)                               = 0
openat(AT_FDCWD, "/var/lib/cardano-node/db-shelley_qa/volatile/blocks-3.dat", O_RDONLY) = 25
pread64(25, "\202\217\32\0\5\t\0\32\0f\321\223X 3\fK.T\242\210n\34R\\N@3\271\301\2337"..., 1002, 948824) = 1002
close(25)                               = 0
openat(AT_FDCWD, "/var/lib/cardano-node/db-shelley_qa/volatile/blocks-3.dat", O_RDONLY) = 25
pread64(25, "\202\217\32\0\5\t\1\32\0f\321\340X \377\327\212\336z\305\230z\336h\237W\276M0\20\301\205"..., 1002, 949832) = 1002
close(25)                               = 0
openat(AT_FDCWD, "/var/lib/cardano-node/db-shelley_qa/volatile/blocks-3.dat", O_RDONLY) = 25
pread64(25, "\202\217\32\0\5\t\2\32\0f\321\345X \331\305\366\37\33b\303\373a\6\207;\222\246#\233x\322"..., 1002, 950840) = 1002
close(25)                               = 0
openat(AT_FDCWD, "/var/lib/cardano-node/db-shelley_qa/volatile/blocks-3.dat", O_RDONLY) = 25
pread64(25, "\202\217\32\0\5\t\3\32\0f\321\365X (J\311g\255\2>\353\251JS~[\5b\200\372\244"..., 1002, 951848) = 1002
close(25)                               = 0
openat(AT_FDCWD, "/var/lib/cardano-node/db-shelley_qa/volatile/blocks-3.dat", O_RDONLY) = 25
pread64(25, "\202\217\32\0\5\t\4\32\0f\322\10X \236\331\24\17\24\253\376};w\36\241w6\3221\335\307"..., 1002, 952856) = 1002
close(25)                               = 0
openat(AT_FDCWD, "/var/lib/cardano-node/db-shelley_qa/volatile/blocks-3.dat", O_RDONLY) = 25
pread64(25, "\202\217\32\0\5\t\5\32\0f\322XX \341\303\201\225S\354{\306z\275\356\372]'Z&\373\342"..., 1002, 953864) = 1002
close(25)                               = 0
openat(AT_FDCWD, "/var/lib/cardano-node/db-shelley_qa/volatile/blocks-3.dat", O_RDONLY) = 25
pread64(25, "\202\217\32\0\5\t\6\32\0f\322\200X H\32\273\220\323\356{\310;_\342\263d\340\350UC#"..., 1002, 954872) = 1002
close(25)                               = 0
openat(AT_FDCWD, "/var/lib/cardano-node/db-shelley_qa/volatile/blocks-3.dat", O_RDONLY) = 25
pread64(25, "\202\217\32\0\5\t\7\32\0f\322\201X \204\234\267\231\202\254\177\204PA;\24\372#\2779\276\347"..., 1002, 955880) = 1002
close(25)                               = 0
openat(AT_FDCWD, "/var/lib/cardano-node/db-shelley_qa/volatile/blocks-3.dat", O_RDONLY) = 25
pread64(25, "\202\217\32\0\5\t\10\32\0f\322\241X `\320\227\36`\356\202\3\250S\243\234\352mjq\336\350"..., 1002, 956888) = 1002
close(25)                               = 0
openat(AT_FDCWD, "/var/lib/cardano-node/db-shelley_qa/volatile/blocks-3.dat", O_RDONLY) = 25
pread64(25, "\202\217\32\0\5\t\t\32\0f\322\275X \212HG\210\361\215\235+9b\217\4\340?\212s\355|"..., 1002, 957896) = 1002
close(25)                               = 0
openat(AT_FDCWD, "/var/lib/cardano-node/db-shelley_qa/volatile/blocks-3.dat", O_RDONLY) = 25
pread64(25, "\202\2\204\202\217\32\0\5\10\346\32\0f\317\3X  \254\300\343\317\277\270LX`&lbZ\244"..., 1008, 922613) = 1008
close(25)                               = 0
openat(AT_FDCWD, "/var/lib/cardano-node/db-shelley_qa/volatile/blocks-3.dat", O_RDONLY) = 25
pread64(25, "\202\2\204\202\217\32\0\5\10\347\32\0f\317\20X \227\227{;P<)\371`\215%Pn|I"..., 1008, 923621) = 1008
close(25)                               = 0
openat(AT_FDCWD, "/var/lib/cardano-node/db-shelley_qa/volatile/blocks-3.dat", O_RDONLY) = 25
pread64(25, "\202\2\204\202\217\32\0\5\10\350\32\0f\3178X \0340OAU\16At\r\244\235\200\363n\335"..., 1008, 924629) = 1008
close(25)                               = 0
openat(AT_FDCWD, "/var/lib/cardano-node/db-shelley_qa/volatile/blocks-3.dat", O_RDONLY) = 25
pread64(25, "\202\2\204\202\217\32\0\5\10\351\32\0f\317?X \252\261\4#\272\25O`1;\237\t\235\255\325"..., 1008, 925637) = 1008
close(25)                               = 0
openat(AT_FDCWD, "/var/lib/cardano-node/db-shelley_qa/volatile/blocks-3.dat", O_RDONLY) = 25
pread64(25, "\202\2\204\202\217\32\0\5\10\352\32\0f\317GX ThN\351\332\220Z\24q\222\376y\364G\307"..., 1008, 926645) = 1008
close(25)                               = 0
openat(AT_FDCWD, "/var/lib/cardano-node/db-shelley_qa/volatile/blocks-3.dat", O_RDONLY) = 25
pread64(25, "\202\2\204\202\217\32\0\5\10\353\32\0f\317\210X \366\363}\265\23\347\326\342\22\303\255.\376?$"..., 1008, 927653) = 1008
close(25)                               = 0
openat(AT_FDCWD, "/var/lib/cardano-node/db-shelley_qa/volatile/blocks-3.dat", O_RDONLY) = 25
pread64(25, "\202\2\204\202\217\32\0\5\10\354\32\0f\317\260X \26*`\364\321\251KLAW\227_\26\270\254"..., 1008, 928661) = 1008
close(25)                               = 0
openat(AT_FDCWD, "/var/lib/cardano-node/db-shelley_qa/volatile/blocks-3.dat", O_RDONLY) = 25
pread64(25, "\202\2\204\202\217\32\0\5\10\355\32\0f\320\0X 8i\262\332x\327\200|C\261Ig\262c\30"..., 1008, 929669) = 1008
close(25)                               = 0
openat(AT_FDCWD, "/var/lib/cardano-node/db-shelley_qa/volatile/blocks-3.dat", O_RDONLY) = 25
pread64(25, "\202\2\204\202\217\32\0\5\10\356\32\0f\320\35X \373\334\2471\341Y\6\373\r\214\301\332\2540\304"..., 1008, 930677) = 1008
close(25)                               = 0
openat(AT_FDCWD, "/var/lib/cardano-node/db-shelley_qa/volatile/blocks-3.dat", O_RDONLY) = 25
pread64(25, "\202\2\204\202\217\32\0\5\10\357\32\0f\320(X i\366\17'\375lO\302\222\207\216\220\2028{"..., 1008, 931685) = 1008
close(25)                               = 0
openat(AT_FDCWD, "/var/lib/cardano-node/db-shelley_qa/volatile/blocks-3.dat", O_RDONLY) = 25
pread64(25, "\202\2\204\202\217\32\0\5\10\360\32\0f\320;X \217UZ\274Q\345\305\243&\274\207e\354H\321"..., 1008, 932693) = 1008
close(25)                               = 0
openat(AT_FDCWD, "/var/lib/cardano-node/db-shelley_qa/volatile/blocks-3.dat", O_RDONLY) = 25
pread64(25, "\202\2\204\202\217\32\0\5\10\361\32\0f\320EX \213l\22\305&)\250\262\346\302\375-\272\16T"..., 1008, 933701) = 1008
close(25)                               = 0
openat(AT_FDCWD, "/var/lib/cardano-node/db-shelley_qa/volatile/blocks-3.dat", O_RDONLY) = 25
pread64(25, "\202\2\204\202\217\32\0\5\10\362\32\0f\320xX \3\306Y\352\221\255\177\377\377\230\345\340B\320\336"..., 1008, 934709) = 1008
close(25)                               = 0
openat(AT_FDCWD, "/var/lib/cardano-node/db-shelley_qa/volatile/blocks-3.dat", O_RDONLY) = 25
pread64(25, "\202\2\204\202\217\32\0\5\10\363\32\0f\320\203X Q\223<\4f\233\273\273\214uV(\216\300-"..., 1008, 935717) = 1008
close(25)                               = 0
openat(AT_FDCWD, "/var/lib/cardano-node/db-shelley_qa/volatile/blocks-3.dat", O_RDONLY) = 25
pread64(25, "\202\2\204\202\217\32\0\5\10\364\32\0f\320\227X \222\273W\303XS\270\v\216w&\306\256'M"..., 1008, 936725) = 1008
close(25)                               = 0
openat(AT_FDCWD, "/var/lib/cardano-node/db-shelley_qa/volatile/blocks-3.dat", O_RDONLY) = 25
pread64(25, "\202\2\204\202\217\32\0\5\10\365\32\0f\320\240X \256U\345A\310\253W\237\270\0317;\312\227p"..., 1008, 937733) = 1008
close(25)                               = 0
openat(AT_FDCWD, "/var/lib/cardano-node/db-shelley_qa/volatile/blocks-3.dat", O_RDONLY) = 25
pread64(25, "\202\2\204\202\217\32\0\5\10\366\32\0f\320\360X \250\377\321\313uo\243\235G\352\333&D1\356"..., 1008, 938741) = 1008
close(25)                               = 0
openat(AT_FDCWD, "/var/lib/cardano-node/db-shelley_qa/volatile/blocks-3.dat", O_RDONLY) = 25
pread64(25, "\202\2\204\202\217\32\0\5\10\367\32\0f\320\363X L\327[\2704\367\272\262\245M[B\257\234\375"..., 1008, 939749) = 1008
close(25)                               = 0
openat(AT_FDCWD, "/var/lib/cardano-node/db-shelley_qa/volatile/blocks-3.dat", O_RDONLY) = 25
pread64(25, "\202\2\204\202\217\32\0\5\10\370\32\0f\320\365X \254hkI+F&Izy\32M;\25\325"..., 1008, 940757) = 1008
close(25)                               = 0
openat(AT_FDCWD, "/var/lib/cardano-node/db-shelley_qa/volatile/blocks-3.dat", O_RDONLY) = 25
pread64(25, "\202\2\204\202\217\32\0\5\10\371\32\0f\321\30X \312J]!\260O\315j\262\\\r\374\220\231\225"..., 1008, 941765) = 1008
close(25)                               = 0
openat(AT_FDCWD, "/var/lib/cardano-node/db-shelley_qa/volatile/blocks-3.dat", O_RDONLY) = 25
pread64(25, "\202\2\204\202\217\32\0\5\10\372\32\0f\321\35X \1\257\205\276\36\323?\223\300\356\255\203\17\237\32"..., 1008, 942773) = 1008
close(25)                               = 0
openat(AT_FDCWD, "/var/lib/cardano-node/db-shelley_qa/volatile/blocks-3.dat", O_RDONLY) = 25
pread64(25, "\202\2\204\202\217\32\0\5\10\373\32\0f\321hX \24\245\255\204\250\16\2275\3609j\324\353x\255"..., 1008, 943781) = 1008
close(25)                               = 0
openat(AT_FDCWD, "/var/lib/cardano-node/db-shelley_qa/volatile/blocks-3.dat", O_RDONLY) = 25
pread64(25, "\202\2\204\202\217\32\0\5\10\374\32\0f\321sX \213$\307\237\363R\334\n\352\354V\362^E\257"..., 1008, 944789) = 1008
close(25)                               = 0
openat(AT_FDCWD, "/var/lib/cardano-node/db-shelley_qa/volatile/blocks-3.dat", O_RDONLY) = 25
pread64(25, "\202\2\204\202\217\32\0\5\10\375\32\0f\321wX A\231l\247l\276\337\360\374\254\2508\275Y#"..., 1008, 945797) = 1008
close(25)                               = 0
openat(AT_FDCWD, "/var/lib/cardano-node/db-shelley_qa/volatile/blocks-3.dat", O_RDONLY) = 25
pread64(25, "\202\2\204\202\217\32\0\5\10\376\32\0f\321\203X d\263\3i\271\360f\263\22K\335\350\343\260\21"..., 1008, 946805) = 1008
close(25)                               = 0
openat(AT_FDCWD, "/var/lib/cardano-node/db-shelley_qa/volatile/blocks-3.dat", O_RDONLY) = 25
pread64(25, "\202\2\204\202\217\32\0\5\10\377\32\0f\321\220X \213=\1\272\20@Xh\217,\317\234M\333#"..., 1008, 947813) = 1008
close(25)                               = 0
openat(AT_FDCWD, "/var/lib/cardano-node/db-shelley_qa/volatile/blocks-3.dat", O_RDONLY) = 25
pread64(25, "\202\2\204\202\217\32\0\5\t\0\32\0f\321\223X 3\fK.T\242\210n\34R\\N@3\271"..., 1008, 948821) = 1008
close(25)                               = 0
rt_sigprocmask(SIG_BLOCK, [INT], [], 8) = 0
clock_gettime(CLOCK_THREAD_CPUTIME_ID, {tv_sec=25, tv_nsec=975405159}) = 0
getrusage(RUSAGE_SELF, {ru_utime={tv_sec=40, tv_usec=60855}, ru_stime={tv_sec=5, tv_usec=815232}, ...}) = 0
clock_gettime(CLOCK_THREAD_CPUTIME_ID, {tv_sec=25, tv_nsec=976010811}) = 0
clock_gettime(CLOCK_PROCESS_CPUTIME_ID, {tv_sec=45, tv_nsec=876694499}) = 0
rt_sigprocmask(SIG_SETMASK, [], NULL, 8) = 0
openat(AT_FDCWD, "/var/lib/cardano-node/db-shelley_qa/volatile/blocks-3.dat", O_RDONLY) = 25
pread64(25, "\202\2\204\202\217\32\0\5\t\1\32\0f\321\340X \377\327\212\336z\305\230z\336h\237W\276M0"..., 1008, 949829) = 1008
close(25)                               = 0
openat(AT_FDCWD, "/var/lib/cardano-node/db-shelley_qa/volatile/blocks-3.dat", O_RDONLY) = 25
pread64(25, "\202\2\204\202\217\32\0\5\t\2\32\0f\321\345X \331\305\366\37\33b\303\373a\6\207;\222\246#"..., 1008, 950837) = 1008
close(25)                               = 0
openat(AT_FDCWD, "/var/lib/cardano-node/db-shelley_qa/volatile/blocks-3.dat", O_RDONLY) = 25
pread64(25, "\202\2\204\202\217\32\0\5\t\3\32\0f\321\365X (J\311g\255\2>\353\251JS~[\5b"..., 1008, 951845) = 1008
close(25)                               = 0
openat(AT_FDCWD, "/var/lib/cardano-node/db-shelley_qa/volatile/blocks-3.dat", O_RDONLY) = 25
pread64(25, "\202\2\204\202\217\32\0\5\t\4\32\0f\322\10X \236\331\24\17\24\253\376};w\36\241w6\322"..., 1008, 952853) = 1008
close(25)                               = 0
openat(AT_FDCWD, "/var/lib/cardano-node/db-shelley_qa/volatile/blocks-3.dat", O_RDONLY) = 25
pread64(25, "\202\2\204\202\217\32\0\5\t\5\32\0f\322XX \341\303\201\225S\354{\306z\275\356\372]'Z"..., 1008, 953861) = 1008
close(25)                               = 0
openat(AT_FDCWD, "/var/lib/cardano-node/db-shelley_qa/volatile/blocks-3.dat", O_RDONLY) = 25
pread64(25, "\202\2\204\202\217\32\0\5\t\6\32\0f\322\200X H\32\273\220\323\356{\310;_\342\263d\340\350"..., 1008, 954869) = 1008
close(25)                               = 0
openat(AT_FDCWD, "/var/lib/cardano-node/db-shelley_qa/volatile/blocks-3.dat", O_RDONLY) = 25
pread64(25, "\202\2\204\202\217\32\0\5\t\7\32\0f\322\201X \204\234\267\231\202\254\177\204PA;\24\372#\277"..., 1008, 955877) = 1008
close(25)                               = 0
openat(AT_FDCWD, "/var/lib/cardano-node/db-shelley_qa/volatile/blocks-3.dat", O_RDONLY) = 25
pread64(25, "\202\2\204\202\217\32\0\5\t\10\32\0f\322\241X `\320\227\36`\356\202\3\250S\243\234\352mj"..., 1008, 956885) = 1008
close(25)                               = 0
openat(AT_FDCWD, "/var/lib/cardano-node/db-shelley_qa/volatile/blocks-3.dat", O_RDONLY) = 25
pread64(25, "\202\2\204\202\217\32\0\5\t\t\32\0f\322\275X \212HG\210\361\215\235+9b\217\4\340?\212"..., 1008, 957893) = 1008
close(25)                               = 0
futex(0x7fe178000be8, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x7fe178000bf0, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x1bd4438, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x7fe174000bec, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x7fe174000bf0, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x1bc3e18, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x7fe178000bec, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x7fe178000bf0, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x1bd4438, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x7fe178000be8, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x7fe178000bf0, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x1bd4438, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x7fe174000be8, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x7fe174000bf0, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x1bc3e18, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x1bf3928, FUTEX_WAIT_PRIVATE, 0, NULL) = -1 EAGAIN (Resource temporarily unavailable)
futex(0x1bf3930, FUTEX_WAKE_PRIVATE, 1) = 0
futex(0x7fe178000bec, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x7fe178000bf0, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x1bd4438, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x7fe174000bec, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x7fe174000bf0, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x1bc3e18, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x1bf392c, FUTEX_WAIT_PRIVATE, 0, NULL) = 0
futex(0x1bf3930, FUTEX_WAKE_PRIVATE, 1) = 0
futex(0x7fe174000be8, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x7fe174000bf0, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x1bc3e18, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x1bf3928, FUTEX_WAIT_PRIVATE, 0, NULL) = 0
futex(0x1bf3930, FUTEX_WAKE_PRIVATE, 1) = 0
mmap(NULL, 16384, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7fe17c0bc000
mprotect(0x7fe17c0bd000, 4096, PROT_NONE) = 0
mprotect(0x7fe17c0bf000, 4096, PROT_NONE) = 0
madvise(0x7fe17c0be000, 4096, MADV_DONTDUMP) = 0
mlock(0x7fe17c0be000, 4096)             = 0
mprotect(0x7fe17c0bc000, 4096, PROT_READ) = 0
mmap(NULL, 16384, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7fe17c0b8000
mprotect(0x7fe17c0b9000, 4096, PROT_NONE) = 0
mprotect(0x7fe17c0bb000, 4096, PROT_NONE) = 0
madvise(0x7fe17c0ba000, 4096, MADV_DONTDUMP) = 0
mlock(0x7fe17c0ba000, 4096)             = 0
mprotect(0x7fe17c0b8000, 4096, PROT_READ) = 0
mmap(NULL, 16384, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7fe17c0b4000
mprotect(0x7fe17c0b5000, 4096, PROT_NONE) = 0
mprotect(0x7fe17c0b7000, 4096, PROT_NONE) = 0
madvise(0x7fe17c0b6000, 4096, MADV_DONTDUMP) = 0
mlock(0x7fe17c0b6000, 4096)             = 0
mprotect(0x7fe17c0b4000, 4096, PROT_READ) = 0
mmap(NULL, 16384, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7fe17c0b0000
mprotect(0x7fe17c0b1000, 4096, PROT_NONE) = 0
mprotect(0x7fe17c0b3000, 4096, PROT_NONE) = 0
madvise(0x7fe17c0b2000, 4096, MADV_DONTDUMP) = 0
mlock(0x7fe17c0b2000, 4096)             = 0
mprotect(0x7fe17c0b0000, 4096, PROT_READ) = 0
mmap(NULL, 16384, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7fe17c0ac000
mprotect(0x7fe17c0ad000, 4096, PROT_NONE) = 0
mprotect(0x7fe17c0af000, 4096, PROT_NONE) = 0
madvise(0x7fe17c0ae000, 4096, MADV_DONTDUMP) = 0
mlock(0x7fe17c0ae000, 4096)             = 0
mprotect(0x7fe17c0ac000, 4096, PROT_READ) = 0
mmap(NULL, 16384, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7fe17c0a8000
mprotect(0x7fe17c0a9000, 4096, PROT_NONE) = 0
mprotect(0x7fe17c0ab000, 4096, PROT_NONE) = 0
madvise(0x7fe17c0aa000, 4096, MADV_DONTDUMP) = 0
mlock(0x7fe17c0aa000, 4096)             = 0
mprotect(0x7fe17c0a8000, 4096, PROT_READ) = 0
mmap(NULL, 16384, PROT_READ|PROT_WRITE, MAP_PRIVATE|MAP_ANONYMOUS, -1, 0) = 0x7fe17c0a4000
mprotect(0x7fe17c0a5000, 4096, PROT_NONE) = 0
mprotect(0x7fe17c0a7000, 4096, PROT_NONE) = 0
madvise(0x7fe17c0a6000, 4096, MADV_DONTDUMP) = 0
mlock(0x7fe17c0a6000, 4096)             = 0
mprotect(0x7fe17c0a4000, 4096, PROT_READ) = 0
clock_gettime(CLOCK_PROCESS_CPUTIME_ID, {tv_sec=45, tv_nsec=901247904}) = 0
futex(0x7fe178000be8, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x7fe178000bf0, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x1bd4438, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x7fe178000bec, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x7fe178000bf0, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x1bd4438, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x7fe178000be8, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x7fe178000bf0, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x1bd4438, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x7fe174000bec, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x7fe174000bf0, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x1bc3e18, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x7fe178000bec, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x7fe178000bf0, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x1bd4438, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x7fe174000be8, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x7fe174000bf0, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x1bc3e18, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x7fe178000be8, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x7fe178000bf0, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x1bd4438, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x7fe174000bec, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x7fe174000bf0, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x1bc3e18, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x7fe178000bec, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x7fe178000bf0, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x1bd4438, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x7fe170000bec, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x7fe170000bf0, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x1bc3e18, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x7fe178000be8, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x7fe178000bf0, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x1bd4438, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x7fe178000bec, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x7fe178000bf0, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x1bd4438, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x7fe174000be8, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x7fe174000bf0, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x1bc3e18, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x7fe174000bec, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x7fe174000bf0, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x1bc3e18, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x7fe174000bec, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x7fe174000bf0, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x1bc3e18, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x7fe174000be8, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x7fe174000bf0, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x1bc3e18, FUTEX_WAKE_PRIVATE, 1) = 1
futex(0x1bf392c, FUTEX_WAIT_PRIVATE, 0, NULL) = ?
+++ killed by SIGSEGV (core dumped) +++
jbgi commented 3 years ago

Reopening since the segfault is not fixed.

rdlrt commented 3 years ago

strace is pretty much the same on my end too (against mainnet as well as testnet - started with absent db), and occurs post TraceOpenEvent.OpenedDB

Jimbo4350 commented 1 year ago

Closing this. If this is still relevant please re-open.