search

eosnetworkfoundation / mandel

Obsolete. Use https://github.com/AntelopeIO/leap instead.
Other
87 stars 30 forks source link

nodeos corrupted size vs. prev_size on exit #789

Closed matthewdarwin closed 1 year ago

matthewdarwin commented 2 years ago

Using: mandel 3.1-rc3.

Notice 8 minute delay on shutdown.

The "corrupted size vs. prev_size" is not a new problem (happened in earlier versions of nodeos). would be good to understand what is happening though. Seems to not cause any problems as nodeos starts fine next time from the written state.

Aug  6 19:48:37 nodename nodeos[1897725]: killing pid=<1895214>
Aug  6 19:48:37 nodename nodeos[1895214]: info  2022-08-06T19:48:37.970 nodeos    resource_monitor_plugi:122    plugin_shutdown      ] shutdown...
Aug  6 19:48:37 nodename nodeos[1895214]: info  2022-08-06T19:48:37.970 nodeos    resource_monitor_plugi:129    plugin_shutdown      ] exit shutdown
Aug  6 19:48:37 nodename nodeos[1895214]: info  2022-08-06T19:48:37.970 nodeos    net_plugin.cpp:3772           plugin_shutdown      ] shutdown..
Aug  6 19:48:37 nodename nodeos[1895214]: info  2022-08-06T19:48:37.970 nodeos    net_plugin.cpp:3789           plugin_shutdown      ] close 12 connections
Aug  6 19:48:37 nodename nodeos[1895214]: info  2022-08-06T19:48:37.970 net-2     net_plugin.cpp:1016           _close               ] ["eosn-eos-blkrly27:9876 - cce5b7f" - 2 10.88.64.242:9876] closing
Aug  6 19:48:37 nodename nodeos[1895214]: info  2022-08-06T19:48:37.970 net-1     net_plugin.cpp:1016           _close               ] ["eosn-eos-blkrly28:9876 - 847a060" - 3 10.88.64.112:9876] closing
Aug  6 19:48:37 nodename nodeos[1895214]: info  2022-08-06T19:48:37.970 net-3     net_plugin.cpp:1016           _close               ] ["eosn-eos-blkrly7:9876 - 4189b20" - 4 10.88.65.41:9876] closing
Aug  6 19:48:37 nodename nodeos[1895214]: info  2022-08-06T19:48:37.970 net-0     net_plugin.cpp:1016           _close               ] ["eosn-eos-peer22a:9876 - a152c00" - 5 10.88.0.35:9876] closing
Aug  6 19:48:37 nodename nodeos[1895214]: info  2022-08-06T19:48:37.970 nodeos    net_plugin.cpp:3809           plugin_shutdown      ] exit shutdown
Aug  6 19:56:21 nodename nodeos[1895214]: corrupted size vs. prev_size
Aug  6 19:56:21 nodename systemd[1]: nodeos.service: Main process exited, code=killed, status=6/ABRT
taokayan commented 1 year ago

hi @matthewdarwin would you share your exact commit hash, OS, config, and the steps to re-produce? is this random behavior?

matthewdarwin commented 1 year ago

I believe the step to reproduce is to keep running curl on /v1/chain/get_info while shutting down nodeos. It has been seen on many versions going back to at least 2.0, so not specific to any version.

spoonincode commented 1 year ago

Will track this in linked leap issue now