airalab / robonomics

Robonomics node implementation for Polkadot ecosystem; Kusama parachain slot #2048 since January 2022
https://robonomics.subscan.io/
Apache License 2.0
214 stars 58 forks source link

Signature verification has not been called before `SignatureBatching::drop` #66

Closed khssnv closed 3 years ago

khssnv commented 4 years ago

I'm running network node on VPS and recently it crashed after a day of operations. Please find failure log below.

My setup

-> % uname -a
Linux hetzner 5.4.56 #1-NixOS SMP Wed Aug 5 07:59:52 UTC 2020 x86_64 GNU/Linux
-> % sudo nix-channel --list
home-manager https://github.com/rycee/home-manager/archive/master.tar.gz
nixos https://nixos.org/channels/nixos-unstable
-> % free -h
              total        used        free      shared  buff/cache   available
Mem:          3.8Gi       484Mi       1.3Gi       3.0Mi       1.9Gi       3.1Gi
Swap:         2.9Gi       4.0Mi       2.9Gi
-> % df -h --type btrfs --type ext4 --type ext3 --type ext2 --type vfat --type iso9660
Filesystem      Size  Used Avail Use% Mounted on
/dev/sda1        38G   21G   15G  59% /

Failure log

[nix-shell:~/Workspace]$ ~/Workspace/robonomics_v0.20.0 --chain parachain --port 30363 --name "Khassanov-H1 🤖" ```console [nix-shell:~/Workspace]$ ~/Workspace/robonomics_v0.20.0 --chain parachain --port 30363 --name "Khassanov-H1 🤖" yyyy-mm-dd hh:mm:ss airalab-robonomics yyyy-mm-dd hh:mm:ss ✌️ version 0.20.0-5997540-x86_64-linux-gnu yyyy-mm-dd hh:mm:ss ❤️ by Airalab , 2018-2020 yyyy-mm-dd hh:mm:ss 📋 Chain specification: Robonomics yyyy-mm-dd hh:mm:ss 🏷 Node name: Khassanov-H1 🤖 yyyy-mm-dd hh:mm:ss 👤 Role: FULL yyyy-mm-dd hh:mm:ss 💾 Database: RocksDb at /home/khassanov/.local/share/robonomics/chains/robonomics/db yyyy-mm-dd hh:mm:ss ⛓ Native runtime: robonomics-1 (robonomics-airalab-1.tx1.au1) ... 2020-08-11 14:40:07 ✨ [Parachain] Imported #44071 (0x4539…2706) 2020-08-11 14:40:11 💤 [Parachain] Idle (47 peers), best: #44069 (0x8d1c…6d39), finalized #44067 (0x978a…bf17), ⬇ 6.7kiB/s ⬆ 6.1kiB/s 2020-08-11 14:40:11 💤 [Relaychain] Idle (23 peers), best: #56840 (0xeedf…fef0), finalized #56837 (0xd6d3…98af), ⬇ 30.3kiB/s ⬆ 28.9kiB/s 2020-08-11 14:40:12 ✨ [Relaychain] Imported #56841 (0xe5f9…0ec4) ==================== Version: 0.20.0-5997540-x86_64-linux-gnu 0: sp_panic_handler::set::{{closure}} 1: std::panicking::rust_panic_with_hook at /rustc/d7f94516345a36ddfcd68cbdf1df835d356795c3/src/libstd/panicking.rs:530 2: std::panicking::begin_panic 3: frame_executive::Executive::execute_block 4: ,sp_runtime::generic::unchecked_extrinsic::UncheckedExtrinsic< as sp_runtime::traits::StaticLookup>::Source,robono mics_parachain_runtime::Call,sp_runtime::MultiSignature,(frame_system::extensions::check_spec_version::CheckSpecVersion,frame_system::extensions ::check_tx_version::CheckTxVersion,frame_system::extensions::check_genesis::CheckGenesis,frame_system::ex tensions::check_mortality::CheckMortality,frame_system::extensions::check_nonce::CheckNonce,frame_system: :extensions::check_weight::CheckWeight,pallet_transaction_payment::ChargeTransactionPayment)>>>>::execute _block 5: sp_api::runtime_decl_for_Core::execute_block_native_call_generator::{{closure}} 6: std::thread::local::LocalKey::with 7: sc_executor::native_executor::WasmExecutor::with_instance::{{closure}} 8: sc_executor::wasm_runtime::RuntimeCache::with_instance 9: as sp_core::traits::CodeExecutor>::call 10: sp_state_machine::StateMachine::execute_aux 11: sp_state_machine::StateMachine::execute_using_consensus_failure_handler 12: as sp_api::CallApiAt>::ball_api_at 13: sp_api::runtime_decl_for_Core::execute_block_call_api_at 14: sp_api::Core::execute_block_with_context 15: <&sc_service::client::client::Client as sp_consensus::block_import::BlockImport>::import_block 16: as sp_consensus::block_import::BlockImport>::import_block 17: sp_consensus::import_queue::import_single_block_metered 18: as core::future::future::Future>::poll 19: as core::future::future::Future>::poll 20: ::Output> as core::future::future::Future>::poll 21: as core::future::future::Future>::poll 22: std::panicking::try 23: as core::future::future::Future>::poll 24: std::thread::local::LocalKey::with 25: futures_executor::local_pool::block_on 26: tokio::loom::std::unsafe_cell::UnsafeCell::with_mut 27: tokio::runtime::task::core::Core::poll 28: as core::ops::function::FnOnce<()>>::call_once 29: tokio::runtime::task::raw::poll 30: tokio::runtime::blocking::pool::Inner::run 31: tokio::runtime::context::enter 32: std::sys_common::backtrace::__rust_begin_short_backtrace 33: core::ops::function::FnOnce::call_once{{vtable.shim}} 34: as core::ops::function::FnOnce>::call_once at /rustc/d7f94516345a36ddfcd68cbdf1df835d356795c3/src/liballoc/boxed.rs:1081 as core::ops::function::FnOnce>::call_once at /rustc/d7f94516345a36ddfcd68cbdf1df835d356795c3/src/liballoc/boxed.rs:1081 std::sys::unix::thread::Thread::new::thread_start at /rustc/d7f94516345a36ddfcd68cbdf1df835d356795c3/src/libstd/sys/unix/thread.rs:87 35: start_thread 36: __clone Thread 'tokio-runtime-worker' panicked at 'Inability to pay some fees (e.g. account balance too low)', /rustc/d7f94516345a36ddfcd68cbdf1df835d356795c3/src/libstd/macros.rs:13 This is a bug. Please report it at: https://github.com/airalab/robonomics/issues/new ==================== Version: 0.20.0-5997540-x86_64-linux-gnu 0: sp_panic_handler::set::{{closure}} 1: std::panicking::rust_panic_with_hook at /rustc/d7f94516345a36ddfcd68cbdf1df835d356795c3/src/libstd/panicking.rs:530 2: std::panicking::begin_panic 3: ::drop 4: frame_executive::Executive::execute_block 5: ,sp_runtime::generic::unchecked_extrinsic::UncheckedExtrinsic< as sp_runtime::traits::StaticLookup>::Source,robono mics_parachain_runtime::Call,sp_runtime::MultiSignature,(frame_system::extensions::check_spec_version::CheckSpecVersion,frame_system::extensions ::check_tx_version::CheckTxVersion,frame_system::extensions::check_genesis::CheckGenesis,frame_system::ex tensions::check_mortality::CheckMortality,frame_system::extensions::check_nonce::CheckNonce,frame_system: :extensions::check_weight::CheckWeight,pallet_transaction_payment::ChargeTransactionPayment)>>>>::execute _block 6: sp_api::runtime_decl_for_Core::execute_block_native_call_generator::{{closure}} 7: std::thread::local::LocalKey::with 8: sc_executor::native_executor::WasmExecutor::with_instance::{{closure}} 9: sc_executor::wasm_runtime::RuntimeCache::with_instance 10: as sp_core::traits::CodeExecutor>::call 11: sp_state_machine::StateMachine::execute_aux 12: sp_state_machine::StateMachine::execute_using_consensus_failure_handler 13: as sp_api::CallApiAt>::call_api_at 14: sp_api::runtime_decl_for_Core::execute_block_call_api_at 15: sp_api::Core::execute_block_with_context 16: <&sc_service::client::client::Client as sp_consensus::block_import::BlockImport>::import_block 17: as sp_consensus::block_import::BlockImport>::import_block 18: sp_consensus::import_queue::import_single_block_metered 19: as core::future::future::Future>::poll 20: as core::future::future::Future>::poll 21: ::Output> as core::future::future::Future>::poll 22: as core::future::future::Future>::poll 23: std::panicking::try 24: as core::future::future::Future>::poll 25: std::thread::local::LocalKey::with 26: futures_executor::local_pool::block_on 27: tokio::loom::std::unsafe_cell::UnsafeCell::with_mut 28: tokio::runtime::task::core::Core::poll 29: as core::ops::function::FnOnce<()>>::call_once 30: tokio::runtime::task::raw::poll 31: tokio::runtime::blocking::pool::Inner::run 32: tokio::runtime::context::enter 33: std::sys_common::backtrace::__rust_begin_short_backtrace 34: core::ops::function::FnOnce::call_once{{vtable.shim}} 35: as core::ops::function::FnOnce>::call_once at /rustc/d7f94516345a36ddfcd68cbdf1df835d356795c3/src/liballoc/boxed.rs:1081 as core::ops::function::FnOnce>::call_once at /rustc/d7f94516345a36ddfcd68cbdf1df835d356795c3/src/liballoc/boxed.rs:1081 std::sys::unix::thread::Thread::new::thread_start at /rustc/d7f94516345a36ddfcd68cbdf1df835d356795c3/src/libstd/sys/unix/thread.rs:87 36: start_thread 37: __clone Thread 'tokio-runtime-worker' panicked at 'Signature verification has not been called before `SignatureBatching::drop`', /home/khassanov/.cargo/git/checkouts/substrate-7e08433d4c370a2 1/d15f420/primitives/runtime/src/lib.rs:799 This is a bug. Please report it at: https://github.com/airalab/robonomics/issues/new thread panicked while panicking. aborting. Illegal instruction (core dumped) [nix-shell:~/Workspace]$ ```
khssnv commented 4 years ago

FYI, I'm continue experiencing the issue.

akru commented 3 years ago

Outdated