Thread 'tokio-runtime-worker' panicked at 'Storage root must match that calculated.'

[khssnv]

After a couple of hours node running I've got an issue. Please find a log below. Unfortunately it's not full while it produces tens of log strings per second but all the same like one below.

My setup

-> % uname -a
Linux hetzner 5.4.56 #1-NixOS SMP Wed Aug 5 07:59:52 UTC 2020 x86_64 GNU/Linux
-> % sudo nix-channel --list
home-manager https://github.com/rycee/home-manager/archive/master.tar.gz
nixos https://nixos.org/channels/nixos-unstable
-> % free -h
              total        used        free      shared  buff/cache   available
Mem:          3.8Gi       527Mi       1.4Gi       3.0Mi       1.8Gi       3.0Gi
Swap:         2.9Gi       4.0Mi       2.9Gi
-> % df -h --type btrfs --type ext4 --type ext3 --type ext2 --type vfat --type iso9660
Filesystem      Size  Used Avail Use% Mounted on
/dev/sda1        38G   21G   15G  59% /

Failure log

[nix-shell:~/Workspace]$ ~/Workspace/robonomics_v0.20.0 --chain parachain --port 30363 --name "Khassanov-H1 🤖"

```console [nix-shell:~/Workspace]$ ~/Workspace/robonomics_v0.20.0 --chain parachain --port 30363 --name "Khassanov-H1 🤖" yyyy-mm-dd hh:mm:ss airalab-robonomics yyyy-mm-dd hh:mm:ss ✌️ version 0.20.0-5997540-x86_64-linux-gnu yyyy-mm-dd hh:mm:ss ❤️ by Airalab , 2018-2020 yyyy-mm-dd hh:mm:ss 📋 Chain specification: Robonomics ... 33: core::ops::function::FnOnce::call_once{{vtable.shim}} 34: as core::ops::function::FnOnce>::call_once at /rustc/d7f94516345a36ddfcd68cbdf1df835d356795c3/src/liballoc/boxed.rs:1081 as core::ops::function::FnOnce>::call_once at /rustc/d7f94516345a36ddfcd68cbdf1df835d356795c3/src/liballoc/boxed.rs:1081 std::sys::unix::thread::Thread::new::thread_start at /rustc/d7f94516345a36ddfcd68cbdf1df835d356795c3/src/libstd/sys/unix/thread.rs:87 35: start_thread 36: __clone Thread 'tokio-runtime-worker' panicked at 'Storage root must match that calculated.', /rustc/d7f94516345a36ddfcd68cbdf1df835d356795c3/src/libstd/macros.rs:13 This is a bug. Please report it at: https://github.com/airalab/robonomics/issues/new 2020-08-13 19:39:30 panicked at 'Storage root must match that calculated.', /rustc/d7f94516345a36ddfcd68cbdf1df835d356795c3/src/libcore/macros/mod.rs:10:9 2020-08-13 19:39:30 Block prepare storage changes error: Execution(Wasmi(Trap(Trap { kind: Unreachable }))) 2020-08-13 19:39:30 💔 Error importing block 0x1b6b2dc756f9e99a0e1ea55a24e4a2b5005fbf7b0582141ab72367dd3ac04a55: Err(Other(ClientImport("Execution: Trap: Trap { kind: Unreachable }"))) Hash: given=193f9c71bf8fa937da91fcb4a35df3340a350dcb720c0f4f3e9fbef6363dfa3c, expected=955e78c7e535731f9a8d14918162d5174eccbfd5c5f8bafe4aeec6702e4c6134 ==================== Version: 0.20.0-5997540-x86_64-linux-gnu 0: sp_panic_handler::set::{{closure}} 1: std::panicking::rust_panic_with_hook at /rustc/d7f94516345a36ddfcd68cbdf1df835d356795c3/src/libstd/panicking.rs:530 2: std::panicking::begin_panic 3: frame_executive::Executive::execute_block 4: ,sp_runtime::generic: :unchecked_extrinsic::UncheckedExtrinsic< as sp_runtime::traits::StaticLookup>::Source,robonomics_parachain_runtime::Call,sp_runtime::MultiSignature, (frame_system::extensions::check_spec_version::CheckSpecVersion,frame_system::extensions::check_tx_version::CheckTxVersion,frame_syst em::extensions::check_genesis::CheckGenesis,frame_system::extensions::check_mortality::CheckMortality,frame_system::extensions::check _nonce::CheckNonce,frame_system::extensions::check_weight::CheckWeight,pallet_transaction_payment::ChargeTransactionPayment)>>>>::execute_block 5: sp_api::runtime_decl_for_Core::execute_block_native_call_generator::{{closure}} 6: std::thread::local::LocalKey::with 7: sc_executor::native_executor::WasmExecutor::with_instance::{{closure}} 8: sc_executor::wasm_runtime::RuntimeCache::with_instance 9: as sp_core::traits::CodeExecutor>::call 10: sp_state_machine::StateMachine::execute_aux 11: sp_state_machine::StateMachine::execute_using_consensus_failure_handler 12: as sp_api::CallApiAt>::call_api_at 13: sp_api::runtime_decl_for_Core::execute_block_call_api_at 14: sp_api::Core::execute_block_with_context 15: <&sc_service::client::client::Client as sp_consensus::block_import::BlockImport>::import_block 16: as sp_consensus::block_import::BlockImport>::import_block 17: sp_consensus::import_queue::import_single_block_metered 18: as core::future::future::Future>::poll 19: as core::future::future::Future>::poll 20: ::Output> as core::future::future::Future>::poll 21: as core::future::future::Future>::poll 22: std::panicking::try 23: as core::future::future::Future>::poll 24: std::thread::local::LocalKey::with 25: futures_executor::local_pool::block_on 26: tokio::loom::std::unsafe_cell::UnsafeCell::with_mut 27: tokio::runtime::task::core::Core::poll 28: as core::ops::function::FnOnce<()>>::call_once 29: tokio::runtime::task::raw::poll 30: tokio::runtime::blocking::pool::Inner::run 31: tokio::runtime::context::enter 32: std::sys_common::backtrace::__rust_begin_short_backtrace 33: core::ops::function::FnOnce::call_once{{vtable.shim}} 34: as core::ops::function::FnOnce>::call_once at /rustc/d7f94516345a36ddfcd68cbdf1df835d356795c3/src/liballoc/boxed.rs:1081 as core::ops::function::FnOnce>::call_once at /rustc/d7f94516345a36ddfcd68cbdf1df835d356795c3/src/liballoc/boxed.rs:1081 std::sys::unix::thread::Thread::new::thread_start at /rustc/d7f94516345a36ddfcd68cbdf1df835d356795c3/src/libstd/sys/unix/thread.rs:87 35: start_thread 36: __clone Thread 'tokio-runtime-worker' panicked at 'Storage root must match that calculated.', /rustc/d7f94516345a36ddfcd68cbdf1df835d356795c3/src/libstd/macros.rs:13 This is a bug. Please report it at: https://github.com/airalab/robonomics/issues/new 2020-08-13 19:39:30 ✨ [Relaychain] Imported #88600 (0x953b…f400) 2020-08-13 19:39:30 panicked at 'Storage root must match that calculated.', /rustc/d7f94516345a36ddfcd68cbdf1df835d356795c3/src/libcore/macros/mod.rs:10:9 2020-08-13 19:39:30 Block prepare storage changes error: Execution(Wasmi(Trap(Trap { kind: Unreachable }))) 2020-08-13 19:39:30 💔 Error importing block 0x1b6b2dc756f9e99a0e1ea55a24e4a2b5005fbf7b0582141ab72367dd3ac04a55: Err(Other(ClientImport("Execution: Trap: Trap { kind: Unreachable }"))) Hash: given=193f9c71bf8fa937da91fcb4a35df3340a350dcb720c0f4f3e9fbef6363dfa3c, expected=955e78c7e535731f9a8d14918162d5174eccbfd5c5f8bafe4aeec6702e4c6134 ==================== Version: 0.20.0-5997540-x86_64-linux-gnu 0: sp_panic_handler::set::{{closure}} 1: std::panicking::rust_panic_with_hook at /rustc/d7f94516345a36ddfcd68cbdf1df835d356795c3/src/libstd/panicking.rs:530 2: std::panicking::begin_panic 3: frame_executive::Executive::execute_block 4: ,sp_runtime::generic: :unchecked_extrinsic::UncheckedExtrinsic< as sp_runtime::traits::StaticLookup>::Source,robonomics_parachain_runtime::Call,sp_runtime::MultiSignature, (frame_system::extensions::check_spec_version::CheckSpecVersion,frame_system::extensions::check_tx_version::CheckTxVersion,frame_syst em::extensions::check_genesis::CheckGenesis,frame_system::extensions::check_mortality::CheckMortality,frame_system::extensions::check _nonce::CheckNonce,frame_system::extensions::check_weight::CheckWeight,pallet_transaction_payment::ChargeTransactionPayment)>>>>::execute_block 5: sp_api::runtime_decl_for_Core::execute_block_native_call_generator::{{closure}} 6: std::thread::local::LocalKey::with 7: sc_executor::native_executor::WasmExecutor::with_instance::{{closure}} 8: sc_executor::wasm_runtime::RuntimeCache::with_instance 9: as sp_core::traits::CodeExecutor>::call 10: sp_state_machine::StateMachine::execute_aux 11: sp_state_machine::StateMachine::execute_using_consensus_failure_handler 12: as sp_api::CallApiAt>::call_api_at 13: sp_api::runtime_decl_for_Core::execute_block_call_api_at 14: sp_api::Core::execute_block_with_context 15: <&sc_service::client::client::Client as sp_consensus::block_import::BlockImport>::import_block 16: as sp_consensus::block_import::BlockImport>::import_block 17: sp_consensus::import_queue::import_single_block_metered 18: as core::future::future::Future>::poll 19: as core::future::future::Future>::poll 20: ::Output> as core::future::future::Future>::poll 21: as core::future::future::Future>::poll 22: std::panicking::try 23: as core::future::future::Future>::poll 24: std::thread::local::LocalKey::with 25: futures_executor::local_pool::block_on 26: tokio::loom::std::unsafe_cell::UnsafeCell::with_mut 27: tokio::runtime::task::core::Core::poll 28: as core::ops::function::FnOnce<()>>::call_once 29: tokio::runtime::task::raw::poll 30: tokio::runtime::blocking::pool::Inner::run 31: tokio::runtime::context::enter 32: std::sys_common::backtrace::__rust_begin_short_backtrace 33: core::ops::function::FnOnce::call_once{{vtable.shim}} 34: as core::ops::function::FnOnce>::call_once at /rustc/d7f94516345a36ddfcd68cbdf1df835d356795c3/src/liballoc/boxed.rs:1081 as core::ops::function::FnOnce>::call_once at /rustc/d7f94516345a36ddfcd68cbdf1df835d356795c3/src/liballoc/boxed.rs:1081 std::sys::unix::thread::Thread::new::thread_start at /rustc/d7f94516345a36ddfcd68cbdf1df835d356795c3/src/libstd/sys/unix/thread.rs:87 35: start_thread 36: __clone Thread 'tokio-runtime-worker' panicked at 'Storage root must match that calculated.', /rustc/d7f94516345a36ddfcd68cbdf1df835d356795c3/src/libstd/macros.rs:13 This is a bug. Please report it at: https://github.com/airalab/robonomics/issues/new 2020-08-13 19:39:31 panicked at 'Storage root must match that calculated.', /rustc/d7f94516345a36ddfcd68cbdf1df835d356795c3/src/libcore/macros/mod.rs:10:9 2020-08-13 19:39:31 Block prepare storage changes error: Execution(Wasmi(Trap(Trap { kind: Unreachable }))) 2020-08-13 19:39:31 💔 Error importing block 0x1b6b2dc756f9e99a0e1ea55a24e4a2b5005fbf7b0582141ab72367dd3ac04a55: Err(Other(ClientImport("Execution: Trap: Trap { kind: Unreachable }"))) Hash: given=193f9c71bf8fa937da91fcb4a35df3340a350dcb720c0f4f3e9fbef6363dfa3c, expected=955e78c7e535731f9a8d14918162d5174eccbfd5c5f8bafe4aeec6702e4c6134 ==================== Version: 0.20.0-5997540-x86_64-linux-gnu 0: sp_panic_handler::set::{{closure}} 1: std::panicking::rust_panic_with_hook at /rustc/d7f94516345a36ddfcd68cbdf1df835d356795c3/src/libstd/panicking.rs:530 2: std::panicking::begin_panic 3: frame_executive::Executive::execute_block 4: ,sp_runtime::generic: :unchecked_extrinsic::UncheckedExtrinsic< as sp_runtime::traits::StaticLookup>::Source,robonomics_parachain_runtime::Call,sp_runtime::MultiSignature, (frame_system::extensions::check_spec_version::CheckSpecVersion,frame_system::extensions::check_tx_version::CheckTxVersion,frame_syst em::extensions::check_genesis::CheckGenesis,frame_system::extensions::check_mortality::CheckMortality,frame_system::extensions::check _nonce::CheckNonce,frame_system::extensions::check_weight::CheckWeight,pallet_transaction_payment::ChargeTransactionPayment)>>>>::execute_block 5: sp_api::runtime_decl_for_Core::execute_block_native_call_generator::{{closure}} 6: std::thread::local::LocalKey::with 7: sc_executor::native_executor::WasmExecutor::with_instance::{{closure}} 8: sc_executor::wasm_runtime::RuntimeCache::with_instance 9: as sp_core::traits::CodeExecutor>::call 10: sp_state_machine::StateMachine::execute_aux 11: sp_state_machine::StateMachine::execute_using_consensus_failure_handler 12: as sp_api::CallApiAt>::call_api_at 13: sp_api::runtime_decl_for_Core::execute_block_call_api_at 14: sp_api::Core::execute_block_with_context 15: <&sc_service::client::client::Client as sp_consensus::block_import::BlockImport>::import_block 16: as sp_consensus::block_import::BlockImport>::import_block 17: sp_consensus::import_queue::import_single_block_metered 18: as core::future::future::Future>::poll 19: as core::future::future::Future>::poll 20: ::Output> as core::future::future::Future>::poll 21: as core::future::future::Future>::poll 22: std::panicking::try 23: as core::future::future::Future>::poll 24: std::thread::local::LocalKey::with 25: futures_executor::local_pool::block_on 26: tokio::loom::std::unsafe_cell::UnsafeCell::with_mut 27: tokio::runtime::task::core::Core::poll 28: as core::ops::function::FnOnce<()>>::call_once 29: tokio::runtime::task::raw::poll 30: tokio::runtime::blocking::pool::Inner::run 31: tokio::runtime::context::enter 32: std::sys_common::backtrace::__rust_begin_short_backtrace 33: core::ops::function::FnOnce::call_once{{vtable.shim}} 34: as core::ops::function::FnOnce>::call_once at /rustc/d7f94516345a36ddfcd68cbdf1df835d356795c3/src/liballoc/boxed.rs:1081 as core::ops::function::FnOnce>::call_once at /rustc/d7f94516345a36ddfcd68cbdf1df835d356795c3/src/liballoc/boxed.rs:1081 std::sys::unix::thread::Thread::new::thread_start at /rustc/d7f94516345a36ddfcd68cbdf1df835d356795c3/src/libstd/sys/unix/thread.rs:87 35: start_thread 36: __clone Thread 'tokio-runtime-worker' panicked at 'Storage root must match that calculated.', /rustc/d7f94516345a36ddfcd68cbdf1df835d356795c3/src/libstd/macros.rs:13 This is a bug. Please report it at: https://github.com/airalab/robonomics/issues/new 2020-08-13 19:39:31 panicked at 'Storage root must match that calculated.', /rustc/d7f94516345a36ddfcd68cbdf1df835d356795c3/src/libcore/macros/mod.rs:10:9 2020-08-13 19:39:31 Block prepare storage changes error: Execution(Wasmi(Trap(Trap { kind: Unreachable }))) 2020-08-13 19:39:31 💔 Error importing block 0x1b6b2dc756f9e99a0e1ea55a24e4a2b5005fbf7b0582141ab72367dd3ac04a55: Err(Other(ClientImport("Execution: Trap: Trap { kind: Unreachable }"))) ^C2020-08-13 19:39:31 Availability worker exiting ```

Outdated