opentensor / subtensor

Bittensor Blockchain Layer
The Unlicense
146 stars 150 forks source link

Archive Node: Block prepare storage changes error: Error at calling runtime api: Execution failed: Execution aborted due to trap: wasm trap: wasm `unreachable` instruction executed #811

Open pamanseau opened 2 weeks ago

pamanseau commented 2 weeks ago

Describe the bug

While indexing an Archive node

To Reproduce

node-subtensor \ --base-path /blockchain \ --chain raw_spec_finney.json \ --rpc-external --rpc-cors all \ --prometheus-external --no-telemetry \ --no-mdns \ --max-runtime-instances 32 --rpc-max-response-size 2048 \ --rpc-max-connections 10000 --in-peers 32 --out-peers 8 \ --bootnodes /dns/bootnode.finney.chain.opentensor.ai/tcp/30333/ws/p2p/12D3KooWRwbMb85RWnT8DSXSYMWQtuDwh4LJzndoRrTDotTR5gDC \ --pruning=archive

Expected behavior

Indexing all blocks without errors

Screenshots

No response

Environment

Linux Ubuntu 20.04

Additional context

2024-09-14 02:58:12 Subtensor Node
2024-09-14 02:58:12 ✌️ version 4.0.0-dev-4f3f151ce94
2024-09-14 02:58:12 ❀️ by Substrate DevHub https://github.com/substrate-developer-hub, 2017-2024
2024-09-14 02:58:12 πŸ“‹ Chain specification: Bittensor
2024-09-14 02:58:12 🏷 Node name: befitting-soap-9473
2024-09-14 02:58:12 πŸ‘€ Role: FULL
2024-09-14 02:58:12 πŸ’Ύ Database: RocksDb at /blockchain/chains/bittensor/db/full
2024-09-14 03:02:04 🏷 Local node identity is: 12D3KooWSjeN8hDtrKXLooW6rC8AToR2btLhRdXtj3TWFuE628hV
2024-09-14 03:02:04 πŸ’» Operating system: linux
2024-09-14 03:02:04 πŸ’» CPU architecture: x86_64
2024-09-14 03:02:04 πŸ’» Target environment: gnu
2024-09-14 03:02:04 πŸ’» CPU: AMD EPYC 9354 32-Core Processor
2024-09-14 03:02:04 πŸ’» CPU cores: 32
2024-09-14 03:02:04 πŸ’» Memory: 773341MB
2024-09-14 03:02:04 πŸ’» Kernel: 5.15.0-119-generic
2024-09-14 03:02:04 πŸ’» Linux distribution: Ubuntu 20.04.6 LTS
2024-09-14 03:02:04 πŸ’» Virtual machine: no
2024-09-14 03:02:04 πŸ“¦ Highest known block at #2585476
2024-09-14 03:02:04 〽️ Prometheus exporter started at 0.0.0.0:9615
2024-09-14 03:02:04 Running JSON-RPC server: addr=0.0.0.0:9944, allowed origins=["*"]
2024-09-14 03:02:05 Error while running root epoch: "Not the block to update emission values."
2024-09-14 03:02:05 πŸ” Discovered new external address for our node: /ip4/5.39.216.204/tcp/30333/ws/p2p/12D3KooWSjeN8hDtrKXLooW6rC8AToR2btLhRdXtj3TWFuE628hV
2024-09-14 03:02:05 πŸ” Discovered new external address for our node: /ip4/46.17.102.137/tcp/30333/ws/p2p/12D3KooWSjeN8hDtrKXLooW6rC8AToR2btLhRdXtj3TWFuE628hV
2024-09-14 03:02:05 Report 12D3KooWBabDG4BH8FC6YFgYVYypqNjh3Ggnu2ZdAKnXiddA8grQ: -2147483648 to -2147483648. Reason: Genesis mismatch. Banned, disconnecting.
2024-09-14 03:02:09 βš™οΈ Syncing, target=#3822571 (36 peers), best: #2585476 (0x3a90…a05e), finalized #2585088 (0x4c58…6368), ⬇ 468.3kiB/s ⬆ 47.7kiB/s

Log when the issue happen with 198 subtensor.log

Restarted the node with 202 subtensor202.log