moonbeam-foundation / moonbeam

An Ethereum-compatible smart contract parachain on Polkadot
https://moonbeam.network
GNU General Public License v3.0
920 stars 336 forks source link

Moonriver node don't sync #2998

Open xinzhongyoumeng opened 2 days ago

xinzhongyoumeng commented 2 days ago

node version: 0.40.1-e23e6874495 node command: /moonbeam --validator --name=xx --base-path=/mnt/movrmain/node --chain=moonriver --relay-chain-rpc-urls xx --database=paritydb --wasm-execution=compiled --trie-cache-size=0 --db-cache=4000 --rpc-port=9944 --unsafe-rpc-external --rpc-methods=unsafe --rpc-cors=all --rpc-max-connections=2000 --port=30333 --runtime-cache-size=64 --ethapi=debug,txpool,trace --wasm-runtime-overrides=/opt/movrmain/core/moonriver-substitutes-tracing --sync=full --state-pruning=archive --blocks-pruning=archive the log is show:

2024-10-09 19:55:07 [🌗] Failed to claim slot err=UnknownBlock("Header was not found in the database: 0xfcdc0f3c19326338371cc27100bf4e6b29f70346ca544d9a232ca88c1223754c") parent=Header { parent_hash: 0x7c24877b604c0f255b2a70f894b1f9a362a0f99d6e01332a02a22ba90dbf5f3a, number: 8531601, state_root: 0x44dd733d79476751069db54c651f39d2ff7770f8621e279e305d40eed8e6a157, extrinsics_root: 0xd9193d021a7ee2b4fc14195b21a18e2025ea126d4ff96e0c2f524a8934a64872, digest: Digest { logs: [DigestItem::PreRuntime([110, 109, 98, 115], [16, 7, 44, 155, 34, 82, 204, 20, 234, 168, 49, 222, 131, 16, 167, 98, 111, 136, 151, 18, 27, 37, 138, 212, 28, 123, 62, 181, 157, 241, 21, 49]), DigestItem::PreRuntime([114, 97, 110, 100], [208, 70, 89, 111, 179, 250, 137, 228, 141, 108, 71, 152, 89, 215, 232, 43, 89, 50, 209, 70, 126, 78, 97, 106, 149, 105, 214, 205, 130, 136, 227, 124, 162, 147, 203, 168, 98, 61, 52, 215, 134, 197, 111, 187, 96, 239, 125, 35, 92, 207, 190, 214, 93, 8, 51, 235, 84, 42, 221, 136, 70, 205, 32, 15, 141, 236, 235, 133, 20, 143, 62, 45, 32, 217, 238, 151, 3, 90, 122, 216, 150, 154, 240, 211, 22, 96, 57, 135, 176, 72, 129, 153, 132, 26, 214, 15]), DigestItem::Consensus([82, 80, 83, 82], [98, 106, 103, 127, 235, 216, 50, 210, 216, 14, 25, 168, 51, 224, 147, 170, 172, 209, 76, 55, 173, 58, 208, 18, 205, 43, 92, 235, 171, 33, 84, 177, 6, 59, 6, 6]), DigestItem::Consensus([102, 114, 111, 110], [1, 11, 150, 11, 186, 34, 142, 9, 55, 172, 178, 93, 226, 245, 203, 101, 191, 88, 54, 201, 251, 129, 204, 104, 118, 97, 218, 224, 85, 51, 75, 157, 79, 0]), DigestItem::Seal([110, 109, 98, 115], [28, 163, 174, 76, 242, 179, 195, 237, 63, 163, 135, 231, 233, 119, 6, 148, 232, 22, 125, 14, 161, 241, 150, 27, 90, 204, 239, 73, 236, 233, 61, 44, 176, 128, 192, 196, 21, 205, 1, 127, 16, 169, 158, 66, 84, 87, 28, 201, 35, 1, 204, 135, 197, 46, 157, 247, 81, 229, 97, 73, 205, 159, 220, 142])] } } relay_parent=Header { parent_hash: 0x066fd0b5a91c83f3c9870cf856a0d300702b0bb3908ade1639fe9a33b485deb1, number: 25267907, state_root: 0x3aa854c7c7feca814a527b2fc52330f3e95c85438ceab614fa3bc1fff06f3ade, extrinsics_root: 0x993196789ba1b0e1df73800bcda07ffd0f9000733dc9b1d4379e42c818ec1b8d, digest: Digest { logs: [DigestItem::PreRuntime([66, 65, 66, 69], [3, 160, 1, 0, 0, 47, 189, 43, 17, 0, 0, 0, 0, 70, 240, 174, 111, 113, 47, 33, 11, 253, 229, 231, 198, 219, 86, 235, 105, 189, 70, 2, 253, 30, 72, 227, 217, 196, 125, 60, 129, 34, 216, 31, 61, 203, 57, 134, 230, 127, 93, 227, 32, 232, 27, 70, 80, 29, 245, 239, 16, 178, 4, 189, 169, 36, 202, 164, 53, 198, 102, 47, 68, 62, 135, 90, 8, 178, 108, 30, 249, 78, 13, 55, 234, 191, 153, 223, 207, 217, 18, 217, 6, 97, 220, 148, 47, 217, 247, 151, 86, 65, 104, 40, 187, 85, 59, 252, 2]), DigestItem::Consensus([66, 69, 69, 70], [3, 247, 203, 15, 29, 21, 234, 97, 8, 3, 219, 134, 55, 238, 218, 31, 60, 253, 82, 249, 15, 185, 163, 229, 209, 136, 160, 104, 228, 26, 27, 100, 232]), DigestItem::Seal([66, 65, 66, 69], [130, 44, 59, 115, 129, 197, 200, 88, 121, 155, 38, 195, 193, 37, 203, 108, 224, 93, 13, 99, 108, 70, 157, 189, 241, 40, 55, 119, 48, 112, 95, 15, 244, 200, 64, 133, 73, 71, 234, 137, 240, 225, 246, 251, 71, 220, 112, 197, 37, 111, 231, 22, 40, 187, 173, 162, 78, 145, 194, 101, 101, 43, 57, 133])] } } included_block=0xfcdc0f3c19326338371cc27100bf4e6b29f70346ca544d9a232ca88c1223754c
2024-10-09 19:55:09 [🌗] ⚙️  Syncing  3.6 bps, target=#8526409 (22 peers), best: #689893 (0x5743…1998), finalized #0 (0x401a…474b), ⬇ 1.7kiB/s ⬆ 0.2kiB/s
2024-10-09 19:55:13 [Relaychain] Received imported block via RPC: #25267908 (0xcfe0…e4f0 -> 0x12bc…20b0)
2024-10-09 19:55:13 [🌗] Failed to claim slot err=UnknownBlock("Header was not found in the database: 0xc32682ebca5e9cee8780709bc11ae2a83233b2eb5f82f1757750bf0ff90c8235") parent=Header { parent_hash: 0xfcdc0f3c19326338371cc27100bf4e6b29f70346ca544d9a232ca88c1223754c, number: 8531602, state_root: 0x4f66f35b0eb1bed2107a12092c13605466dcb84cbc30108333d1247535201008, extrinsics_root: 0x46da58c25cb922a4e1ee5bc1262c73ec0df6787e64563bb4016cc62735cd93e3, digest: Digest { logs: [DigestItem::PreRuntime([110, 109, 98, 115], [32, 151, 123, 97, 169, 115, 2, 105, 144, 94, 1, 5, 249, 129, 31, 224, 121, 136, 128, 145, 244, 38, 86, 115, 247, 45, 245, 200, 165, 84, 240, 26]), DigestItem::PreRuntime([114, 97, 110, 100], [134, 238, 110, 235, 162, 63, 179, 125, 241, 46, 20, 133, 172, 154, 147, 16, 195, 219, 29, 187, 186, 224, 22, 194, 111, 25, 221, 85, 81, 169, 251, 58, 242, 218, 192, 62, 216, 119, 239, 221, 251, 153, 106, 188, 73, 197, 38, 232, 131, 219, 53, 233, 33, 40, 174, 134, 18, 217, 88, 198, 100, 17, 232, 10, 197, 154, 98, 90, 137, 237, 49, 226, 163, 120, 77, 85, 173, 136, 77, 7, 144, 185, 90, 61, 127, 92, 140, 30, 25, 19, 196, 70, 134, 136, 146, 8]), DigestItem::Consensus([82, 80, 83, 82], [56, 125, 5, 150, 193, 246, 72, 173, 253, 142, 50, 236, 47, 243, 105, 47, 233, 175, 173, 9, 13, 139, 166, 206, 154, 48, 228, 217, 149, 11, 77, 169, 10, 59, 6, 6]), DigestItem::Consensus([102, 114, 111, 110], [1, 143, 127, 59, 171, 238, 168, 202, 252, 71, 203, 136, 240, 21, 43, 74, 26, 48, 252, 176, 209, 170, 198, 213, 238, 40, 236, 49, 79, 197, 237, 222, 77, 0]), DigestItem::Seal([110, 109, 98, 115], [118, 213, 90, 79, 238, 2, 204, 147, 241, 76, 112, 166, 144, 88, 94, 200, 228, 45, 188, 192, 74, 178, 138, 114, 132, 7, 31, 10, 224, 69, 77, 19, 54, 81, 9, 127, 113, 247, 161, 255, 122, 157, 237, 59, 218, 171, 237, 164, 227, 189, 96, 91, 112, 237, 163, 232, 34, 67, 63, 47, 106, 50, 151, 129])] } } relay_parent=Header { parent_hash: 0xcfe0a8210e436c17e461b8b768776db2187f78c6a943521c73cb434894a4e4f0, number: 25267908, state_root: 0xba484c52a70f3b7eff5857f48976ebf6b2dcfbaacdc33e0014a949db68dabe11, extrinsics_root: 0x039a1b37561514dc0c380a6ab0528309e52b62a2d21c03b7be4596af237da569, digest: Digest { logs: [DigestItem::PreRuntime([66, 65, 66, 69], [3, 118, 2, 0, 0, 48, 189, 43, 17, 0, 0, 0, 0, 20, 110, 232, 34, 253, 121, 215, 191, 232, 90, 42, 219, 202, 15, 132, 217, 39, 32, 56, 202, 177, 65, 233, 183, 88, 57, 171, 132, 58, 193, 86, 93, 118, 114, 66, 40, 195, 85, 247, 61, 50, 211, 137, 125, 118, 26, 250, 8, 249, 57, 239, 119, 66, 138, 169, 215, 77, 111, 99, 64, 119, 12, 116, 0, 220, 85, 158, 54, 23, 228, 139, 134, 248, 175, 98, 125, 210, 98, 162, 129, 21, 164, 176, 33, 178, 227, 53, 252, 186, 97, 242, 132, 198, 200, 184, 7]), DigestItem::Consensus([66, 69, 69, 70], [3, 3, 139, 154, 221, 124, 11, 61, 249, 204, 37, 143, 65, 82, 70, 214, 10, 63, 160, 125, 71, 193, 167, 55, 245, 120, 4, 182, 137, 201, 11, 159, 38]), DigestItem::Seal([66, 65, 66, 69], [234, 72, 124, 239, 147, 54, 194, 220, 146, 241, 69, 195, 223, 140, 197, 63, 64, 71, 244, 196, 221, 250, 241, 121, 34, 40, 198, 131, 5, 63, 168, 117, 245, 6, 146, 248, 222, 8, 167, 127, 113, 10, 161, 183, 138, 40, 21, 120, 23, 6, 51, 195, 157, 206, 88, 61, 42, 168, 85, 236, 238, 130, 117, 128])] } } included_block=0xc32682ebca5e9cee8780709bc11ae2a83233b2eb5f82f1757750bf0ff90c8235
xinzhongyoumeng commented 2 days ago

relay-chain-rpc-urls the ksm node version is polkadot-stable2409

RomarQ commented 2 days ago

The wasm overrides used for the tracing node did not have metadata-hash enabled, which is a new transaction extension added to polkadot-sdk. To fix the issue you should download the latest wasm overrides for runtime-3200 from https://github.com/moonbeam-foundation/moonbeam-runtime-overrides.git

https://docs.moonbeam.network/node-operators/networks/tracing-node

albertov19 commented 2 days ago

Why use wasm-runtime-overrides for a block producer? You should follow our documentation -> https://docs.moonbeam.network/node-operators/networks/run-a-node/systemd/

xinzhongyoumeng commented 1 day ago

Why use wasm-runtime-overrides for a block producer? You should follow our documentation -> https://docs.moonbeam.network/node-operators/networks/run-a-node/systemd/

we need the tracing node.

xinzhongyoumeng commented 1 day ago

The wasm overrides used for the tracing node did not have metadata-hash enabled, which is a new transaction extension added to polkadot-sdk. To fix the issue you should download the latest wasm overrides for runtime-3200 from https://github.com/moonbeam-foundation/moonbeam-runtime-overrides.git

https://docs.moonbeam.network/node-operators/networks/tracing-node

thank you , I will try it.

albertov19 commented 1 day ago

@xinzhongyoumeng I recommend removing the validator flag if you are running a tracing node. Check the docs I shared. Regards

xinzhongyoumeng commented 1 day ago

@xinzhongyoumeng I recommend removing the validator flag if you are running a tracing node. Check the docs I shared. Regards

you are right, thank you. But the finalized is not update, is still 0. Is this normal?

xinzhongyoumeng commented 1 day ago

the log is:

2024-10-10 19:48:12 [Relaychain] Received imported block via RPC: #25281923 (0x34a1…eda9 -> 0x5670…fa35)
2024-10-10 19:48:15 [🌗] ⚙️  Syncing 45.8 bps, target=#8545227 (13 peers), best: #28649 (0xee4e…5a5c), finalized #0 (0x401a…474b), ⬇ 137.7kiB/s ⬆ 0.1kiB/s
2024-10-10 19:48:18 [Relaychain] Received imported block via RPC: #25281924 (0x5670…fa35 -> 0x633f…e2a4)
2024-10-10 19:48:20 [🌗] ⚙️  Syncing 46.4 bps, target=#8545227 (13 peers), best: #28881 (0x4792…efdc), finalized #0 (0x401a…474b), ⬇ 100.4kiB/s ⬆ 0.3kiB/s
2024-10-10 19:48:24 [Relaychain] Received imported block via RPC: #25281925 (0x633f…e2a4 -> 0x2f48…f739)
2024-10-10 19:48:24 [Relaychain] Received imported block via RPC: #25281925 (0x633f…e2a4 -> 0xae72…5fda)
2024-10-10 19:48:24 [Relaychain] Received imported block via RPC: #25281925 (0x633f…e2a4 -> 0x94b4…865a)
2024-10-10 19:48:25 [Relaychain] Received imported block via RPC: #25281925 (0x633f…e2a4 -> 0x933d…ef2f)
2024-10-10 19:48:25 [Relaychain] Received finalized block via RPC: #25281918 (0x02a1…fe8a -> 0x15e0…59cb)
2024-10-10 19:48:25 [🌗] ⚙️  Syncing 46.0 bps, target=#8545227 (13 peers), best: #29111 (0x58cd…7298), finalized #0 (0x401a…474b), ⬇ 139.2kiB/s ⬆ 0.1kiB/s
2024-10-10 19:48:30 [Relaychain] Received finalized block via RPC: #25281921 (0xb8a8…023c -> 0x866e…9def)
2024-10-10 19:48:30 [🌗] ⚙️  Syncing 46.2 bps, target=#8545227 (13 peers), best: #29342 (0x6dae…8e2a), finalized #0 (0x401a…474b), ⬇ 101.6kiB/s ⬆ 0.2kiB/s
2024-10-10 19:48:30 [Relaychain] Received imported block via RPC: #25281926 (0x2f48…f739 -> 0xb2b1…c958)
2024-10-10 19:48:30 [Relaychain] Received imported block via RPC: #25281926 (0x2f48…f739 -> 0x5e6b…b900)
2024-10-10 19:48:35 [🌗] ⚙️  Syncing 46.6 bps, target=#8545227 (13 peers), best: #29575 (0xbdbf…797f), finalized #0 (0x401a…474b), ⬇ 135.1kiB/s ⬆ 0.5kiB/s
2024-10-10 19:48:36 [Relaychain] Received imported block via RPC: #25281927 (0x5e6b…b900 -> 0xdee6…24b9)
2024-10-10 19:48:40 [🌗] ⚙️  Syncing 46.0 bps, target=#8545227 (13 peers), best: #29805 (0x5653…ce39), finalized #0 (0x401a…474b), ⬇ 135.1kiB/s ⬆ 0.6kiB/s
2024-10-10 19:48:42 [Relaychain] Received finalized block via RPC: #25281924 (0x5670…fa35 -> 0x633f…e2a4)
2024-10-10 19:48:42 [Relaychain] Received imported block via RPC: #25281928 (0xdee6…24b9 -> 0x80dd…9a06)
2024-10-10 19:48:45 [🌗] ⚙️  Syncing 46.2 bps, target=#8545227 (13 peers), best: #30036 (0xbe32…db35), finalized #0 (0x401a…474b), ⬇ 101.2kiB/s ⬆ 0.2kiB/s
2024-10-10 19:48:49 [Relaychain] Received imported block via RPC: #25281929 (0x80dd…9a06 -> 0xdaca…bac7)
2024-10-10 19:48:50 [🌗] ⚙️  Syncing 46.2 bps, target=#8545227 (13 peers), best: #30267 (0x720d…45a5), finalized #0 (0x401a…474b), ⬇ 134.7kiB/s ⬆ 0.1kiB/s
2024-10-10 19:48:54 [Relaychain] Received imported block via RPC: #25281930 (0xdaca…bac7 -> 0x322f…a0b6)
2024-10-10 19:48:55 [🌗] ⚙️  Syncing 46.2 bps, target=#8545227 (13 peers), best: #30498 (0x527e…1780), finalized #0 (0x401a…474b), ⬇ 124.1kiB/s ⬆ 0.7kiB/s
2024-10-10 19:49:00 [🌗] ⚙️  Syncing 46.6 bps, target=#8545227 (13 peers), best: #30731 (0xc145…a87d), finalized #0 (0x401a…474b), ⬇ 118.1kiB/s ⬆ 0.2kiB/s
2024-10-10 19:49:00 [Relaychain] Received imported block via RPC: #25281931 (0x322f…a0b6 -> 0xfb88…6866)
2024-10-10 19:49:03 [Relaychain] Received finalized block via RPC: #25281928 (0xdee6…24b9 -> 0x80dd…9a06)
2024-10-10 19:49:05 [🌗] ⚙️  Syncing 45.0 bps, target=#8545227 (13 peers), best: #30956 (0x2b6c…38ce), finalized #0 (0x401a…474b), ⬇ 134.2kiB/s ⬆ 0.4kiB/s
2024-10-10 19:49:06 [Relaychain] Received imported block via RPC: #25281932 (0xfb88…6866 -> 0xa63f…b0f6)
2024-10-10 19:49:10 [🌗] ⚙️  Syncing 47.2 bps, target=#8545227 (13 peers), best: #31192 (0xf7e5…0a1f), finalized #0 (0x401a…474b), ⬇ 101.6kiB/s ⬆ 0.4kiB/s
2024-10-10 19:49:12 [Relaychain] Received imported block via RPC: #25281933 (0xa63f…b0f6 -> 0x292e…759f)
2024-10-10 19:49:15 [🌗] ⚙️  Syncing 45.4 bps, target=#8545227 (13 peers), best: #31419 (0xe397…43e5), finalized #0 (0x401a…474b), ⬇ 134.6kiB/s ⬆ 0.1kiB/s
2024-10-10 19:49:19 [Relaychain] Received imported block via RPC: #25281934 (0x292e…759f -> 0xba5e…ba24)
2024-10-10 19:49:20 [🌗] ⚙️  Syncing 46.6 bps, target=#8545227 (13 peers), best: #31652 (0x661f…2c0f), finalized #0 (0x401a…474b), ⬇ 135.4kiB/s ⬆ 0.7kiB/s
albertov19 commented 1 day ago

@xinzhongyoumeng It is syncing from zero, unsure if you removed the database or what

xinzhongyoumeng commented 1 day ago

@xinzhongyoumeng It is syncing from zero, unsure if you removed the database or what

yes, I reset the database.

xinzhongyoumeng commented 1 day ago

@xinzhongyoumeng It is syncing from zero, unsure if you removed the database or what

How long the finalized will update when it is syncing from zero?

albertov19 commented 1 day ago

@xinzhongyoumeng It is syncing from zero, unsure if you removed the database or what

How long the finalized will update when it is syncing from zero?

A long time, there are some community members that have snapshots:

xinzhongyoumeng commented 1 day ago

@xinzhongyoumeng It is syncing from zero, unsure if you removed the database or what

How long the finalized will update when it is syncing from zero?

A long time, there are some community members that have snapshots:

thank you, if have any pruned state snapshots ?

albertov19 commented 1 day ago

@xinzhongyoumeng It is syncing from zero, unsure if you removed the database or what

How long the finalized will update when it is syncing from zero?

A long time, there are some community members that have snapshots:

thank you, if have any pruned state snapshots ?

Unfortunately not