openethereum / parity-ethereum

The fast, light, and robust client for Ethereum-like networks.
Other
6.82k stars 1.69k forks source link

Goerli node in archive mode stops loading new blocks after fully synced #11730

Closed pavlovdog closed 4 years ago

pavlovdog commented 4 years ago

I have a Goeli node, which is syncing in an archive mode. It's fully synced. About a week ago, it has started to stop loading new blocks. I've restarted it and for a few hours everything was fine. After that, it already stopped syncing. Usually, it takes 1-2 hours after I restart the node, before the node stops syncing. Here's the comparison with the block number from the https://goerli.etherscan.io/:

image

Here's the openethereum configuration:

/usr/bin/parity --chain=goerli --cache-size 3572 --jsonrpc-interface 0.0.0.0 --jsonrpc-apis "eth" --jsonrpc-cors "http://remix.ethereum.org" --allow-ips=public --min-peers=512 --max-peers=512 --reserved-only --reserved-peers=/var/io.parity.ethereum/reserved.peers --base-path='/var/io.parity.ethereum' --db-path='/var/io.parity.ethereum/chains' --keys-path='/var/io.parity.ethereum/keys' --pruning=archive

The RPC is available for only specific IPs with a firewall. Here's the content of the reserved.peers:

enode://a61215641fb8714a373c80edbfa0ea8878243193f57c96eeb44d0bc019ef295abd4e044fd619bfc4c59731a73fb79afe84e9ab6da0c743ceb479cbb6d263fa91@3.11.147.67:30303
enode://06333009fc9ef3c9e174768e495722a7f98fe7afd4660542e983005f85e556028410fd03278944f44cfe5437b1750b5e6bd1738f700fe7da3626d52010d2954c@51.141.15.254:30303
enode://176b9417f511d05b6b2cf3e34b756cf0a7096b3094572a8f6ef4cdcb9d1f9d00683bf0f83347eebdf3b81c3521c2332086d9592802230bf528eaf606a1d9677b@13.93.54.137:30303
enode://a61215641fb8714a373c80edbfa0ea8878243193f57c96eeb44d0bc019ef295abd4e044fd619bfc4c59731a73fb79afe84e9ab6da0c743ceb479cbb6d263fa91@3.11.147.67:30303
enode://67913271d14f445689e8310270c304d42f268428f2de7a4ac0275bea97690e021df6f549f462503ff4c7a81d9dd27288867bbfa2271477d0911378b8944fae55@157.230.239.163:30303
enode://a87685902a0622e9cf18c68e73a0ea45156ec53e857ef049b185a9db2296ca04d776417bf1901c0b4eacb5b26271d8694e88e3f17c20d49eb77e1a41ab26b5b3@51.141.78.53:30303
enode://ae8658da8d255d1992c3ec6e62e11d6e1c5899aa1566504bc1ff96a0c9c8bd44838372be643342553817f5cc7d78f1c83a8093dee13d77b3b0a583c050c81940@18.232.185.151:30303
enode://ae8658da8d255d1992c3ec6e62e11d6e1c5899aa1566504bc1ff96a0c9c8bd44838372be643342553817f5cc7d78f1c83a8093dee13d77b3b0a583c050c81940@18.232.185.151:30303
enode://b477ca6d507a3f57070783eb62ba838847635f8b1a0cbffb8b7f8173f5894cf550f0225a5c279341e2d862a606e778b57180a4f1db3db78c51eadcfa4fdc6963@40.68.240.160:30303
enode://46add44b9f13965f7b9875ac6b85f016f341012d84f975377573800a863526f4da19ae2c620ec73d11591fa9510e992ecc03ad0751f53cc02f7c7ed6d55c7291@94.237.54.114:30313
enode://6113f1a790d36c47d4cbb7032bf83306967033220a1f0f4f3b97acfdc09a725a422eeef74201d6958bef56d744804beaee479b1ceddb496d3a223c2670d255b1@163.172.147.254:30303
enode://9aaf72310ba1881b7b9fdd1c4c0dbbffd50ee5c1cca393ce57f1fed1ca63caa2b30a75b17d784954298f11b881cad008cc4454277eabcc0e3f19a1a4313f348e@140.82.51.150:30303
enode://102166873f9edba3c317b5038e53b7fd0ba688fe0c6367709b905e830baba5f2e50c96814edfe47eabcbb4273e1f82b16de5f88b00a8e3439b47caeee3c83c85@95.217.8.76:30303
enode://c7d00666fa65b6bb94106eddfc61e0c32a86aa606d7883d0c560f8b63932e23d350e66e96b67ec08299c7cda84a52cf3e4693bf60b54e0d7b720d879d71e8e91@103.25.200.156:30303
enode://f3732b2112018ad16448aa2d664fc5148426b7ee40c8163b29204ac6714cc646b28dc339e2b7d139d94c0f7fd057bc889a950422408fd01dec308f892bd140e7@161.156.79.245:30603
enode://358229d726b01058211a5a2aa95d08f91481afda219eadc6a709fd0f73996638a80881c6362e75f07653a60f5b95a3d0d410ab9fea8178ba5a1b8d6f783d319f@45.76.217.13:30303
enode://c5d798e569ed63940605149b13a52b6a2068563a424df2813e3b4735d16d002fc1b61510095a429f846a2b147c3757fb1946536cabe74880c58cb302a8e5015a@173.249.45.157:30303
enode://9b4870a5116da615cb9fd6b086da86cce1826272ee5c495a50db6de01bfb0621669c7bb06c1b7ac2ad460c1eda2bb95442984f48c8b9667f5102b7a6385a1502@94.130.106.12:30303
enode://94b129fa3f7475ba10c4bf6f1da5597f4411fb5b5f5ec95bad1d1775498ecbfe628a3d61c4e2e3f8ca20aeb1f0bc67280182f39aab4aa469ce67dc538faabed9@138.201.173.154:30303
enode://e185db9c7e2b7c34f5c305fcde3f1f8a3e8998982c96b7edd3fadaedcbd684a1b08d1d13ffadb881e64040a05d5753aae206d8da7a3315b621ad144348aa623e@134.255.190.114:30303
enode://659bfbe1616cc36e83f9d8f3c9226307b03aabd4b9377e9af7f4e31ce04a03acbb2e3a93fc3ae4eb751d897efbfb82579df7ae954b43ecdaea80f98d219395ef@23.243.214.68:30303
enode://cddc533636c6bc0762593a9148f6d7adb345bddb2a7d142a4ac2554197ac61dd16191bb249237997c6c8788248db5b50a572c724564e36aa005b51c3444c36b9@149.248.56.53:30303
enode://13c6bee0b32d024dbb5a5ef0ef1b4fca67230d8a9ec76c39a6555f1e4e12fca34ad8ec2ac1bda3a639ca29c099d8515223460f1ab79cfc2c42a580d78d6db40b@70.187.137.197:60606
enode://0dad712a549e09b268c78384b22ae79ce0594afa9d788c9c7bfb3693872f4d40cdcd4d47fd0ce5ee97bb757db0cc000f195c815d8a7f91bd1ccf18ede88bbaca@35.189.82.16:30303
enode://a61215641fb8714a373c80edbfa0ea8878243193f57c96eeb44d0bc019ef295abd4e044fd619bfc4c59731a73fb79afe84e9ab6da0c743ceb479cbb6d263fa91@3.11.147.67:30303

The peers are taken from the openethereum and geth configuration. Here are the openethereum logs:

May 23 17:55:53 parity-ethereum-2 parity[27732]: 2020-05-23 17:55:53 UTC Imported #2748249 0x4331…c564 (0 txs, 0.00 Mgas, 0 ms, 0.59 KiB)
May 23 17:56:03 parity-ethereum-2 parity[27732]: 2020-05-23 17:56:03 UTC    2/512 peers     13 MiB chain  308 KiB db  0 bytes queue    2 MiB sync  RPC:  0 conn,    2 req/s,  158 µs
May 23 17:56:07 parity-ethereum-2 parity[27732]: 2020-05-23 17:56:07 UTC Imported #2748250 0x4315…8dd9 (1 txs, 0.45 Mgas, 40 ms, 1.33 KiB)
May 23 17:56:21 parity-ethereum-2 parity[27732]: 2020-05-23 17:56:21 UTC Imported #2748251 0x5ad3…f305 (0 txs, 0.00 Mgas, 0 ms, 0.59 KiB)
May 23 17:56:33 parity-ethereum-2 parity[27732]: 2020-05-23 17:56:33 UTC    2/512 peers     13 MiB chain  308 KiB db  0 bytes queue    2 MiB sync  RPC:  0 conn,    3 req/s,  176 µs
May 23 17:56:38 parity-ethereum-2 parity[27732]: 2020-05-23 17:56:38 UTC Imported #2748252 0xfabd…1e5a (0 txs, 0.00 Mgas, 0 ms, 0.59 KiB)
May 23 17:57:00 parity-ethereum-2 parity[27732]: 2020-05-23 17:57:00 UTC Imported #2748253 0x7646…92b5 (1 txs, 0.49 Mgas, 10 ms, 1.58 KiB)
May 23 17:57:03 parity-ethereum-2 parity[27732]: 2020-05-23 17:57:03 UTC    2/512 peers     13 MiB chain  308 KiB db  0 bytes queue    5 MiB sync  RPC:  0 conn,    3 req/s,  174 µs
May 23 17:57:06 parity-ethereum-2 parity[27732]: 2020-05-23 17:57:06 UTC Imported #2748254 0xaf75…34a2 (4 txs, 1.49 Mgas, 37 ms, 4.53 KiB)
May 23 17:57:33 parity-ethereum-2 parity[27732]: 2020-05-23 17:57:33 UTC    2/512 peers     13 MiB chain  308 KiB db  0 bytes queue    7 MiB sync  RPC:  0 conn,    4 req/s,  158 µs
May 23 17:58:08 parity-ethereum-2 parity[27732]: 2020-05-23 17:58:08 UTC    2/512 peers     13 MiB chain  308 KiB db  0 bytes queue    7 MiB sync  RPC:  0 conn,    0 req/s,  144 µs
May 23 17:58:38 parity-ethereum-2 parity[27732]: 2020-05-23 17:58:38 UTC    2/512 peers     13 MiB chain  308 KiB db  0 bytes queue   10 MiB sync  RPC:  0 conn,    0 req/s,  157 µs
May 23 17:59:08 parity-ethereum-2 parity[27732]: 2020-05-23 17:59:08 UTC    2/512 peers     13 MiB chain  308 KiB db  0 bytes queue   10 MiB sync  RPC:  0 conn,    2 req/s,  152 µs
May 23 17:59:38 parity-ethereum-2 parity[27732]: 2020-05-23 17:59:38 UTC    2/512 peers     13 MiB chain  308 KiB db  0 bytes queue   10 MiB sync  RPC:  0 conn,    2 req/s,  152 µs
May 23 18:00:08 parity-ethereum-2 parity[27732]: 2020-05-23 18:00:08 UTC    2/512 peers     13 MiB chain  308 KiB db  0 bytes queue   10 MiB sync  RPC:  0 conn,    0 req/s,  160 µs
May 23 18:00:38 parity-ethereum-2 parity[27732]: 2020-05-23 18:00:38 UTC    2/512 peers     13 MiB chain  308 KiB db  0 bytes queue   10 MiB sync  RPC:  0 conn,    0 req/s,  145 µs
May 23 18:01:13 parity-ethereum-2 parity[27732]: 2020-05-23 18:01:13 UTC    2/512 peers     13 MiB chain  308 KiB db  0 bytes queue   12 MiB sync  RPC:  0 conn,    2 req/s,  152 µs
May 23 18:01:43 parity-ethereum-2 parity[27732]: 2020-05-23 18:01:43 UTC    2/512 peers     13 MiB chain  308 KiB db  0 bytes queue   10 MiB sync  RPC:  0 conn,    3 req/s,  155 µs
May 23 18:02:13 parity-ethereum-2 parity[27732]: 2020-05-23 18:02:13 UTC    2/512 peers     13 MiB chain  308 KiB db  0 bytes queue   10 MiB sync  RPC:  0 conn,    4 req/s,  150 µs
May 23 18:02:43 parity-ethereum-2 parity[27732]: 2020-05-23 18:02:43 UTC    2/512 peers     13 MiB chain  308 KiB db  0 bytes queue   11 MiB sync  RPC:  0 conn,    4 req/s,  149 µs
May 23 18:03:13 parity-ethereum-2 parity[27732]: 2020-05-23 18:03:13 UTC    2/512 peers     13 MiB chain  308 KiB db  0 bytes queue   10 MiB sync  RPC:  0 conn,    0 req/s,  150 µs
May 23 18:03:43 parity-ethereum-2 parity[27732]: 2020-05-23 18:03:43 UTC    2/512 peers     13 MiB chain  308 KiB db  0 bytes queue   11 MiB sync  RPC:  0 conn,    1 req/s,  157 µs
May 23 18:04:13 parity-ethereum-2 parity[27732]: 2020-05-23 18:04:13 UTC    2/512 peers     13 MiB chain  308 KiB db  0 bytes queue   12 MiB sync  RPC:  0 conn,    1 req/s,  148 µs
May 23 18:04:43 parity-ethereum-2 parity[27732]: 2020-05-23 18:04:43 UTC    2/512 peers     13 MiB chain  308 KiB db  0 bytes queue   10 MiB sync  RPC:  0 conn,    2 req/s,  158 µs
May 23 18:05:18 parity-ethereum-2 parity[27732]: 2020-05-23 18:05:18 UTC    2/512 peers     13 MiB chain  308 KiB db  0 bytes queue   11 MiB sync  RPC:  0 conn,    3 req/s,  139 µs
May 23 18:05:48 parity-ethereum-2 parity[27732]: 2020-05-23 18:05:48 UTC    2/512 peers     13 MiB chain  308 KiB db  0 bytes queue   11 MiB sync  RPC:  0 conn,    3 req/s,  172 µs
May 23 18:06:18 parity-ethereum-2 parity[27732]: 2020-05-23 18:06:18 UTC    2/512 peers     13 MiB chain  308 KiB db  0 bytes queue   10 MiB sync  RPC:  0 conn,    3 req/s,  163 µs
May 23 18:06:48 parity-ethereum-2 parity[27732]: 2020-05-23 18:06:48 UTC    2/512 peers     13 MiB chain  308 KiB db  0 bytes queue   11 MiB sync  RPC:  0 conn,    3 req/s,  176 µs
May 23 18:07:18 parity-ethereum-2 parity[27732]: 2020-05-23 18:07:18 UTC    2/512 peers     13 MiB chain  308 KiB db  0 bytes queue   10 MiB sync  RPC:  0 conn,    3 req/s,  175 µs
May 23 18:07:48 parity-ethereum-2 parity[27732]: 2020-05-23 18:07:48 UTC    2/512 peers     13 MiB chain  308 KiB db  0 bytes queue   12 MiB sync  RPC:  0 conn,    2 req/s,  154 µs
May 23 18:08:23 parity-ethereum-2 parity[27732]: 2020-05-23 18:08:23 UTC    2/512 peers     13 MiB chain  308 KiB db  0 bytes queue   12 MiB sync  RPC:  0 conn,    1 req/s,  142 µs
May 23 18:08:53 parity-ethereum-2 parity[27732]: 2020-05-23 18:08:53 UTC    2/512 peers     13 MiB chain  308 KiB db  0 bytes queue   10 MiB sync  RPC:  0 conn,    2 req/s,  160 µs
May 23 18:09:23 parity-ethereum-2 parity[27732]: 2020-05-23 18:09:23 UTC    2/512 peers     13 MiB chain  308 KiB db  0 bytes queue   12 MiB sync  RPC:  0 conn,    4 req/s,  146 µs
May 23 18:09:53 parity-ethereum-2 parity[27732]: 2020-05-23 18:09:53 UTC    2/512 peers     13 MiB chain  308 KiB db  0 bytes queue   11 MiB sync  RPC:  0 conn,    2 req/s,  134 µs

As you see, there're no error logs or something. It just stops loading new blocks. How can I fix that?

Thanks in advance!

vorot93 commented 4 years ago

Reproduced locally.

vorot93 commented 4 years ago

Please check if #11265 resolves the issue.

pavlovdog commented 4 years ago

@vorot93 works fine, thanks a lot! image