search

erigontech / erigon

Ethereum implementation on the efficiency frontier https://erigon.gitbook.io
GNU Lesser General Public License v3.0
3.09k stars 1.08k forks source link

{'error': {'code': -32000, 'message': 'Unable to complete request at this time.'}} #10030

Open fridary opened 4 months ago

fridary commented 4 months ago

Erigon version: erigon version 2.59.3-088fd8ef OS & Version: Ubuntu 20.04.6 LTS, CPU E5-2695 v4, 72 processes, 192 Gb RAM Disk: NVMe HPE MT006400KWHAE 6.4 Tb Erigon Command (with flags/config): ExecStart=/home/root/erigon/build/bin/erigon --internalcl --datadir=/disk_sde/erigon --http.api=eth,erigon,engine,web3,net,debug,trace,txpool --authrpc.jwtsecret=/home/root/erigon/jwtsecret --metrics --prune.h.before=13916166 --prune.r.before=13916166 --prune.t.before=13916166 --prune.c.before=13916166 --torrent.download.rate=128mb Chain/Network: mainnet

Error

{'error': {'code': -32000,
           'message': 'Unable to complete request at this time.'},
 'id': 1,
 'jsonrpc': '2.0'}

Steps to reproduce the behaviour

I do high load multiprocessing in 72 processes (72 parallel jobs) to query Ethereum node with RPC.

After around more than some millions requests in 15 mins I get error above. Any ideas what can be wrong? Maybe I need to change Erigon flags to allow more requests? Or problem with reading disk database so often?

Logs

Last 200 logs during executing.

apr 23 16:40:16 root-pc erigon[4794]: [WARN] [04-23|16:40:16.893] [rpc] served                             conn=127.0.0.1:36942 method=eth_call reqid=1 t=1.203206ms err="execution reverted"
apr 23 16:40:16 root-pc erigon[4794]: [WARN] [04-23|16:40:16.904] [rpc] served                             conn=127.0.0.1:36942 method=eth_call reqid=3 t=428.835µs err="execution reverted"
apr 23 16:40:16 root-pc erigon[4794]: [WARN] [04-23|16:40:16.913] [rpc] served                             conn=127.0.0.1:36942 method=eth_call reqid=5 t=344.083µs err="execution reverted"
apr 23 16:40:16 root-pc erigon[4794]: [WARN] [04-23|16:40:16.940] [rpc] served                             conn=127.0.0.1:59300 method=eth_call reqid=13 t=6.410576ms err="execution reverted"
apr 23 16:40:16 root-pc erigon[4794]: [WARN] [04-23|16:40:16.948] [rpc] served                             conn=127.0.0.1:59300 method=eth_call reqid=15 t=469.047µs err="execution reverted"
apr 23 16:40:16 root-pc erigon[4794]: [WARN] [04-23|16:40:16.958] [rpc] served                             conn=127.0.0.1:59300 method=eth_call reqid=17 t=486.317µs err="execution reverted"
apr 23 16:40:17 root-pc erigon[4794]: [WARN] [04-23|16:40:17.091] [rpc] served                             conn=127.0.0.1:37466 method=eth_call reqid=1 t=328.174µs err="execution reverted"
apr 23 16:40:17 root-pc erigon[4794]: [WARN] [04-23|16:40:17.105] [rpc] served                             conn=127.0.0.1:37466 method=eth_call reqid=3 t=363.427µs err="execution reverted"
apr 23 16:40:17 root-pc erigon[4794]: [WARN] [04-23|16:40:17.116] [rpc] served                             conn=127.0.0.1:37466 method=eth_call reqid=5 t=404.924µs err="execution reverted"
apr 23 16:40:17 root-pc erigon[4794]: [WARN] [04-23|16:40:17.178] [rpc] served                             conn=127.0.0.1:35810 method=eth_call reqid=7 t=368.525µs err="execution reverted"
apr 23 16:40:17 root-pc erigon[4794]: [WARN] [04-23|16:40:17.184] [rpc] served                             conn=127.0.0.1:35810 method=eth_call reqid=9 t=242.98µs err="execution reverted"
apr 23 16:40:17 root-pc erigon[4794]: [WARN] [04-23|16:40:17.190] [rpc] served                             conn=127.0.0.1:35810 method=eth_call reqid=11 t=231.35µs err="execution reverted"
apr 23 16:40:17 root-pc erigon[4794]: [WARN] [04-23|16:40:17.210] [rpc] served                             conn=127.0.0.1:35884 method=eth_call reqid=7 t=381.106µs err="execution reverted"
apr 23 16:40:17 root-pc erigon[4794]: [WARN] [04-23|16:40:17.219] [rpc] served                             conn=127.0.0.1:35884 method=eth_call reqid=9 t=321.891µs err="execution reverted"
apr 23 16:40:17 root-pc erigon[4794]: [WARN] [04-23|16:40:17.227] [rpc] served                             conn=127.0.0.1:35884 method=eth_call reqid=11 t=365.216µs err="execution reverted"
apr 23 16:40:17 root-pc erigon[4794]: [WARN] [04-23|16:40:17.251] [rpc] served                             conn=127.0.0.1:35884 method=eth_call reqid=13 t=477.302µs err="execution reverted"
apr 23 16:40:17 root-pc erigon[4794]: [WARN] [04-23|16:40:17.258] [rpc] served                             conn=127.0.0.1:35884 method=eth_call reqid=15 t=397.437µs err="execution reverted"
apr 23 16:40:17 root-pc erigon[4794]: [WARN] [04-23|16:40:17.283] [rpc] served                             conn=127.0.0.1:35884 method=eth_call reqid=17 t=267.427µs err="execution reverted"
apr 23 16:40:17 root-pc erigon[4794]: [WARN] [04-23|16:40:17.355] [rpc] served                             conn=127.0.0.1:36436 method=eth_call reqid=7 t=616.633µs err="execution reverted"
apr 23 16:40:17 root-pc erigon[4794]: [WARN] [04-23|16:40:17.364] [rpc] served                             conn=127.0.0.1:36436 method=eth_call reqid=9 t=282.01µs err="execution reverted"
apr 23 16:40:17 root-pc erigon[4794]: [WARN] [04-23|16:40:17.369] [rpc] served                             conn=127.0.0.1:36436 method=eth_call reqid=11 t=277.455µs err="execution reverted"
apr 23 16:40:17 root-pc erigon[4794]: [WARN] [04-23|16:40:17.385] [rpc] served                             conn=127.0.0.1:36436 method=eth_call reqid=13 t=401.401µs err="execution reverted"
apr 23 16:40:17 root-pc erigon[4794]: [WARN] [04-23|16:40:17.392] [rpc] served                             conn=127.0.0.1:36436 method=eth_call reqid=15 t=326.248µs err="execution reverted"
apr 23 16:40:17 root-pc erigon[4794]: [WARN] [04-23|16:40:17.400] [rpc] served                             conn=127.0.0.1:36436 method=eth_call reqid=17 t=427.386µs err="execution reverted"
apr 23 16:40:17 root-pc erigon[4794]: [INFO] [04-23|16:40:17.596] [updateForkchoice] Fork choice update: flushing in-memory state (built by previous newPayload)
apr 23 16:40:17 root-pc erigon[4794]: [WARN] [04-23|16:40:17.709] [rpc] served                             conn=127.0.0.1:39328 method=eth_call reqid=1 t=449.25µs err="execution reverted"
apr 23 16:40:17 root-pc erigon[4794]: [WARN] [04-23|16:40:17.717] [rpc] served                             conn=127.0.0.1:39328 method=eth_call reqid=3 t=421.008µs err="execution reverted"
apr 23 16:40:17 root-pc erigon[4794]: [WARN] [04-23|16:40:17.723] [rpc] served                             conn=127.0.0.1:39328 method=eth_call reqid=5 t=339.623µs err="execution reverted"
apr 23 16:40:17 root-pc erigon[4794]: [WARN] [04-23|16:40:17.745] [rpc] served                             conn=127.0.0.1:35328 method=eth_call reqid=13 t=445.121µs err="execution reverted"
apr 23 16:40:17 root-pc erigon[4794]: [WARN] [04-23|16:40:17.752] [rpc] served                             conn=127.0.0.1:35328 method=eth_call reqid=15 t=586.21µs err="execution reverted"
apr 23 16:40:17 root-pc erigon[4794]: [WARN] [04-23|16:40:17.759] [rpc] served                             conn=127.0.0.1:35328 method=eth_call reqid=17 t=490.151µs err="execution reverted"
apr 23 16:40:18 root-pc erigon[4794]: [WARN] [04-23|16:40:18.017] [rpc] served                             conn=127.0.0.1:35976 method=eth_call reqid=13 t=439.841µs err="execution reverted"
apr 23 16:40:18 root-pc erigon[4794]: [WARN] [04-23|16:40:18.026] [rpc] served                             conn=127.0.0.1:35976 method=eth_call reqid=15 t=397.042µs err="execution reverted"
apr 23 16:40:18 root-pc erigon[4794]: [WARN] [04-23|16:40:18.034] [rpc] served                             conn=127.0.0.1:35976 method=eth_call reqid=17 t=329.715µs err="execution reverted"
apr 23 16:40:18 root-pc erigon[4794]: [WARN] [04-23|16:40:18.086] [rpc] served                             conn=127.0.0.1:36436 method=eth_call reqid=19 t=267.365µs err="execution reverted"
apr 23 16:40:18 root-pc erigon[4794]: [WARN] [04-23|16:40:18.092] [rpc] served                             conn=127.0.0.1:36436 method=eth_call reqid=21 t=274.548µs err="execution reverted"
apr 23 16:40:18 root-pc erigon[4794]: [WARN] [04-23|16:40:18.099] [rpc] served                             conn=127.0.0.1:36436 method=eth_call reqid=23 t=320.771µs err="execution reverted"
apr 23 16:40:18 root-pc erigon[4794]: [INFO] [04-23|16:40:18.117] RPC Daemon notified of new headers       from=19718450 to=19718451 amount=1 hash=0x60616f3f2a42633b18e257ea8b4cc2db7ed53cffdb60f400a3a3705db8f7da5b header sending=21.285µs log sending=443ns
apr 23 16:40:18 root-pc erigon[4794]: [INFO] [04-23|16:40:18.117] head updated                             hash=0x60616f3f2a42633b18e257ea8b4cc2db7ed53cffdb60f400a3a3705db8f7da5b number=19718451
apr 23 16:40:18 root-pc erigon[4794]: [WARN] [04-23|16:40:18.125] [rpc] served                             conn=127.0.0.1:36436 method=eth_call reqid=25 t=3.480457ms err="execution reverted"
apr 23 16:40:18 root-pc erigon[4794]: [WARN] [04-23|16:40:18.134] [rpc] served                             conn=127.0.0.1:36436 method=eth_call reqid=27 t=304.724µs err="execution reverted"
apr 23 16:40:18 root-pc erigon[4794]: [WARN] [04-23|16:40:18.137] [rpc] served                             conn=127.0.0.1:40654 method=eth_call reqid=1 t=257.79µs err="execution reverted"
apr 23 16:40:18 root-pc erigon[4794]: [WARN] [04-23|16:40:18.141] [rpc] served                             conn=127.0.0.1:36436 method=eth_call reqid=29 t=219.461µs err="execution reverted"
apr 23 16:40:18 root-pc erigon[4794]: [WARN] [04-23|16:40:18.142] [rpc] served                             conn=127.0.0.1:38374 method=eth_call reqid=7 t=266.453µs err="execution reverted"
apr 23 16:40:18 root-pc erigon[4794]: [WARN] [04-23|16:40:18.145] [rpc] served                             conn=127.0.0.1:40654 method=eth_call reqid=3 t=285.706µs err="execution reverted"
apr 23 16:40:18 root-pc erigon[4794]: [WARN] [04-23|16:40:18.150] [rpc] served                             conn=127.0.0.1:38374 method=eth_call reqid=9 t=257.404µs err="execution reverted"
apr 23 16:40:18 root-pc erigon[4794]: [WARN] [04-23|16:40:18.152] [rpc] served                             conn=127.0.0.1:40654 method=eth_call reqid=5 t=334.509µs err="execution reverted"
apr 23 16:40:18 root-pc erigon[4794]: [WARN] [04-23|16:40:18.158] [rpc] served                             conn=127.0.0.1:38374 method=eth_call reqid=11 t=265.81µs err="execution reverted"
apr 23 16:40:18 root-pc erigon[4794]: [WARN] [04-23|16:40:18.180] [rpc] served                             conn=127.0.0.1:38374 method=eth_call reqid=13 t=372.957µs err="execution reverted"
apr 23 16:40:18 root-pc erigon[4794]: [WARN] [04-23|16:40:18.189] [rpc] served                             conn=127.0.0.1:38374 method=eth_call reqid=15 t=259.178µs err="execution reverted"
apr 23 16:40:18 root-pc erigon[4794]: [WARN] [04-23|16:40:18.197] [rpc] served                             conn=127.0.0.1:38374 method=eth_call reqid=17 t=276.639µs err="execution reverted"
apr 23 16:40:18 root-pc erigon[4794]: [WARN] [04-23|16:40:18.808] [rpc] served                             conn=127.0.0.1:41470 method=eth_call reqid=1 t=238.656µs err="execution reverted"
apr 23 16:40:18 root-pc erigon[4794]: [WARN] [04-23|16:40:18.814] [rpc] served                             conn=127.0.0.1:41488 method=eth_call reqid=1 t=278.742µs err="execution reverted"
apr 23 16:40:18 root-pc erigon[4794]: [WARN] [04-23|16:40:18.815] [rpc] served                             conn=127.0.0.1:41470 method=eth_call reqid=3 t=193.039µs err="execution reverted"
apr 23 16:40:18 root-pc erigon[4794]: [WARN] [04-23|16:40:18.821] [rpc] served                             conn=127.0.0.1:41488 method=eth_call reqid=3 t=453.865µs err="execution reverted"
apr 23 16:40:18 root-pc erigon[4794]: [WARN] [04-23|16:40:18.822] [rpc] served                             conn=127.0.0.1:41470 method=eth_call reqid=5 t=217.691µs err="execution reverted"
apr 23 16:40:18 root-pc erigon[4794]: [WARN] [04-23|16:40:18.828] [rpc] served                             conn=127.0.0.1:41488 method=eth_call reqid=5 t=335.231µs err="execution reverted"
apr 23 16:40:18 root-pc erigon[4794]: [WARN] [04-23|16:40:18.851] [rpc] served                             conn=127.0.0.1:41488 method=eth_call reqid=7 t=297.528µs err="execution reverted"
apr 23 16:40:18 root-pc erigon[4794]: [WARN] [04-23|16:40:18.859] [rpc] served                             conn=127.0.0.1:41488 method=eth_call reqid=9 t=400.87µs err="execution reverted"
apr 23 16:40:18 root-pc erigon[4794]: [WARN] [04-23|16:40:18.866] [rpc] served                             conn=127.0.0.1:41488 method=eth_call reqid=11 t=412.788µs err="execution reverted"
apr 23 16:40:19 root-pc erigon[4794]: [WARN] [04-23|16:40:19.139] [rpc] served                             conn=127.0.0.1:41670 method=eth_call reqid=1 t=327.97µs err="execution reverted"
apr 23 16:40:19 root-pc erigon[4794]: [WARN] [04-23|16:40:19.146] [rpc] served                             conn=127.0.0.1:41670 method=eth_call reqid=3 t=351.086µs err="execution reverted"
apr 23 16:40:19 root-pc erigon[4794]: [WARN] [04-23|16:40:19.152] [rpc] served                             conn=127.0.0.1:41670 method=eth_call reqid=5 t=272.464µs err="execution reverted"
apr 23 16:40:19 root-pc erigon[4794]: [WARN] [04-23|16:40:19.171] [rpc] served                             conn=127.0.0.1:41670 method=eth_call reqid=7 t=232.126µs err="execution reverted"
apr 23 16:40:19 root-pc erigon[4794]: [WARN] [04-23|16:40:19.176] [rpc] served                             conn=127.0.0.1:41670 method=eth_call reqid=9 t=216.736µs err="execution reverted"
apr 23 16:40:19 root-pc erigon[4794]: [WARN] [04-23|16:40:19.181] [rpc] served                             conn=127.0.0.1:41670 method=eth_call reqid=11 t=209.196µs err="execution reverted"
apr 23 16:40:19 root-pc erigon[4794]: [WARN] [04-23|16:40:19.549] [rpc] served                             conn=127.0.0.1:40742 method=eth_call reqid=13 t=581.353µs err="execution reverted"
apr 23 16:40:19 root-pc erigon[4794]: [WARN] [04-23|16:40:19.559] [rpc] served                             conn=127.0.0.1:40742 method=eth_call reqid=15 t=357.381µs err="execution reverted"
apr 23 16:40:19 root-pc erigon[4794]: [WARN] [04-23|16:40:19.566] [rpc] served                             conn=127.0.0.1:40742 method=eth_call reqid=17 t=605.612µs err="execution reverted"
apr 23 16:40:20 root-pc erigon[4794]: [WARN] [04-23|16:40:20.794] [rpc] served                             conn=127.0.0.1:41720 method=eth_call reqid=13 t=473.302µs err="execution reverted"
apr 23 16:40:20 root-pc erigon[4794]: [WARN] [04-23|16:40:20.802] [rpc] served                             conn=127.0.0.1:41720 method=eth_call reqid=15 t=468.196µs err="execution reverted"
apr 23 16:40:20 root-pc erigon[4794]: [WARN] [04-23|16:40:20.811] [rpc] served                             conn=127.0.0.1:41720 method=eth_call reqid=17 t=291.349µs err="execution reverted"
apr 23 16:40:22 root-pc erigon[4794]: [WARN] [04-23|16:40:22.100] [rpc] served                             conn=127.0.0.1:49768 method=eth_call reqid=1 t=344.624µs err="execution reverted"
apr 23 16:40:22 root-pc erigon[4794]: [WARN] [04-23|16:40:22.106] [rpc] served                             conn=127.0.0.1:49768 method=eth_call reqid=3 t=311.829µs err="execution reverted"
apr 23 16:40:22 root-pc erigon[4794]: [WARN] [04-23|16:40:22.111] [rpc] served                             conn=127.0.0.1:49768 method=eth_call reqid=5 t=412.637µs err="execution reverted"
apr 23 16:40:23 root-pc erigon[4794]: [WARN] [04-23|16:40:23.481] [rpc] served                             conn=127.0.0.1:49792 method=eth_call reqid=7 t=387.815µs err="execution reverted"
apr 23 16:40:23 root-pc erigon[4794]: [WARN] [04-23|16:40:23.487] [rpc] served                             conn=127.0.0.1:49792 method=eth_call reqid=9 t=382.732µs err="execution reverted"
apr 23 16:40:23 root-pc erigon[4794]: [WARN] [04-23|16:40:23.493] [rpc] served                             conn=127.0.0.1:49792 method=eth_call reqid=11 t=298.497µs err="execution reverted"
apr 23 16:40:24 root-pc erigon[4794]: [WARN] [04-23|16:40:24.151] [rpc] served                             conn=127.0.0.1:49792 method=eth_call reqid=13 t=333.175µs err="execution reverted"
apr 23 16:40:24 root-pc erigon[4794]: [WARN] [04-23|16:40:24.156] [rpc] served                             conn=127.0.0.1:49792 method=eth_call reqid=15 t=260.281µs err="execution reverted"
apr 23 16:40:24 root-pc erigon[4794]: [WARN] [04-23|16:40:24.161] [rpc] served                             conn=127.0.0.1:49792 method=eth_call reqid=17 t=243.955µs err="execution reverted"
apr 23 16:40:30 root-pc erigon[4794]: [INFO] [04-23|16:40:30.537] [updateForkchoice] Fork choice update: flushing in-memory state (built by previous newPayload)
apr 23 16:40:30 root-pc erigon[4794]: [INFO] [04-23|16:40:30.864] RPC Daemon notified of new headers       from=19718451 to=19718452 amount=1 hash=0x157f9b70c6a1002e70c09f7e47077c6fde4d8eee9a77e53a4d808857c193133e header sending=21.076µs log sending=367ns
apr 23 16:40:30 root-pc erigon[4794]: [INFO] [04-23|16:40:30.864] head updated                             hash=0x157f9b70c6a1002e70c09f7e47077c6fde4d8eee9a77e53a4d808857c193133e number=19718452
apr 23 16:40:39 root-pc erigon[4794]: [INFO] [04-23|16:40:39.995] [updateForkchoice] Fork choice update: flushing in-memory state (built by previous newPayload)
apr 23 16:40:40 root-pc erigon[4794]: [INFO] [04-23|16:40:40.221] RPC Daemon notified of new headers       from=19718452 to=19718453 amount=1 hash=0x9bc38461d80fa4a98887c98a075683bc97c4ba2f87fe8c5e5de68273849b4625 header sending=36.207µs log sending=414ns
apr 23 16:40:40 root-pc erigon[4794]: [INFO] [04-23|16:40:40.221] head updated                             hash=0x9bc38461d80fa4a98887c98a075683bc97c4ba2f87fe8c5e5de68273849b4625 number=19718453
apr 23 16:40:46 root-pc erigon[4794]: [INFO] [04-23|16:40:46.913] P2P                                      app=caplin peers=62
apr 23 16:40:54 root-pc erigon[4794]: [INFO] [04-23|16:40:54.304] [updateForkchoice] Fork choice update: flushing in-memory state (built by previous newPayload)
apr 23 16:40:54 root-pc erigon[4794]: [INFO] [04-23|16:40:54.956] RPC Daemon notified of new headers       from=19718453 to=19718454 amount=1 hash=0xff70748861f33efffb77916e14ace4acd1f9ac151bbd32fb73a3f4483fd7d652 header sending=21.554µs log sending=313ns
apr 23 16:40:54 root-pc erigon[4794]: [INFO] [04-23|16:40:54.956] head updated                             hash=0xff70748861f33efffb77916e14ace4acd1f9ac151bbd32fb73a3f4483fd7d652 number=19718454
apr 23 16:41:03 root-pc erigon[4794]: [INFO] [04-23|16:41:03.780] [updateForkchoice] Fork choice update: flushing in-memory state (built by previous newPayload)
apr 23 16:41:04 root-pc erigon[4794]: [INFO] [04-23|16:41:04.006] RPC Daemon notified of new headers       from=19718454 to=19718455 amount=1 hash=0x1ab09786624121dce6495fb104b095e54a8a4a5f4fea6801dad8548ff37bc1be header sending=26.539µs log sending=439ns
apr 23 16:41:04 root-pc erigon[4794]: [INFO] [04-23|16:41:04.006] head updated                             hash=0x1ab09786624121dce6495fb104b095e54a8a4a5f4fea6801dad8548ff37bc1be number=19718455
apr 23 16:41:06 root-pc erigon[4794]: [WARN] [04-23|16:41:06.424] [rpc] served                             conn=127.0.0.1:50208 method=eth_call reqid=5 t=192.058µs err="execution reverted"
apr 23 16:41:06 root-pc erigon[4794]: [WARN] [04-23|16:41:06.471] [rpc] served                             conn=127.0.0.1:50338 method=eth_call reqid=1 t=266.749µs err="execution reverted"
apr 23 16:41:06 root-pc erigon[4794]: [WARN] [04-23|16:41:06.474] [rpc] served                             conn=127.0.0.1:50208 method=eth_call reqid=11 t=191.376µs err="execution reverted"
apr 23 16:41:06 root-pc erigon[4794]: [WARN] [04-23|16:41:06.481] [rpc] served                             conn=127.0.0.1:50338 method=eth_call reqid=3 t=422.909µs err="execution reverted"
apr 23 16:41:06 root-pc erigon[4794]: [WARN] [04-23|16:41:06.487] [rpc] served                             conn=127.0.0.1:50338 method=eth_call reqid=5 t=280.194µs err="execution reverted"
apr 23 16:41:06 root-pc erigon[4794]: [WARN] [04-23|16:41:06.957] [rpc] served                             conn=127.0.0.1:51962 method=eth_call reqid=1 t=275.048µs err="execution reverted"
apr 23 16:41:06 root-pc erigon[4794]: [WARN] [04-23|16:41:06.963] [rpc] served                             conn=127.0.0.1:51962 method=eth_call reqid=3 t=270.651µs err="execution reverted"
apr 23 16:41:06 root-pc erigon[4794]: [WARN] [04-23|16:41:06.972] [rpc] served                             conn=127.0.0.1:51962 method=eth_call reqid=5 t=377.186µs err="execution reverted"
apr 23 16:41:07 root-pc erigon[4794]: [WARN] [04-23|16:41:07.012] [rpc] served                             conn=127.0.0.1:52074 method=eth_call reqid=1 t=303.2µs err="execution reverted"
apr 23 16:41:07 root-pc erigon[4794]: [WARN] [04-23|16:41:07.021] [rpc] served                             conn=127.0.0.1:52074 method=eth_call reqid=3 t=233.601µs err="execution reverted"
apr 23 16:41:07 root-pc erigon[4794]: [WARN] [04-23|16:41:07.029] [rpc] served                             conn=127.0.0.1:52074 method=eth_call reqid=5 t=227.387µs err="execution reverted"
apr 23 16:41:07 root-pc erigon[4794]: [WARN] [04-23|16:41:07.049] [rpc] served                             conn=127.0.0.1:52176 method=eth_call reqid=5 t=276.821µs err="execution reverted"
apr 23 16:41:07 root-pc erigon[4794]: [WARN] [04-23|16:41:07.085] [rpc] served                             conn=127.0.0.1:52176 method=eth_call reqid=11 t=308.459µs err="execution reverted"
apr 23 16:41:07 root-pc erigon[4794]: [WARN] [04-23|16:41:07.648] [rpc] served                             conn=127.0.0.1:53196 method=eth_call reqid=5 t=385.849µs err="execution reverted"
apr 23 16:41:07 root-pc erigon[4794]: [WARN] [04-23|16:41:07.672] [rpc] served                             conn=127.0.0.1:53196 method=eth_call reqid=7 t=538.795µs err="execution reverted"
apr 23 16:41:08 root-pc erigon[4794]: [WARN] [04-23|16:41:08.577] [rpc] served                             conn=127.0.0.1:52606 method=eth_call reqid=9 t=689.783µs err="execution reverted" errdata=0x46756e6374696f6e206e6f7420666f756e640000
apr 23 16:41:08 root-pc erigon[4794]: [WARN] [04-23|16:41:08.589] [rpc] served                             conn=127.0.0.1:52606 method=eth_call reqid=11 t=731.252µs err="execution reverted" errdata=0x46756e6374696f6e206e6f7420666f756e640000
apr 23 16:41:09 root-pc erigon[4794]: [WARN] [04-23|16:41:09.611] [rpc] served                             conn=127.0.0.1:54710 method=eth_call reqid=5 t=416.406µs err="execution reverted"
apr 23 16:41:09 root-pc erigon[4794]: [WARN] [04-23|16:41:09.693] [rpc] served                             conn=127.0.0.1:54710 method=eth_call reqid=11 t=394.69µs err="execution reverted"
apr 23 16:41:19 root-pc erigon[4794]: [INFO] [04-23|16:41:19.649] [updateForkchoice] Fork choice update: flushing in-memory state (built by previous newPayload)
apr 23 16:41:20 root-pc erigon[4794]: [INFO] [04-23|16:41:20.669] RPC Daemon notified of new headers       from=19718455 to=19718456 amount=1 hash=0xa350366ee8a621dda9c038c9cc12bd0ca934c019bdb1461f7b791367c890c7e9 header sending=25.879µs log sending=516ns
apr 23 16:41:20 root-pc erigon[4794]: [INFO] [04-23|16:41:20.669] head updated                             hash=0xa350366ee8a621dda9c038c9cc12bd0ca934c019bdb1461f7b791367c890c7e9 number=19718456
apr 23 16:41:46 root-pc erigon[4794]: [INFO] [04-23|16:41:46.556] [4/12 Execution] Completed on            block=19718458
apr 23 16:41:46 root-pc erigon[4794]: [INFO] [04-23|16:41:46.913] P2P                                      app=caplin peers=69
apr 23 16:41:47 root-pc erigon[4794]: [INFO] [04-23|16:41:47.566] RPC Daemon notified of new headers       from=19718456 to=19718458 amount=2 hash=0x91467399d66afd3b892431cbf1f6010641bddff63bbd3597e90df00e01007433 header sending=24.248µs log sending=378ns
apr 23 16:41:47 root-pc erigon[4794]: [INFO] [04-23|16:41:47.566] head updated                             hash=0x91467399d66afd3b892431cbf1f6010641bddff63bbd3597e90df00e01007433 number=19718458
apr 23 16:42:08 root-pc erigon[4794]: [INFO] [04-23|16:42:08.765] [p2p] GoodPeers                          eth67=28 eth66=2 eth68=32
apr 23 16:42:13 root-pc erigon[4794]: [INFO] [04-23|16:42:13.378] [txpool] stat                            pending=390 baseFee=30000 queued=29768 alloc=7.6GB sys=21.9GB
apr 23 16:42:13 root-pc erigon[4794]: [INFO] [04-23|16:42:13.389] [mem] memory stats                       Rss=97.5MB Size=0B Pss=97.5MB SharedClean=5.3KB SharedDirty=0B PrivateClean=76.3MB PrivateDirty=21.2MB Referenced=85.6MB Anonymous=21.2MB Swap=931.3KB alloc=7.6GB sys=21.9GB
apr 23 16:42:30 root-pc erigon[4794]: [INFO] [04-23|16:42:30.775] [4/12 Execution] Completed on            block=19718462
apr 23 16:42:32 root-pc erigon[4794]: [INFO] [04-23|16:42:32.041] RPC Daemon notified of new headers       from=19718458 to=19718462 amount=4 hash=0x1ea94c759270f3f2a9bb93db6c9b5162f230b86ccb9468ad1518585b5c2c088c header sending=29.251µs log sending=424ns
apr 23 16:42:32 root-pc erigon[4794]: [INFO] [04-23|16:42:32.041] head updated                             hash=0x1ea94c759270f3f2a9bb93db6c9b5162f230b86ccb9468ad1518585b5c2c088c number=19718462
apr 23 16:42:42 root-pc erigon[4794]: [INFO] [04-23|16:42:42.222] [updateForkchoice] Fork choice update: flushing in-memory state (built by previous newPayload)
apr 23 16:42:42 root-pc erigon[4794]: [INFO] [04-23|16:42:42.694] RPC Daemon notified of new headers       from=19718462 to=19718463 amount=1 hash=0x85099c270ffd1c509111cd1ae7c6cd3108f12e9b738342666113833078e348b0 header sending=36.848µs log sending=692ns
apr 23 16:42:42 root-pc erigon[4794]: [INFO] [04-23|16:42:42.694] head updated                             hash=0x85099c270ffd1c509111cd1ae7c6cd3108f12e9b738342666113833078e348b0 number=19718463
apr 23 16:42:46 root-pc erigon[4794]: [INFO] [04-23|16:42:46.913] P2P                                      app=caplin peers=58
apr 23 16:42:56 root-pc erigon[4794]: [INFO] [04-23|16:42:56.431] [updateForkchoice] Fork choice update: flushing in-memory state (built by previous newPayload)
apr 23 16:42:56 root-pc erigon[4794]: [INFO] [04-23|16:42:56.732] RPC Daemon notified of new headers       from=19718463 to=19718464 amount=1 hash=0xcdd9438e766b3fc807457aa77246374f37c7f30a2ac2507be569dbfd9e1084fe header sending=17.834µs log sending=413ns
apr 23 16:42:56 root-pc erigon[4794]: [INFO] [04-23|16:42:56.732] head updated                             hash=0xcdd9438e766b3fc807457aa77246374f37c7f30a2ac2507be569dbfd9e1084fe number=19718464
apr 23 16:43:00 root-pc erigon[4794]: [WARN] [04-23|16:43:00.187] [rpc] served                             conn=127.0.0.1:33954 method=eth_call reqid=7 t=1.797755ms err="execution reverted"
apr 23 16:43:00 root-pc erigon[4794]: [WARN] [04-23|16:43:00.192] [rpc] served                             conn=127.0.0.1:33954 method=eth_call reqid=9 t=189.415µs err="execution reverted"
apr 23 16:43:00 root-pc erigon[4794]: [WARN] [04-23|16:43:00.198] [rpc] served                             conn=127.0.0.1:33954 method=eth_call reqid=11 t=445.488µs err="execution reverted"
apr 23 16:43:00 root-pc erigon[4794]: [WARN] [04-23|16:43:00.213] [rpc] served                             conn=127.0.0.1:33954 method=eth_call reqid=13 t=160.945µs err="execution reverted"
apr 23 16:43:00 root-pc erigon[4794]: [WARN] [04-23|16:43:00.217] [rpc] served                             conn=127.0.0.1:33954 method=eth_call reqid=15 t=199.137µs err="execution reverted"
apr 23 16:43:00 root-pc erigon[4794]: [WARN] [04-23|16:43:00.223] [rpc] served                             conn=127.0.0.1:33954 method=eth_call reqid=17 t=220.556µs err="execution reverted"
apr 23 16:43:14 root-pc erigon[4794]: [WARN] [04-23|16:43:14.598] [rpc] served                             conn=127.0.0.1:60784 method=eth_call reqid=1 t=295.887µs err="execution reverted"
apr 23 16:43:14 root-pc erigon[4794]: [WARN] [04-23|16:43:14.607] [rpc] served                             conn=127.0.0.1:60784 method=eth_call reqid=3 t=397.388µs err="execution reverted"
apr 23 16:43:14 root-pc erigon[4794]: [WARN] [04-23|16:43:14.615] [rpc] served                             conn=127.0.0.1:60784 method=eth_call reqid=5 t=309.929µs err="execution reverted"
apr 23 16:43:14 root-pc erigon[4794]: [WARN] [04-23|16:43:14.679] [rpc] served                             conn=127.0.0.1:60980 method=eth_call reqid=1 t=286.606µs err="execution reverted"
apr 23 16:43:14 root-pc erigon[4794]: [WARN] [04-23|16:43:14.687] [rpc] served                             conn=127.0.0.1:60980 method=eth_call reqid=3 t=286.808µs err="execution reverted"
apr 23 16:43:14 root-pc erigon[4794]: [WARN] [04-23|16:43:14.695] [rpc] served                             conn=127.0.0.1:60980 method=eth_call reqid=5 t=269.136µs err="execution reverted"
apr 23 16:43:14 root-pc erigon[4794]: [WARN] [04-23|16:43:14.707] [rpc] served                             conn=127.0.0.1:32776 method=eth_call reqid=1 t=220.384µs err="execution reverted"
apr 23 16:43:14 root-pc erigon[4794]: [WARN] [04-23|16:43:14.716] [rpc] served                             conn=127.0.0.1:32776 method=eth_call reqid=3 t=226.017µs err="execution reverted"
apr 23 16:43:14 root-pc erigon[4794]: [WARN] [04-23|16:43:14.723] [rpc] served                             conn=127.0.0.1:32776 method=eth_call reqid=5 t=194.431µs err="execution reverted"
apr 23 16:43:15 root-pc erigon[4794]: [WARN] [04-23|16:43:15.093] [rpc] served                             conn=127.0.0.1:33158 method=eth_call reqid=1 t=335.477µs err="execution reverted"
apr 23 16:43:15 root-pc erigon[4794]: [WARN] [04-23|16:43:15.101] [rpc] served                             conn=127.0.0.1:33158 method=eth_call reqid=3 t=394.986µs err="execution reverted"
apr 23 16:43:15 root-pc erigon[4794]: [WARN] [04-23|16:43:15.112] [rpc] served                             conn=127.0.0.1:33158 method=eth_call reqid=5 t=355.515µs err="execution reverted"
apr 23 16:43:15 root-pc erigon[4794]: [WARN] [04-23|16:43:15.244] [rpc] served                             conn=127.0.0.1:33462 method=eth_call reqid=1 t=243.793µs err="execution reverted"
apr 23 16:43:15 root-pc erigon[4794]: [WARN] [04-23|16:43:15.251] [rpc] served                             conn=127.0.0.1:33462 method=eth_call reqid=3 t=260.405µs err="execution reverted"
apr 23 16:43:15 root-pc erigon[4794]: [WARN] [04-23|16:43:15.259] [rpc] served                             conn=127.0.0.1:33462 method=eth_call reqid=5 t=262.027µs err="execution reverted"
apr 23 16:43:15 root-pc erigon[4794]: [WARN] [04-23|16:43:15.375] [rpc] served                             conn=127.0.0.1:60784 method=eth_call reqid=7 t=189.844µs err="execution reverted"
apr 23 16:43:15 root-pc erigon[4794]: [WARN] [04-23|16:43:15.381] [rpc] served                             conn=127.0.0.1:60784 method=eth_call reqid=9 t=255.263µs err="execution reverted"
apr 23 16:43:15 root-pc erigon[4794]: [WARN] [04-23|16:43:15.387] [rpc] served                             conn=127.0.0.1:60784 method=eth_call reqid=11 t=255.521µs err="execution reverted"
apr 23 16:43:15 root-pc erigon[4794]: [WARN] [04-23|16:43:15.525] [rpc] served                             conn=127.0.0.1:60980 method=eth_call reqid=7 t=329.084µs err="execution reverted"
apr 23 16:43:15 root-pc erigon[4794]: [WARN] [04-23|16:43:15.533] [rpc] served                             conn=127.0.0.1:60980 method=eth_call reqid=9 t=290.435µs err="execution reverted"
apr 23 16:43:15 root-pc erigon[4794]: [WARN] [04-23|16:43:15.539] [rpc] served                             conn=127.0.0.1:60980 method=eth_call reqid=11 t=327.128µs err="execution reverted"
apr 23 16:43:15 root-pc erigon[4794]: [WARN] [04-23|16:43:15.708] [rpc] served                             conn=127.0.0.1:34282 method=eth_call reqid=5 t=325.962µs err="execution reverted"
apr 23 16:43:16 root-pc erigon[4794]: [WARN] [04-23|16:43:16.032] [rpc] served                             conn=127.0.0.1:33158 method=eth_call reqid=7 t=229.842µs err="execution reverted"
apr 23 16:43:16 root-pc erigon[4794]: [WARN] [04-23|16:43:16.040] [rpc] served                             conn=127.0.0.1:33158 method=eth_call reqid=9 t=339.319µs err="execution reverted"
apr 23 16:43:16 root-pc erigon[4794]: [WARN] [04-23|16:43:16.049] [rpc] served                             conn=127.0.0.1:33158 method=eth_call reqid=11 t=271.148µs err="execution reverted"
apr 23 16:43:16 root-pc erigon[4794]: [WARN] [04-23|16:43:16.375] [rpc] served                             conn=127.0.0.1:36026 method=eth_call reqid=1 t=385.246µs err="execution reverted"
apr 23 16:43:16 root-pc erigon[4794]: [WARN] [04-23|16:43:16.380] [rpc] served                             conn=127.0.0.1:36026 method=eth_call reqid=3 t=258.192µs err="execution reverted"
apr 23 16:43:16 root-pc erigon[4794]: [WARN] [04-23|16:43:16.386] [rpc] served                             conn=127.0.0.1:36026 method=eth_call reqid=5 t=223.128µs err="execution reverted"
apr 23 16:43:16 root-pc erigon[4794]: [WARN] [04-23|16:43:16.505] [rpc] served                             conn=127.0.0.1:60980 method=eth_call reqid=13 t=257.847µs err="execution reverted"
apr 23 16:43:16 root-pc erigon[4794]: [WARN] [04-23|16:43:16.510] [rpc] served                             conn=127.0.0.1:60980 method=eth_call reqid=15 t=268.838µs err="execution reverted"
apr 23 16:43:16 root-pc erigon[4794]: [WARN] [04-23|16:43:16.516] [rpc] served                             conn=127.0.0.1:60980 method=eth_call reqid=17 t=330.331µs err="execution reverted"
apr 23 16:43:16 root-pc erigon[4794]: [WARN] [04-23|16:43:16.519] [rpc] served                             conn=127.0.0.1:36256 method=eth_call reqid=1 t=246.56µs err="execution reverted"
apr 23 16:43:16 root-pc erigon[4794]: [WARN] [04-23|16:43:16.527] [rpc] served                             conn=127.0.0.1:36256 method=eth_call reqid=3 t=183.507µs err="execution reverted"
apr 23 16:43:16 root-pc erigon[4794]: [WARN] [04-23|16:43:16.534] [rpc] served                             conn=127.0.0.1:36256 method=eth_call reqid=5 t=195.131µs err="execution reverted"
apr 23 16:43:16 root-pc erigon[4794]: [WARN] [04-23|16:43:16.704] [rpc] served                             conn=127.0.0.1:36354 method=eth_call reqid=9 t=198.387µs err="execution reverted"
apr 23 16:43:16 root-pc erigon[4794]: [WARN] [04-23|16:43:16.713] [rpc] served                             conn=127.0.0.1:36384 method=eth_call reqid=1 t=312.197µs err="execution reverted"
apr 23 16:43:16 root-pc erigon[4794]: [WARN] [04-23|16:43:16.718] [rpc] served                             conn=127.0.0.1:36384 method=eth_call reqid=3 t=221.623µs err="execution reverted"
apr 23 16:43:16 root-pc erigon[4794]: [WARN] [04-23|16:43:16.723] [rpc] served                             conn=127.0.0.1:36384 method=eth_call reqid=5 t=226.845µs err="execution reverted"
apr 23 16:43:16 root-pc erigon[4794]: [WARN] [04-23|16:43:16.732] [rpc] served                             conn=127.0.0.1:36386 method=eth_call reqid=1 t=305.113µs err="execution reverted"
apr 23 16:43:16 root-pc erigon[4794]: [WARN] [04-23|16:43:16.738] [rpc] served                             conn=127.0.0.1:36384 method=eth_call reqid=7 t=241.404µs err="execution reverted"
apr 23 16:43:16 root-pc erigon[4794]: [WARN] [04-23|16:43:16.738] [rpc] served                             conn=127.0.0.1:36386 method=eth_call reqid=3 t=190.089µs err="execution reverted"
apr 23 16:43:16 root-pc erigon[4794]: [WARN] [04-23|16:43:16.742] [rpc] served                             conn=127.0.0.1:36384 method=eth_call reqid=9 t=229.099µs err="execution reverted"
apr 23 16:43:16 root-pc erigon[4794]: [WARN] [04-23|16:43:16.743] [rpc] served                             conn=127.0.0.1:36386 method=eth_call reqid=5 t=199.444µs err="execution reverted"
apr 23 16:43:16 root-pc erigon[4794]: [WARN] [04-23|16:43:16.747] [rpc] served                             conn=127.0.0.1:36384 method=eth_call reqid=11 t=247.085µs err="execution reverted"
apr 23 16:43:17 root-pc erigon[4794]: [WARN] [04-23|16:43:17.069] [rpc] served                             conn=127.0.0.1:36438 method=eth_call reqid=5 t=293.351µs err="execution reverted"
apr 23 16:43:17 root-pc erigon[4794]: [WARN] [04-23|16:43:17.095] [rpc] served                             conn=127.0.0.1:36438 method=eth_call reqid=11 t=239.556µs err="execution reverted"
apr 23 16:43:17 root-pc erigon[4794]: [WARN] [04-23|16:43:17.175] [rpc] served                             conn=127.0.0.1:36026 method=eth_call reqid=7 t=291.653µs err="execution reverted"
apr 23 16:43:17 root-pc erigon[4794]: [WARN] [04-23|16:43:17.180] [rpc] served                             conn=127.0.0.1:36026 method=eth_call reqid=9 t=284.82µs err="execution reverted"
apr 23 16:43:17 root-pc erigon[4794]: [WARN] [04-23|16:43:17.186] [rpc] served                             conn=127.0.0.1:36026 method=eth_call reqid=11 t=151.526µs err="execution reverted"
apr 23 16:43:17 root-pc erigon[4794]: [WARN] [04-23|16:43:17.516] [rpc] served                             conn=127.0.0.1:36386 method=eth_call reqid=7 t=333.675µs err="execution reverted"
apr 23 16:43:17 root-pc erigon[4794]: [WARN] [04-23|16:43:17.523] [rpc] served                             conn=127.0.0.1:36386 method=eth_call reqid=9 t=302.044µs err="execution reverted"
apr 23 16:43:17 root-pc erigon[4794]: [WARN] [04-23|16:43:17.528] [rpc] served                             conn=127.0.0.1:36386 method=eth_call reqid=11 t=505.954µs err="execution reverted"
apr 23 16:43:17 root-pc erigon[4794]: [WARN] [04-23|16:43:17.859] [rpc] served                             conn=127.0.0.1:36026 method=eth_call reqid=13 t=316.103µs err="execution reverted"
apr 23 16:43:17 root-pc erigon[4794]: [WARN] [04-23|16:43:17.865] [rpc] served                             conn=127.0.0.1:36026 method=eth_call reqid=15 t=245.804µs err="execution reverted"
apr 23 16:43:17 root-pc erigon[4794]: [WARN] [04-23|16:43:17.870] [rpc] served                             conn=127.0.0.1:36026 method=eth_call reqid=17 t=222.79µs err="execution reverted"
apr 23 16:43:19 root-pc erigon[4794]: [INFO] [04-23|16:43:19.975] [updateForkchoice] Fork choice update: flushing in-memory state (built by previous newPayload)
apr 23 16:43:20 root-pc erigon[4794]: [INFO] [04-23|16:43:20.610] RPC Daemon notified of new headers       from=19718464 to=19718465 amount=1 hash=0xa5ffbe3f180616d4cfb75f074479fc12c113726d59a0a0128fc92baec07d9b75 header sending=26.067µs log sending=653ns
apr 23 16:43:20 root-pc erigon[4794]: [INFO] [04-23|16:43:20.611] head updated                             hash=0xa5ffbe3f180616d4cfb75f074479fc12c113726d59a0a0128fc92baec07d9b75 number=19718465
apr 23 16:43:29 root-pc erigon[4794]: [INFO] [04-23|16:43:29.953] [updateForkchoice] Fork choice update: flushing in-memory state (built by previous newPayload)
apr 23 16:43:30 root-pc erigon[4794]: [INFO] [04-23|16:43:30.479] RPC Daemon notified of new headers       from=19718465 to=19718466 amount=1 hash=0x74b4289d13da329c992d312f1871171b2a34b9a93e4610848956835eda7215e3 header sending=24.255µs log sending=689ns
apr 23 16:43:30 root-pc erigon[4794]: [INFO] [04-23|16:43:30.479] head updated                             hash=0x74b4289d13da329c992d312f1871171b2a34b9a93e4610848956835eda7215e3 number=19718466
awskii commented 4 months ago

Hey @fridary.

Could you share logs having both moments when request is served OK and then served with error? You could send your requests in batches and set --rpc.batch.limit=x for erigon.

fridary commented 4 months ago

@awskii thanks for reply. I searched for how to close connections for web3py and have found no information about it. So I guess there is no way how to close connections. Is that right? Here is example with pure http request on python that I do:

requests.post(testnet, json={"method":"eth_getTransactionByHash","params":[hash_],"id":1,"jsonrpc":"2.0"}, headers={"Content-Type": "application/json"}).json()['result']

and w3 examples with contract data:

w3 = Web3(Web3.HTTPProvider('http://127.0.0.1:8545/?t'))
contract = w3.eth.contract(address=address, abi=abi_address)
balance = contract.functions.balanceOf(pair_address).call(block_identifier=block)

Yes, for sure I am not referring old blocks. Moreover, in case of old block there will be an error block was not found, but not an error like mine with fully exiting application.

I will try send logs both ways later.