How long does erigon ethereum take to sync to latest height?

bdonglobal commented 1 month ago

System information

Erigon version: erigon version 2.60.6-f30c4c43

OS & Version: Linux

Commit hash:

Erigon Command (with flags/config): ./build/bin/erigon --datadir=pwd/data --http --http.addr "0.0.0.0" --http.port 1111 --http.api "eth,net,web3,admin,txpool" --maxpeers 200 --ws --ws.port 1546 --torrent.download.rate=512mb --txpool.globalqueue 100000 --txpool.lifetime 50h0m0s --txpool.globalslots 100000 --allow-insecure-unlock

Consensus Layer:

Consensus Layer Command (with flags/config):

Chain/Network: Ethereum

Expected behaviour

sync to latest block height within 3 days

Actual behaviour

have started the sync for 1.5weeks, it is at 16213214 for now

INFO[09-10|12:38:52.268] [4/12 Execution] Executed blocks         number=16210326 blk/s=3.1 tx/s=513.9 Mgas/s=47.6 gasState=0.02 batch=17.1MB alloc=4.5GB sys=10.1GB               
INFO[09-10|12:39:22.442] [4/12 Execution] Executed blocks         number=16210450 blk/s=4.1 tx/s=497.6 Mgas/s=62.6 gasState=0.02 batch=20.8MB alloc=5.3GB sys=10.1GB               
INFO[09-10|12:39:52.286] [4/12 Execution] Executed blocks         number=16210578 blk/s=4.3 tx/s=506.1 Mgas/s=64.9 gasState=0.02 batch=24.4MB alloc=3.4GB sys=10.1GB               
INFO[09-10|12:40:22.280] [4/12 Execution] Executed blocks         number=16210703 blk/s=4.2 tx/s=502.4 Mgas/s=63.6 gasState=0.03 batch=27.8MB alloc=4.2GB sys=10.1GB               
INFO[09-10|12:40:52.234] [4/12 Execution] Executed blocks         number=16210826 blk/s=4.1 tx/s=422.1 Mgas/s=63.2 gasState=0.03 batch=31.4MB alloc=4.9GB sys=10.1GB               
INFO[09-10|12:41:22.690] [4/12 Execution] Executed blocks         number=16210965 blk/s=4.6 tx/s=456.0 Mgas/s=70.0 gasState=0.03 batch=35.7MB alloc=5.6GB sys=10.1GB               
INFO[09-10|12:41:48.007] [p2p] GoodPeers                          eth68=39 eth67=19 eth66=2                                                                                        
INFO[09-10|12:41:48.012] [txpool] stat                            pending=0 baseFee=0 queued=100000 alloc=6.2GB sys=10.1GB                                                         
INFO[09-10|12:41:49.644] [mem] memory stats                       Rss=21.7GB Size=0B Pss=21.7GB SharedClean=2.6MB SharedDirty=0B PrivateClean=14.1GB PrivateDirty=7.6GB Referenced=
21.5GB Anonymous=7.6GB Swap=0B alloc=6.3GB sys=10.1GB                                                                                                                              
INFO[09-10|12:41:52.281] [4/12 Execution] Executed blocks         number=16211097 blk/s=4.5 tx/s=451.4 Mgas/s=67.3 gasState=0.04 batch=39.6MB alloc=5.7GB sys=10.1GB               
INFO[09-10|12:42:22.346] [4/12 Execution] Executed blocks         number=16211255 blk/s=5.3 tx/s=576.0 Mgas/s=80.5 gasState=0.04 batch=43.9MB alloc=4.1GB sys=10.1GB               
INFO[09-10|12:42:52.453] [4/12 Execution] Executed blocks         number=16211372 blk/s=3.9 tx/s=708.8 Mgas/s=61.5 gasState=0.04 batch=46.2MB alloc=4.7GB sys=10.1GB               
INFO[09-10|12:43:22.221] [4/12 Execution] Executed blocks         number=16211546 blk/s=5.8 tx/s=816.0 Mgas/s=87.1 gasState=0.05 batch=50.3MB alloc=5.7GB sys=10.1GB               
INFO[09-10|12:43:52.212] [4/12 Execution] Executed blocks         number=16211753 blk/s=6.9 tx/s=1080.0 Mgas/s=104.5 gasState=0.06 batch=54.9MB alloc=3.8GB sys=10.1GB             
INFO[09-10|12:44:22.286] [4/12 Execution] Executed blocks         number=16211943 blk/s=6.3 tx/s=856.3 Mgas/s=95.8 gasState=0.06 batch=59.1MB alloc=4.8GB sys=10.1GB               
INFO[09-10|12:44:48.007] [p2p] GoodPeers                          eth66=2 eth68=39 eth67=19                                                                                        
INFO[09-10|12:44:48.012] [txpool] stat                            pending=0 baseFee=0 queued=100000 alloc=5.5GB sys=10.1GB                                                         
INFO[09-10|12:44:49.649] [mem] memory stats                       Rss=21.8GB Size=0B Pss=21.8GB SharedClean=2.6MB SharedDirty=0B PrivateClean=13.8GB PrivateDirty=8.0GB Referenced=
21.5GB Anonymous=8.0GB Swap=0B alloc=5.6GB sys=10.1GB                                                                                                                              
INFO[09-10|12:44:52.316] [4/12 Execution] Executed blocks         number=16212119 blk/s=5.9 tx/s=781.3 Mgas/s=89.0 gasState=0.07 batch=62.7MB alloc=5.7GB sys=10.1GB               
INFO[09-10|12:45:22.228] [4/12 Execution] Executed blocks         number=16212326 blk/s=6.9 tx/s=1010.2 Mgas/s=106.2 gasState=0.07 batch=67.0MB alloc=3.6GB sys=10.1GB             
INFO[09-10|12:45:52.248] [4/12 Execution] Executed blocks         number=16212563 blk/s=7.9 tx/s=1021.5 Mgas/s=118.6 gasState=0.08 batch=71.6MB alloc=4.8GB sys=10.1GB             
INFO[09-10|12:46:22.274] [4/12 Execution] Executed blocks         number=16212759 blk/s=6.5 tx/s=861.1 Mgas/s=99.2 gasState=0.08 batch=75.8MB alloc=5.9GB sys=10.1GB               
INFO[09-10|12:46:52.218] [4/12 Execution] Executed blocks         number=16212987 blk/s=7.6 tx/s=1075.6 Mgas/s=114.8 gasState=0.09 batch=79.9MB alloc=3.9GB sys=10.1GB             
INFO[09-10|12:47:22.208] [4/12 Execution] Executed blocks         number=16213214 blk/s=7.6 tx/s=957.3 Mgas/s=116.3 gasState=0.10 batch=84.6MB alloc=5.1GB sys=10.1GB              
INFO[09-10|12:47:48.008] [p2p] GoodPeers                          eth66=2 eth68=40 eth67=19                                                                                        
INFO[09-10|12:47:48.012] [txpool] stat                            pending=0 baseFee=0 queued=100000 alloc=6.1GB sys=10.1GB                                                         
INFO[09-10|12:47:49.686] [mem] memory stats                       Rss=21.6GB Size=0B Pss=21.6GB SharedClean=2.6MB SharedDirty=0B PrivateClean=13.5GB PrivateDirty=8.1GB Referenced=
21.3GB Anonymous=8.1GB Swap=0B alloc=6.2GB sys=10.1GB

Steps to reproduce the behaviour

configuration of machine: 8 cores + 32g ram + SSD

Backtrace

[backtrace]

what should I do to speed up this progress?

yorickdowne commented 1 month ago

This is usually IOPS.

SSD - if own hardware, what is the make and model, and also get its temperature with smartctl -x. If cloud, provider and offering chosen.

Anything else that might slow things down? Hardware RAID, ZFS, virtualization?

bdonglobal commented 1 month ago

The hardware is ESSD in alicloud, the most highest ipos is 10000 from spec. From the prometheus monitoring dashboard, the current iops is 2K-3K at most. 1725954620558

AskAlexSharov commented 1 month ago

it's not about IOPS - it's about disk read latency (not throughput). ESSD - it's likely "cloud drive" with high latency.

You still can try:

add more RAM - it will store more data in PageCache and will read less from disk. It will use any amount of RAM.
run with WRITE_MAP=true env variable
run with MDBX_READAHEAD=true env variable - this one can make better or worse. even if better - still it may cause too high read-io
or switch to local-nvme

erigontech / erigon