ledgerwatch / erigon

Ethereum implementation on the efficiency frontier
GNU Lesser General Public License v3.0
3.04k stars 1.06k forks source link

dl: removal of `downloader` dir caused network traffic on monitoring #10976

Open AskAlexSharov opened 1 week ago

AskAlexSharov commented 1 week ago

i have node which have all files. after delete downloader dir - in logs:

[INFO] [07-02|10:30:25.606] [1/6 Snapshots] downloading header-chain progress="12.00% 192.2GB/1.6TB" time-left=3hrs:14m total-time=23m40s download=123.5MB/s upload=102.4KB/s peers=1107 files=524 metadata=524/524 connections=2779 alloc=10.0GB sys=15.5GB

in monitoring (produced by node, not by erigon):

Screenshot 2024-07-02 at 17 31 57
AskAlexSharov commented 5 days ago

after 3 days (7 restarts) nodes not finished downloading:

ethmainnet: 
[INFO] [07-05|04:45:57.711] [1/6 Snapshots] downloading header-chain progress="70.99% 1.1TB/1.6TB" time-left=1321hrs:51m total-time=9m40s download=102.4KB/s upload=102.4KB/s peers=682 files=524 metadata=524/524 connections=1180 alloc=8.4GB sys=12.3GB
[DBUG] [07-05|04:48:53.960] [snapshots] download info                len=524 webTransfers=0 torrent=524 db=137 t-complete=387 webseed-trips=0 webseed-active=0 webseed-max-active=0 webseed-discards=0 webseed-fails=0 webseed-bytes=0B localHashes=0 localHashTime=0s

sepolia: 
[INFO] [07-05|04:47:07.408] [1/6 Snapshots] downloading header-chain progress="22.87% 115.4GB/504.4GB" time-left=29010291hrs:30m total-time=9m0s download=4B/s upload=0B/s peers=79 files=178 metadata=178/178 connections=903 alloc=2.4GB sys=2.9GB
[DBUG] [07-05|04:49:05.661] [snapshots] download info                len=178 webTransfers=0 torrent=178 db=143 t-complete=35 webseed-trips=0 webseed-active=0 webseed-max-active=0 webseed-discards=0 webseed-fails=0 webseed-bytes=0B localHashes=0 localHashTime=0s
AskAlexSharov commented 5 days ago

I fixed download stuck by: https://github.com/ledgerwatch/erigon/pull/11037

awskii commented 5 days ago

closed by #11037