status-im / infra-nimbus

Infrastructure for Nimbus cluster
https://nimbus.team
9 stars 6 forks source link

Deploy two hosts for benchmarking nimbus-eth1 import #194

Open jakubgs opened 3 weeks ago

jakubgs commented 3 weeks ago

The development of nimbus-eth1 is ramping up, and for that reason we will need to perform benchmarking of the process of importing the network state data with validation from ERA files. Currently this process is not optimized, as it's in it's early stages of development, which means a full sync of mainnet would probably take more than a week. Despite that we need to start measuring results in order to figure out progress in import process optimization.

This benchmarking will require two kind of tests on two hosts:

Both of those will not finish, so they will have to be aborted, but the amount of blocks they are able to sync will be the measure of performance. These performance reports will have to be archived in some way, simplest way would be to commit them to a dedicated repository. In addition to the reports gained this way the import process will make available a /metrics endpoint which we can scrape with Prometheus.

The two hosts can be purchased from Hetzner as the hosts will not be using external connections. The storage required will need to be at least 2x the size of Mainnet ERA and ERA1 files, which is currently ~1 2B, so a 2 TB additional NVMe would suffice. Aside from that more than 16 GB of RAM and 4 cores is enough.

siddarthkay commented 3 weeks ago

How urgently do we need the 2 hosts? I could either get a cheaper host from auction via Hetzner

Screenshot 2024-08-22 at 5 27 30 PM

OR

I could get a dedicated host which would be comparatively more expensive example : https://www.hetzner.com/dedicated-rootserver/ax52/

Screenshot 2024-08-22 at 5 29 36 PM

My assumption is that the host from Auction might take longer to get compared to the dedicated one.

siddarthkay commented 3 weeks ago

After discussing with @jakubgs, I finally went ahead with the following

2 x Dedicated Server AX42

Order Details :

Screenshot_2024-08-22_at_5 55 10_PM

Possible wait times :

Screenshot_2024-08-22_at_5 54 55_PM

siddarthkay commented 2 weeks ago

These 2 AX42 hosts have been activated by Hetzner and currently boot into rescue system. I'll bootstrap these hosts and add them to our inventory.