status-im / nimbus-eth1

Nimbus: an Ethereum Execution Client for Resource-Restricted Devices
https://status-im.github.io/nimbus-eth1/
Apache License 2.0
571 stars 115 forks source link

nimbus t8n(evm) speed report #2356

Open winsvega opened 3 months ago

winsvega commented 3 months ago

the most timeconsuming tests in nimbus t8n vs geth t8n (Cancun only) (most of this tests has high amount of transactions)

NIMBUS
*** Execution time stats
Total Time:                               : 2453.19         :   38.02 (1%)              : 2418.66 (98%)
stTimeConsuming                       time: 674.20   cputime:    8.47 (1%)       t8ntime:  666.59 (98%)
stBadOpcode                           time: 426.38   cputime:    6.79 (1%)       t8ntime:  420.27 (98%)
stEIP1559                             time: 182.41   cputime:    3.99 (2%)       t8ntime:  178.72 (97%)
vmPerformance                         time: 166.92   cputime:    0.03 (0%)       t8ntime:  166.90 (99%)
stPreCompiledContracts                time: 98.67    cputime:    1.40 (1%)       t8ntime:   97.41 (98%)
stZeroKnowledge                       time: 95.12    cputime:    1.53 (1%)       t8ntime:   93.74 (98%)
stMemoryTest                          time: 56.24    cputime:    0.88 (1%)       t8ntime:   55.44 (98%)
stStaticCall                          time: 55.58    cputime:    0.85 (1%)       t8ntime:   54.81 (98%)
eip4844_blobs                         time: 53.98    cputime:    1.02 (1%)       t8ntime:   53.05 (98%)
stZeroKnowledge2                      time: 51.22    cputime:    0.97 (1%)       t8ntime:   50.33 (98%)
stEIP150singleCodeGasPrices           time: 45.41    cputime:    0.63 (1%)       t8ntime:   44.86 (98%)
stSStoreTest                          time: 43.74    cputime:    0.58 (1%)       t8ntime:   43.23 (98%)
stStackTests                          time: 41.46    cputime:    1.38 (3%)       t8ntime:   40.15 (96%)
stRandom                              time: 32.51    cputime:    0.80 (2%)       t8ntime:   31.78 (97%)

GETH
*** Execution time stats
Total Time:                               : 1118.55         :   36.63 (3%)              : 1084.98 (96%)
stTimeConsuming                       time: 298.80   cputime:    8.12 (2%)       t8ntime:  291.40 (97%)
stBadOpcode                           time: 189.22   cputime:    6.51 (3%)       t8ntime:  183.30 (96%)
stEIP1559                             time: 81.92    cputime:    3.91 (4%)       t8ntime:   78.29 (95%)
vmPerformance                         time: 58.25    cputime:    0.03 (0%)       t8ntime:   58.23 (99%)
stZeroKnowledge                       time: 43.15    cputime:    1.49 (3%)       t8ntime:   41.80 (96%)
stPreCompiledContracts                time: 41.32    cputime:    1.31 (3%)       t8ntime:   40.15 (97%)
eip4844_blobs                         time: 39.76    cputime:    0.99 (2%)       t8ntime:   38.86 (97%)
stMemoryTest                          time: 25.12    cputime:    0.85 (3%)       t8ntime:   24.35 (96%)
jangko commented 3 months ago

loading kzg trusted setup maybe?

arnetheduck commented 1 month ago

@winsvega I'd be curious to see the results of the latest master of nimbus today on the same machine, if you still have access

winsvega commented 1 month ago

The nimbus t8n broke on aug 17. Do you still support --state.reward=-1 ?

Here are the stats for Cancun only state tests:

http://retesteth.ethdevops.io/results/log//2024-08-19-1724047927-nimbus.txt

arnetheduck commented 1 month ago

Should be fixed now, the tracer config accidentally broke

winsvega commented 1 month ago

Today's stats. Keep in mind that it also fluctuates from run to run.

NIMBUS
*** Execution time stats
Total Time:                               : 2312.56         :   38.78 (1%)              : 2277.28 (98%)
stTimeConsuming                       time: 644.08   cputime:    8.61 (1%)       t8ntime:  636.30 (98%)
stBadOpcode                           time: 414.28   cputime:    6.97 (1%)       t8ntime:  408.01 (98%)
stEIP1559                             time: 175.61   cputime:    4.05 (2%)       t8ntime:  171.87 (97%)
vmPerformance                         time: 108.96   cputime:    0.04 (0%)       t8ntime:  108.93 (99%)
stZeroKnowledge                       time: 90.72    cputime:    1.58 (1%)       t8ntime:   89.29 (98%)
stPreCompiledContracts                time: 89.80    cputime:    1.35 (1%)       t8ntime:   88.59 (98%)
stStaticCall                          time: 55.68    cputime:    0.91 (1%)       t8ntime:   54.85 (98%)
stMemoryTest                          time: 54.61    cputime:    0.90 (1%)       t8ntime:   53.80 (98%)
eip4844_blobs                         time: 53.64    cputime:    1.06 (1%)       t8ntime:   52.67 (98%)
stZeroKnowledge2                      time: 48.65    cputime:    0.95 (1%)       t8ntime:   47.78 (98%)
stSStoreTest                          time: 45.23    cputime:    0.65 (1%)       t8ntime:   44.65 (98%)
stEIP150singleCodeGasPrices           time: 41.55    cputime:    0.60 (1%)       t8ntime:   41.02 (98%)
stStackTests                          time: 38.86    cputime:    1.38 (3%)       t8ntime:   37.55 (96%)
stRandom                              time: 34.15    cputime:    0.82 (2%)       t8ntime:   33.39 (97%

GETH
*** Execution time stats
Total Time:                               : 1157.52         :   37.87 (3%)              : 1122.83 (97%)
stTimeConsuming                       time: 310.45   cputime:    8.46 (2%)       t8ntime:  302.76 (97%)
stBadOpcode                           time: 197.76   cputime:    6.76 (3%)       t8ntime:  191.63 (96%)
stEIP1559                             time: 84.13    cputime:    4.01 (4%)       t8ntime:   80.38 (95%)
vmPerformance                         time: 59.78    cputime:    0.03 (0%)       t8ntime:   59.75 (99%)
stZeroKnowledge                       time: 43.12    cputime:    1.52 (3%)       t8ntime:   41.73 (96%)
stPreCompiledContracts                time: 42.71    cputime:    1.32 (3%)       t8ntime:   41.52 (97%)
eip4844_blobs                         time: 40.29    cputime:    0.99 (2%)       t8ntime:   39.38 (97%)
stMemoryTest                          time: 25.64    cputime:    0.88 (3%)       t8ntime:   24.84 (96%)