status-im / nimbus-eth2

Nim implementation of the Ethereum Beacon Chain
https://nimbus.guide
Other
543 stars 233 forks source link

kurtosis network testing script #6489

Closed advaita-saha closed 2 months ago

advaita-saha commented 3 months ago

The kurtosis package that will spin up a private Ethereum testnet over Docker or Kubernetes with multi-client support, Flashbot's mev-boost infrastructure for PBS-related testing/validation, and other useful network tools (transaction spammer, monitoring tools, etc). Kurtosis packages are entirely reproducible and composable, so this will work the same way over Docker or Kubernetes, in the cloud or locally on your machine. For more details https://github.com/ethpandaops/ethereum-package

This PR adds easier support to spin up test networks and run testnets locally. For running the testnet and then the checks run the run-kurtosis-check.sh script. This will spin up a testnet with your local nimbus-eth2 build and pull the latest releases from the other clients then run the following tests

The current client combination matrix

All combinations from the bellow table is made as client pairs and a network is setup for the tests

EL CL
geth nimbus-eth2 (local)
nethermind lighthouse
erigon prysm
github-actions[bot] commented 3 months ago

Unit Test Results

         9 files  ±0    1 334 suites  ±0   29m 51s :stopwatch: -16s   5 064 tests ±0    4 716 :heavy_check_mark: ±0  348 :zzz: ±0  0 :x: ±0  20 991 runs  ±0  20 587 :heavy_check_mark: ±0  404 :zzz: ±0  0 :x: ±0 

Results for commit e1346c34. ± Comparison against base commit b511f3ee.

:recycle: This comment has been updated with latest results.