celestiaorg / celestia-app

Celestia consensus node
https://celestiaorg.github.io/celestia-app/
Apache License 2.0
345 stars 285 forks source link

Add explicit e2e load test #3965

Open evan-forbes opened 1 week ago

evan-forbes commented 1 week ago

We have manual load tests elsewhere, however we should add an explicit automated e2e load test where we have a high enough load in the mempool that we expect full blocks.

This would involve starting ~4 knuu nodes and an equivalent number of txsim instances, enough txsim load to fill blocks some multiple of the capacity (8 is fine imo for example).

bonus: Ideally, we'd also test that the txs are included within a specific period of time.

evan-forbes commented 6 days ago

the load test can analyze block times using basic stats

extracting a gist here from #3882 that @staheri14 wrote https://gist.github.com/evan-forbes/3674902cffbdbc06e85ddf763f381f2f

staheri14 commented 6 days ago

The e2e benhcamrk tests do the load test already, I think the only thing to do is to add it to the CI.