Open staheri14 opened 1 week ago
The updates introduce new functionality and enhancements to the benchmark
package of the e2e
testing suite. Notable changes include the addition of the CheckResults
method for result validation, new test case functions for various block sizes and latency scenarios, defined constants for data sizes, and modifications to existing configurations to use descriptive constants for gRPC message sizes. These changes aim to improve clarity, correctness, and overall benchmarking capabilities.
Files | Change Summary |
---|---|
test/e2e/benchmark/benchmark.go |
Added new imports for context , appconsts , and testnode packages. Introduced CheckResults method in BenchmarkTest struct. |
test/e2e/benchmark/main.go |
Added new test cases: TwoNodeBigBlock8MB , TwoNodeBigBlock32MB , TwoNodeBigBlock8MBLatency , TwoNodeBigBlock64MB , LargeNetworkBigBlock8MB , LargeNetworkBigBlock32MB , and LargeNetworkBigBlock64MB . |
test/e2e/benchmark/manifest.go |
Added summary method to the Manifest struct to generate summary strings. |
test/e2e/benchmark/throughput.go |
Added bigBlockManifest variable. Introduced several new functions for benchmark tests with different block sizes and network configurations. |
test/e2e/testnet/defaults.go |
Introduced new constants for data size conversions (MB, GB, MiB, GiB) and updated existing TxsimVersion constant. |
test/e2e/testnet/node.go |
Updated PullRoundStateTraces to PullBlockSummaryTraces , reflecting changes in log messages and event types. |
test/e2e/testnet/setup.go |
Modified MakeConfig and MakeAppConfig functions to set certain values using appropriate constants. |
test/e2e/testnet/testnet.go |
Added additional logging during the synchronization process of genesis nodes. |
test/txsim/run.go |
Replaced hardcoded gRPC message sizes with constants for better clarity. |
Objective | Addressed | Explanation |
---|---|---|
Clarifying unit of grpcMaxRecvMsgSize/SendMsgSize (#3614) | ✅ | |
Improve E2E Benchmark Test Correctness Verification to Avoid False Positives (#3638) | ✅ |
Thank you for using CodeRabbit. We offer it for free to the OSS community and would appreciate your support in helping us grow. If you find it useful, would you consider giving us a shout-out on your favorite social media?
The markdown linter issue should be resolved by #3639
I have tested all the benchmark tests in this branch. However, I made a few recent changes (a few hours ago) that I am still re-running tests for them to ensure they haven't caused any regression. I will mark the PR as a draft, but any early review is welcome!
Part of #3557 Closes https://github.com/celestiaorg/celestia-app/issues/3614 Closes #3638 Closes https://github.com/celestiaorg/celestia-app/issues/3371