[post] How to build a distributed load generator

[at15]

Type

• request post from @at15

Related

Projects by @at15 from gradschool

• https://github.com/benchhub/benchhub
• https://github.com/xephonhq/xephon-b

Description

We love doing bechmark, having good performance in benchmark does not mean the system is good, but having poor results means the system cannot handle the workload.

How to generate different type of workload

• TPS, how to keep a consistent transcations per second, on multiple threads, on multiple hosts (distributed)
• CPS, how to keep connections per second https://community.f5.com/t5/technical-articles/understanding-performance-metrics-and-network-traffic/ta-p/286109 (TPS, CPS etc.)

Popular frameworks

• https://github.com/grafana/k6 accquired by grafana
• https://github.com/locustio/locust
• Several database benchmark frameworks
• I think BenchHub and Xephon-B might have some reference as well

Let's build one for http API (just for simplicity)

• In Go
• In Java, using thread pool vs reactive (i.e. async)
• In Rust, (if I still remember how to

Update