search

GoogleCloudPlatform / PerfKitBenchmarker

PerfKit Benchmarker (PKB) contains a set of benchmarks to measure and compare cloud offerings. The benchmarks use default settings to reflect what most users will see. PerfKit Benchmarker is licensed under the Apache 2 license terms. Please make sure to read, understand and agree to the terms of the LICENSE and CONTRIBUTING files before proceeding.
https://googlecloudplatform.github.io/PerfKitBenchmarker/
Apache License 2.0
1.9k stars 510 forks source link

How to benchmark LB services using PKB #771

Open paolelw opened 8 years ago

paolelw commented 8 years ago

Dears, please how to benchmark a load balance service using perfKit? Is there any well-known industry benchmark which could be integrated into perfKit? Thanks very much.

meteorfox commented 8 years ago

@paolelw I'm not aware of a "well-known industry benchmark" for LBs, but @voellm benchmark that was posted on Google Cloud Platform Blog seems like a great candidate to be included in PKB, and perhaps a good starting point for an industry wide benchmark for LBs.

paolelw commented 8 years ago

@meteorfox Thanks for your reply. I see that @voellm uses curl-loader (http://curl-loader.sourceforge.net/) to benchmark the load balancing service. But it seems there is still long way to integrate curl-loader into PKB.

voellm commented 8 years ago

We have some code but its not been good enough to publish yet. The basics has been to set up the LB, create 1 to more VM's to receive load, and then use curl loader to generate requests. We looking at total message per seconds, latency of messages, etc.

The trick to to look at the hockey stick of throughput vs latency and not over drive the system.

Adding @yuyantingzero @cmccoy who has worked on load balancing analysis.