Can we do any load-testing before launch?

[agstephens]

@cehbrecht Can you think of any simple way we can do some load-testing before launch?

E.g.:

• Submit 500 requests in 10 seconds - do they all get received, queued and processed successfully?
• Submit 500 requests in 10 minutes - do they all get received, queued and processed successfully?

[cehbrecht]

I looked already at: https://locust.io/

Looks easy ... and my test server survived the tests 😄

We can add a test-suite for this to rook ...

[agstephens]

Hi @cehbrecht how much work do you think this would take? Here is a previous locust-based benchmarker I wrote for another project: https://github.com/glamod/glamod-wfs-benchmarker

I suspect it would take us a week to build something.

[cehbrecht]

I can add a locust test to rook this week ... we can improve it later. But should be fine for an initial test run.

[agstephens]

Hi @cehbrecht, what results did you get from the locust test?

[cehbrecht]

I have defined locust tests: https://github.com/roocs/rook/tree/master/tests/storm

Run:

locust -f tests/storm/locustfile.py

And select the rook server to test in the web interface: http://0.0.0.0:8089 (If running on a Vagrant VM - you can typically view this via the private IP of the VM rather than 0.0.0.0).

The old VM (8CPUs, 16GB) could barely hold one 1 user. The new one (32CPUs, 128GB) survives 5-10 concurrent users.

There are settings in locust to tune ... and test-cases to define ... short/long-running processes.