puppetlabs / gatling-puppet-load-test

34 stars 44 forks source link

scale testing issues #389

Open RandellP opened 4 years ago

billclaytor commented 4 years ago

@RandellP and @billclaytor 1) run the current scale tests on Kearney @johnduarte 2) run with environment_timeout = 0 5 runs each starting with Lovejoy

billclaytor commented 4 years ago

Revisit when testing is complete. Spike ticket to investigate MongoDB article and AWS options. Dedicated instances?

billclaytor commented 4 years ago

Talk to the puppetserver team (and/or Charlie) to see if they can think of reasons why the environment timeout would cause the variability we're seeing.

billclaytor commented 4 years ago

Cold start eliminates much of the variability. This is sufficient for now. We may revisit other options in the future.