search

flightstats / hub

fault tolerant, highly available service for data storage and distribution
http://www.flightstats.com
MIT License
103 stars 35 forks source link

Resiliency test setup #1217

Closed Paul-Hess closed 5 years ago

Paul-Hess commented 5 years ago

I started this work for max items test, but no longer need for that particular test, instead added a placeholder test to show how it's use until a real test takes it's place soon.

Paul-Hess commented 5 years ago

One question that is outside the scope is: what happens to these tests if I have the hub url set to a dev environment or an environment that's already spun up? Do we still create a new install if the configuration for a test isn't default?

It will ignore the install if release name is set to an existing environment just like the helm suite configuration. It assumes the user to set that value to an environment that was built on the expected config.

lkemmerer commented 5 years ago

I guess that makes sense. I suppose I'm just worried I'm going to stupidly try to run tests that expect something with a very specialized config against iad.dev or something. Which is a PEBKAC issue, not something we should solve with code. ...thanks for letting me think through that here. :P