Come up with a way to do integration tests with say hundreds of services.

Originate / exosphere

A modern cloud-based micro-service framework

MIT License

17 stars 6 forks source link

Come up with a way to do integration tests with say hundreds of services. #324

Closed stefansavev-o closed 7 years ago

stefansavev-o commented 7 years ago

This was another bottleneck I faced. How to make sure, after developing 4 different services they work well in production before integrating them in the front-end. For example, service d, consume a and c and c consumes a and b. Unit tests in cucumber don't enforce that. For example the go exocom client used in tests is different than exocom that is deployed. Another issue not tested is compatibility between messages sent/receive between different services. A third issue is testing at scale, e.g. gigabyte size databases or hundreds of messages per second.

What I need here is a way to do the following:

how to setup (preload) databases
how to have "a driver" that sends lots of messages (e.g. a mock front-end)
how to pass env. variables to multiple tests environments
report success/failures measure latency/throughput under different scenarios

kevgo commented 7 years ago

Hey @stefansavev-o! All good points.

[x] yes, we need end-to-end tests for applications to make sure all the services talk directly to each other. Here is the ticket for that.
[x] yes, we need load tests by spinning up an app with hundreds of services (ticket), as well as for Exocom directly (ticket).
[ ] can you please provide an example what ENV variables you want to pass around to the different environments? These should be defined in application.yml. @hugobho can you please work with @stefansavev-o today to work this part out?
some of these tests will use services that emit a ton of messages, as you describe. These services will be remote-controlled by the test suite.

hugoesthere commented 7 years ago

The sdk currently doesn't have support for that - defining env vars in application.yml. What do you guys think is the best way to inject env vars? See: https://github.com/Originate/exosphere-sdk/issues/301

stefansavev-o commented 7 years ago

@hugobho I can't see the link.

hugoesthere commented 7 years ago

That seems to be on a private repo. @kevgo should we continue adding users to that repo or port that conversion over to this repo instead?

kevgo commented 7 years ago

@stefansavev-o I have added you to Team Exosphere. You should be able to see the private repo now.

charlierudolph commented 7 years ago

@kevgo @stefansavev-o anything left to do in this issue or can it be closed? It appears some things were extracted into other tickets

kevgo commented 7 years ago

Good to close from my end, but @stefansavev-o should chime in as well here.

stefansavev-o commented 7 years ago

Thank you!