Review comprehensive nature of loadtest

[jasonrichardsmith]

Right now it often seems to be missing whole chunks for long periods of time (or even forever).

Insure that the endpoint tests are comprehensive across all services and steady.

[rade]

steady

A little bit of variance - the odd connection coming and going - is fine, and arguably quite good, since it shows that we are showing realtime info.

[pidster]

Micro Sock shows the expected topology:

The load test should also lead to a nearly identical graph being formed.

[vlal-zz]

Seems to be working as expected now.

[rade]

Nice! Watching it for a few minutes, I can occasionally see frontend->user and frontend->carts connections. Are these real, or some scope glitch? If they are real, then that's exactly the right level of variance to illustrate that it's "live"; so well done :)

[jasonrichardsmith]

Can we close this issue? @rade

[rade]

Can we close this issue? @rade

Nope. Here's what I am seeing right now:

[jasonrichardsmith]

@rade I am showing connections being made and going away.

https://www.youtube.com/watch?v=7zwwHCuiEsE

[rade]

I am showing connections being made and going away.

Yep. And some of that is fine. But there is way too much of it going on. Large chunks of the system become disconnected for some time. I've just tried it again.

Btw, note that the layout in the youtube vid looks nothing like what @pidster and @vlal posted above, though hitting 'redraw' would probably correct most of that and also make it easier for you to see when the "chunks become disconnected" happens.

[lukemarsden]

@rade

I've just taken a look at this in staging and it looks fine to me now. We can't have variance and a completely connected graph at all times.

[rade]

I said the variance was optional. Give me a fully connected graph all the time first. Then dial it back.

No, it's not fine as is.

[lukemarsden]

I'll take another look.

[lukemarsden]

@vlal can you take a look at staging? If you watch the "services" view of staging for long enough, you'll see things become disconnected.

What delays and concurrency do you have configured on the load test at the moment? Can we do the prime number thing to avoid overlapping gaps?

[lukemarsden]

Let's aim for fully connected all the time for now.

[jasonrichardsmith]

closing, add to dx board if determined a priority