usebruno / bruno

Opensource IDE For Exploring and Testing Api's (lightweight alternative to postman/insomnia)
https://www.usebruno.com/
MIT License
21.9k stars 1.03k forks source link

Collection runner parallelism should be optional #2251

Open MelGrubb opened 2 months ago

MelGrubb commented 2 months ago

I have checked the following:

Describe the feature you want to add

The iteration count on the collection runner could be used for performance testing if it had an option to disable running the tests in parallel. For instance, I'd like to run a certain request 10 times so that I can figure out the average timing. Running the tests in parallel shows how it will perform under high load, but running them serially would be more useful for evaluating whether a specific change makes things better or worse.

Also, on the Runner page, it would be very helpful if the results table included timing information broken down per request. You can dig this information out by drilling into each iteration and finding the request you're interested in.

And finally, some way to run multiple iterations of a single request would be very helpful, especially when I'm trying to tune an individual operation. For now, I can just move the request to a folder and run that “collection”, but a more official way would be better.

My use case is testing whether a query optimization is actually making things better or worse. I want to run an individual query 10 times, and gather the average time for the whole run before and after each tweak I make.

Mockups or Images of the feature

image image

helloanoop commented 2 months ago

@lohxt1 Assigning this to you.

Please work on it when you find some time. I believe this should be a relatively straightforward implementation. Showing the time info would also be really helpful.