search

postmanlabs / postman-app-support

Postman is an API platform for building and using APIs. Postman simplifies each step of the API lifecycle and streamlines collaboration so you can create better APIs—faster.
https://www.postman.com
5.85k stars 839 forks source link

Extend functionality for collection run flag Stop run if an error occurs #13261

Open bogdan-barsan opened 2 days ago

bogdan-barsan commented 2 days ago

Is there an existing request for this feature?

Is your feature request related to a problem?

In postman application you introduce a check box "Stop run if an error occurs" on my suggestion a while ago. But this flag is not working as I expect; test run stops only if endpoint is not responding(rest path does not exist). I would like to extend this and include in stop condition a fail assertion or introduce a new check box flag "Stop run on assertion fail".

In my team we have complex test scenarios, sometimes 20-30 steps per folder. We have blue green deployment and we can easily spot failing tests. Then we execute tests with local code in order to detect the issue. If failing test is at 17 out of 30 steps for example we start running the folder and untick steps that are after failing test to be able to call again failing one in order to investigate. This is a bit annoying to tick so many check boxes and stop on assertion fail condition will help a lot and will be more easy to rich failing conditions.

Describe the solution you'd like

I would like to extend this and include in stop condition a fail assertion or introduce a new check box flag "Stop run on assertion fail".

Describe alternatives you've considered

image

Additional context

No response

bogdan-barsan commented 2 days ago

I attached a printscreen with an example of failing step(I change assertion from 200 response on purpose to fail). So while postman is running the folder with tests, I would like to stop execution on first failing assertion instead of executing all steps in folder collection.