onsi / ginkgo

A Modern Testing Framework for Go
http://onsi.github.io/ginkgo/
MIT License
8.09k stars 643 forks source link

[Question] Can I set a threshold for sum of FlakeAttempts? #1343

Open mateusoliveira43 opened 5 months ago

mateusoliveira43 commented 5 months ago

I would like to have a threshold for the total time tests are retried.

Example: if I have 10 tests and set FlakeAttempts(3) to all of them, I may end up running 30 (10 * 3, 20 being retries) tests.

I would like to set a limit to the total times of retries of tests, and if that limit is reached, fail the suite. (For example, in previous example, the limit is implicit 20, but would like to configure it to 5)

Is this possible? thanks!

onsi commented 5 months ago

hey @mateusoliveira43 - that's not possible at the moment, no. the only suite-wide limit you can impose is a time limit.

mateusoliveira43 commented 5 months ago

thanks for quick answer @onsi !