Pass --max-runs=MAX_RUNS and/or --min-passes=MIN_PASSES to control the behavior of flaky if --force-flaky is specified. Flaky decorators on individual tests will override these defaults.
However, flaky decorators on individual tests do not override these defaults.
To repro the issue, consider the following test file test.py:
This means an individual test's decorators won't be translated into flaky attributes, as the test's flaky attributes have already been set to the defaults (or values set in CLI args) here:
From
README.rst
:However, flaky decorators on individual tests do not override these defaults.
To repro the issue, consider the following test file
test.py
:Then run
pytest test.py --force-flaky
and observe the test was run the default 2 times instead of the 10 specified by the decorator.