Tests are skipped if pytest fixtures fail

box / flaky

Plugin for nose or pytest that automatically reruns flaky tests.

Apache License 2.0

378 stars 60 forks source link

Tests are skipped if pytest fixtures fail #114

Closed recht closed 5 years ago

recht commented 7 years ago

A test marked with @flaky will not be marked as failed if the fixture fails for whatever reason - instead, any error is just swallowed and ignored.

Hebbeman commented 7 years ago

Hah, I just logged-in to report exactly this bug.

Actually, it looks like if anything goes wrong during fixture setup or in any hook - causing the test into state "ERROR" - flaky will fail to report the test at all.

Hebbeman commented 7 years ago

My problem with flaky not reporting tests at all is FIXED with v3.4.0 :)

Jeff-Meadows commented 7 years ago

Woot!

lalithach commented 3 years ago

Hi, is this issue resolved? I still find this issue with flaky 3.6.1. The problem I am facing is, when there is any exception at the fixture level and the test fails because of it, I don't see flaky rerunning the failed test again. Could someone please help on this. Thanks.