If a test is marked both xfail and abort_on_fail, it should still abort

charmed-kubernetes / pytest-operator

Apache License 2.0

7 stars 13 forks source link

If a test is marked both xfail and abort_on_fail, it should still abort #46

Open johnsca opened 2 years ago

johnsca commented 2 years ago

It seems that if a test is marked with abort_on_fail but also xfail and it fails as expected, it does not also abort, which makes subsequent tests have a real FAILURE rather than an XFAIL.

johnsca commented 2 years ago

Encountered in https://github.com/canonical/traefik-k8s-operator/pull/3

johnsca commented 2 years ago

It seems like this ought to be handled but that there is some bug lurking there.